2023-12-03T11:14:21.612 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-03T11:14:21.612 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476136 --description rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} --verbose --name alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi --owner scheduled_alimasa@teuthology -- /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476136/orig.config.yaml 2023-12-03T11:14:21.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-03T11:14:21.741 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476136 branch: wip-alimasa-multi-pubsub-etag description: rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: null first_in_suite: false job_id: '7476136' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-alimasa-multi-pubsub-etag ceph: conf: client: debug rgw: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: bcbf278cf395873c2a482f5a7b2345faf2160319 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bcbf278cf395873c2a482f5a7b2345faf2160319 rgw: compression type: random ec-data-pool: true frontend: beast storage classes: LUKEWARM, FROZEN s3tests: force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-alimasa-multi-pubsub-etag sha1: bcbf278cf395873c2a482f5a7b2345faf2160319 owner: scheduled_alimasa@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: bcbf278cf395873c2a482f5a7b2345faf2160319 sleep_before_teardown: 0 suite: rgw suite_branch: wip-alimasa-multi-pubsub-etag suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bcbf278cf395873c2a482f5a7b2345faf2160319 targets: smithi044.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEjVgoNZsA4+nJDNNbVQcRvbU+qh2yA/AydLGaw/f+bA6qmXDxMYkXpHapKUQlf8qB3+RmoWZQz6FiiPq/GHxt4= smithi091.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAMA8rmc7tNlD/CrJT2zG94+3pIdpxiAZ4MY138usUaHhQ2vca7Wiwaxn6PV8HGBKDqqyIAtTkGok9mHEuso4Kc= tasks: - install: extra_system_packages: deb: - s3cmd rpm: - s3cmd - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-03_11:04:43 tube: smithi user: alimasa verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-03T11:14:21.741 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa; will attempt to use it 2023-12-03T11:14:21.742 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks 2023-12-03T11:14:21.742 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-03T11:14:21.744 INFO:teuthology.task.internal:Checking packages... 2023-12-03T11:14:21.766 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bcbf278cf395873c2a482f5a7b2345faf2160319' 2023-12-03T11:14:21.766 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-03T11:14:21.767 INFO:teuthology.packaging:ref: None 2023-12-03T11:14:21.767 INFO:teuthology.packaging:tag: None 2023-12-03T11:14:21.767 INFO:teuthology.packaging:branch: wip-alimasa-multi-pubsub-etag 2023-12-03T11:14:21.767 INFO:teuthology.packaging:sha1: bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:14:21.767 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-alimasa-multi-pubsub-etag 2023-12-03T11:14:21.906 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7537.gbcbf278c 2023-12-03T11:14:21.907 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-03T11:14:21.915 INFO:teuthology.task.internal:no buildpackages task found 2023-12-03T11:14:21.915 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-03T11:14:21.960 INFO:teuthology.task.internal:Saving configuration 2023-12-03T11:14:21.976 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-03T11:14:21.982 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-03T11:14:22.006 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476136', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-03 11:09:19.973086', 'locked_by': 'scheduled_alimasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEjVgoNZsA4+nJDNNbVQcRvbU+qh2yA/AydLGaw/f+bA6qmXDxMYkXpHapKUQlf8qB3+RmoWZQz6FiiPq/GHxt4='} 2023-12-03T11:14:22.030 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi091.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476136', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-03 11:09:19.971455', 'locked_by': 'scheduled_alimasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAMA8rmc7tNlD/CrJT2zG94+3pIdpxiAZ4MY138usUaHhQ2vca7Wiwaxn6PV8HGBKDqqyIAtTkGok9mHEuso4Kc='} 2023-12-03T11:14:22.031 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-03T11:14:22.037 INFO:teuthology.task.internal:roles: ubuntu@smithi044.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-12-03T11:14:22.037 INFO:teuthology.task.internal:roles: ubuntu@smithi091.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-12-03T11:14:22.037 INFO:teuthology.run_tasks:Running task console_log... 2023-12-03T11:14:22.126 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5c3d6c6f70>, signals=[15]) 2023-12-03T11:14:22.127 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-03T11:14:22.132 INFO:teuthology.task.internal:Opening connections... 2023-12-03T11:14:22.132 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi044.front.sepia.ceph.com 2023-12-03T11:14:22.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:14:22.232 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi091.front.sepia.ceph.com 2023-12-03T11:14:22.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:14:22.319 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-03T11:14:22.325 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2023-12-03T11:14:22.343 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2023-12-03T11:14:22.343 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2023-12-03T11:14:22.401 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2023-12-03T11:14:22.401 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2023-12-03T11:14:22.401 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2023-12-03T11:14:22.401 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2023-12-03T11:14:22.401 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2023-12-03T11:14:22.401 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2023-12-03T11:14:22.401 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-03T11:14:22.401 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2023-12-03T11:14:22.401 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2023-12-03T11:14:22.401 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-03T11:14:22.401 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2023-12-03T11:14:22.401 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-03T11:14:22.402 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-03T11:14:22.402 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-03T11:14:22.402 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2023-12-03T11:14:22.429 DEBUG:teuthology.orchestra.run.smithi091:> uname -m 2023-12-03T11:14:22.447 INFO:teuthology.orchestra.run.smithi091.stdout:x86_64 2023-12-03T11:14:22.447 DEBUG:teuthology.orchestra.run.smithi091:> cat /etc/os-release 2023-12-03T11:14:22.507 INFO:teuthology.orchestra.run.smithi091.stdout:NAME="CentOS Stream" 2023-12-03T11:14:22.507 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION="9" 2023-12-03T11:14:22.507 INFO:teuthology.orchestra.run.smithi091.stdout:ID="centos" 2023-12-03T11:14:22.507 INFO:teuthology.orchestra.run.smithi091.stdout:ID_LIKE="rhel fedora" 2023-12-03T11:14:22.508 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION_ID="9" 2023-12-03T11:14:22.508 INFO:teuthology.orchestra.run.smithi091.stdout:PLATFORM_ID="platform:el9" 2023-12-03T11:14:22.508 INFO:teuthology.orchestra.run.smithi091.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-03T11:14:22.508 INFO:teuthology.orchestra.run.smithi091.stdout:ANSI_COLOR="0;31" 2023-12-03T11:14:22.508 INFO:teuthology.orchestra.run.smithi091.stdout:LOGO="fedora-logo-icon" 2023-12-03T11:14:22.508 INFO:teuthology.orchestra.run.smithi091.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-03T11:14:22.508 INFO:teuthology.orchestra.run.smithi091.stdout:HOME_URL="https://centos.org/" 2023-12-03T11:14:22.508 INFO:teuthology.orchestra.run.smithi091.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-03T11:14:22.508 INFO:teuthology.orchestra.run.smithi091.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-03T11:14:22.508 INFO:teuthology.orchestra.run.smithi091.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-03T11:14:22.508 INFO:teuthology.lock.ops:Updating smithi091.front.sepia.ceph.com on lock server 2023-12-03T11:14:22.529 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-03T11:14:22.538 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-03T11:14:22.560 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-03T11:14:22.561 DEBUG:teuthology.orchestra.run.smithi044:> test '!' -e /home/ubuntu/cephtest 2023-12-03T11:14:22.563 DEBUG:teuthology.orchestra.run.smithi091:> test '!' -e /home/ubuntu/cephtest 2023-12-03T11:14:22.579 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-03T11:14:22.585 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-03T11:14:22.585 DEBUG:teuthology.orchestra.run.smithi044:> test -z $(ls -A /var/lib/ceph) 2023-12-03T11:14:22.621 DEBUG:teuthology.orchestra.run.smithi091:> test -z $(ls -A /var/lib/ceph) 2023-12-03T11:14:22.719 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-03T11:14:22.770 INFO:teuthology.run_tasks:Running task kernel... 2023-12-03T11:14:22.784 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-03T11:14:22.784 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-03T11:14:22.784 DEBUG:teuthology.orchestra.run.smithi044:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-03T11:14:22.785 DEBUG:teuthology.orchestra.run.smithi091:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-03T11:14:22.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:14:22.801 DEBUG:teuthology.orchestra.run.smithi091:> uname -r 2023-12-03T11:14:22.802 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:14:22.802 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2023-12-03T11:14:22.860 INFO:teuthology.orchestra.run.smithi044.stdout:5.14.0-361.el9.x86_64 2023-12-03T11:14:22.860 INFO:teuthology.task.kernel:Running kernel on smithi044: 5.14.0-361.el9.x86_64 2023-12-03T11:14:22.860 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum install -y kernel 2023-12-03T11:14:22.862 INFO:teuthology.orchestra.run.smithi091.stdout:5.14.0-361.el9.x86_64 2023-12-03T11:14:22.862 INFO:teuthology.task.kernel:Running kernel on smithi091: 5.14.0-361.el9.x86_64 2023-12-03T11:14:22.862 DEBUG:teuthology.orchestra.run.smithi091:> sudo yum install -y kernel 2023-12-03T11:14:24.945 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS-9 - AppStream 15 MB/s | 6.4 MB 00:00 2023-12-03T11:14:24.985 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS-9 - AppStream 13 MB/s | 6.4 MB 00:00 2023-12-03T11:14:26.311 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS-9 - BaseOS 6.4 MB/s | 2.0 MB 00:00 2023-12-03T11:14:26.402 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS-9 - BaseOS 6.3 MB/s | 2.0 MB 00:00 2023-12-03T11:14:27.901 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - BaseOS 6.8 MB/s | 7.9 MB 00:01 2023-12-03T11:14:28.485 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 7.9 MB 00:01 2023-12-03T11:14:30.486 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS Stream 9 - AppStream 21 MB/s | 18 MB 00:00 2023-12-03T11:14:31.361 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - AppStream 7.9 MB/s | 18 MB 00:02 2023-12-03T11:14:35.478 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 5.8 MB 00:01 2023-12-03T11:14:35.620 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - CRB 8.2 MB/s | 5.8 MB 00:00 2023-12-03T11:14:37.062 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 15 kB 00:00 2023-12-03T11:14:37.270 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 15 kB 00:00 2023-12-03T11:14:38.363 INFO:teuthology.orchestra.run.smithi091.stdout:Extra Packages for Enterprise Linux 21 MB/s | 20 MB 00:00 2023-12-03T11:14:39.150 INFO:teuthology.orchestra.run.smithi044.stdout:Extra Packages for Enterprise Linux 10 MB/s | 20 MB 00:01 2023-12-03T11:14:43.146 INFO:teuthology.orchestra.run.smithi091.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2023-12-03T11:14:44.047 INFO:teuthology.orchestra.run.smithi044.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2023-12-03T11:14:45.427 INFO:teuthology.orchestra.run.smithi091.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-03T11:14:45.427 INFO:teuthology.orchestra.run.smithi091.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-03T11:14:45.522 INFO:teuthology.orchestra.run.smithi091.stdout:Dependencies resolved. 2023-12-03T11:14:45.532 INFO:teuthology.orchestra.run.smithi091.stdout:================================================================================ 2023-12-03T11:14:45.532 INFO:teuthology.orchestra.run.smithi091.stdout: Package Architecture Version Repository Size 2023-12-03T11:14:45.532 INFO:teuthology.orchestra.run.smithi091.stdout:================================================================================ 2023-12-03T11:14:45.532 INFO:teuthology.orchestra.run.smithi091.stdout:Installing: 2023-12-03T11:14:45.533 INFO:teuthology.orchestra.run.smithi091.stdout: kernel x86_64 5.14.0-388.el9 baseos 5.6 M 2023-12-03T11:14:45.533 INFO:teuthology.orchestra.run.smithi091.stdout:Installing dependencies: 2023-12-03T11:14:45.533 INFO:teuthology.orchestra.run.smithi091.stdout: kernel-core x86_64 5.14.0-388.el9 baseos 20 M 2023-12-03T11:14:45.533 INFO:teuthology.orchestra.run.smithi091.stdout: kernel-modules x86_64 5.14.0-388.el9 baseos 38 M 2023-12-03T11:14:45.533 INFO:teuthology.orchestra.run.smithi091.stdout: kernel-modules-core x86_64 5.14.0-388.el9 baseos 32 M 2023-12-03T11:14:45.533 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:14:45.533 INFO:teuthology.orchestra.run.smithi091.stdout:Transaction Summary 2023-12-03T11:14:45.533 INFO:teuthology.orchestra.run.smithi091.stdout:================================================================================ 2023-12-03T11:14:45.533 INFO:teuthology.orchestra.run.smithi091.stdout:Install 4 Packages 2023-12-03T11:14:45.533 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:14:45.534 INFO:teuthology.orchestra.run.smithi091.stdout:Total download size: 96 M 2023-12-03T11:14:45.534 INFO:teuthology.orchestra.run.smithi091.stdout:Installed size: 121 M 2023-12-03T11:14:45.534 INFO:teuthology.orchestra.run.smithi091.stdout:Downloading Packages: 2023-12-03T11:14:45.914 INFO:teuthology.orchestra.run.smithi091.stdout:(1/4): kernel-5.14.0-388.el9.x86_64.rpm 21 MB/s | 5.6 MB 00:00 2023-12-03T11:14:46.264 INFO:teuthology.orchestra.run.smithi091.stdout:(2/4): kernel-core-5.14.0-388.el9.x86_64.rpm 33 MB/s | 20 MB 00:00 2023-12-03T11:14:46.496 INFO:teuthology.orchestra.run.smithi044.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-03T11:14:46.496 INFO:teuthology.orchestra.run.smithi044.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-03T11:14:46.578 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2023-12-03T11:14:46.586 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2023-12-03T11:14:46.587 INFO:teuthology.orchestra.run.smithi044.stdout: Package Architecture Version Repository Size 2023-12-03T11:14:46.587 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2023-12-03T11:14:46.587 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2023-12-03T11:14:46.587 INFO:teuthology.orchestra.run.smithi044.stdout: kernel x86_64 5.14.0-388.el9 baseos 5.6 M 2023-12-03T11:14:46.587 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2023-12-03T11:14:46.587 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-core x86_64 5.14.0-388.el9 baseos 20 M 2023-12-03T11:14:46.587 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-modules x86_64 5.14.0-388.el9 baseos 38 M 2023-12-03T11:14:46.587 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-modules-core x86_64 5.14.0-388.el9 baseos 32 M 2023-12-03T11:14:46.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:14:46.587 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2023-12-03T11:14:46.587 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2023-12-03T11:14:46.587 INFO:teuthology.orchestra.run.smithi044.stdout:Install 4 Packages 2023-12-03T11:14:46.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:14:46.588 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 96 M 2023-12-03T11:14:46.588 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 121 M 2023-12-03T11:14:46.588 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2023-12-03T11:14:46.789 INFO:teuthology.orchestra.run.smithi091.stdout:(3/4): kernel-modules-5.14.0-388.el9.x86_64.rpm 33 MB/s | 38 MB 00:01 2023-12-03T11:14:47.081 INFO:teuthology.orchestra.run.smithi091.stdout:(4/4): kernel-modules-core-5.14.0-388.el9.x86_6 28 MB/s | 32 MB 00:01 2023-12-03T11:14:47.081 INFO:teuthology.orchestra.run.smithi091.stdout:-------------------------------------------------------------------------------- 2023-12-03T11:14:47.081 INFO:teuthology.orchestra.run.smithi091.stdout:Total 62 MB/s | 96 MB 00:01 2023-12-03T11:14:47.232 INFO:teuthology.orchestra.run.smithi044.stdout:(1/4): kernel-5.14.0-388.el9.x86_64.rpm 11 MB/s | 5.6 MB 00:00 2023-12-03T11:14:47.890 INFO:teuthology.orchestra.run.smithi044.stdout:(2/4): kernel-core-5.14.0-388.el9.x86_64.rpm 18 MB/s | 20 MB 00:01 2023-12-03T11:14:47.938 INFO:teuthology.orchestra.run.smithi091.stdout:Running transaction check 2023-12-03T11:14:48.322 INFO:teuthology.orchestra.run.smithi091.stdout:Transaction check succeeded. 2023-12-03T11:14:48.322 INFO:teuthology.orchestra.run.smithi091.stdout:Running transaction test 2023-12-03T11:14:48.707 INFO:teuthology.orchestra.run.smithi044.stdout:(3/4): kernel-modules-core-5.14.0-388.el9.x86_6 22 MB/s | 32 MB 00:01 2023-12-03T11:14:49.066 INFO:teuthology.orchestra.run.smithi044.stdout:(4/4): kernel-modules-5.14.0-388.el9.x86_64.rpm 16 MB/s | 38 MB 00:02 2023-12-03T11:14:49.066 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2023-12-03T11:14:49.066 INFO:teuthology.orchestra.run.smithi044.stdout:Total 39 MB/s | 96 MB 00:02 2023-12-03T11:14:49.641 INFO:teuthology.orchestra.run.smithi091.stdout:Transaction test succeeded. 2023-12-03T11:14:49.641 INFO:teuthology.orchestra.run.smithi091.stdout:Running transaction 2023-12-03T11:14:49.955 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2023-12-03T11:14:50.391 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2023-12-03T11:14:50.391 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2023-12-03T11:14:51.757 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2023-12-03T11:14:51.757 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2023-12-03T11:14:52.518 INFO:teuthology.orchestra.run.smithi091.stdout: Preparing : 1/1 2023-12-03T11:14:53.154 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : kernel-modules-core-5.14.0-388.el9.x86_64 1/4 2023-12-03T11:14:53.297 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-03T11:14:54.549 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2023-12-03T11:14:55.224 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : kernel-modules-core-5.14.0-388.el9.x86_64 1/4 2023-12-03T11:14:55.358 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-03T11:14:56.069 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-03T11:14:56.258 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-03T11:14:58.236 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-03T11:14:58.420 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-03T11:15:00.872 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-03T11:15:00.981 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : kernel-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:15:03.383 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-03T11:15:03.513 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : kernel-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:15:05.618 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:15:08.499 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:15:34.514 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:15:34.562 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:15:34.927 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: kernel-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:15:34.928 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : kernel-5.14.0-388.el9.x86_64 1/4 2023-12-03T11:15:34.928 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-03T11:15:34.928 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-03T11:15:35.314 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:15:35.314 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:15:35.314 INFO:teuthology.orchestra.run.smithi091.stdout:Installed: 2023-12-03T11:15:35.314 INFO:teuthology.orchestra.run.smithi091.stdout: kernel-5.14.0-388.el9.x86_64 2023-12-03T11:15:35.314 INFO:teuthology.orchestra.run.smithi091.stdout: kernel-core-5.14.0-388.el9.x86_64 2023-12-03T11:15:35.314 INFO:teuthology.orchestra.run.smithi091.stdout: kernel-modules-5.14.0-388.el9.x86_64 2023-12-03T11:15:35.314 INFO:teuthology.orchestra.run.smithi091.stdout: kernel-modules-core-5.14.0-388.el9.x86_64 2023-12-03T11:15:35.314 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:15:35.314 INFO:teuthology.orchestra.run.smithi091.stdout:Complete! 2023-12-03T11:15:35.813 DEBUG:teuthology.orchestra.run.smithi091:> rpm -q kernel | sort -rV | head -n 1 2023-12-03T11:15:35.953 INFO:teuthology.orchestra.run.smithi091.stdout:kernel-5.14.0-388.el9.x86_64 2023-12-03T11:15:35.953 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-12-03T11:15:35.954 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-388.el9.x86_64 2023-12-03T11:15:35.954 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-03T11:15:35.954 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-03T11:15:35.954 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-12-03T11:15:35.954 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi091.front.sepia.ceph.com, path=None, version=distro) 2023-12-03T11:15:35.954 DEBUG:teuthology.orchestra.run.smithi091:> rpm -q kernel | sort -rV | head -n 1 2023-12-03T11:15:36.071 INFO:teuthology.orchestra.run.smithi091.stdout:kernel-5.14.0-388.el9.x86_64 2023-12-03T11:15:36.071 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-12-03T11:15:36.071 DEBUG:teuthology.orchestra.run.smithi091:> sudo rpm -qi grub2-tools 2023-12-03T11:15:36.104 INFO:teuthology.orchestra.run.smithi091.stdout:Name : grub2-tools 2023-12-03T11:15:36.104 INFO:teuthology.orchestra.run.smithi091.stdout:Epoch : 1 2023-12-03T11:15:36.105 INFO:teuthology.orchestra.run.smithi091.stdout:Version : 2.06 2023-12-03T11:15:36.105 INFO:teuthology.orchestra.run.smithi091.stdout:Release : 68.el9 2023-12-03T11:15:36.105 INFO:teuthology.orchestra.run.smithi091.stdout:Architecture: x86_64 2023-12-03T11:15:36.105 INFO:teuthology.orchestra.run.smithi091.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-03T11:15:36.105 INFO:teuthology.orchestra.run.smithi091.stdout:Group : Unspecified 2023-12-03T11:15:36.105 INFO:teuthology.orchestra.run.smithi091.stdout:Size : 8264254 2023-12-03T11:15:36.105 INFO:teuthology.orchestra.run.smithi091.stdout:License : GPLv3+ 2023-12-03T11:15:36.105 INFO:teuthology.orchestra.run.smithi091.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-03T11:15:36.105 INFO:teuthology.orchestra.run.smithi091.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-03T11:15:36.105 INFO:teuthology.orchestra.run.smithi091.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-03T11:15:36.105 INFO:teuthology.orchestra.run.smithi091.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-03T11:15:36.105 INFO:teuthology.orchestra.run.smithi091.stdout:Packager : builder@centos.org 2023-12-03T11:15:36.105 INFO:teuthology.orchestra.run.smithi091.stdout:Vendor : CentOS 2023-12-03T11:15:36.105 INFO:teuthology.orchestra.run.smithi091.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-03T11:15:36.106 INFO:teuthology.orchestra.run.smithi091.stdout:Summary : Support tools for GRUB. 2023-12-03T11:15:36.106 INFO:teuthology.orchestra.run.smithi091.stdout:Description : 2023-12-03T11:15:36.106 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:15:36.106 INFO:teuthology.orchestra.run.smithi091.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-03T11:15:36.106 INFO:teuthology.orchestra.run.smithi091.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-03T11:15:36.106 INFO:teuthology.orchestra.run.smithi091.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-03T11:15:36.106 INFO:teuthology.orchestra.run.smithi091.stdout:hardware devices. 2023-12-03T11:15:36.106 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:15:36.106 INFO:teuthology.orchestra.run.smithi091.stdout:This subpackage provides tools for support of all platforms. 2023-12-03T11:15:36.107 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-03T11:15:36.107 INFO:teuthology.task.kernel:Updating grub on smithi091 to boot 5.14.0-388.el9.x86_64 2023-12-03T11:15:36.107 DEBUG:teuthology.orchestra.run.smithi091:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-03T11:15:36.728 INFO:teuthology.orchestra.run.smithi091.stderr:Generating grub configuration file ... 2023-12-03T11:15:38.153 INFO:teuthology.orchestra.run.smithi091.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-03T11:15:38.174 INFO:teuthology.orchestra.run.smithi091.stderr:done 2023-12-03T11:15:38.176 DEBUG:teuthology.orchestra.run.smithi091:> mktemp 2023-12-03T11:15:38.191 INFO:teuthology.orchestra.run.smithi091.stdout:/tmp/tmp.sKFpglP4s1 2023-12-03T11:15:38.191 DEBUG:teuthology.orchestra.run.smithi091:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.sKFpglP4s1 2023-12-03T11:15:38.259 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0666 /tmp/tmp.sKFpglP4s1 2023-12-03T11:15:38.401 DEBUG:teuthology.orchestra.remote:smithi091:/tmp/tmp.sKFpglP4s1 is 6KB 2023-12-03T11:15:38.449 DEBUG:teuthology.orchestra.run.smithi091:> rm -fr /tmp/tmp.sKFpglP4s1 2023-12-03T11:15:38.464 DEBUG:teuthology.orchestra.run.smithi091:> sudo /bin/ls /boot/loader/entries || true 2023-12-03T11:15:38.528 INFO:teuthology.orchestra.run.smithi091.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-03T11:15:38.528 INFO:teuthology.orchestra.run.smithi091.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-03T11:15:38.528 INFO:teuthology.orchestra.run.smithi091.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-03T11:15:38.528 INFO:teuthology.orchestra.run.smithi091.stdout:15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64.conf 2023-12-03T11:15:38.530 DEBUG:teuthology.orchestra.run.smithi091:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64 2023-12-03T11:15:38.677 DEBUG:teuthology.orchestra.run.smithi091:> sudo shutdown -r now 2023-12-03T11:15:39.243 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:15:39.288 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:15:39.808 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:15:39.808 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : kernel-5.14.0-388.el9.x86_64 1/4 2023-12-03T11:15:39.808 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-03T11:15:39.808 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-03T11:15:40.245 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:15:40.245 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:15:40.245 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2023-12-03T11:15:40.246 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-5.14.0-388.el9.x86_64 2023-12-03T11:15:40.246 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-core-5.14.0-388.el9.x86_64 2023-12-03T11:15:40.246 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-modules-5.14.0-388.el9.x86_64 2023-12-03T11:15:40.246 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-modules-core-5.14.0-388.el9.x86_64 2023-12-03T11:15:40.246 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:15:40.246 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2023-12-03T11:15:40.750 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q kernel | sort -rV | head -n 1 2023-12-03T11:15:40.898 INFO:teuthology.orchestra.run.smithi044.stdout:kernel-5.14.0-388.el9.x86_64 2023-12-03T11:15:40.898 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-12-03T11:15:40.899 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-388.el9.x86_64 2023-12-03T11:15:40.899 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-03T11:15:40.899 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-03T11:15:40.899 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-12-03T11:15:40.899 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi044.front.sepia.ceph.com, path=None, version=distro) 2023-12-03T11:15:40.899 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q kernel | sort -rV | head -n 1 2023-12-03T11:15:41.021 INFO:teuthology.orchestra.run.smithi044.stdout:kernel-5.14.0-388.el9.x86_64 2023-12-03T11:15:41.021 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-12-03T11:15:41.021 DEBUG:teuthology.orchestra.run.smithi044:> sudo rpm -qi grub2-tools 2023-12-03T11:15:41.064 INFO:teuthology.orchestra.run.smithi044.stdout:Name : grub2-tools 2023-12-03T11:15:41.064 INFO:teuthology.orchestra.run.smithi044.stdout:Epoch : 1 2023-12-03T11:15:41.064 INFO:teuthology.orchestra.run.smithi044.stdout:Version : 2.06 2023-12-03T11:15:41.064 INFO:teuthology.orchestra.run.smithi044.stdout:Release : 68.el9 2023-12-03T11:15:41.064 INFO:teuthology.orchestra.run.smithi044.stdout:Architecture: x86_64 2023-12-03T11:15:41.064 INFO:teuthology.orchestra.run.smithi044.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-03T11:15:41.064 INFO:teuthology.orchestra.run.smithi044.stdout:Group : Unspecified 2023-12-03T11:15:41.065 INFO:teuthology.orchestra.run.smithi044.stdout:Size : 8264254 2023-12-03T11:15:41.065 INFO:teuthology.orchestra.run.smithi044.stdout:License : GPLv3+ 2023-12-03T11:15:41.065 INFO:teuthology.orchestra.run.smithi044.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-03T11:15:41.065 INFO:teuthology.orchestra.run.smithi044.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-03T11:15:41.065 INFO:teuthology.orchestra.run.smithi044.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-03T11:15:41.065 INFO:teuthology.orchestra.run.smithi044.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-03T11:15:41.065 INFO:teuthology.orchestra.run.smithi044.stdout:Packager : builder@centos.org 2023-12-03T11:15:41.065 INFO:teuthology.orchestra.run.smithi044.stdout:Vendor : CentOS 2023-12-03T11:15:41.065 INFO:teuthology.orchestra.run.smithi044.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-03T11:15:41.065 INFO:teuthology.orchestra.run.smithi044.stdout:Summary : Support tools for GRUB. 2023-12-03T11:15:41.065 INFO:teuthology.orchestra.run.smithi044.stdout:Description : 2023-12-03T11:15:41.065 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:15:41.065 INFO:teuthology.orchestra.run.smithi044.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-03T11:15:41.066 INFO:teuthology.orchestra.run.smithi044.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-03T11:15:41.066 INFO:teuthology.orchestra.run.smithi044.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-03T11:15:41.066 INFO:teuthology.orchestra.run.smithi044.stdout:hardware devices. 2023-12-03T11:15:41.066 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:15:41.066 INFO:teuthology.orchestra.run.smithi044.stdout:This subpackage provides tools for support of all platforms. 2023-12-03T11:15:41.067 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-03T11:15:41.067 INFO:teuthology.task.kernel:Updating grub on smithi044 to boot 5.14.0-388.el9.x86_64 2023-12-03T11:15:41.067 DEBUG:teuthology.orchestra.run.smithi044:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-03T11:15:41.688 INFO:teuthology.orchestra.run.smithi044.stderr:Generating grub configuration file ... 2023-12-03T11:15:43.061 INFO:teuthology.orchestra.run.smithi044.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-03T11:15:43.096 INFO:teuthology.orchestra.run.smithi044.stderr:done 2023-12-03T11:15:43.096 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2023-12-03T11:15:43.116 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.4k7DVQQQul 2023-12-03T11:15:43.117 DEBUG:teuthology.orchestra.run.smithi044:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4k7DVQQQul 2023-12-03T11:15:43.188 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.4k7DVQQQul 2023-12-03T11:15:43.333 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.4k7DVQQQul is 6KB 2023-12-03T11:15:43.381 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.4k7DVQQQul 2023-12-03T11:15:43.396 DEBUG:teuthology.orchestra.run.smithi044:> sudo /bin/ls /boot/loader/entries || true 2023-12-03T11:15:43.464 INFO:teuthology.orchestra.run.smithi044.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-03T11:15:43.464 INFO:teuthology.orchestra.run.smithi044.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-03T11:15:43.464 INFO:teuthology.orchestra.run.smithi044.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-03T11:15:43.464 INFO:teuthology.orchestra.run.smithi044.stdout:15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64.conf 2023-12-03T11:15:43.465 DEBUG:teuthology.orchestra.run.smithi044:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64 2023-12-03T11:15:43.627 DEBUG:teuthology.orchestra.run.smithi044:> sudo shutdown -r now 2023-12-03T11:16:08.702 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-12-03T11:16:08.709 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-12-03T11:16:08.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:16:13.634 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-03T11:16:13.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2023-12-03T11:16:13.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:16:27.110 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-03T11:16:31.970 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.44 2023-12-03T11:16:36.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-12-03T11:16:36.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:16:39.170 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-03T11:16:40.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2023-12-03T11:16:40.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:16:51.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-12-03T11:16:51.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:17:09.602 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-03T11:17:24.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-12-03T11:17:24.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:17:24.987 DEBUG:teuthology.orchestra.run.smithi091:> true 2023-12-03T11:17:25.345 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-12-03T11:17:25.345 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-388.el9.x86_64"... 2023-12-03T11:17:25.345 DEBUG:teuthology.orchestra.run.smithi091:> uname -r 2023-12-03T11:17:25.359 INFO:teuthology.orchestra.run.smithi091.stdout:5.14.0-388.el9.x86_64 2023-12-03T11:17:25.359 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-388.el9.x86_64 vs 5.14.0-388.el9.x86_64 2023-12-03T11:17:25.359 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-03T11:17:25.359 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-03T11:17:26.361 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-03T11:17:26.361 DEBUG:teuthology.orchestra.run.smithi091:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-03T11:17:26.427 INFO:teuthology.orchestra.run.smithi091.stdout:ttyS1 2023-12-03T11:17:26.481 DEBUG:teuthology.parallel:result is None 2023-12-03T11:17:40.975 DEBUG:teuthology.orchestra.remote:timed out 2023-12-03T11:17:52.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2023-12-03T11:17:52.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:17:53.306 DEBUG:teuthology.orchestra.run.smithi044:> true 2023-12-03T11:17:53.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2023-12-03T11:17:53.669 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-388.el9.x86_64"... 2023-12-03T11:17:53.669 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2023-12-03T11:17:53.685 INFO:teuthology.orchestra.run.smithi044.stdout:5.14.0-388.el9.x86_64 2023-12-03T11:17:53.685 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-388.el9.x86_64 vs 5.14.0-388.el9.x86_64 2023-12-03T11:17:53.685 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-03T11:17:53.686 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-03T11:17:54.687 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-03T11:17:54.687 DEBUG:teuthology.orchestra.run.smithi044:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-03T11:17:54.757 INFO:teuthology.orchestra.run.smithi044.stdout:ttyS1 2023-12-03T11:17:54.803 DEBUG:teuthology.parallel:result is None 2023-12-03T11:17:54.803 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-03T11:17:54.813 INFO:teuthology.task.internal:Creating test directory... 2023-12-03T11:17:54.813 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-03T11:17:54.815 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-03T11:17:54.834 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-03T11:17:54.860 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-03T11:17:54.901 INFO:teuthology.task.internal:Creating archive directory... 2023-12-03T11:17:54.901 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-03T11:17:54.904 DEBUG:teuthology.orchestra.run.smithi091:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-03T11:17:54.977 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-03T11:17:54.988 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-03T11:17:54.988 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-03T11:17:54.991 DEBUG:teuthology.orchestra.run.smithi091:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-03T11:17:55.028 INFO:teuthology.orchestra.run.smithi091.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-03T11:17:55.033 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-03T11:17:55.042 INFO:teuthology.orchestra.run.smithi091.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-03T11:17:55.051 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-03T11:17:55.052 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-03T11:17:55.061 INFO:teuthology.task.internal:Configuring sudo... 2023-12-03T11:17:55.062 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-03T11:17:55.064 DEBUG:teuthology.orchestra.run.smithi091:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-03T11:17:55.114 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-03T11:17:55.126 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-03T11:17:55.126 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-03T11:17:55.137 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-03T11:17:55.171 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-03T11:17:55.235 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-03T11:17:55.296 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-03T11:17:55.340 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-03T11:17:55.389 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:17:55.389 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-03T11:17:55.461 DEBUG:teuthology.orchestra.run.smithi091:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-03T11:17:55.505 DEBUG:teuthology.orchestra.run.smithi091:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-03T11:17:55.562 DEBUG:teuthology.orchestra.run.smithi091:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-03T11:17:55.648 DEBUG:teuthology.orchestra.run.smithi091:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-03T11:17:55.695 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-03T11:17:55.695 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-03T11:17:55.766 DEBUG:teuthology.orchestra.run.smithi044:> sudo service rsyslog restart 2023-12-03T11:17:55.769 DEBUG:teuthology.orchestra.run.smithi091:> sudo service rsyslog restart 2023-12-03T11:17:55.820 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-03T11:17:55.860 INFO:teuthology.orchestra.run.smithi091.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-03T11:17:56.333 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-03T11:17:56.341 INFO:teuthology.task.internal:Starting timer... 2023-12-03T11:17:56.342 INFO:teuthology.run_tasks:Running task pcp... 2023-12-03T11:17:56.395 INFO:teuthology.run_tasks:Running task selinux... 2023-12-03T11:17:56.438 DEBUG:teuthology.orchestra.run.smithi044:> sudo service auditd rotate 2023-12-03T11:17:56.505 INFO:teuthology.orchestra.run.smithi044.stdout:Rotating logs: 2023-12-03T11:17:56.507 DEBUG:teuthology.orchestra.run.smithi091:> sudo service auditd rotate 2023-12-03T11:17:56.566 INFO:teuthology.orchestra.run.smithi091.stdout:Rotating logs: 2023-12-03T11:17:56.568 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-03T11:17:56.568 DEBUG:teuthology.orchestra.run.smithi044:> /usr/sbin/getenforce 2023-12-03T11:17:56.600 INFO:teuthology.orchestra.run.smithi044.stdout:Permissive 2023-12-03T11:17:56.600 DEBUG:teuthology.orchestra.run.smithi091:> /usr/sbin/getenforce 2023-12-03T11:17:56.635 INFO:teuthology.orchestra.run.smithi091.stdout:Permissive 2023-12-03T11:17:56.636 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi044.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi091.front.sepia.ceph.com': 'permissive'} 2023-12-03T11:17:56.636 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-03T11:17:56.669 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:17:56.669 DEBUG:teuthology.orchestra.run.smithi091:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-03T11:17:56.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:17:56.706 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-03T11:17:56.706 DEBUG:teuthology.orchestra.run.smithi044:> sudo /usr/sbin/setenforce permissive 2023-12-03T11:17:56.743 DEBUG:teuthology.orchestra.run.smithi091:> sudo /usr/sbin/setenforce permissive 2023-12-03T11:17:56.782 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-03T11:17:56.793 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-03T11:17:56.806 INFO:teuthology.repo_utils:Fetching main from origin 2023-12-03T11:17:56.950 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-03T11:17:56.967 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-03T11:17:56.968 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi044.front.sepia.ceph.com,smithi091.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-03T11:23:51.091 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi044.front.sepia.ceph.com'), Remote(name='ubuntu@smithi091.front.sepia.ceph.com')] 2023-12-03T11:23:51.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2023-12-03T11:23:51.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:23:51.191 DEBUG:teuthology.orchestra.run.smithi044:> true 2023-12-03T11:23:51.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2023-12-03T11:23:51.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-12-03T11:23:51.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:23:51.347 DEBUG:teuthology.orchestra.run.smithi091:> true 2023-12-03T11:23:51.413 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-12-03T11:23:51.414 INFO:teuthology.run_tasks:Running task clock... 2023-12-03T11:23:51.425 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-03T11:23:51.425 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-03T11:23:51.426 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-03T11:23:51.429 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-03T11:23:51.429 DEBUG:teuthology.orchestra.run.smithi091:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-03T11:23:51.463 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-03T11:23:51.484 INFO:teuthology.orchestra.run.smithi091.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-03T11:23:51.485 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-03T11:23:51.501 INFO:teuthology.orchestra.run.smithi091.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-03T11:23:51.521 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: ntpd: command not found 2023-12-03T11:23:51.529 INFO:teuthology.orchestra.run.smithi091.stderr:sudo: ntpd: command not found 2023-12-03T11:23:51.538 INFO:teuthology.orchestra.run.smithi044.stdout:506 Cannot talk to daemon 2023-12-03T11:23:51.543 INFO:teuthology.orchestra.run.smithi091.stdout:506 Cannot talk to daemon 2023-12-03T11:23:51.558 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-03T11:23:51.559 INFO:teuthology.orchestra.run.smithi091.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-03T11:23:51.575 INFO:teuthology.orchestra.run.smithi091.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-03T11:23:51.578 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-03T11:23:51.618 INFO:teuthology.orchestra.run.smithi091.stderr:bash: line 1: ntpq: command not found 2023-12-03T11:23:51.621 INFO:teuthology.orchestra.run.smithi091.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-03T11:23:51.621 INFO:teuthology.orchestra.run.smithi091.stdout:=============================================================================== 2023-12-03T11:23:51.621 INFO:teuthology.orchestra.run.smithi091.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:23:51.621 INFO:teuthology.orchestra.run.smithi091.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:23:51.621 INFO:teuthology.orchestra.run.smithi091.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:23:51.621 INFO:teuthology.orchestra.run.smithi091.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:23:51.625 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2023-12-03T11:23:51.629 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-03T11:23:51.629 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2023-12-03T11:23:51.629 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:23:51.629 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:23:51.629 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:23:51.629 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:23:51.630 INFO:teuthology.run_tasks:Running task install... 2023-12-03T11:23:51.638 DEBUG:teuthology.task.install:project ceph 2023-12-03T11:23:51.638 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319'}} 2023-12-03T11:23:51.638 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd'], 'rpm': ['s3cmd']}, 'flavor': 'default', 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319'} 2023-12-03T11:23:51.638 INFO:teuthology.task.install:Using flavor: default 2023-12-03T11:23:51.644 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-03T11:23:51.644 INFO:teuthology.task.install:extra packages: [] 2023-12-03T11:23:51.645 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd'], 'rpm': ['s3cmd']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319', 'tag': None, 'wait_for_package': False} 2023-12-03T11:23:51.645 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:23:51.647 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd'], 'rpm': ['s3cmd']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319', 'tag': None, 'wait_for_package': False} 2023-12-03T11:23:51.647 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:23:51.791 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/ 2023-12-03T11:23:51.791 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7537.gbcbf278c 2023-12-03T11:23:51.872 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/ 2023-12-03T11:23:51.872 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7537.gbcbf278c 2023-12-03T11:23:51.905 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-03T11:23:51.905 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-03T11:23:51.905 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-03T11:23:51.932 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, s3cmd, s3cmd on remote rpm x86_64 2023-12-03T11:23:51.933 DEBUG:teuthology.orchestra.run.smithi091:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bcbf278cf395873c2a482f5a7b2345faf2160319/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-03T11:23:51.983 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-03T11:23:51.983 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:23:51.983 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-03T11:23:52.000 DEBUG:teuthology.orchestra.run.smithi091:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-03T11:23:52.016 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, s3cmd, s3cmd, s3cmd on remote rpm x86_64 2023-12-03T11:23:52.016 DEBUG:teuthology.orchestra.run.smithi044:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bcbf278cf395873c2a482f5a7b2345faf2160319/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-03T11:23:52.080 DEBUG:teuthology.orchestra.run.smithi091:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-03T11:23:52.088 DEBUG:teuthology.orchestra.run.smithi044:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-03T11:23:52.146 INFO:teuthology.orchestra.run.smithi091.stdout:check_obsoletes = 1 2023-12-03T11:23:52.147 DEBUG:teuthology.orchestra.run.smithi091:> sudo yum clean all 2023-12-03T11:23:52.176 DEBUG:teuthology.orchestra.run.smithi044:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-03T11:23:52.206 INFO:teuthology.orchestra.run.smithi044.stdout:check_obsoletes = 1 2023-12-03T11:23:52.208 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum clean all 2023-12-03T11:23:52.394 INFO:teuthology.orchestra.run.smithi091.stdout:73 files removed 2023-12-03T11:23:52.421 DEBUG:teuthology.orchestra.run.smithi091:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd s3cmd s3cmd s3cmd 2023-12-03T11:23:52.462 INFO:teuthology.orchestra.run.smithi044.stdout:73 files removed 2023-12-03T11:23:52.489 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd s3cmd s3cmd s3cmd 2023-12-03T11:23:53.165 INFO:teuthology.orchestra.run.smithi091.stdout:ceph packages for x86_64 182 kB/s | 78 kB 00:00 2023-12-03T11:23:53.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph packages for x86_64 210 kB/s | 78 kB 00:00 2023-12-03T11:23:53.573 INFO:teuthology.orchestra.run.smithi091.stdout:ceph noarch packages 26 kB/s | 9.5 kB 00:00 2023-12-03T11:23:53.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph noarch packages 27 kB/s | 9.5 kB 00:00 2023-12-03T11:23:55.115 INFO:teuthology.orchestra.run.smithi091.stdout:ceph source packages 1.2 kB/s | 1.9 kB 00:01 2023-12-03T11:23:55.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph source packages 1.1 kB/s | 1.9 kB 00:01 2023-12-03T11:23:55.601 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS-9 - AppStream 14 MB/s | 6.4 MB 00:00 2023-12-03T11:23:55.721 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS-9 - AppStream 16 MB/s | 6.4 MB 00:00 2023-12-03T11:23:57.010 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS-9 - BaseOS 7.0 MB/s | 2.0 MB 00:00 2023-12-03T11:23:57.255 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS-9 - BaseOS 4.6 MB/s | 2.0 MB 00:00 2023-12-03T11:23:57.792 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 7.9 MB 00:00 2023-12-03T11:23:58.129 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 7.9 MB 00:00 2023-12-03T11:24:00.180 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - AppStream 21 MB/s | 18 MB 00:00 2023-12-03T11:24:00.976 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS Stream 9 - AppStream 8.9 MB/s | 18 MB 00:02 2023-12-03T11:24:05.223 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 5.8 MB 00:01 2023-12-03T11:24:05.951 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 5.8 MB 00:01 2023-12-03T11:24:06.649 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 15 kB 00:00 2023-12-03T11:24:07.792 INFO:teuthology.orchestra.run.smithi044.stdout:Extra Packages for Enterprise Linux 20 MB/s | 20 MB 00:00 2023-12-03T11:24:08.310 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 15 kB 00:01 2023-12-03T11:24:09.248 INFO:teuthology.orchestra.run.smithi091.stdout:Extra Packages for Enterprise Linux 25 MB/s | 20 MB 00:00 2023-12-03T11:24:12.675 INFO:teuthology.orchestra.run.smithi044.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2023-12-03T11:24:13.994 INFO:teuthology.orchestra.run.smithi091.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2023-12-03T11:24:15.514 INFO:teuthology.orchestra.run.smithi044.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-03T11:24:15.515 INFO:teuthology.orchestra.run.smithi044.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-03T11:24:15.589 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2023-12-03T11:24:15.607 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================================ 2023-12-03T11:24:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2023-12-03T11:24:15.607 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================================ 2023-12-03T11:24:15.607 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2023-12-03T11:24:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: ceph x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 6.6 k 2023-12-03T11:24:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 5.2 M 2023-12-03T11:24:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 860 k 2023-12-03T11:24:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 141 k 2023-12-03T11:24:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 1.5 M 2023-12-03T11:24:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 133 k 2023-12-03T11:24:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 1.8 M 2023-12-03T11:24:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 7.4 M 2023-12-03T11:24:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 50 k 2023-12-03T11:24:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 8.6 M 2023-12-03T11:24:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 41 M 2023-12-03T11:24:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 262 k 2023-12-03T11:24:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 774 k 2023-12-03T11:24:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 31 k 2023-12-03T11:24:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 718 k 2023-12-03T11:24:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 126 k 2023-12-03T11:24:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 162 k 2023-12-03T11:24:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 320 k 2023-12-03T11:24:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 298 k 2023-12-03T11:24:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 99 k 2023-12-03T11:24:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 85 k 2023-12-03T11:24:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 3.0 M 2023-12-03T11:24:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 170 k 2023-12-03T11:24:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: s3cmd noarch 2.3.0-4.el9 epel 197 k 2023-12-03T11:24:15.609 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrading: 2023-12-03T11:24:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: librados2 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 3.3 M 2023-12-03T11:24:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 3.0 M 2023-12-03T11:24:15.609 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2023-12-03T11:24:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-03T11:24:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 19 M 2023-12-03T11:24:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 28 k 2023-12-03T11:24:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 2.1 M 2023-12-03T11:24:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 243 k 2023-12-03T11:24:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 4.4 M 2023-12-03T11:24:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 18 M 2023-12-03T11:24:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 15 k 2023-12-03T11:24:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 24 k 2023-12-03T11:24:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-03T11:24:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-03T11:24:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-03T11:24:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-03T11:24:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-03T11:24:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-03T11:24:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-12-03T11:24:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-12-03T11:24:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 164 k 2023-12-03T11:24:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-03T11:24:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-03T11:24:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-03T11:24:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-03T11:24:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-03T11:24:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 475 k 2023-12-03T11:24:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-03T11:24:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 4.8 M 2023-12-03T11:24:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-03T11:24:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-03T11:24:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-03T11:24:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2023-12-03T11:24:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-03T11:24:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-03T11:24:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-03T11:24:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-03T11:24:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-12-03T11:24:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-03T11:24:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-03T11:24:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-03T11:24:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-03T11:24:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 45 k 2023-12-03T11:24:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 129 k 2023-12-03T11:24:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-03T11:24:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-03T11:24:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-03T11:24:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-03T11:24:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-03T11:24:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-03T11:24:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-03T11:24:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-03T11:24:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-03T11:24:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-03T11:24:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-03T11:24:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-03T11:24:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-03T11:24:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-03T11:24:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-03T11:24:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-03T11:24:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-03T11:24:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-03T11:24:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-03T11:24:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-03T11:24:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-03T11:24:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-03T11:24:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-03T11:24:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-03T11:24:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-03T11:24:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-03T11:24:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-03T11:24:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-03T11:24:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-03T11:24:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-03T11:24:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-03T11:24:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-03T11:24:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-03T11:24:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-03T11:24:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-03T11:24:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-03T11:24:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-03T11:24:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-03T11:24:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-03T11:24:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-03T11:24:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-03T11:24:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-03T11:24:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-03T11:24:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-03T11:24:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-03T11:24:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-03T11:24:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-03T11:24:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-03T11:24:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-03T11:24:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-03T11:24:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-03T11:24:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-03T11:24:15.616 INFO:teuthology.orchestra.run.smithi044.stdout:Installing weak dependencies: 2023-12-03T11:24:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-03T11:24:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:24:15.616 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2023-12-03T11:24:15.616 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================================ 2023-12-03T11:24:15.616 INFO:teuthology.orchestra.run.smithi044.stdout:Install 118 Packages 2023-12-03T11:24:15.616 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrade 2 Packages 2023-12-03T11:24:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:24:15.616 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 181 M 2023-12-03T11:24:15.617 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2023-12-03T11:24:16.327 INFO:teuthology.orchestra.run.smithi044.stdout:(1/120): ceph-18.0.0-7537.gbcbf278c.el9.x86_64. 31 kB/s | 6.6 kB 00:00 2023-12-03T11:24:16.691 INFO:teuthology.orchestra.run.smithi091.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-03T11:24:16.692 INFO:teuthology.orchestra.run.smithi091.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-03T11:24:16.762 INFO:teuthology.orchestra.run.smithi091.stdout:Dependencies resolved. 2023-12-03T11:24:16.770 INFO:teuthology.orchestra.run.smithi091.stdout:============================================================================================ 2023-12-03T11:24:16.771 INFO:teuthology.orchestra.run.smithi091.stdout: Package Arch Version Repository Size 2023-12-03T11:24:16.771 INFO:teuthology.orchestra.run.smithi091.stdout:============================================================================================ 2023-12-03T11:24:16.771 INFO:teuthology.orchestra.run.smithi091.stdout:Installing: 2023-12-03T11:24:16.771 INFO:teuthology.orchestra.run.smithi091.stdout: ceph x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 6.6 k 2023-12-03T11:24:16.771 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-base x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 5.2 M 2023-12-03T11:24:16.771 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-fuse x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 860 k 2023-12-03T11:24:16.771 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 141 k 2023-12-03T11:24:16.771 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 1.5 M 2023-12-03T11:24:16.771 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 133 k 2023-12-03T11:24:16.771 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 1.8 M 2023-12-03T11:24:16.771 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 7.4 M 2023-12-03T11:24:16.771 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-rook noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 50 k 2023-12-03T11:24:16.771 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-radosgw x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 8.6 M 2023-12-03T11:24:16.772 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-test x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 41 M 2023-12-03T11:24:16.772 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-volume noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 262 k 2023-12-03T11:24:16.772 INFO:teuthology.orchestra.run.smithi091.stdout: cephadm noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 774 k 2023-12-03T11:24:16.772 INFO:teuthology.orchestra.run.smithi091.stdout: libcephfs-devel x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 31 k 2023-12-03T11:24:16.772 INFO:teuthology.orchestra.run.smithi091.stdout: libcephfs2 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 718 k 2023-12-03T11:24:16.772 INFO:teuthology.orchestra.run.smithi091.stdout: librados-devel x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 126 k 2023-12-03T11:24:16.772 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cephfs x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 162 k 2023-12-03T11:24:16.772 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rados x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 320 k 2023-12-03T11:24:16.772 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rbd x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 298 k 2023-12-03T11:24:16.772 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rgw x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 99 k 2023-12-03T11:24:16.772 INFO:teuthology.orchestra.run.smithi091.stdout: rbd-fuse x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 85 k 2023-12-03T11:24:16.772 INFO:teuthology.orchestra.run.smithi091.stdout: rbd-mirror x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 3.0 M 2023-12-03T11:24:16.772 INFO:teuthology.orchestra.run.smithi091.stdout: rbd-nbd x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 170 k 2023-12-03T11:24:16.773 INFO:teuthology.orchestra.run.smithi091.stdout: s3cmd noarch 2.3.0-4.el9 epel 197 k 2023-12-03T11:24:16.773 INFO:teuthology.orchestra.run.smithi091.stdout:Upgrading: 2023-12-03T11:24:16.773 INFO:teuthology.orchestra.run.smithi091.stdout: librados2 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 3.3 M 2023-12-03T11:24:16.773 INFO:teuthology.orchestra.run.smithi091.stdout: librbd1 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 3.0 M 2023-12-03T11:24:16.773 INFO:teuthology.orchestra.run.smithi091.stdout:Installing dependencies: 2023-12-03T11:24:16.773 INFO:teuthology.orchestra.run.smithi091.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-03T11:24:16.773 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-common x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 19 M 2023-12-03T11:24:16.773 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 28 k 2023-12-03T11:24:16.773 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mds x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 2.1 M 2023-12-03T11:24:16.773 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 243 k 2023-12-03T11:24:16.773 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mon x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 4.4 M 2023-12-03T11:24:16.773 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-osd x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 18 M 2023-12-03T11:24:16.773 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 15 k 2023-12-03T11:24:16.774 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-selinux x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 24 k 2023-12-03T11:24:16.774 INFO:teuthology.orchestra.run.smithi091.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-03T11:24:16.774 INFO:teuthology.orchestra.run.smithi091.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-03T11:24:16.774 INFO:teuthology.orchestra.run.smithi091.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-03T11:24:16.774 INFO:teuthology.orchestra.run.smithi091.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-03T11:24:16.774 INFO:teuthology.orchestra.run.smithi091.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-03T11:24:16.774 INFO:teuthology.orchestra.run.smithi091.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-03T11:24:16.774 INFO:teuthology.orchestra.run.smithi091.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-12-03T11:24:16.774 INFO:teuthology.orchestra.run.smithi091.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-12-03T11:24:16.774 INFO:teuthology.orchestra.run.smithi091.stdout: libcephsqlite x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 164 k 2023-12-03T11:24:16.774 INFO:teuthology.orchestra.run.smithi091.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-03T11:24:16.775 INFO:teuthology.orchestra.run.smithi091.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-03T11:24:16.775 INFO:teuthology.orchestra.run.smithi091.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-03T11:24:16.775 INFO:teuthology.orchestra.run.smithi091.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-03T11:24:16.775 INFO:teuthology.orchestra.run.smithi091.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-03T11:24:16.775 INFO:teuthology.orchestra.run.smithi091.stdout: libradosstriper1 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 475 k 2023-12-03T11:24:16.775 INFO:teuthology.orchestra.run.smithi091.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-03T11:24:16.775 INFO:teuthology.orchestra.run.smithi091.stdout: librgw2 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 4.8 M 2023-12-03T11:24:16.775 INFO:teuthology.orchestra.run.smithi091.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-03T11:24:16.775 INFO:teuthology.orchestra.run.smithi091.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-03T11:24:16.775 INFO:teuthology.orchestra.run.smithi091.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-03T11:24:16.775 INFO:teuthology.orchestra.run.smithi091.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2023-12-03T11:24:16.775 INFO:teuthology.orchestra.run.smithi091.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-03T11:24:16.775 INFO:teuthology.orchestra.run.smithi091.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-03T11:24:16.776 INFO:teuthology.orchestra.run.smithi091.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-03T11:24:16.776 INFO:teuthology.orchestra.run.smithi091.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-03T11:24:16.776 INFO:teuthology.orchestra.run.smithi091.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-12-03T11:24:16.776 INFO:teuthology.orchestra.run.smithi091.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-03T11:24:16.776 INFO:teuthology.orchestra.run.smithi091.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-03T11:24:16.776 INFO:teuthology.orchestra.run.smithi091.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-03T11:24:16.776 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-03T11:24:16.776 INFO:teuthology.orchestra.run.smithi091.stdout: python3-ceph-argparse x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 45 k 2023-12-03T11:24:16.776 INFO:teuthology.orchestra.run.smithi091.stdout: python3-ceph-common x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 129 k 2023-12-03T11:24:16.776 INFO:teuthology.orchestra.run.smithi091.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-03T11:24:16.776 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-03T11:24:16.776 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-03T11:24:16.777 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-03T11:24:16.777 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-03T11:24:16.777 INFO:teuthology.orchestra.run.smithi091.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-03T11:24:16.777 INFO:teuthology.orchestra.run.smithi091.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-03T11:24:16.777 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-03T11:24:16.777 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-03T11:24:16.777 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-03T11:24:16.777 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-03T11:24:16.777 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-03T11:24:16.777 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-03T11:24:16.777 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-03T11:24:16.777 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-03T11:24:16.777 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-03T11:24:16.778 INFO:teuthology.orchestra.run.smithi091.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-03T11:24:16.778 INFO:teuthology.orchestra.run.smithi091.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-03T11:24:16.778 INFO:teuthology.orchestra.run.smithi091.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-03T11:24:16.778 INFO:teuthology.orchestra.run.smithi091.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-03T11:24:16.778 INFO:teuthology.orchestra.run.smithi091.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-03T11:24:16.778 INFO:teuthology.orchestra.run.smithi091.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-03T11:24:16.778 INFO:teuthology.orchestra.run.smithi091.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-03T11:24:16.778 INFO:teuthology.orchestra.run.smithi091.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-03T11:24:16.779 INFO:teuthology.orchestra.run.smithi091.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-03T11:24:16.779 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-03T11:24:16.779 INFO:teuthology.orchestra.run.smithi091.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-03T11:24:16.779 INFO:teuthology.orchestra.run.smithi091.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-03T11:24:16.779 INFO:teuthology.orchestra.run.smithi091.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-03T11:24:16.779 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-03T11:24:16.779 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-03T11:24:16.779 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-03T11:24:16.779 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-03T11:24:16.780 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-03T11:24:16.780 INFO:teuthology.orchestra.run.smithi091.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-03T11:24:16.780 INFO:teuthology.orchestra.run.smithi091.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-03T11:24:16.780 INFO:teuthology.orchestra.run.smithi091.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-03T11:24:16.780 INFO:teuthology.orchestra.run.smithi091.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-03T11:24:16.780 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-03T11:24:16.780 INFO:teuthology.orchestra.run.smithi091.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-03T11:24:16.780 INFO:teuthology.orchestra.run.smithi091.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-03T11:24:16.780 INFO:teuthology.orchestra.run.smithi091.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-03T11:24:16.780 INFO:teuthology.orchestra.run.smithi091.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-03T11:24:16.780 INFO:teuthology.orchestra.run.smithi091.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-03T11:24:16.780 INFO:teuthology.orchestra.run.smithi091.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-03T11:24:16.780 INFO:teuthology.orchestra.run.smithi091.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-03T11:24:16.781 INFO:teuthology.orchestra.run.smithi091.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-03T11:24:16.781 INFO:teuthology.orchestra.run.smithi091.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-03T11:24:16.781 INFO:teuthology.orchestra.run.smithi091.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-03T11:24:16.781 INFO:teuthology.orchestra.run.smithi091.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-03T11:24:16.781 INFO:teuthology.orchestra.run.smithi091.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-03T11:24:16.781 INFO:teuthology.orchestra.run.smithi091.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-03T11:24:16.781 INFO:teuthology.orchestra.run.smithi091.stdout:Installing weak dependencies: 2023-12-03T11:24:16.781 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-03T11:24:16.781 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:24:16.781 INFO:teuthology.orchestra.run.smithi091.stdout:Transaction Summary 2023-12-03T11:24:16.781 INFO:teuthology.orchestra.run.smithi091.stdout:============================================================================================ 2023-12-03T11:24:16.781 INFO:teuthology.orchestra.run.smithi091.stdout:Install 118 Packages 2023-12-03T11:24:16.782 INFO:teuthology.orchestra.run.smithi091.stdout:Upgrade 2 Packages 2023-12-03T11:24:16.782 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:24:16.782 INFO:teuthology.orchestra.run.smithi091.stdout:Total download size: 181 M 2023-12-03T11:24:16.782 INFO:teuthology.orchestra.run.smithi091.stdout:Downloading Packages: 2023-12-03T11:24:16.802 INFO:teuthology.orchestra.run.smithi044.stdout:(2/120): ceph-fuse-18.0.0-7537.gbcbf278c.el9.x8 1.8 MB/s | 860 kB 00:00 2023-12-03T11:24:16.894 INFO:teuthology.orchestra.run.smithi044.stdout:(3/120): ceph-immutable-object-cache-18.0.0-753 1.5 MB/s | 141 kB 00:00 2023-12-03T11:24:17.428 INFO:teuthology.orchestra.run.smithi044.stdout:(4/120): ceph-common-18.0.0-7537.gbcbf278c.el9. 14 MB/s | 19 MB 00:01 2023-12-03T11:24:17.512 INFO:teuthology.orchestra.run.smithi044.stdout:(5/120): ceph-base-18.0.0-7537.gbcbf278c.el9.x8 3.7 MB/s | 5.2 MB 00:01 2023-12-03T11:24:17.561 INFO:teuthology.orchestra.run.smithi044.stdout:(6/120): ceph-mgr-18.0.0-7537.gbcbf278c.el9.x86 11 MB/s | 1.5 MB 00:00 2023-12-03T11:24:17.604 INFO:teuthology.orchestra.run.smithi091.stdout:(1/120): ceph-18.0.0-7537.gbcbf278c.el9.x86_64. 26 kB/s | 6.6 kB 00:00 2023-12-03T11:24:17.695 INFO:teuthology.orchestra.run.smithi044.stdout:(7/120): ceph-mds-18.0.0-7537.gbcbf278c.el9.x86 2.6 MB/s | 2.1 MB 00:00 2023-12-03T11:24:18.129 INFO:teuthology.orchestra.run.smithi044.stdout:(8/120): ceph-mon-18.0.0-7537.gbcbf278c.el9.x86 7.1 MB/s | 4.4 MB 00:00 2023-12-03T11:24:18.221 INFO:teuthology.orchestra.run.smithi044.stdout:(9/120): ceph-selinux-18.0.0-7537.gbcbf278c.el9 263 kB/s | 24 kB 00:00 2023-12-03T11:24:18.646 INFO:teuthology.orchestra.run.smithi091.stdout:(2/120): ceph-fuse-18.0.0-7537.gbcbf278c.el9.x8 826 kB/s | 860 kB 00:01 2023-12-03T11:24:18.788 INFO:teuthology.orchestra.run.smithi091.stdout:(3/120): ceph-immutable-object-cache-18.0.0-753 996 kB/s | 141 kB 00:00 2023-12-03T11:24:18.855 INFO:teuthology.orchestra.run.smithi044.stdout:(10/120): ceph-osd-18.0.0-7537.gbcbf278c.el9.x8 14 MB/s | 18 MB 00:01 2023-12-03T11:24:18.921 INFO:teuthology.orchestra.run.smithi044.stdout:(11/120): libcephfs-devel-18.0.0-7537.gbcbf278c 469 kB/s | 31 kB 00:00 2023-12-03T11:24:19.089 INFO:teuthology.orchestra.run.smithi044.stdout:(12/120): libcephfs2-18.0.0-7537.gbcbf278c.el9. 4.2 MB/s | 718 kB 00:00 2023-12-03T11:24:19.180 INFO:teuthology.orchestra.run.smithi044.stdout:(13/120): libcephsqlite-18.0.0-7537.gbcbf278c.e 1.8 MB/s | 164 kB 00:00 2023-12-03T11:24:19.264 INFO:teuthology.orchestra.run.smithi044.stdout:(14/120): librados-devel-18.0.0-7537.gbcbf278c. 1.5 MB/s | 126 kB 00:00 2023-12-03T11:24:19.364 INFO:teuthology.orchestra.run.smithi044.stdout:(15/120): libradosstriper1-18.0.0-7537.gbcbf278 4.7 MB/s | 475 kB 00:00 2023-12-03T11:24:20.071 INFO:teuthology.orchestra.run.smithi091.stdout:(4/120): ceph-mds-18.0.0-7537.gbcbf278c.el9.x86 1.6 MB/s | 2.1 MB 00:01 2023-12-03T11:24:20.209 INFO:teuthology.orchestra.run.smithi044.stdout:(16/120): librgw2-18.0.0-7537.gbcbf278c.el9.x86 5.7 MB/s | 4.8 MB 00:00 2023-12-03T11:24:20.293 INFO:teuthology.orchestra.run.smithi044.stdout:(17/120): python3-ceph-argparse-18.0.0-7537.gbc 542 kB/s | 45 kB 00:00 2023-12-03T11:24:20.376 INFO:teuthology.orchestra.run.smithi044.stdout:(18/120): python3-ceph-common-18.0.0-7537.gbcbf 1.5 MB/s | 129 kB 00:00 2023-12-03T11:24:20.469 INFO:teuthology.orchestra.run.smithi044.stdout:(19/120): python3-cephfs-18.0.0-7537.gbcbf278c. 1.7 MB/s | 162 kB 00:00 2023-12-03T11:24:20.569 INFO:teuthology.orchestra.run.smithi044.stdout:(20/120): python3-rados-18.0.0-7537.gbcbf278c.e 3.1 MB/s | 320 kB 00:00 2023-12-03T11:24:20.661 INFO:teuthology.orchestra.run.smithi044.stdout:(21/120): ceph-radosgw-18.0.0-7537.gbcbf278c.el 2.9 MB/s | 8.6 MB 00:02 2023-12-03T11:24:20.686 INFO:teuthology.orchestra.run.smithi044.stdout:(22/120): python3-rbd-18.0.0-7537.gbcbf278c.el9 2.5 MB/s | 298 kB 00:00 2023-12-03T11:24:20.745 INFO:teuthology.orchestra.run.smithi044.stdout:(23/120): python3-rgw-18.0.0-7537.gbcbf278c.el9 1.2 MB/s | 99 kB 00:00 2023-12-03T11:24:20.770 INFO:teuthology.orchestra.run.smithi044.stdout:(24/120): rbd-fuse-18.0.0-7537.gbcbf278c.el9.x8 1.0 MB/s | 85 kB 00:00 2023-12-03T11:24:20.838 INFO:teuthology.orchestra.run.smithi091.stdout:(5/120): ceph-mgr-18.0.0-7537.gbcbf278c.el9.x86 1.9 MB/s | 1.5 MB 00:00 2023-12-03T11:24:20.854 INFO:teuthology.orchestra.run.smithi044.stdout:(25/120): rbd-nbd-18.0.0-7537.gbcbf278c.el9.x86 2.0 MB/s | 170 kB 00:00 2023-12-03T11:24:20.937 INFO:teuthology.orchestra.run.smithi044.stdout:(26/120): ceph-grafana-dashboards-18.0.0-7537.g 336 kB/s | 28 kB 00:00 2023-12-03T11:24:21.029 INFO:teuthology.orchestra.run.smithi044.stdout:(27/120): ceph-mgr-cephadm-18.0.0-7537.gbcbf278 1.4 MB/s | 133 kB 00:00 2023-12-03T11:24:21.121 INFO:teuthology.orchestra.run.smithi091.stdout:(6/120): ceph-base-18.0.0-7537.gbcbf278c.el9.x8 1.4 MB/s | 5.2 MB 00:03 2023-12-03T11:24:21.438 INFO:teuthology.orchestra.run.smithi044.stdout:(28/120): ceph-test-18.0.0-7537.gbcbf278c.el9.x 13 MB/s | 41 MB 00:03 2023-12-03T11:24:21.488 INFO:teuthology.orchestra.run.smithi044.stdout:(29/120): ceph-mgr-dashboard-18.0.0-7537.gbcbf2 3.8 MB/s | 1.8 MB 00:00 2023-12-03T11:24:21.622 INFO:teuthology.orchestra.run.smithi044.stdout:(30/120): rbd-mirror-18.0.0-7537.gbcbf278c.el9. 3.4 MB/s | 3.0 MB 00:00 2023-12-03T11:24:21.656 INFO:teuthology.orchestra.run.smithi044.stdout:(31/120): ceph-mgr-modules-core-18.0.0-7537.gbc 1.4 MB/s | 243 kB 00:00 2023-12-03T11:24:21.722 INFO:teuthology.orchestra.run.smithi044.stdout:(32/120): ceph-mgr-rook-18.0.0-7537.gbcbf278c.e 503 kB/s | 50 kB 00:00 2023-12-03T11:24:21.739 INFO:teuthology.orchestra.run.smithi044.stdout:(33/120): ceph-prometheus-alerts-18.0.0-7537.gb 181 kB/s | 15 kB 00:00 2023-12-03T11:24:21.815 INFO:teuthology.orchestra.run.smithi044.stdout:(34/120): ceph-volume-18.0.0-7537.gbcbf278c.el9 2.8 MB/s | 262 kB 00:00 2023-12-03T11:24:21.915 INFO:teuthology.orchestra.run.smithi044.stdout:(35/120): cephadm-18.0.0-7537.gbcbf278c.el9.noa 4.3 MB/s | 774 kB 00:00 2023-12-03T11:24:21.940 INFO:teuthology.orchestra.run.smithi044.stdout:(36/120): boost-program-options-1.75.0-8.el9.x8 845 kB/s | 106 kB 00:00 2023-12-03T11:24:21.966 INFO:teuthology.orchestra.run.smithi044.stdout:(37/120): flexiblas-3.0.4-8.el9.x86_64.rpm 630 kB/s | 32 kB 00:00 2023-12-03T11:24:22.058 INFO:teuthology.orchestra.run.smithi044.stdout:(38/120): ceph-mgr-diskprediction-local-18.0.0- 12 MB/s | 7.4 MB 00:00 2023-12-03T11:24:22.191 INFO:teuthology.orchestra.run.smithi044.stdout:(39/120): flexiblas-openblas-openmp-3.0.4-8.el9 76 kB/s | 17 kB 00:00 2023-12-03T11:24:22.255 INFO:teuthology.orchestra.run.smithi091.stdout:(7/120): ceph-common-18.0.0-7537.gbcbf278c.el9. 3.9 MB/s | 19 MB 00:04 2023-12-03T11:24:22.258 INFO:teuthology.orchestra.run.smithi044.stdout:(40/120): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.4 MB/s | 3.0 MB 00:00 2023-12-03T11:24:22.284 INFO:teuthology.orchestra.run.smithi044.stdout:(41/120): jq-1.6-16.el9.x86_64.rpm 827 kB/s | 186 kB 00:00 2023-12-03T11:24:22.309 INFO:teuthology.orchestra.run.smithi044.stdout:(42/120): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 159 kB 00:00 2023-12-03T11:24:22.334 INFO:teuthology.orchestra.run.smithi044.stdout:(43/120): librabbitmq-0.11.0-7.el9.x86_64.rpm 590 kB/s | 44 kB 00:00 2023-12-03T11:24:22.376 INFO:teuthology.orchestra.run.smithi044.stdout:(44/120): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.1 MB/s | 282 kB 00:00 2023-12-03T11:24:22.388 INFO:teuthology.orchestra.run.smithi091.stdout:(8/120): ceph-mon-18.0.0-7537.gbcbf278c.el9.x86 2.8 MB/s | 4.4 MB 00:01 2023-12-03T11:24:22.401 INFO:teuthology.orchestra.run.smithi044.stdout:(45/120): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 661 kB 00:00 2023-12-03T11:24:22.435 INFO:teuthology.orchestra.run.smithi044.stdout:(46/120): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 187 kB 00:00 2023-12-03T11:24:22.447 INFO:teuthology.orchestra.run.smithi091.stdout:(9/120): ceph-selinux-18.0.0-7537.gbcbf278c.el9 414 kB/s | 24 kB 00:00 2023-12-03T11:24:22.460 INFO:teuthology.orchestra.run.smithi044.stdout:(47/120): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.5 MB/s | 217 kB 00:00 2023-12-03T11:24:22.485 INFO:teuthology.orchestra.run.smithi044.stdout:(48/120): openblas-0.3.21-2.el9.x86_64.rpm 689 kB/s | 34 kB 00:00 2023-12-03T11:24:22.652 INFO:teuthology.orchestra.run.smithi044.stdout:(49/120): openblas-openmp-0.3.21-2.el9.x86_64.r 22 MB/s | 4.7 MB 00:00 2023-12-03T11:24:22.678 INFO:teuthology.orchestra.run.smithi044.stdout:(50/120): python3-jinja2-2.11.3-4.el9.noarch.rp 1.2 MB/s | 228 kB 00:00 2023-12-03T11:24:22.786 INFO:teuthology.orchestra.run.smithi044.stdout:(51/120): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2023-12-03T11:24:22.811 INFO:teuthology.orchestra.run.smithi044.stdout:(52/120): python3-jsonpatch-1.21-16.el9.noarch. 157 kB/s | 24 kB 00:00 2023-12-03T11:24:22.837 INFO:teuthology.orchestra.run.smithi044.stdout:(53/120): python3-jsonpointer-2.0-4.el9.noarch. 116 kB/s | 18 kB 00:00 2023-12-03T11:24:22.862 INFO:teuthology.orchestra.run.smithi044.stdout:(54/120): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2023-12-03T11:24:22.887 INFO:teuthology.orchestra.run.smithi044.stdout:(55/120): python3-markupsafe-1.1.1-12.el9.x86_6 636 kB/s | 32 kB 00:00 2023-12-03T11:24:23.017 INFO:teuthology.orchestra.run.smithi044.stdout:(56/120): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 4.8 MB 00:00 2023-12-03T11:24:23.040 INFO:teuthology.orchestra.run.smithi044.stdout:(57/120): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2023-12-03T11:24:23.074 INFO:teuthology.orchestra.run.smithi044.stdout:(58/120): python3-oauthlib-3.1.1-5.el9.noarch.r 952 kB/s | 174 kB 00:00 2023-12-03T11:24:23.091 INFO:teuthology.orchestra.run.smithi044.stdout:(59/120): python3-prettytable-0.7.2-27.el9.noar 570 kB/s | 41 kB 00:00 2023-12-03T11:24:23.116 INFO:teuthology.orchestra.run.smithi044.stdout:(60/120): python3-pyasn1-modules-0.4.8-6.el9.no 5.0 MB/s | 211 kB 00:00 2023-12-03T11:24:23.141 INFO:teuthology.orchestra.run.smithi044.stdout:(61/120): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2023-12-03T11:24:23.158 INFO:teuthology.orchestra.run.smithi044.stdout:(62/120): python3-pytz-2021.1-5.el9.noarch.rpm 709 kB/s | 47 kB 00:00 2023-12-03T11:24:23.175 INFO:teuthology.orchestra.run.smithi044.stdout:(63/120): python3-requests-oauthlib-1.3.0-12.el 734 kB/s | 43 kB 00:00 2023-12-03T11:24:23.192 INFO:teuthology.orchestra.run.smithi044.stdout:(64/120): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-12-03T11:24:23.197 INFO:teuthology.orchestra.run.smithi091.stdout:(10/120): ceph-radosgw-18.0.0-7537.gbcbf278c.el 9.2 MB/s | 8.6 MB 00:00 2023-12-03T11:24:23.247 INFO:teuthology.orchestra.run.smithi091.stdout:(11/120): libcephfs-devel-18.0.0-7537.gbcbf278c 627 kB/s | 31 kB 00:00 2023-12-03T11:24:23.292 INFO:teuthology.orchestra.run.smithi044.stdout:(65/120): socat-1.7.4.1-5.el9.x86_64.rpm 2.5 MB/s | 300 kB 00:00 2023-12-03T11:24:23.347 INFO:teuthology.orchestra.run.smithi091.stdout:(12/120): libcephfs2-18.0.0-7537.gbcbf278c.el9. 7.0 MB/s | 718 kB 00:00 2023-12-03T11:24:23.350 INFO:teuthology.orchestra.run.smithi044.stdout:(66/120): xmlstarlet-1.6.1-20.el9.x86_64.rpm 403 kB/s | 63 kB 00:00 2023-12-03T11:24:23.398 INFO:teuthology.orchestra.run.smithi091.stdout:(13/120): libcephsqlite-18.0.0-7537.gbcbf278c.e 3.2 MB/s | 164 kB 00:00 2023-12-03T11:24:23.448 INFO:teuthology.orchestra.run.smithi091.stdout:(14/120): librados-devel-18.0.0-7537.gbcbf278c. 2.5 MB/s | 126 kB 00:00 2023-12-03T11:24:23.523 INFO:teuthology.orchestra.run.smithi091.stdout:(15/120): libradosstriper1-18.0.0-7537.gbcbf278 6.2 MB/s | 475 kB 00:00 2023-12-03T11:24:23.543 INFO:teuthology.orchestra.run.smithi044.stdout:(67/120): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2023-12-03T11:24:23.568 INFO:teuthology.orchestra.run.smithi044.stdout:(68/120): fuse-2.9.9-15.el9.x86_64.rpm 288 kB/s | 79 kB 00:00 2023-12-03T11:24:23.601 INFO:teuthology.orchestra.run.smithi044.stdout:(69/120): libgfortran-11.4.1-2.3.el9.x86_64.rpm 3.2 MB/s | 803 kB 00:00 2023-12-03T11:24:23.627 INFO:teuthology.orchestra.run.smithi044.stdout:(70/120): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2023-12-03T11:24:23.652 INFO:teuthology.orchestra.run.smithi044.stdout:(71/120): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-12-03T11:24:23.685 INFO:teuthology.orchestra.run.smithi044.stdout:(72/120): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2023-12-03T11:24:23.710 INFO:teuthology.orchestra.run.smithi044.stdout:(73/120): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2023-12-03T11:24:23.736 INFO:teuthology.orchestra.run.smithi044.stdout:(74/120): python3-requests-2.25.1-7.el9.noarch. 2.2 MB/s | 113 kB 00:00 2023-12-03T11:24:23.761 INFO:teuthology.orchestra.run.smithi044.stdout:(75/120): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 124 kB 00:00 2023-12-03T11:24:23.786 INFO:teuthology.orchestra.run.smithi044.stdout:(76/120): python3-urllib3-1.26.5-4.el9.noarch.r 2.4 MB/s | 187 kB 00:00 2023-12-03T11:24:23.945 INFO:teuthology.orchestra.run.smithi044.stdout:(77/120): python3-devel-3.9.17-2.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2023-12-03T11:24:23.965 INFO:teuthology.orchestra.run.smithi091.stdout:(16/120): librgw2-18.0.0-7537.gbcbf278c.el9.x86 11 MB/s | 4.8 MB 00:00 2023-12-03T11:24:24.007 INFO:teuthology.orchestra.run.smithi091.stdout:(17/120): python3-ceph-argparse-18.0.0-7537.gbc 1.1 MB/s | 45 kB 00:00 2023-12-03T11:24:24.057 INFO:teuthology.orchestra.run.smithi091.stdout:(18/120): python3-ceph-common-18.0.0-7537.gbcbf 2.5 MB/s | 129 kB 00:00 2023-12-03T11:24:24.108 INFO:teuthology.orchestra.run.smithi091.stdout:(19/120): python3-cephfs-18.0.0-7537.gbcbf278c. 3.2 MB/s | 162 kB 00:00 2023-12-03T11:24:24.177 INFO:teuthology.orchestra.run.smithi091.stdout:(20/120): python3-rados-18.0.0-7537.gbcbf278c.e 4.5 MB/s | 320 kB 00:00 2023-12-03T11:24:24.252 INFO:teuthology.orchestra.run.smithi091.stdout:(21/120): python3-rbd-18.0.0-7537.gbcbf278c.el9 3.9 MB/s | 298 kB 00:00 2023-12-03T11:24:24.302 INFO:teuthology.orchestra.run.smithi091.stdout:(22/120): python3-rgw-18.0.0-7537.gbcbf278c.el9 1.9 MB/s | 99 kB 00:00 2023-12-03T11:24:24.353 INFO:teuthology.orchestra.run.smithi091.stdout:(23/120): rbd-fuse-18.0.0-7537.gbcbf278c.el9.x8 1.7 MB/s | 85 kB 00:00 2023-12-03T11:24:24.445 INFO:teuthology.orchestra.run.smithi044.stdout:(78/120): lua-devel-5.4.4-4.el9.x86_64.rpm 34 kB/s | 22 kB 00:00 2023-12-03T11:24:24.471 INFO:teuthology.orchestra.run.smithi044.stdout:(79/120): gperftools-libs-2.9.1-2.el9.x86_64.rp 451 kB/s | 309 kB 00:00 2023-12-03T11:24:24.528 INFO:teuthology.orchestra.run.smithi091.stdout:(24/120): ceph-osd-18.0.0-7537.gbcbf278c.el9.x8 5.2 MB/s | 18 MB 00:03 2023-12-03T11:24:24.587 INFO:teuthology.orchestra.run.smithi091.stdout:(25/120): rbd-nbd-18.0.0-7537.gbcbf278c.el9.x86 2.9 MB/s | 170 kB 00:00 2023-12-03T11:24:24.596 INFO:teuthology.orchestra.run.smithi044.stdout:(80/120): libarrow-doc-9.0.0-9.el9.noarch.rpm 163 kB/s | 24 kB 00:00 2023-12-03T11:24:24.612 INFO:teuthology.orchestra.run.smithi044.stdout:(81/120): liboath-2.6.7-2.el9.x86_64.rpm 344 kB/s | 49 kB 00:00 2023-12-03T11:24:24.629 INFO:teuthology.orchestra.run.smithi091.stdout:(26/120): ceph-grafana-dashboards-18.0.0-7537.g 674 kB/s | 28 kB 00:00 2023-12-03T11:24:24.688 INFO:teuthology.orchestra.run.smithi091.stdout:(27/120): ceph-mgr-cephadm-18.0.0-7537.gbcbf278 2.2 MB/s | 133 kB 00:00 2023-12-03T11:24:24.821 INFO:teuthology.orchestra.run.smithi091.stdout:(28/120): rbd-mirror-18.0.0-7537.gbcbf278c.el9. 6.4 MB/s | 3.0 MB 00:00 2023-12-03T11:24:24.846 INFO:teuthology.orchestra.run.smithi044.stdout:(82/120): libarrow-9.0.0-9.el9.x86_64.rpm 4.9 MB/s | 4.4 MB 00:00 2023-12-03T11:24:24.873 INFO:teuthology.orchestra.run.smithi044.stdout:(83/120): libunwind-1.6.2-1.el9.x86_64.rpm 245 kB/s | 67 kB 00:00 2023-12-03T11:24:24.897 INFO:teuthology.orchestra.run.smithi044.stdout:(84/120): luarocks-3.9.2-1.el9.noarch.rpm 534 kB/s | 151 kB 00:00 2023-12-03T11:24:24.980 INFO:teuthology.orchestra.run.smithi091.stdout:(29/120): ceph-mgr-dashboard-18.0.0-7537.gbcbf2 6.0 MB/s | 1.8 MB 00:00 2023-12-03T11:24:25.055 INFO:teuthology.orchestra.run.smithi091.stdout:(30/120): ceph-mgr-modules-core-18.0.0-7537.gbc 3.2 MB/s | 243 kB 00:00 2023-12-03T11:24:25.089 INFO:teuthology.orchestra.run.smithi044.stdout:(85/120): parquet-libs-9.0.0-9.el9.x86_64.rpm 3.8 MB/s | 837 kB 00:00 2023-12-03T11:24:25.097 INFO:teuthology.orchestra.run.smithi091.stdout:(31/120): ceph-mgr-rook-18.0.0-7537.gbcbf278c.e 1.2 MB/s | 50 kB 00:00 2023-12-03T11:24:25.139 INFO:teuthology.orchestra.run.smithi091.stdout:(32/120): ceph-prometheus-alerts-18.0.0-7537.gb 363 kB/s | 15 kB 00:00 2023-12-03T11:24:25.206 INFO:teuthology.orchestra.run.smithi091.stdout:(33/120): ceph-volume-18.0.0-7537.gbcbf278c.el9 3.8 MB/s | 262 kB 00:00 2023-12-03T11:24:25.222 INFO:teuthology.orchestra.run.smithi044.stdout:(86/120): python3-asyncssh-2.13.2-3.el9.noarch. 1.5 MB/s | 548 kB 00:00 2023-12-03T11:24:25.248 INFO:teuthology.orchestra.run.smithi044.stdout:(87/120): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 124 kB/s | 43 kB 00:00 2023-12-03T11:24:25.273 INFO:teuthology.orchestra.run.smithi044.stdout:(88/120): python3-cachetools-4.2.4-1.el9.noarch 175 kB/s | 32 kB 00:00 2023-12-03T11:24:25.323 INFO:teuthology.orchestra.run.smithi091.stdout:(34/120): cephadm-18.0.0-7537.gbcbf278c.el9.noa 6.5 MB/s | 774 kB 00:00 2023-12-03T11:24:25.398 INFO:teuthology.orchestra.run.smithi044.stdout:(89/120): python3-certifi-2021.10.8-2.el9.noarc 85 kB/s | 15 kB 00:00 2023-12-03T11:24:25.499 INFO:teuthology.orchestra.run.smithi044.stdout:(90/120): python3-cheroot-8.6.0-4.el9.noarch.rp 763 kB/s | 172 kB 00:00 2023-12-03T11:24:25.574 INFO:teuthology.orchestra.run.smithi044.stdout:(91/120): python3-cherrypy-18.6.1-2.el9.noarch. 1.2 MB/s | 358 kB 00:00 2023-12-03T11:24:25.599 INFO:teuthology.orchestra.run.smithi044.stdout:(92/120): python3-google-auth-2.23.4-1.el9.noar 986 kB/s | 197 kB 00:00 2023-12-03T11:24:25.623 INFO:teuthology.orchestra.run.smithi091.stdout:(35/120): ceph-mgr-diskprediction-local-18.0.0- 9.2 MB/s | 7.4 MB 00:00 2023-12-03T11:24:25.624 INFO:teuthology.orchestra.run.smithi044.stdout:(93/120): python3-jaraco-8.2.1-3.el9.noarch.rpm 85 kB/s | 11 kB 00:00 2023-12-03T11:24:25.648 INFO:teuthology.orchestra.run.smithi091.stdout:(36/120): boost-program-options-1.75.0-8.el9.x8 325 kB/s | 106 kB 00:00 2023-12-03T11:24:25.682 INFO:teuthology.orchestra.run.smithi091.stdout:(37/120): flexiblas-3.0.4-8.el9.x86_64.rpm 542 kB/s | 32 kB 00:00 2023-12-03T11:24:25.693 INFO:teuthology.orchestra.run.smithi044.stdout:(94/120): python3-jaraco-classes-3.2.1-5.el9.no 152 kB/s | 18 kB 00:00 2023-12-03T11:24:25.733 INFO:teuthology.orchestra.run.smithi044.stdout:(95/120): python3-jaraco-collections-3.0.0-8.el 214 kB/s | 23 kB 00:00 2023-12-03T11:24:25.767 INFO:teuthology.orchestra.run.smithi044.stdout:(96/120): python3-jaraco-functools-3.5.0-2.el9. 137 kB/s | 19 kB 00:00 2023-12-03T11:24:25.817 INFO:teuthology.orchestra.run.smithi044.stdout:(97/120): python3-jaraco-text-3.2.0-6.el9.noarc 156 kB/s | 20 kB 00:00 2023-12-03T11:24:25.841 INFO:teuthology.orchestra.run.smithi091.stdout:(38/120): flexiblas-openblas-openmp-3.0.4-8.el9 108 kB/s | 17 kB 00:00 2023-12-03T11:24:25.859 INFO:teuthology.orchestra.run.smithi044.stdout:(98/120): python3-jwt+crypto-2.4.0-1.el9.noarch 72 kB/s | 9.0 kB 00:00 2023-12-03T11:24:25.892 INFO:teuthology.orchestra.run.smithi044.stdout:(99/120): python3-jwt-2.4.0-1.el9.noarch.rpm 326 kB/s | 41 kB 00:00 2023-12-03T11:24:26.008 INFO:teuthology.orchestra.run.smithi091.stdout:(39/120): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.3 MB/s | 3.0 MB 00:00 2023-12-03T11:24:26.033 INFO:teuthology.orchestra.run.smithi091.stdout:(40/120): jq-1.6-16.el9.x86_64.rpm 975 kB/s | 186 kB 00:00 2023-12-03T11:24:26.058 INFO:teuthology.orchestra.run.smithi091.stdout:(41/120): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.7 MB/s | 44 kB 00:00 2023-12-03T11:24:26.059 INFO:teuthology.orchestra.run.smithi044.stdout:(100/120): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2023-12-03T11:24:26.075 INFO:teuthology.orchestra.run.smithi091.stdout:(42/120): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2023-12-03T11:24:26.085 INFO:teuthology.orchestra.run.smithi044.stdout:(101/120): python3-logutils-0.3.5-21.el9.noarch 205 kB/s | 46 kB 00:00 2023-12-03T11:24:26.108 INFO:teuthology.orchestra.run.smithi091.stdout:(43/120): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-12-03T11:24:26.110 INFO:teuthology.orchestra.run.smithi044.stdout:(102/120): python3-more-itertools-8.12.0-2.el9. 363 kB/s | 79 kB 00:00 2023-12-03T11:24:26.134 INFO:teuthology.orchestra.run.smithi091.stdout:(44/120): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-12-03T11:24:26.159 INFO:teuthology.orchestra.run.smithi091.stdout:(45/120): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-12-03T11:24:26.176 INFO:teuthology.orchestra.run.smithi044.stdout:(103/120): python3-natsort-7.1.1-5.el9.noarch.r 495 kB/s | 58 kB 00:00 2023-12-03T11:24:26.184 INFO:teuthology.orchestra.run.smithi091.stdout:(46/120): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2023-12-03T11:24:26.209 INFO:teuthology.orchestra.run.smithi091.stdout:(47/120): openblas-0.3.21-2.el9.x86_64.rpm 685 kB/s | 34 kB 00:00 2023-12-03T11:24:26.294 INFO:teuthology.orchestra.run.smithi044.stdout:(104/120): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2023-12-03T11:24:26.319 INFO:teuthology.orchestra.run.smithi044.stdout:(105/120): python3-portend-3.1.0-2.el9.noarch.r 79 kB/s | 16 kB 00:00 2023-12-03T11:24:26.344 INFO:teuthology.orchestra.run.smithi044.stdout:(106/120): python3-pyOpenSSL-21.0.0-1.el9.noarc 538 kB/s | 90 kB 00:00 2023-12-03T11:24:26.436 INFO:teuthology.orchestra.run.smithi044.stdout:(107/120): python3-repoze-lru-0.7-16.el9.noarch 217 kB/s | 31 kB 00:00 2023-12-03T11:24:26.503 INFO:teuthology.orchestra.run.smithi044.stdout:(108/120): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2023-12-03T11:24:26.528 INFO:teuthology.orchestra.run.smithi044.stdout:(109/120): python3-rsa-4.9-2.el9.noarch.rpm 322 kB/s | 59 kB 00:00 2023-12-03T11:24:26.535 INFO:teuthology.orchestra.run.smithi091.stdout:(48/120): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2023-12-03T11:24:26.553 INFO:teuthology.orchestra.run.smithi044.stdout:(110/120): python3-tempora-5.0.0-2.el9.noarch.r 305 kB/s | 36 kB 00:00 2023-12-03T11:24:26.593 INFO:teuthology.orchestra.run.smithi091.stdout:(49/120): openblas-openmp-0.3.21-2.el9.x86_64.r 12 MB/s | 4.7 MB 00:00 2023-12-03T11:24:26.595 INFO:teuthology.orchestra.run.smithi044.stdout:(111/120): python3-typing-extensions-4.4.0-2.el 554 kB/s | 51 kB 00:00 2023-12-03T11:24:26.619 INFO:teuthology.orchestra.run.smithi091.stdout:(50/120): python3-jinja2-2.11.3-4.el9.noarch.rp 2.7 MB/s | 228 kB 00:00 2023-12-03T11:24:26.652 INFO:teuthology.orchestra.run.smithi091.stdout:(51/120): python3-jsonpointer-2.0-4.el9.noarch. 546 kB/s | 18 kB 00:00 2023-12-03T11:24:26.671 INFO:teuthology.orchestra.run.smithi044.stdout:(112/120): python3-webob-1.8.7-6.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2023-12-03T11:24:26.694 INFO:teuthology.orchestra.run.smithi091.stdout:(52/120): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2023-12-03T11:24:26.696 INFO:teuthology.orchestra.run.smithi044.stdout:(113/120): python3-websocket-client-1.2.3-2.el9 631 kB/s | 90 kB 00:00 2023-12-03T11:24:26.728 INFO:teuthology.orchestra.run.smithi091.stdout:(53/120): python3-markupsafe-1.1.1-12.el9.x86_6 945 kB/s | 32 kB 00:00 2023-12-03T11:24:26.813 INFO:teuthology.orchestra.run.smithi044.stdout:(114/120): python3-werkzeug-2.0.3-3.el9.1.noarc 1.9 MB/s | 427 kB 00:00 2023-12-03T11:24:26.836 INFO:teuthology.orchestra.run.smithi091.stdout:(54/120): python3-jsonpatch-1.21-16.el9.noarch. 101 kB/s | 24 kB 00:00 2023-12-03T11:24:26.838 INFO:teuthology.orchestra.run.smithi044.stdout:(115/120): python3-zc-lockfile-2.0-10.el9.noarc 120 kB/s | 20 kB 00:00 2023-12-03T11:24:26.863 INFO:teuthology.orchestra.run.smithi044.stdout:(116/120): re2-20211101-3.el9.x86_64.rpm 1.1 MB/s | 192 kB 00:00 2023-12-03T11:24:26.903 INFO:teuthology.orchestra.run.smithi091.stdout:(55/120): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 4.8 MB 00:00 2023-12-03T11:24:26.928 INFO:teuthology.orchestra.run.smithi091.stdout:(56/120): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 217 kB 00:00 2023-12-03T11:24:26.955 INFO:teuthology.orchestra.run.smithi044.stdout:(117/120): s3cmd-2.3.0-4.el9.noarch.rpm 1.4 MB/s | 197 kB 00:00 2023-12-03T11:24:26.970 INFO:teuthology.orchestra.run.smithi091.stdout:(57/120): python3-prettytable-0.7.2-27.el9.noar 984 kB/s | 41 kB 00:00 2023-12-03T11:24:27.112 INFO:teuthology.orchestra.run.smithi091.stdout:(58/120): python3-oauthlib-3.1.1-5.el9.noarch.r 836 kB/s | 174 kB 00:00 2023-12-03T11:24:27.114 INFO:teuthology.orchestra.run.smithi044.stdout:(118/120): thrift-0.15.0-2.el9.x86_64.rpm 5.7 MB/s | 1.6 MB 00:00 2023-12-03T11:24:27.146 INFO:teuthology.orchestra.run.smithi091.stdout:(59/120): python3-pyasn1-modules-0.4.8-6.el9.no 6.2 MB/s | 211 kB 00:00 2023-12-03T11:24:27.180 INFO:teuthology.orchestra.run.smithi091.stdout:(60/120): python3-pyasn1-0.4.8-6.el9.noarch.rpm 632 kB/s | 132 kB 00:00 2023-12-03T11:24:27.205 INFO:teuthology.orchestra.run.smithi091.stdout:(61/120): python3-pytz-2021.1-5.el9.noarch.rpm 803 kB/s | 47 kB 00:00 2023-12-03T11:24:27.390 INFO:teuthology.orchestra.run.smithi044.stdout:(119/120): librbd1-18.0.0-7537.gbcbf278c.el9.x8 6.9 MB/s | 3.0 MB 00:00 2023-12-03T11:24:27.430 INFO:teuthology.orchestra.run.smithi091.stdout:(62/120): python3-requests-oauthlib-1.3.0-12.el 171 kB/s | 43 kB 00:00 2023-12-03T11:24:27.647 INFO:teuthology.orchestra.run.smithi091.stdout:(63/120): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2023-12-03T11:24:27.664 INFO:teuthology.orchestra.run.smithi044.stdout:(120/120): librados2-18.0.0-7537.gbcbf278c.el9. 4.1 MB/s | 3.3 MB 00:00 2023-12-03T11:24:27.669 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2023-12-03T11:24:27.670 INFO:teuthology.orchestra.run.smithi044.stdout:Total 15 MB/s | 181 MB 00:12 2023-12-03T11:24:27.672 INFO:teuthology.orchestra.run.smithi091.stdout:(64/120): python3-toml-0.10.2-6.el9.noarch.rpm 161 kB/s | 39 kB 00:00 2023-12-03T11:24:27.694 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2023-12-03T11:24:27.698 INFO:teuthology.orchestra.run.smithi091.stdout:(65/120): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 300 kB 00:00 2023-12-03T11:24:27.723 INFO:teuthology.orchestra.run.smithi091.stdout:(66/120): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2023-12-03T11:24:27.748 INFO:teuthology.orchestra.run.smithi091.stdout:(67/120): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2023-12-03T11:24:27.774 INFO:teuthology.orchestra.run.smithi091.stdout:(68/120): libgfortran-11.4.1-2.3.el9.x86_64.rpm 16 MB/s | 803 kB 00:00 2023-12-03T11:24:27.799 INFO:teuthology.orchestra.run.smithi091.stdout:(69/120): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.9 MB/s | 195 kB 00:00 2023-12-03T11:24:27.804 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2023-12-03T11:24:27.804 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2023-12-03T11:24:27.824 INFO:teuthology.orchestra.run.smithi091.stdout:(70/120): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-12-03T11:24:27.875 INFO:teuthology.orchestra.run.smithi091.stdout:(71/120): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.1 MB 00:00 2023-12-03T11:24:27.900 INFO:teuthology.orchestra.run.smithi091.stdout:(72/120): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 103 kB 00:00 2023-12-03T11:24:27.925 INFO:teuthology.orchestra.run.smithi091.stdout:(73/120): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2023-12-03T11:24:27.951 INFO:teuthology.orchestra.run.smithi091.stdout:(74/120): python3-requests-2.25.1-7.el9.noarch. 2.2 MB/s | 113 kB 00:00 2023-12-03T11:24:27.976 INFO:teuthology.orchestra.run.smithi091.stdout:(75/120): python3-urllib3-1.26.5-4.el9.noarch.r 3.6 MB/s | 187 kB 00:00 2023-12-03T11:24:28.068 INFO:teuthology.orchestra.run.smithi091.stdout:(76/120): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2023-12-03T11:24:28.568 INFO:teuthology.orchestra.run.smithi091.stdout:(77/120): gperftools-libs-2.9.1-2.el9.x86_64.rp 618 kB/s | 309 kB 00:00 2023-12-03T11:24:28.844 INFO:teuthology.orchestra.run.smithi091.stdout:(78/120): python3-devel-3.9.17-2.el9.x86_64.rpm 275 kB/s | 245 kB 00:00 2023-12-03T11:24:29.019 INFO:teuthology.orchestra.run.smithi091.stdout:(79/120): libarrow-9.0.0-9.el9.x86_64.rpm 9.8 MB/s | 4.4 MB 00:00 2023-12-03T11:24:29.127 INFO:teuthology.orchestra.run.smithi091.stdout:(80/120): libarrow-doc-9.0.0-9.el9.noarch.rpm 86 kB/s | 24 kB 00:00 2023-12-03T11:24:29.153 INFO:teuthology.orchestra.run.smithi091.stdout:(81/120): liboath-2.6.7-2.el9.x86_64.rpm 364 kB/s | 49 kB 00:00 2023-12-03T11:24:29.269 INFO:teuthology.orchestra.run.smithi091.stdout:(82/120): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2023-12-03T11:24:29.320 INFO:teuthology.orchestra.run.smithi091.stdout:(83/120): libunwind-1.6.2-1.el9.x86_64.rpm 350 kB/s | 67 kB 00:00 2023-12-03T11:24:29.399 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2023-12-03T11:24:29.399 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2023-12-03T11:24:29.436 INFO:teuthology.orchestra.run.smithi091.stdout:(84/120): parquet-libs-9.0.0-9.el9.x86_64.rpm 4.9 MB/s | 837 kB 00:00 2023-12-03T11:24:29.554 INFO:teuthology.orchestra.run.smithi091.stdout:(85/120): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 372 kB/s | 43 kB 00:00 2023-12-03T11:24:29.604 INFO:teuthology.orchestra.run.smithi091.stdout:(86/120): python3-asyncssh-2.13.2-3.el9.noarch. 1.9 MB/s | 548 kB 00:00 2023-12-03T11:24:29.654 INFO:teuthology.orchestra.run.smithi091.stdout:(87/120): python3-cachetools-4.2.4-1.el9.noarch 321 kB/s | 32 kB 00:00 2023-12-03T11:24:29.705 INFO:teuthology.orchestra.run.smithi091.stdout:(88/120): python3-certifi-2021.10.8-2.el9.noarc 150 kB/s | 15 kB 00:00 2023-12-03T11:24:29.781 INFO:teuthology.orchestra.run.smithi091.stdout:(89/120): python3-cheroot-8.6.0-4.el9.noarch.rp 1.3 MB/s | 172 kB 00:00 2023-12-03T11:24:29.872 INFO:teuthology.orchestra.run.smithi091.stdout:(90/120): python3-cherrypy-18.6.1-2.el9.noarch. 2.1 MB/s | 358 kB 00:00 2023-12-03T11:24:29.980 INFO:teuthology.orchestra.run.smithi091.stdout:(91/120): python3-google-auth-2.23.4-1.el9.noar 986 kB/s | 197 kB 00:00 2023-12-03T11:24:30.006 INFO:teuthology.orchestra.run.smithi091.stdout:(92/120): python3-jaraco-8.2.1-3.el9.noarch.rpm 80 kB/s | 11 kB 00:00 2023-12-03T11:24:30.106 INFO:teuthology.orchestra.run.smithi091.stdout:(93/120): python3-jaraco-classes-3.2.1-5.el9.no 141 kB/s | 18 kB 00:00 2023-12-03T11:24:30.131 INFO:teuthology.orchestra.run.smithi091.stdout:(94/120): python3-jaraco-collections-3.0.0-8.el 184 kB/s | 23 kB 00:00 2023-12-03T11:24:30.240 INFO:teuthology.orchestra.run.smithi091.stdout:(95/120): python3-jaraco-functools-3.5.0-2.el9. 146 kB/s | 19 kB 00:00 2023-12-03T11:24:30.265 INFO:teuthology.orchestra.run.smithi091.stdout:(96/120): python3-jaraco-text-3.2.0-6.el9.noarc 147 kB/s | 20 kB 00:00 2023-12-03T11:24:30.416 INFO:teuthology.orchestra.run.smithi091.stdout:(97/120): python3-jwt+crypto-2.4.0-1.el9.noarch 52 kB/s | 9.0 kB 00:00 2023-12-03T11:24:30.449 INFO:teuthology.orchestra.run.smithi091.stdout:(98/120): python3-jwt-2.4.0-1.el9.noarch.rpm 223 kB/s | 41 kB 00:00 2023-12-03T11:24:30.541 INFO:teuthology.orchestra.run.smithi091.stdout:(99/120): python3-kubernetes-26.1.0-2.el9.noarc 8.2 MB/s | 1.0 MB 00:00 2023-12-03T11:24:30.566 INFO:teuthology.orchestra.run.smithi091.stdout:(100/120): python3-logutils-0.3.5-21.el9.noarch 396 kB/s | 46 kB 00:00 2023-12-03T11:24:30.642 INFO:teuthology.orchestra.run.smithi091.stdout:(101/120): python3-more-itertools-8.12.0-2.el9. 786 kB/s | 79 kB 00:00 2023-12-03T11:24:30.658 INFO:teuthology.orchestra.run.smithi091.stdout:(102/120): python3-natsort-7.1.1-5.el9.noarch.r 628 kB/s | 58 kB 00:00 2023-12-03T11:24:30.776 INFO:teuthology.orchestra.run.smithi091.stdout:(103/120): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2023-12-03T11:24:30.792 INFO:teuthology.orchestra.run.smithi091.stdout:(104/120): python3-portend-3.1.0-2.el9.noarch.r 123 kB/s | 16 kB 00:00 2023-12-03T11:24:30.876 INFO:teuthology.orchestra.run.smithi091.stdout:(105/120): python3-pyOpenSSL-21.0.0-1.el9.noarc 898 kB/s | 90 kB 00:00 2023-12-03T11:24:30.901 INFO:teuthology.orchestra.run.smithi091.stdout:(106/120): python3-repoze-lru-0.7-16.el9.noarch 283 kB/s | 31 kB 00:00 2023-12-03T11:24:30.993 INFO:teuthology.orchestra.run.smithi091.stdout:(107/120): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2023-12-03T11:24:31.018 INFO:teuthology.orchestra.run.smithi091.stdout:(108/120): python3-rsa-4.9-2.el9.noarch.rpm 506 kB/s | 59 kB 00:00 2023-12-03T11:24:31.094 INFO:teuthology.orchestra.run.smithi091.stdout:(109/120): python3-tempora-5.0.0-2.el9.noarch.r 358 kB/s | 36 kB 00:00 2023-12-03T11:24:31.119 INFO:teuthology.orchestra.run.smithi091.stdout:(110/120): python3-typing-extensions-4.4.0-2.el 509 kB/s | 51 kB 00:00 2023-12-03T11:24:31.228 INFO:teuthology.orchestra.run.smithi091.stdout:(111/120): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2023-12-03T11:24:31.244 INFO:teuthology.orchestra.run.smithi091.stdout:(112/120): python3-websocket-client-1.2.3-2.el9 717 kB/s | 90 kB 00:00 2023-12-03T11:24:31.387 INFO:teuthology.orchestra.run.smithi091.stdout:(113/120): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2023-12-03T11:24:31.411 INFO:teuthology.orchestra.run.smithi091.stdout:(114/120): python3-zc-lockfile-2.0-10.el9.noarc 120 kB/s | 20 kB 00:00 2023-12-03T11:24:31.520 INFO:teuthology.orchestra.run.smithi091.stdout:(115/120): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2023-12-03T11:24:31.595 INFO:teuthology.orchestra.run.smithi091.stdout:(116/120): s3cmd-2.3.0-4.el9.noarch.rpm 1.0 MB/s | 197 kB 00:00 2023-12-03T11:24:31.737 INFO:teuthology.orchestra.run.smithi091.stdout:(117/120): thrift-0.15.0-2.el9.x86_64.rpm 7.3 MB/s | 1.6 MB 00:00 2023-12-03T11:24:32.106 INFO:teuthology.orchestra.run.smithi091.stdout:(118/120): librbd1-18.0.0-7537.gbcbf278c.el9.x8 8.1 MB/s | 3.0 MB 00:00 2023-12-03T11:24:32.163 INFO:teuthology.orchestra.run.smithi091.stdout:(119/120): librados2-18.0.0-7537.gbcbf278c.el9. 5.8 MB/s | 3.3 MB 00:00 2023-12-03T11:24:32.596 INFO:teuthology.orchestra.run.smithi091.stdout:(120/120): ceph-test-18.0.0-7537.gbcbf278c.el9. 4.1 MB/s | 41 MB 00:10 2023-12-03T11:24:32.600 INFO:teuthology.orchestra.run.smithi091.stdout:-------------------------------------------------------------------------------- 2023-12-03T11:24:32.600 INFO:teuthology.orchestra.run.smithi091.stdout:Total 11 MB/s | 181 MB 00:15 2023-12-03T11:24:32.625 INFO:teuthology.orchestra.run.smithi091.stdout:Running transaction check 2023-12-03T11:24:32.725 INFO:teuthology.orchestra.run.smithi091.stdout:Transaction check succeeded. 2023-12-03T11:24:32.725 INFO:teuthology.orchestra.run.smithi091.stdout:Running transaction test 2023-12-03T11:24:34.180 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2023-12-03T11:24:34.249 INFO:teuthology.orchestra.run.smithi091.stdout:Transaction test succeeded. 2023-12-03T11:24:34.250 INFO:teuthology.orchestra.run.smithi091.stdout:Running transaction 2023-12-03T11:24:34.259 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/122 2023-12-03T11:24:34.284 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/122 2023-12-03T11:24:34.336 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/122 2023-12-03T11:24:34.370 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/122 2023-12-03T11:24:34.421 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/122 2023-12-03T11:24:34.772 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 6/122 2023-12-03T11:24:34.819 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 7/122 2023-12-03T11:24:34.925 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 7/122 2023-12-03T11:24:35.004 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 8/122 2023-12-03T11:24:35.214 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 8/122 2023-12-03T11:24:35.253 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rados-2:18.0.0-7537.gbcbf278c.el9.x86_64 9/122 2023-12-03T11:24:35.289 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 10/122 2023-12-03T11:24:35.376 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 10/122 2023-12-03T11:24:35.406 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86 11/122 2023-12-03T11:24:35.538 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86 11/122 2023-12-03T11:24:35.577 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 12/122 2023-12-03T11:24:35.649 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : liboath-2.6.7-2.el9.x86_64 13/122 2023-12-03T11:24:35.701 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 14/122 2023-12-03T11:24:35.744 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 15/122 2023-12-03T11:24:35.783 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 16/122 2023-12-03T11:24:35.824 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 17/122 2023-12-03T11:24:35.899 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 18/122 2023-12-03T11:24:35.947 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 19/122 2023-12-03T11:24:35.981 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 20/122 2023-12-03T11:24:36.008 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-5.4.4-4.el9.x86_64 21/122 2023-12-03T11:24:36.082 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/122 2023-12-03T11:24:36.114 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-common-2:18.0.0-7537.gbcbf278c.el9. 23/122 2023-12-03T11:24:36.157 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-argparse-2:18.0.0-7537.gbcbf278c.el 24/122 2023-12-03T11:24:36.185 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cephfs-2:18.0.0-7537.gbcbf278c.el9.x86_6 25/122 2023-12-03T11:24:36.259 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 26/122 2023-12-03T11:24:36.337 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : luarocks-3.9.2-1.el9.noarch 27/122 2023-12-03T11:24:36.492 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 28/122 2023-12-03T11:24:36.554 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 29/122 2023-12-03T11:24:37.145 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rsa-4.9-2.el9.noarch 30/122 2023-12-03T11:24:37.226 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 31/122 2023-12-03T11:24:37.269 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 32/122 2023-12-03T11:24:37.307 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librados-devel-2:18.0.0-7537.gbcbf278c.el9.x86_6 33/122 2023-12-03T11:24:37.346 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 34/122 2023-12-03T11:24:37.457 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : re2-1:20211101-3.el9.x86_64 35/122 2023-12-03T11:24:37.491 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 36/122 2023-12-03T11:24:37.548 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 37/122 2023-12-03T11:24:37.623 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 38/122 2023-12-03T11:24:37.658 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 39/122 2023-12-03T11:24:37.695 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 40/122 2023-12-03T11:24:37.743 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 41/122 2023-12-03T11:24:37.788 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 42/122 2023-12-03T11:24:37.838 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 43/122 2023-12-03T11:24:37.990 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 44/122 2023-12-03T11:24:38.031 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 45/122 2023-12-03T11:24:38.073 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 46/122 2023-12-03T11:24:38.172 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 47/122 2023-12-03T11:24:38.206 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 48/122 2023-12-03T11:24:38.246 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 49/122 2023-12-03T11:24:38.279 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 50/122 2023-12-03T11:24:38.382 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 51/122 2023-12-03T11:24:38.432 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 52/122 2023-12-03T11:24:38.491 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ply-3.11-14.el9.noarch 53/122 2023-12-03T11:24:38.555 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 54/122 2023-12-03T11:24:38.761 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 55/122 2023-12-03T11:24:38.820 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 56/122 2023-12-03T11:24:38.967 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 57/122 2023-12-03T11:24:39.014 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 58/122 2023-12-03T11:24:39.042 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 59/122 2023-12-03T11:24:39.085 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 60/122 2023-12-03T11:24:39.117 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 61/122 2023-12-03T11:24:39.150 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : fuse-2.9.9-15.el9.x86_64 62/122 2023-12-03T11:24:39.174 INFO:teuthology.orchestra.run.smithi091.stdout: Preparing : 1/1 2023-12-03T11:24:39.204 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 63/122 2023-12-03T11:24:39.247 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 64/122 2023-12-03T11:24:39.250 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/122 2023-12-03T11:24:39.276 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 65/122 2023-12-03T11:24:39.292 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/122 2023-12-03T11:24:39.337 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/122 2023-12-03T11:24:39.356 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 66/122 2023-12-03T11:24:39.369 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/122 2023-12-03T11:24:39.395 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 67/122 2023-12-03T11:24:39.420 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/122 2023-12-03T11:24:39.428 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/122 2023-12-03T11:24:39.470 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/122 2023-12-03T11:24:39.504 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/122 2023-12-03T11:24:39.599 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/122 2023-12-03T11:24:39.632 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 72/122 2023-12-03T11:24:39.740 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 73/122 2023-12-03T11:24:39.749 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 6/122 2023-12-03T11:24:39.801 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 74/122 2023-12-03T11:24:39.802 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 7/122 2023-12-03T11:24:39.922 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 7/122 2023-12-03T11:24:39.945 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 8/122 2023-12-03T11:24:40.019 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 8/122 2023-12-03T11:24:40.061 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-rados-2:18.0.0-7537.gbcbf278c.el9.x86_64 9/122 2023-12-03T11:24:40.088 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 10/122 2023-12-03T11:24:40.182 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 10/122 2023-12-03T11:24:40.206 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86 11/122 2023-12-03T11:24:40.341 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86 11/122 2023-12-03T11:24:40.368 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 12/122 2023-12-03T11:24:40.438 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : liboath-2.6.7-2.el9.x86_64 13/122 2023-12-03T11:24:40.499 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 14/122 2023-12-03T11:24:40.536 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 15/122 2023-12-03T11:24:40.574 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 16/122 2023-12-03T11:24:40.581 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 75/122 2023-12-03T11:24:40.614 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 17/122 2023-12-03T11:24:40.630 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 76/122 2023-12-03T11:24:40.663 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 77/122 2023-12-03T11:24:40.677 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 18/122 2023-12-03T11:24:40.697 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 78/122 2023-12-03T11:24:40.722 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 19/122 2023-12-03T11:24:40.755 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 20/122 2023-12-03T11:24:40.783 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : lua-5.4.4-4.el9.x86_64 21/122 2023-12-03T11:24:40.852 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/122 2023-12-03T11:24:40.882 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-0.3.21-2.el9.x86_64 79/122 2023-12-03T11:24:40.887 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-ceph-common-2:18.0.0-7537.gbcbf278c.el9. 23/122 2023-12-03T11:24:40.910 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 80/122 2023-12-03T11:24:40.931 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-ceph-argparse-2:18.0.0-7537.gbcbf278c.el 24/122 2023-12-03T11:24:40.960 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-cephfs-2:18.0.0-7537.gbcbf278c.el9.x86_6 25/122 2023-12-03T11:24:40.992 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 81/122 2023-12-03T11:24:41.031 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 26/122 2023-12-03T11:24:41.106 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : luarocks-3.9.2-1.el9.noarch 27/122 2023-12-03T11:24:41.248 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 28/122 2023-12-03T11:24:41.310 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 29/122 2023-12-03T11:24:41.691 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 82/122 2023-12-03T11:24:41.813 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 83/122 2023-12-03T11:24:41.835 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-rsa-4.9-2.el9.noarch 30/122 2023-12-03T11:24:41.913 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 31/122 2023-12-03T11:24:41.951 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 32/122 2023-12-03T11:24:41.989 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : librados-devel-2:18.0.0-7537.gbcbf278c.el9.x86_6 33/122 2023-12-03T11:24:42.029 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 34/122 2023-12-03T11:24:42.135 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : re2-1:20211101-3.el9.x86_64 35/122 2023-12-03T11:24:42.174 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 36/122 2023-12-03T11:24:42.228 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 37/122 2023-12-03T11:24:42.302 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 38/122 2023-12-03T11:24:42.332 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 39/122 2023-12-03T11:24:42.369 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 40/122 2023-12-03T11:24:42.416 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 41/122 2023-12-03T11:24:42.461 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 42/122 2023-12-03T11:24:42.503 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 43/122 2023-12-03T11:24:42.637 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 44/122 2023-12-03T11:24:42.688 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 45/122 2023-12-03T11:24:42.729 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 46/122 2023-12-03T11:24:42.824 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 47/122 2023-12-03T11:24:42.872 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 48/122 2023-12-03T11:24:42.913 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 49/122 2023-12-03T11:24:42.945 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 50/122 2023-12-03T11:24:43.041 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 51/122 2023-12-03T11:24:43.089 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 52/122 2023-12-03T11:24:43.138 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-ply-3.11-14.el9.noarch 53/122 2023-12-03T11:24:43.158 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/122 2023-12-03T11:24:43.194 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 54/122 2023-12-03T11:24:43.244 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 85/122 2023-12-03T11:24:43.275 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 86/122 2023-12-03T11:24:43.308 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : jq-1.6-16.el9.x86_64 87/122 2023-12-03T11:24:43.393 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 55/122 2023-12-03T11:24:43.443 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 56/122 2023-12-03T11:24:43.582 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 57/122 2023-12-03T11:24:43.622 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 88/122 2023-12-03T11:24:43.629 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 58/122 2023-12-03T11:24:43.646 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 89/122 2023-12-03T11:24:43.658 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 59/122 2023-12-03T11:24:43.692 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 60/122 2023-12-03T11:24:43.725 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 61/122 2023-12-03T11:24:43.729 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 89/122 2023-12-03T11:24:43.757 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : fuse-2.9.9-15.el9.x86_64 62/122 2023-12-03T11:24:43.767 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 90/122 2023-12-03T11:24:43.802 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 63/122 2023-12-03T11:24:43.812 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 91/122 2023-12-03T11:24:43.837 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 64/122 2023-12-03T11:24:43.867 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 65/122 2023-12-03T11:24:43.944 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 66/122 2023-12-03T11:24:43.977 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 67/122 2023-12-03T11:24:44.010 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/122 2023-12-03T11:24:44.052 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/122 2023-12-03T11:24:44.086 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/122 2023-12-03T11:24:44.184 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/122 2023-12-03T11:24:44.214 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 72/122 2023-12-03T11:24:44.268 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 92/122 2023-12-03T11:24:44.298 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 93/122 2023-12-03T11:24:44.316 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 73/122 2023-12-03T11:24:44.370 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 93/122 2023-12-03T11:24:44.373 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 74/122 2023-12-03T11:24:44.400 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 94/122 2023-12-03T11:24:45.109 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 75/122 2023-12-03T11:24:45.162 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 76/122 2023-12-03T11:24:45.195 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 77/122 2023-12-03T11:24:45.228 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 78/122 2023-12-03T11:24:45.414 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : openblas-0.3.21-2.el9.x86_64 79/122 2023-12-03T11:24:45.442 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 80/122 2023-12-03T11:24:45.521 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 81/122 2023-12-03T11:24:46.167 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 82/122 2023-12-03T11:24:46.273 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 83/122 2023-12-03T11:24:46.606 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 95/122 2023-12-03T11:24:46.639 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 95/122 2023-12-03T11:24:47.218 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 95/122 2023-12-03T11:24:47.259 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 96/122 2023-12-03T11:24:47.351 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 96/122 2023-12-03T11:24:47.351 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-03T11:24:47.351 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-03T11:24:47.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:24:47.385 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 97/122 2023-12-03T11:24:47.537 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/122 2023-12-03T11:24:47.618 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 85/122 2023-12-03T11:24:47.649 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 86/122 2023-12-03T11:24:47.682 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : jq-1.6-16.el9.x86_64 87/122 2023-12-03T11:24:47.969 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 88/122 2023-12-03T11:24:47.995 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 89/122 2023-12-03T11:24:48.069 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 89/122 2023-12-03T11:24:48.099 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-rbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 90/122 2023-12-03T11:24:48.136 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 91/122 2023-12-03T11:24:48.562 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 92/122 2023-12-03T11:24:48.597 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 93/122 2023-12-03T11:24:48.674 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 93/122 2023-12-03T11:24:48.699 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-rgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 94/122 2023-12-03T11:24:50.838 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 95/122 2023-12-03T11:24:50.880 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 95/122 2023-12-03T11:24:51.436 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 95/122 2023-12-03T11:24:51.584 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 96/122 2023-12-03T11:24:51.673 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 96/122 2023-12-03T11:24:51.673 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-03T11:24:51.673 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-03T11:24:51.673 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:24:51.710 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 97/122 2023-12-03T11:24:59.152 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 97/122 2023-12-03T11:24:59.152 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /sys 2023-12-03T11:24:59.153 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /proc 2023-12-03T11:24:59.153 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /mnt 2023-12-03T11:24:59.153 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /var/tmp 2023-12-03T11:24:59.153 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /home 2023-12-03T11:24:59.153 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /root 2023-12-03T11:24:59.153 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /tmp 2023-12-03T11:24:59.153 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:24:59.329 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 98/122 2023-12-03T11:24:59.346 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 98/122 2023-12-03T11:24:59.346 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:24:59.346 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-03T11:24:59.346 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:00.990 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 99/122 2023-12-03T11:25:01.017 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 99/122 2023-12-03T11:25:01.017 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:25:01.017 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-03T11:25:01.017 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-03T11:25:01.018 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-03T11:25:01.018 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:01.233 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 100/122 2023-12-03T11:25:01.256 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 100/122 2023-12-03T11:25:01.257 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:25:01.257 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-03T11:25:01.257 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-03T11:25:01.257 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-03T11:25:01.257 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:01.742 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 101/122 2023-12-03T11:25:01.766 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 101/122 2023-12-03T11:25:01.766 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:25:01.766 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-03T11:25:01.766 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-03T11:25:01.766 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-03T11:25:01.766 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:02.225 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 102/122 2023-12-03T11:25:02.257 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 102/122 2023-12-03T11:25:02.287 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7537.gbcbf278c.e 103/122 2023-12-03T11:25:02.350 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7537.gbcbf278c. 104/122 2023-12-03T11:25:02.389 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noa 105/122 2023-12-03T11:25:02.626 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noa 105/122 2023-12-03T11:25:02.656 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.n 106/122 2023-12-03T11:25:02.802 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 97/122 2023-12-03T11:25:02.803 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /sys 2023-12-03T11:25:02.803 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /proc 2023-12-03T11:25:02.803 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /mnt 2023-12-03T11:25:02.803 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /var/tmp 2023-12-03T11:25:02.803 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /home 2023-12-03T11:25:02.803 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /root 2023-12-03T11:25:02.803 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /tmp 2023-12-03T11:25:02.803 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:02.960 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 98/122 2023-12-03T11:25:02.976 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 98/122 2023-12-03T11:25:02.976 INFO:teuthology.orchestra.run.smithi091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:25:02.976 INFO:teuthology.orchestra.run.smithi091.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-03T11:25:02.976 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:03.679 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.n 106/122 2023-12-03T11:25:03.706 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcb 107/122 2023-12-03T11:25:03.813 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcb 107/122 2023-12-03T11:25:03.972 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7537.gbcbf278c.el 108/122 2023-12-03T11:25:04.017 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 109/122 2023-12-03T11:25:04.041 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 109/122 2023-12-03T11:25:04.041 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:25:04.041 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-03T11:25:04.041 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-03T11:25:04.041 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-03T11:25:04.041 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:04.101 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 110/122 2023-12-03T11:25:04.112 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 110/122 2023-12-03T11:25:04.547 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 99/122 2023-12-03T11:25:04.572 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 99/122 2023-12-03T11:25:04.572 INFO:teuthology.orchestra.run.smithi091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:25:04.572 INFO:teuthology.orchestra.run.smithi091.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-03T11:25:04.573 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-03T11:25:04.573 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-03T11:25:04.573 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:04.780 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 100/122 2023-12-03T11:25:04.803 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 100/122 2023-12-03T11:25:04.803 INFO:teuthology.orchestra.run.smithi091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:25:04.803 INFO:teuthology.orchestra.run.smithi091.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-03T11:25:04.803 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-03T11:25:04.803 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-03T11:25:04.803 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:04.938 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-2:18.0.0-7537.gbcbf278c.el9.x86_64 111/122 2023-12-03T11:25:04.977 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 112/122 2023-12-03T11:25:05.001 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 112/122 2023-12-03T11:25:05.001 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:25:05.001 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-03T11:25:05.001 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-03T11:25:05.001 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-03T11:25:05.001 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:05.044 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7537.gbcbf2 113/122 2023-12-03T11:25:05.067 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7537.gbcbf2 113/122 2023-12-03T11:25:05.068 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:25:05.068 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-03T11:25:05.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:05.248 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 101/122 2023-12-03T11:25:05.271 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 101/122 2023-12-03T11:25:05.271 INFO:teuthology.orchestra.run.smithi091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:25:05.271 INFO:teuthology.orchestra.run.smithi091.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-03T11:25:05.271 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-03T11:25:05.271 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-03T11:25:05.271 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:05.387 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 114/122 2023-12-03T11:25:05.410 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 114/122 2023-12-03T11:25:05.410 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:25:05.411 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-03T11:25:05.411 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-03T11:25:05.411 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-03T11:25:05.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:05.711 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 102/122 2023-12-03T11:25:05.738 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 102/122 2023-12-03T11:25:05.768 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7537.gbcbf278c.e 103/122 2023-12-03T11:25:05.828 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7537.gbcbf278c. 104/122 2023-12-03T11:25:05.854 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noa 105/122 2023-12-03T11:25:06.075 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noa 105/122 2023-12-03T11:25:06.112 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.n 106/122 2023-12-03T11:25:07.070 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.n 106/122 2023-12-03T11:25:07.104 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcb 107/122 2023-12-03T11:25:07.202 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcb 107/122 2023-12-03T11:25:07.372 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7537.gbcbf278c.el 108/122 2023-12-03T11:25:07.398 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 109/122 2023-12-03T11:25:07.421 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 109/122 2023-12-03T11:25:07.421 INFO:teuthology.orchestra.run.smithi091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:25:07.421 INFO:teuthology.orchestra.run.smithi091.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-03T11:25:07.421 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-03T11:25:07.421 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-03T11:25:07.421 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:07.465 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 110/122 2023-12-03T11:25:07.476 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 110/122 2023-12-03T11:25:08.241 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-2:18.0.0-7537.gbcbf278c.el9.x86_64 111/122 2023-12-03T11:25:08.283 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 112/122 2023-12-03T11:25:08.305 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 112/122 2023-12-03T11:25:08.305 INFO:teuthology.orchestra.run.smithi091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:25:08.305 INFO:teuthology.orchestra.run.smithi091.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-03T11:25:08.306 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-03T11:25:08.306 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-03T11:25:08.306 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:08.342 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7537.gbcbf2 113/122 2023-12-03T11:25:08.364 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7537.gbcbf2 113/122 2023-12-03T11:25:08.364 INFO:teuthology.orchestra.run.smithi091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:25:08.364 INFO:teuthology.orchestra.run.smithi091.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-03T11:25:08.364 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:08.651 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 114/122 2023-12-03T11:25:08.673 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 114/122 2023-12-03T11:25:08.674 INFO:teuthology.orchestra.run.smithi091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:25:08.674 INFO:teuthology.orchestra.run.smithi091.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-03T11:25:08.674 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-03T11:25:08.674 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-03T11:25:08.674 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:09.499 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-test-2:18.0.0-7537.gbcbf278c.el9.x86_64 115/122 2023-12-03T11:25:09.552 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 116/122 2023-12-03T11:25:09.660 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-nbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 117/122 2023-12-03T11:25:09.688 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 118/122 2023-12-03T11:25:09.749 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs-devel-2:18.0.0-7537.gbcbf278c.el9.x86_ 119/122 2023-12-03T11:25:09.779 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : s3cmd-2.3.0-4.el9.noarch 120/122 2023-12-03T11:25:09.779 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 121/122 2023-12-03T11:25:09.863 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 121/122 2023-12-03T11:25:09.863 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 122/122 2023-12-03T11:25:12.470 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-test-2:18.0.0-7537.gbcbf278c.el9.x86_64 115/122 2023-12-03T11:25:12.512 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : rbd-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 116/122 2023-12-03T11:25:12.610 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : rbd-nbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 117/122 2023-12-03T11:25:12.644 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 118/122 2023-12-03T11:25:12.694 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libcephfs-devel-2:18.0.0-7537.gbcbf278c.el9.x86_ 119/122 2023-12-03T11:25:12.726 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : s3cmd-2.3.0-4.el9.noarch 120/122 2023-12-03T11:25:12.726 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 121/122 2023-12-03T11:25:12.793 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 121/122 2023-12-03T11:25:12.793 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 122/122 2023-12-03T11:25:14.396 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 122/122 2023-12-03T11:25:14.396 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-2:18.0.0-7537.gbcbf278c.el9.x86_64 1/122 2023-12-03T11:25:14.396 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 2/122 2023-12-03T11:25:14.396 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 3/122 2023-12-03T11:25:14.396 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 4/122 2023-12-03T11:25:14.396 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7537.gbcbf2 5/122 2023-12-03T11:25:14.396 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 6/122 2023-12-03T11:25:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 7/122 2023-12-03T11:25:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 8/122 2023-12-03T11:25:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 9/122 2023-12-03T11:25:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 10/122 2023-12-03T11:25:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 11/122 2023-12-03T11:25:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-test-2:18.0.0-7537.gbcbf278c.el9.x86_64 12/122 2023-12-03T11:25:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs-devel-2:18.0.0-7537.gbcbf278c.el9.x86_ 13/122 2023-12-03T11:25:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 14/122 2023-12-03T11:25:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 15/122 2023-12-03T11:25:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados-devel-2:18.0.0-7537.gbcbf278c.el9.x86_6 16/122 2023-12-03T11:25:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86 17/122 2023-12-03T11:25:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 18/122 2023-12-03T11:25:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7537.gbcbf278c.el 19/122 2023-12-03T11:25:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-common-2:18.0.0-7537.gbcbf278c.el9. 20/122 2023-12-03T11:25:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cephfs-2:18.0.0-7537.gbcbf278c.el9.x86_6 21/122 2023-12-03T11:25:14.398 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rados-2:18.0.0-7537.gbcbf278c.el9.x86_64 22/122 2023-12-03T11:25:14.398 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 23/122 2023-12-03T11:25:14.398 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 24/122 2023-12-03T11:25:14.398 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 25/122 2023-12-03T11:25:14.398 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 26/122 2023-12-03T11:25:14.398 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-nbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 27/122 2023-12-03T11:25:14.398 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7537.gbcbf278c. 28/122 2023-12-03T11:25:14.398 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noa 29/122 2023-12-03T11:25:14.406 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.n 30/122 2023-12-03T11:25:14.406 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcb 31/122 2023-12-03T11:25:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7537.gbcbf278c.el 32/122 2023-12-03T11:25:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 33/122 2023-12-03T11:25:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7537.gbcbf278c.e 34/122 2023-12-03T11:25:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 35/122 2023-12-03T11:25:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 36/122 2023-12-03T11:25:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 37/122 2023-12-03T11:25:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 38/122 2023-12-03T11:25:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 39/122 2023-12-03T11:25:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 40/122 2023-12-03T11:25:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : jq-1.6-16.el9.x86_64 41/122 2023-12-03T11:25:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 42/122 2023-12-03T11:25:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 43/122 2023-12-03T11:25:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 44/122 2023-12-03T11:25:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 45/122 2023-12-03T11:25:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-5.4.4-4.el9.x86_64 46/122 2023-12-03T11:25:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 47/122 2023-12-03T11:25:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 48/122 2023-12-03T11:25:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 49/122 2023-12-03T11:25:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 50/122 2023-12-03T11:25:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 51/122 2023-12-03T11:25:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 52/122 2023-12-03T11:25:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 53/122 2023-12-03T11:25:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 54/122 2023-12-03T11:25:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 55/122 2023-12-03T11:25:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 56/122 2023-12-03T11:25:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 57/122 2023-12-03T11:25:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 58/122 2023-12-03T11:25:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 59/122 2023-12-03T11:25:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 60/122 2023-12-03T11:25:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 61/122 2023-12-03T11:25:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 62/122 2023-12-03T11:25:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 63/122 2023-12-03T11:25:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 64/122 2023-12-03T11:25:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 65/122 2023-12-03T11:25:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 66/122 2023-12-03T11:25:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 67/122 2023-12-03T11:25:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 68/122 2023-12-03T11:25:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 69/122 2023-12-03T11:25:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 70/122 2023-12-03T11:25:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 71/122 2023-12-03T11:25:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 72/122 2023-12-03T11:25:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ply-3.11-14.el9.noarch 73/122 2023-12-03T11:25:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 74/122 2023-12-03T11:25:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 75/122 2023-12-03T11:25:14.410 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 76/122 2023-12-03T11:25:14.410 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 77/122 2023-12-03T11:25:14.410 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 78/122 2023-12-03T11:25:14.410 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 79/122 2023-12-03T11:25:14.410 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 80/122 2023-12-03T11:25:14.410 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 81/122 2023-12-03T11:25:14.410 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 82/122 2023-12-03T11:25:14.410 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 83/122 2023-12-03T11:25:14.410 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 84/122 2023-12-03T11:25:14.410 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 85/122 2023-12-03T11:25:14.410 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 86/122 2023-12-03T11:25:14.410 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 87/122 2023-12-03T11:25:14.410 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 88/122 2023-12-03T11:25:14.410 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 89/122 2023-12-03T11:25:14.410 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 90/122 2023-12-03T11:25:14.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 91/122 2023-12-03T11:25:14.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 92/122 2023-12-03T11:25:14.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 93/122 2023-12-03T11:25:14.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 94/122 2023-12-03T11:25:14.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 95/122 2023-12-03T11:25:14.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 96/122 2023-12-03T11:25:14.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 97/122 2023-12-03T11:25:14.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 98/122 2023-12-03T11:25:14.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 99/122 2023-12-03T11:25:14.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 100/122 2023-12-03T11:25:14.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 101/122 2023-12-03T11:25:14.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 102/122 2023-12-03T11:25:14.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 103/122 2023-12-03T11:25:14.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 104/122 2023-12-03T11:25:14.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 105/122 2023-12-03T11:25:14.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 106/122 2023-12-03T11:25:14.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 107/122 2023-12-03T11:25:14.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 108/122 2023-12-03T11:25:14.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 109/122 2023-12-03T11:25:14.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 110/122 2023-12-03T11:25:14.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 111/122 2023-12-03T11:25:14.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 112/122 2023-12-03T11:25:14.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 113/122 2023-12-03T11:25:14.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 114/122 2023-12-03T11:25:14.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 115/122 2023-12-03T11:25:14.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : re2-1:20211101-3.el9.x86_64 116/122 2023-12-03T11:25:14.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : s3cmd-2.3.0-4.el9.noarch 117/122 2023-12-03T11:25:14.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 118/122 2023-12-03T11:25:14.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 119/122 2023-12-03T11:25:14.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 120/122 2023-12-03T11:25:14.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 121/122 2023-12-03T11:25:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 122/122 2023-12-03T11:25:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:16.388 INFO:teuthology.orchestra.run.smithi044.stdout:Upgraded: 2023-12-03T11:25:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.388 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2023-12-03T11:25:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-03T11:25:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:25:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:25:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:25:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:25:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:25:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:25:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:25:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:25:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:25:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-03T11:25:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-03T11:25:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-03T11:25:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-03T11:25:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-03T11:25:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: jq-1.6-16.el9.x86_64 2023-12-03T11:25:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-9.0.0-9.el9.x86_64 2023-12-03T11:25:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-12-03T11:25:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-03T11:25:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-03T11:25:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-03T11:25:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-03T11:25:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-03T11:25:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-03T11:25:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-03T11:25:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-03T11:25:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: lua-5.4.4-4.el9.x86_64 2023-12-03T11:25:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel-5.4.4-4.el9.x86_64 2023-12-03T11:25:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-03T11:25:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-03T11:25:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-03T11:25:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-03T11:25:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-12-03T11:25:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-03T11:25:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-03T11:25:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-03T11:25:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-03T11:25:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-03T11:25:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-03T11:25:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-03T11:25:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-03T11:25:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-03T11:25:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-03T11:25:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-03T11:25:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-03T11:25:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-03T11:25:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-03T11:25:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-03T11:25:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-03T11:25:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-03T11:25:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-03T11:25:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-03T11:25:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-03T11:25:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-03T11:25:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-03T11:25:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-03T11:25:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-03T11:25:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-03T11:25:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-03T11:25:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-03T11:25:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-03T11:25:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-03T11:25:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-03T11:25:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-03T11:25:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply-3.11-14.el9.noarch 2023-12-03T11:25:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-03T11:25:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-03T11:25:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-03T11:25:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-03T11:25:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-03T11:25:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-03T11:25:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-03T11:25:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-03T11:25:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-03T11:25:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-03T11:25:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-03T11:25:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-03T11:25:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-03T11:25:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-03T11:25:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-03T11:25:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-03T11:25:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-03T11:25:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-03T11:25:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-03T11:25:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-03T11:25:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-03T11:25:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:16.396 INFO:teuthology.orchestra.run.smithi044.stdout: re2-1:20211101-3.el9.x86_64 2023-12-03T11:25:16.396 INFO:teuthology.orchestra.run.smithi044.stdout: s3cmd-2.3.0-4.el9.noarch 2023-12-03T11:25:16.396 INFO:teuthology.orchestra.run.smithi044.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-03T11:25:16.396 INFO:teuthology.orchestra.run.smithi044.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-03T11:25:16.396 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-03T11:25:16.396 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:16.396 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2023-12-03T11:25:16.697 DEBUG:teuthology.parallel:result is None 2023-12-03T11:25:17.022 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 122/122 2023-12-03T11:25:17.022 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-2:18.0.0-7537.gbcbf278c.el9.x86_64 1/122 2023-12-03T11:25:17.022 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 2/122 2023-12-03T11:25:17.022 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 3/122 2023-12-03T11:25:17.022 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 4/122 2023-12-03T11:25:17.022 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7537.gbcbf2 5/122 2023-12-03T11:25:17.022 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 6/122 2023-12-03T11:25:17.022 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 7/122 2023-12-03T11:25:17.022 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 8/122 2023-12-03T11:25:17.023 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 9/122 2023-12-03T11:25:17.023 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 10/122 2023-12-03T11:25:17.023 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 11/122 2023-12-03T11:25:17.023 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-test-2:18.0.0-7537.gbcbf278c.el9.x86_64 12/122 2023-12-03T11:25:17.023 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libcephfs-devel-2:18.0.0-7537.gbcbf278c.el9.x86_ 13/122 2023-12-03T11:25:17.023 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 14/122 2023-12-03T11:25:17.023 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 15/122 2023-12-03T11:25:17.023 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librados-devel-2:18.0.0-7537.gbcbf278c.el9.x86_6 16/122 2023-12-03T11:25:17.023 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86 17/122 2023-12-03T11:25:17.023 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 18/122 2023-12-03T11:25:17.023 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7537.gbcbf278c.el 19/122 2023-12-03T11:25:17.023 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-ceph-common-2:18.0.0-7537.gbcbf278c.el9. 20/122 2023-12-03T11:25:17.023 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-cephfs-2:18.0.0-7537.gbcbf278c.el9.x86_6 21/122 2023-12-03T11:25:17.023 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-rados-2:18.0.0-7537.gbcbf278c.el9.x86_64 22/122 2023-12-03T11:25:17.023 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-rbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 23/122 2023-12-03T11:25:17.024 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-rgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 24/122 2023-12-03T11:25:17.024 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : rbd-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 25/122 2023-12-03T11:25:17.024 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 26/122 2023-12-03T11:25:17.024 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : rbd-nbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 27/122 2023-12-03T11:25:17.024 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7537.gbcbf278c. 28/122 2023-12-03T11:25:17.024 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noa 29/122 2023-12-03T11:25:17.024 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.n 30/122 2023-12-03T11:25:17.037 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcb 31/122 2023-12-03T11:25:17.037 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7537.gbcbf278c.el 32/122 2023-12-03T11:25:17.037 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 33/122 2023-12-03T11:25:17.037 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7537.gbcbf278c.e 34/122 2023-12-03T11:25:17.037 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 35/122 2023-12-03T11:25:17.038 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 36/122 2023-12-03T11:25:17.038 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 37/122 2023-12-03T11:25:17.038 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 38/122 2023-12-03T11:25:17.038 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 39/122 2023-12-03T11:25:17.038 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 40/122 2023-12-03T11:25:17.038 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : jq-1.6-16.el9.x86_64 41/122 2023-12-03T11:25:17.038 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 42/122 2023-12-03T11:25:17.038 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 43/122 2023-12-03T11:25:17.038 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 44/122 2023-12-03T11:25:17.038 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 45/122 2023-12-03T11:25:17.038 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : lua-5.4.4-4.el9.x86_64 46/122 2023-12-03T11:25:17.039 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 47/122 2023-12-03T11:25:17.039 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 48/122 2023-12-03T11:25:17.039 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 49/122 2023-12-03T11:25:17.039 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 50/122 2023-12-03T11:25:17.039 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 51/122 2023-12-03T11:25:17.039 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 52/122 2023-12-03T11:25:17.039 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 53/122 2023-12-03T11:25:17.039 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 54/122 2023-12-03T11:25:17.039 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 55/122 2023-12-03T11:25:17.039 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 56/122 2023-12-03T11:25:17.039 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 57/122 2023-12-03T11:25:17.039 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 58/122 2023-12-03T11:25:17.039 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 59/122 2023-12-03T11:25:17.039 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 60/122 2023-12-03T11:25:17.039 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 61/122 2023-12-03T11:25:17.039 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 62/122 2023-12-03T11:25:17.040 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 63/122 2023-12-03T11:25:17.040 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 64/122 2023-12-03T11:25:17.040 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 65/122 2023-12-03T11:25:17.040 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 66/122 2023-12-03T11:25:17.040 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 67/122 2023-12-03T11:25:17.040 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 68/122 2023-12-03T11:25:17.040 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 69/122 2023-12-03T11:25:17.040 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 70/122 2023-12-03T11:25:17.040 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 71/122 2023-12-03T11:25:17.040 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 72/122 2023-12-03T11:25:17.040 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-ply-3.11-14.el9.noarch 73/122 2023-12-03T11:25:17.040 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 74/122 2023-12-03T11:25:17.040 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 75/122 2023-12-03T11:25:17.040 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 76/122 2023-12-03T11:25:17.040 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 77/122 2023-12-03T11:25:17.040 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 78/122 2023-12-03T11:25:17.040 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 79/122 2023-12-03T11:25:17.041 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 80/122 2023-12-03T11:25:17.041 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 81/122 2023-12-03T11:25:17.041 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 82/122 2023-12-03T11:25:17.041 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 83/122 2023-12-03T11:25:17.041 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 84/122 2023-12-03T11:25:17.041 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 85/122 2023-12-03T11:25:17.041 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 86/122 2023-12-03T11:25:17.041 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 87/122 2023-12-03T11:25:17.041 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 88/122 2023-12-03T11:25:17.041 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 89/122 2023-12-03T11:25:17.041 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 90/122 2023-12-03T11:25:17.041 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 91/122 2023-12-03T11:25:17.041 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 92/122 2023-12-03T11:25:17.041 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 93/122 2023-12-03T11:25:17.041 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 94/122 2023-12-03T11:25:17.042 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 95/122 2023-12-03T11:25:17.042 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 96/122 2023-12-03T11:25:17.042 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 97/122 2023-12-03T11:25:17.042 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 98/122 2023-12-03T11:25:17.042 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 99/122 2023-12-03T11:25:17.042 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 100/122 2023-12-03T11:25:17.042 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 101/122 2023-12-03T11:25:17.042 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 102/122 2023-12-03T11:25:17.042 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 103/122 2023-12-03T11:25:17.042 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 104/122 2023-12-03T11:25:17.042 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 105/122 2023-12-03T11:25:17.042 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 106/122 2023-12-03T11:25:17.042 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 107/122 2023-12-03T11:25:17.042 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 108/122 2023-12-03T11:25:17.043 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 109/122 2023-12-03T11:25:17.043 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 110/122 2023-12-03T11:25:17.043 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 111/122 2023-12-03T11:25:17.043 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 112/122 2023-12-03T11:25:17.043 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 113/122 2023-12-03T11:25:17.043 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 114/122 2023-12-03T11:25:17.043 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 115/122 2023-12-03T11:25:17.043 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : re2-1:20211101-3.el9.x86_64 116/122 2023-12-03T11:25:17.043 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : s3cmd-2.3.0-4.el9.noarch 117/122 2023-12-03T11:25:17.043 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 118/122 2023-12-03T11:25:17.043 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 119/122 2023-12-03T11:25:17.043 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 120/122 2023-12-03T11:25:17.043 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 121/122 2023-12-03T11:25:19.136 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 122/122 2023-12-03T11:25:19.136 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:19.137 INFO:teuthology.orchestra.run.smithi091.stdout:Upgraded: 2023-12-03T11:25:19.137 INFO:teuthology.orchestra.run.smithi091.stdout: librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.137 INFO:teuthology.orchestra.run.smithi091.stdout: librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.137 INFO:teuthology.orchestra.run.smithi091.stdout:Installed: 2023-12-03T11:25:19.137 INFO:teuthology.orchestra.run.smithi091.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-03T11:25:19.137 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.137 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.137 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.137 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.137 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-grafana-dashboards-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:25:19.137 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-immutable-object-cache-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.137 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.137 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.137 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:25:19.137 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:25:19.138 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:25:19.138 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-modules-core-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:25:19.138 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:25:19.138 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.138 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.138 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-prometheus-alerts-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:25:19.138 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.138 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.138 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-test-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.138 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:25:19.138 INFO:teuthology.orchestra.run.smithi091.stdout: cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:25:19.138 INFO:teuthology.orchestra.run.smithi091.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-03T11:25:19.138 INFO:teuthology.orchestra.run.smithi091.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-03T11:25:19.138 INFO:teuthology.orchestra.run.smithi091.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-03T11:25:19.139 INFO:teuthology.orchestra.run.smithi091.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-03T11:25:19.139 INFO:teuthology.orchestra.run.smithi091.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-03T11:25:19.139 INFO:teuthology.orchestra.run.smithi091.stdout: jq-1.6-16.el9.x86_64 2023-12-03T11:25:19.139 INFO:teuthology.orchestra.run.smithi091.stdout: libarrow-9.0.0-9.el9.x86_64 2023-12-03T11:25:19.139 INFO:teuthology.orchestra.run.smithi091.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-12-03T11:25:19.139 INFO:teuthology.orchestra.run.smithi091.stdout: libcephfs-devel-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.139 INFO:teuthology.orchestra.run.smithi091.stdout: libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.139 INFO:teuthology.orchestra.run.smithi091.stdout: libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.139 INFO:teuthology.orchestra.run.smithi091.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-03T11:25:19.139 INFO:teuthology.orchestra.run.smithi091.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-03T11:25:19.139 INFO:teuthology.orchestra.run.smithi091.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-03T11:25:19.139 INFO:teuthology.orchestra.run.smithi091.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-03T11:25:19.139 INFO:teuthology.orchestra.run.smithi091.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-03T11:25:19.139 INFO:teuthology.orchestra.run.smithi091.stdout: librados-devel-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.140 INFO:teuthology.orchestra.run.smithi091.stdout: libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.140 INFO:teuthology.orchestra.run.smithi091.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-03T11:25:19.140 INFO:teuthology.orchestra.run.smithi091.stdout: librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.140 INFO:teuthology.orchestra.run.smithi091.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-03T11:25:19.140 INFO:teuthology.orchestra.run.smithi091.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-03T11:25:19.140 INFO:teuthology.orchestra.run.smithi091.stdout: lua-5.4.4-4.el9.x86_64 2023-12-03T11:25:19.140 INFO:teuthology.orchestra.run.smithi091.stdout: lua-devel-5.4.4-4.el9.x86_64 2023-12-03T11:25:19.140 INFO:teuthology.orchestra.run.smithi091.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-03T11:25:19.140 INFO:teuthology.orchestra.run.smithi091.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-03T11:25:19.140 INFO:teuthology.orchestra.run.smithi091.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-03T11:25:19.140 INFO:teuthology.orchestra.run.smithi091.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-03T11:25:19.140 INFO:teuthology.orchestra.run.smithi091.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-12-03T11:25:19.140 INFO:teuthology.orchestra.run.smithi091.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-03T11:25:19.141 INFO:teuthology.orchestra.run.smithi091.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-03T11:25:19.141 INFO:teuthology.orchestra.run.smithi091.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-03T11:25:19.141 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-03T11:25:19.141 INFO:teuthology.orchestra.run.smithi091.stdout: python3-ceph-argparse-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.141 INFO:teuthology.orchestra.run.smithi091.stdout: python3-ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.141 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cephfs-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.141 INFO:teuthology.orchestra.run.smithi091.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-03T11:25:19.141 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-03T11:25:19.141 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-03T11:25:19.141 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-03T11:25:19.141 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-03T11:25:19.141 INFO:teuthology.orchestra.run.smithi091.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-03T11:25:19.142 INFO:teuthology.orchestra.run.smithi091.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-03T11:25:19.142 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-03T11:25:19.142 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-03T11:25:19.142 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-03T11:25:19.142 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-03T11:25:19.142 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-03T11:25:19.142 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-03T11:25:19.142 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-03T11:25:19.142 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-03T11:25:19.142 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-03T11:25:19.142 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-03T11:25:19.142 INFO:teuthology.orchestra.run.smithi091.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-03T11:25:19.142 INFO:teuthology.orchestra.run.smithi091.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-03T11:25:19.142 INFO:teuthology.orchestra.run.smithi091.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-03T11:25:19.143 INFO:teuthology.orchestra.run.smithi091.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-03T11:25:19.143 INFO:teuthology.orchestra.run.smithi091.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-03T11:25:19.143 INFO:teuthology.orchestra.run.smithi091.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-03T11:25:19.143 INFO:teuthology.orchestra.run.smithi091.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-03T11:25:19.143 INFO:teuthology.orchestra.run.smithi091.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-03T11:25:19.143 INFO:teuthology.orchestra.run.smithi091.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-03T11:25:19.143 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-03T11:25:19.143 INFO:teuthology.orchestra.run.smithi091.stdout: python3-ply-3.11-14.el9.noarch 2023-12-03T11:25:19.143 INFO:teuthology.orchestra.run.smithi091.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-03T11:25:19.143 INFO:teuthology.orchestra.run.smithi091.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-03T11:25:19.143 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-03T11:25:19.143 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-03T11:25:19.143 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-03T11:25:19.143 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-03T11:25:19.144 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-03T11:25:19.144 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rados-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.144 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.144 INFO:teuthology.orchestra.run.smithi091.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-03T11:25:19.144 INFO:teuthology.orchestra.run.smithi091.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-03T11:25:19.144 INFO:teuthology.orchestra.run.smithi091.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-03T11:25:19.144 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.144 INFO:teuthology.orchestra.run.smithi091.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-03T11:25:19.144 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-03T11:25:19.144 INFO:teuthology.orchestra.run.smithi091.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-03T11:25:19.144 INFO:teuthology.orchestra.run.smithi091.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-03T11:25:19.144 INFO:teuthology.orchestra.run.smithi091.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-03T11:25:19.145 INFO:teuthology.orchestra.run.smithi091.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-03T11:25:19.145 INFO:teuthology.orchestra.run.smithi091.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-03T11:25:19.145 INFO:teuthology.orchestra.run.smithi091.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-03T11:25:19.145 INFO:teuthology.orchestra.run.smithi091.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-03T11:25:19.145 INFO:teuthology.orchestra.run.smithi091.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-03T11:25:19.145 INFO:teuthology.orchestra.run.smithi091.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-03T11:25:19.145 INFO:teuthology.orchestra.run.smithi091.stdout: rbd-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.145 INFO:teuthology.orchestra.run.smithi091.stdout: rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.145 INFO:teuthology.orchestra.run.smithi091.stdout: rbd-nbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:25:19.145 INFO:teuthology.orchestra.run.smithi091.stdout: re2-1:20211101-3.el9.x86_64 2023-12-03T11:25:19.145 INFO:teuthology.orchestra.run.smithi091.stdout: s3cmd-2.3.0-4.el9.noarch 2023-12-03T11:25:19.145 INFO:teuthology.orchestra.run.smithi091.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-03T11:25:19.145 INFO:teuthology.orchestra.run.smithi091.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-03T11:25:19.146 INFO:teuthology.orchestra.run.smithi091.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-03T11:25:19.146 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:19.146 INFO:teuthology.orchestra.run.smithi091.stdout:Complete! 2023-12-03T11:25:19.460 DEBUG:teuthology.parallel:result is None 2023-12-03T11:25:19.461 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:25:19.604 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-03T11:25:19.630 INFO:teuthology.orchestra.run.smithi044.stdout:18.0.0-7537.gbcbf278c.el9 2023-12-03T11:25:19.631 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7537.gbcbf278c.el9 2023-12-03T11:25:19.631 INFO:teuthology.task.install:The correct ceph version 18.0.0-7537.gbcbf278c is installed. 2023-12-03T11:25:19.631 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:25:19.766 DEBUG:teuthology.orchestra.run.smithi091:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-03T11:25:19.787 INFO:teuthology.orchestra.run.smithi091.stdout:18.0.0-7537.gbcbf278c.el9 2023-12-03T11:25:19.787 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7537.gbcbf278c.el9 2023-12-03T11:25:19.787 INFO:teuthology.task.install:The correct ceph version 18.0.0-7537.gbcbf278c is installed. 2023-12-03T11:25:19.787 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-03T11:25:19.788 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:25:19.788 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-03T11:25:19.827 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-03T11:25:19.827 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-03T11:25:19.857 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-03T11:25:19.857 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:25:19.857 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/daemon-helper 2023-12-03T11:25:19.901 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-03T11:25:19.975 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-03T11:25:19.975 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/usr/bin/daemon-helper 2023-12-03T11:25:20.001 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-03T11:25:20.069 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-03T11:25:20.069 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:25:20.069 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-03T11:25:20.102 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-03T11:25:20.175 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-03T11:25:20.175 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-03T11:25:20.202 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-03T11:25:20.270 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-03T11:25:20.271 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:25:20.271 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/stdin-killer 2023-12-03T11:25:20.303 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-03T11:25:20.376 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-03T11:25:20.376 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/usr/bin/stdin-killer 2023-12-03T11:25:20.403 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-03T11:25:20.469 INFO:teuthology.run_tasks:Running task ceph... 2023-12-03T11:25:20.529 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-03T11:25:20.529 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 777 /var/log/ceph 2023-12-03T11:25:20.531 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 777 /var/log/ceph 2023-12-03T11:25:20.561 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-03T11:25:20.561 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-03T11:25:20.604 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-03T11:25:20.634 INFO:tasks.ceph:Creating extra log directories... 2023-12-03T11:25:20.634 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-03T11:25:20.677 DEBUG:teuthology.orchestra.run.smithi091:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-03T11:25:20.717 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-03T11:25:20.717 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-03T11:25:20.717 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476136', 'branch': 'wip-alimasa-multi-pubsub-etag', 'description': 'rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': None, 'first_in_suite': False, 'job_id': '7476136', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-alimasa-multi-pubsub-etag'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319'}}, 'rgw': {'compression type': 'random', 'ec-data-pool': True, 'frontend': 'beast', 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-alimasa-multi-pubsub-etag', 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319'}}, 'owner': 'scheduled_alimasa@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-alimasa-multi-pubsub-etag', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319', 'targets': {'smithi044.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEjVgoNZsA4+nJDNNbVQcRvbU+qh2yA/AydLGaw/f+bA6qmXDxMYkXpHapKUQlf8qB3+RmoWZQz6FiiPq/GHxt4=', 'smithi091.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAMA8rmc7tNlD/CrJT2zG94+3pIdpxiAZ4MY138usUaHhQ2vca7Wiwaxn6PV8HGBKDqqyIAtTkGok9mHEuso4Kc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd'], 'rpm': ['s3cmd']}, 'flavor': 'default', 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'f2de108beb0a6dde7f3e6c96039071828a1f6269', 'timestamp': '2023-12-03_11:04:43', 'tube': 'smithi', 'user': 'alimasa', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-03T11:25:20.718 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-03T11:25:20.749 DEBUG:teuthology.orchestra.run.smithi091:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-03T11:25:20.764 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/run/ceph 2023-12-03T11:25:20.805 DEBUG:teuthology.orchestra.run.smithi091:> sudo install -d -m0777 -- /var/run/ceph 2023-12-03T11:25:20.833 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:25:20.834 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/scratch_devs of=/dev/stdout 2023-12-03T11:25:20.890 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-03T11:25:20.890 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_1 2023-12-03T11:25:20.945 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-03T11:25:20.945 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:25:20.945 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 665 Links: 1 2023-12-03T11:25:20.945 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:25:20.946 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:25:20.946 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2023-12-03 11:25:10.330535148 +0000 2023-12-03T11:25:20.946 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2023-12-03 11:23:23.098621317 +0000 2023-12-03T11:25:20.946 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2023-12-03 11:23:23.098621317 +0000 2023-12-03T11:25:20.946 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2023-12-03 11:23:23.098621317 +0000 2023-12-03T11:25:20.946 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-03T11:25:21.015 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2023-12-03T11:25:21.015 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2023-12-03T11:25:21.015 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000195622 s, 2.6 MB/s 2023-12-03T11:25:21.016 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-03T11:25:21.073 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_2 2023-12-03T11:25:21.128 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-03T11:25:21.128 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:25:21.128 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-12-03T11:25:21.128 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:25:21.128 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:25:21.128 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2023-12-03 11:25:10.330535148 +0000 2023-12-03T11:25:21.128 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2023-12-03 11:23:23.603613274 +0000 2023-12-03T11:25:21.128 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2023-12-03 11:23:23.603613274 +0000 2023-12-03T11:25:21.128 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2023-12-03 11:23:23.603613274 +0000 2023-12-03T11:25:21.128 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-03T11:25:21.196 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2023-12-03T11:25:21.196 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2023-12-03T11:25:21.197 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000204272 s, 2.5 MB/s 2023-12-03T11:25:21.198 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-03T11:25:21.253 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_3 2023-12-03T11:25:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-03T11:25:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:25:21.310 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 703 Links: 1 2023-12-03T11:25:21.310 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:25:21.310 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:25:21.310 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2023-12-03 11:25:10.331535133 +0000 2023-12-03T11:25:21.310 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2023-12-03 11:23:24.088605550 +0000 2023-12-03T11:25:21.311 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2023-12-03 11:23:24.088605550 +0000 2023-12-03T11:25:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2023-12-03 11:23:24.088605550 +0000 2023-12-03T11:25:21.311 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-03T11:25:21.379 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2023-12-03T11:25:21.379 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2023-12-03T11:25:21.379 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000187353 s, 2.7 MB/s 2023-12-03T11:25:21.380 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-03T11:25:21.435 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_4 2023-12-03T11:25:21.491 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-03T11:25:21.491 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:25:21.491 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 722 Links: 1 2023-12-03T11:25:21.491 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:25:21.491 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:25:21.491 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2023-12-03 11:25:10.331535133 +0000 2023-12-03T11:25:21.491 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2023-12-03 11:23:24.589597571 +0000 2023-12-03T11:25:21.491 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2023-12-03 11:23:24.589597571 +0000 2023-12-03T11:25:21.492 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2023-12-03 11:23:24.589597571 +0000 2023-12-03T11:25:21.492 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-03T11:25:21.560 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2023-12-03T11:25:21.560 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2023-12-03T11:25:21.560 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000188887 s, 2.7 MB/s 2023-12-03T11:25:21.562 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-03T11:25:21.618 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-03T11:25:21.618 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-03T11:25:21.618 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/scratch_devs of=/dev/stdout 2023-12-03T11:25:21.635 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-03T11:25:21.636 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_1 2023-12-03T11:25:21.693 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-03T11:25:21.693 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:25:21.693 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-12-03T11:25:21.693 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:25:21.693 INFO:teuthology.orchestra.run.smithi091.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:25:21.693 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-12-03 11:25:13.199514303 +0000 2023-12-03T11:25:21.693 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-12-03 11:23:12.758213907 +0000 2023-12-03T11:25:21.693 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-12-03 11:23:12.758213907 +0000 2023-12-03T11:25:21.693 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: 2023-12-03 11:23:12.758213907 +0000 2023-12-03T11:25:21.693 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-03T11:25:21.761 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-12-03T11:25:21.761 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-12-03T11:25:21.761 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000189894 s, 2.7 MB/s 2023-12-03T11:25:21.762 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-03T11:25:21.820 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_2 2023-12-03T11:25:21.876 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-03T11:25:21.877 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:25:21.877 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 5h/5d Inode: 684 Links: 1 2023-12-03T11:25:21.877 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:25:21.877 INFO:teuthology.orchestra.run.smithi091.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:25:21.877 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-12-03 11:25:13.200514278 +0000 2023-12-03T11:25:21.877 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-12-03 11:23:13.260201582 +0000 2023-12-03T11:25:21.877 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-12-03 11:23:13.260201582 +0000 2023-12-03T11:25:21.877 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: 2023-12-03 11:23:13.260201582 +0000 2023-12-03T11:25:21.877 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-03T11:25:21.943 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-12-03T11:25:21.944 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-12-03T11:25:21.944 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000185063 s, 2.8 MB/s 2023-12-03T11:25:21.945 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-03T11:25:22.002 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_3 2023-12-03T11:25:22.057 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-03T11:25:22.058 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:25:22.058 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 5h/5d Inode: 701 Links: 1 2023-12-03T11:25:22.058 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:25:22.058 INFO:teuthology.orchestra.run.smithi091.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:25:22.058 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-12-03 11:25:13.200514278 +0000 2023-12-03T11:25:22.058 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-12-03 11:23:13.751189528 +0000 2023-12-03T11:25:22.058 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-12-03 11:23:13.751189528 +0000 2023-12-03T11:25:22.058 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: 2023-12-03 11:23:13.751189528 +0000 2023-12-03T11:25:22.058 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-03T11:25:22.123 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-12-03T11:25:22.123 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-12-03T11:25:22.123 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000196052 s, 2.6 MB/s 2023-12-03T11:25:22.125 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-03T11:25:22.180 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_4 2023-12-03T11:25:22.235 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-03T11:25:22.235 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:25:22.236 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 5h/5d Inode: 721 Links: 1 2023-12-03T11:25:22.236 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:25:22.236 INFO:teuthology.orchestra.run.smithi091.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:25:22.236 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-12-03 11:25:13.200514278 +0000 2023-12-03T11:25:22.236 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-12-03 11:23:14.228177818 +0000 2023-12-03T11:25:22.236 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-12-03 11:23:14.228177818 +0000 2023-12-03T11:25:22.236 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: 2023-12-03 11:23:14.228177818 +0000 2023-12-03T11:25:22.236 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-03T11:25:22.300 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-12-03T11:25:22.300 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-12-03T11:25:22.300 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000202692 s, 2.5 MB/s 2023-12-03T11:25:22.301 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-03T11:25:22.358 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-03T11:25:22.358 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi044.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi091.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-03T11:25:22.358 INFO:tasks.ceph:Generating config... 2023-12-03T11:25:22.359 INFO:tasks.ceph:[client] debug rgw = 20 2023-12-03T11:25:22.359 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2023-12-03T11:25:22.359 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2023-12-03T11:25:22.360 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2023-12-03T11:25:22.360 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2023-12-03T11:25:22.360 INFO:tasks.ceph:[client] rgw torrent flag = True 2023-12-03T11:25:22.360 INFO:tasks.ceph:[client] rgw user counters cache = True 2023-12-03T11:25:22.360 INFO:tasks.ceph:[client] setgroup = ceph 2023-12-03T11:25:22.360 INFO:tasks.ceph:[client] setuser = ceph 2023-12-03T11:25:22.360 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-12-03T11:25:22.360 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2023-12-03T11:25:22.360 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2023-12-03T11:25:22.360 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2023-12-03T11:25:22.360 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1 2023-12-03T11:25:22.360 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-03T11:25:22.361 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-03T11:25:22.361 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-03T11:25:22.361 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-03T11:25:22.361 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-03T11:25:22.361 INFO:tasks.ceph:[mon] lockdep = True 2023-12-03T11:25:22.361 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-03T11:25:22.361 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-03T11:25:22.361 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-12-03T11:25:22.361 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-03T11:25:22.361 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-03T11:25:22.361 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-12-03T11:25:22.361 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-12-03T11:25:22.361 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-03T11:25:22.361 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-03T11:25:22.362 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-12-03T11:25:22.362 INFO:tasks.ceph:[osd] lockdep = True 2023-12-03T11:25:22.362 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-03T11:25:22.362 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-03T11:25:22.362 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-03T11:25:22.362 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-03T11:25:22.362 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-03T11:25:22.362 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-12-03T11:25:22.362 INFO:tasks.ceph:Setting up mon.a... 2023-12-03T11:25:22.362 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-03T11:25:22.423 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.keyring 2023-12-03T11:25:22.426 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-03T11:25:22.475 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-03T11:25:22.507 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.44'), ('mon.c', '[v2:172.21.15.44:3301,v1:172.21.15.44:6790]'), ('mon.b', '172.21.15.91')] 2023-12-03T11:25:22.507 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.44,[v2:172.21.15.44:3301,v1:172.21.15.44:6790],172.21.15.91', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2023-12-03T11:25:22.508 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:25:22.508 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-03T11:25:22.562 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.44 --addv c '[v2:172.21.15.44:3301,v1:172.21.15.44:6790]' --add b 172.21.15.91 --print /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:25:22.648 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:25:22.648 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:25:22.648 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:25:22.649 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: generated fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:25:22.649 INFO:teuthology.orchestra.run.smithi044.stdout:setting min_mon_release = pacific 2023-12-03T11:25:22.649 INFO:teuthology.orchestra.run.smithi044.stdout:epoch 0 2023-12-03T11:25:22.649 INFO:teuthology.orchestra.run.smithi044.stdout:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:25:22.649 INFO:teuthology.orchestra.run.smithi044.stdout:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:25:22.649 INFO:teuthology.orchestra.run.smithi044.stdout:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:25:22.649 INFO:teuthology.orchestra.run.smithi044.stdout:min_mon_release 16 (pacific) 2023-12-03T11:25:22.649 INFO:teuthology.orchestra.run.smithi044.stdout:election_strategy: 1 2023-12-03T11:25:22.649 INFO:teuthology.orchestra.run.smithi044.stdout:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:25:22.649 INFO:teuthology.orchestra.run.smithi044.stdout:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:25:22.649 INFO:teuthology.orchestra.run.smithi044.stdout:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:25:22.649 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-03T11:25:22.650 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-03T11:25:22.665 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID bb5d2624-dbc6-4dd8-acfe-13ca5d09896c... 2023-12-03T11:25:22.666 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-03T11:25:22.707 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-03T11:25:22.757 INFO:teuthology.orchestra.run.smithi091.stdout:[global] 2023-12-03T11:25:22.758 INFO:teuthology.orchestra.run.smithi091.stdout: chdir = "" 2023-12-03T11:25:22.758 INFO:teuthology.orchestra.run.smithi091.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-03T11:25:22.758 INFO:teuthology.orchestra.run.smithi091.stdout: auth supported = cephx 2023-12-03T11:25:22.758 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.758 INFO:teuthology.orchestra.run.smithi091.stdout: filestore xattr use omap = true 2023-12-03T11:25:22.758 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.758 INFO:teuthology.orchestra.run.smithi091.stdout: mon clock drift allowed = 1.000 2023-12-03T11:25:22.758 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.758 INFO:teuthology.orchestra.run.smithi091.stdout: osd crush chooseleaf type = 0 2023-12-03T11:25:22.758 INFO:teuthology.orchestra.run.smithi091.stdout: auth debug = true 2023-12-03T11:25:22.758 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.759 INFO:teuthology.orchestra.run.smithi091.stdout: ms die on old message = true 2023-12-03T11:25:22.759 INFO:teuthology.orchestra.run.smithi091.stdout: ms die on bug = true 2023-12-03T11:25:22.759 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.759 INFO:teuthology.orchestra.run.smithi091.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-03T11:25:22.759 INFO:teuthology.orchestra.run.smithi091.stdout: mon pg warn max object skew = 0 2023-12-03T11:25:22.759 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.759 INFO:teuthology.orchestra.run.smithi091.stdout: # disable pg_autoscaler by default for new pools 2023-12-03T11:25:22.759 INFO:teuthology.orchestra.run.smithi091.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-03T11:25:22.759 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.759 INFO:teuthology.orchestra.run.smithi091.stdout: osd pool default size = 2 2023-12-03T11:25:22.759 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.759 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd allow primary affinity = true 2023-12-03T11:25:22.759 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd allow pg remap = true 2023-12-03T11:25:22.759 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on legacy crush tunables = false 2023-12-03T11:25:22.760 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on crush straw calc version zero = false 2023-12-03T11:25:22.760 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on no sortbitwise = false 2023-12-03T11:25:22.760 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on osd down out interval zero = false 2023-12-03T11:25:22.760 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on too few osds = false 2023-12-03T11:25:22.760 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-03T11:25:22.760 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-03T11:25:22.760 INFO:teuthology.orchestra.run.smithi091.stdout: mon_allow_pool_size_one = true 2023-12-03T11:25:22.760 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.760 INFO:teuthology.orchestra.run.smithi091.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-03T11:25:22.760 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.760 INFO:teuthology.orchestra.run.smithi091.stdout: osd default data pool replay window = 5 2023-12-03T11:25:22.760 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.760 INFO:teuthology.orchestra.run.smithi091.stdout: mon allow pool delete = true 2023-12-03T11:25:22.760 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.760 INFO:teuthology.orchestra.run.smithi091.stdout: mon cluster log file level = debug 2023-12-03T11:25:22.761 INFO:teuthology.orchestra.run.smithi091.stdout: debug asserts on shutdown = true 2023-12-03T11:25:22.761 INFO:teuthology.orchestra.run.smithi091.stdout: mon health detail to clog = false 2023-12-03T11:25:22.761 INFO:teuthology.orchestra.run.smithi091.stdout: mon host = "172.21.15.44,[v2:172.21.15.44:3301,v1:172.21.15.44:6790],172.21.15.91" 2023-12-03T11:25:22.761 INFO:teuthology.orchestra.run.smithi091.stdout: mon client directed command retry = 5 2023-12-03T11:25:22.761 INFO:teuthology.orchestra.run.smithi091.stdout: ms inject socket failures = 5000 2023-12-03T11:25:22.761 INFO:teuthology.orchestra.run.smithi091.stdout: osd_max_pg_log_entries = 10 2023-12-03T11:25:22.761 INFO:teuthology.orchestra.run.smithi091.stdout: osd_min_pg_log_entries = 10 2023-12-03T11:25:22.761 INFO:teuthology.orchestra.run.smithi091.stdout: rgw override bucket index max shards = 1 2023-12-03T11:25:22.761 INFO:teuthology.orchestra.run.smithi091.stdout: fsid = bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:25:22.761 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.761 INFO:teuthology.orchestra.run.smithi091.stdout:[osd] 2023-12-03T11:25:22.761 INFO:teuthology.orchestra.run.smithi091.stdout: osd journal size = 100 2023-12-03T11:25:22.761 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.762 INFO:teuthology.orchestra.run.smithi091.stdout: osd scrub load threshold = 5.0 2023-12-03T11:25:22.762 INFO:teuthology.orchestra.run.smithi091.stdout: osd scrub max interval = 600 2023-12-03T11:25:22.762 INFO:teuthology.orchestra.run.smithi091.stdout: osd mclock profile = high_recovery_ops 2023-12-03T11:25:22.762 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.762 INFO:teuthology.orchestra.run.smithi091.stdout: osd recover clone overlap = true 2023-12-03T11:25:22.762 INFO:teuthology.orchestra.run.smithi091.stdout: osd recovery max chunk = 1048576 2023-12-03T11:25:22.762 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.762 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug shutdown = true 2023-12-03T11:25:22.762 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug op order = true 2023-12-03T11:25:22.762 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug verify stray on activate = true 2023-12-03T11:25:22.762 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug trim objects = true 2023-12-03T11:25:22.762 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.762 INFO:teuthology.orchestra.run.smithi091.stdout: osd open classes on start = true 2023-12-03T11:25:22.763 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug pg log writeout = true 2023-12-03T11:25:22.763 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.763 INFO:teuthology.orchestra.run.smithi091.stdout: osd deep scrub update digest min age = 30 2023-12-03T11:25:22.763 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.763 INFO:teuthology.orchestra.run.smithi091.stdout: osd map max advance = 10 2023-12-03T11:25:22.763 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.763 INFO:teuthology.orchestra.run.smithi091.stdout: journal zero on create = true 2023-12-03T11:25:22.763 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.763 INFO:teuthology.orchestra.run.smithi091.stdout: filestore ondisk finisher threads = 3 2023-12-03T11:25:22.763 INFO:teuthology.orchestra.run.smithi091.stdout: filestore apply finisher threads = 3 2023-12-03T11:25:22.763 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.763 INFO:teuthology.orchestra.run.smithi091.stdout: bdev debug aio = true 2023-12-03T11:25:22.763 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug misdirected ops = true 2023-12-03T11:25:22.763 INFO:teuthology.orchestra.run.smithi091.stdout: bdev async discard = True 2023-12-03T11:25:22.763 INFO:teuthology.orchestra.run.smithi091.stdout: bdev enable discard = True 2023-12-03T11:25:22.764 INFO:teuthology.orchestra.run.smithi091.stdout: bluestore allocator = bitmap 2023-12-03T11:25:22.764 INFO:teuthology.orchestra.run.smithi091.stdout: bluestore block size = 96636764160 2023-12-03T11:25:22.764 INFO:teuthology.orchestra.run.smithi091.stdout: bluestore fsck on mount = True 2023-12-03T11:25:22.764 INFO:teuthology.orchestra.run.smithi091.stdout: debug bluefs = 1/20 2023-12-03T11:25:22.764 INFO:teuthology.orchestra.run.smithi091.stdout: debug bluestore = 1/20 2023-12-03T11:25:22.764 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-12-03T11:25:22.764 INFO:teuthology.orchestra.run.smithi091.stdout: debug osd = 20 2023-12-03T11:25:22.764 INFO:teuthology.orchestra.run.smithi091.stdout: debug rocksdb = 4/10 2023-12-03T11:25:22.764 INFO:teuthology.orchestra.run.smithi091.stdout: lockdep = True 2023-12-03T11:25:22.764 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd backfillfull_ratio = 0.85 2023-12-03T11:25:22.764 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd full ratio = 0.9 2023-12-03T11:25:22.764 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd nearfull ratio = 0.8 2023-12-03T11:25:22.764 INFO:teuthology.orchestra.run.smithi091.stdout: osd failsafe full ratio = 0.95 2023-12-03T11:25:22.764 INFO:teuthology.orchestra.run.smithi091.stdout: osd objectstore = bluestore 2023-12-03T11:25:22.764 INFO:teuthology.orchestra.run.smithi091.stdout: osd shutdown pgref assert = True 2023-12-03T11:25:22.764 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.765 INFO:teuthology.orchestra.run.smithi091.stdout:[mgr] 2023-12-03T11:25:22.765 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-12-03T11:25:22.765 INFO:teuthology.orchestra.run.smithi091.stdout: debug mgr = 20 2023-12-03T11:25:22.765 INFO:teuthology.orchestra.run.smithi091.stdout: debug mon = 20 2023-12-03T11:25:22.765 INFO:teuthology.orchestra.run.smithi091.stdout: debug auth = 20 2023-12-03T11:25:22.765 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min pgs per osd = 4 2023-12-03T11:25:22.765 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min bytes per osd = 10 2023-12-03T11:25:22.765 INFO:teuthology.orchestra.run.smithi091.stdout: mgr/telemetry/nag = false 2023-12-03T11:25:22.765 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.765 INFO:teuthology.orchestra.run.smithi091.stdout:[mon] 2023-12-03T11:25:22.765 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-12-03T11:25:22.765 INFO:teuthology.orchestra.run.smithi091.stdout: debug mon = 20 2023-12-03T11:25:22.765 INFO:teuthology.orchestra.run.smithi091.stdout: debug paxos = 20 2023-12-03T11:25:22.765 INFO:teuthology.orchestra.run.smithi091.stdout: debug auth = 20 2023-12-03T11:25:22.765 INFO:teuthology.orchestra.run.smithi091.stdout: mon data avail warn = 5 2023-12-03T11:25:22.765 INFO:teuthology.orchestra.run.smithi091.stdout: mon mgr mkfs grace = 240 2023-12-03T11:25:22.766 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min pgs per osd = 4 2023-12-03T11:25:22.766 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd reporter subtree level = osd 2023-12-03T11:25:22.766 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd prime pg temp = true 2023-12-03T11:25:22.766 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min bytes per osd = 10 2023-12-03T11:25:22.766 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.766 INFO:teuthology.orchestra.run.smithi091.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-03T11:25:22.766 INFO:teuthology.orchestra.run.smithi091.stdout: auth mon ticket ttl = 660 # 11m 2023-12-03T11:25:22.766 INFO:teuthology.orchestra.run.smithi091.stdout: auth service ticket ttl = 240 # 4m 2023-12-03T11:25:22.766 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.766 INFO:teuthology.orchestra.run.smithi091.stdout: # don't complain about insecure global_id in the test suite 2023-12-03T11:25:22.766 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-03T11:25:22.766 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-03T11:25:22.766 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.766 INFO:teuthology.orchestra.run.smithi091.stdout: # 1m isn't quite enough 2023-12-03T11:25:22.767 INFO:teuthology.orchestra.run.smithi091.stdout: mon_down_mkfs_grace = 2m 2023-12-03T11:25:22.767 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.767 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_filestore_osds = false 2023-12-03T11:25:22.767 INFO:teuthology.orchestra.run.smithi091.stdout: lockdep = True 2023-12-03T11:25:22.767 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-03T11:25:22.767 INFO:teuthology.orchestra.run.smithi091.stdout:[client] 2023-12-03T11:25:22.767 INFO:teuthology.orchestra.run.smithi091.stdout: rgw cache enabled = true 2023-12-03T11:25:22.767 INFO:teuthology.orchestra.run.smithi091.stdout: rgw enable ops log = true 2023-12-03T11:25:22.767 INFO:teuthology.orchestra.run.smithi091.stdout: rgw enable usage log = true 2023-12-03T11:25:22.767 INFO:teuthology.orchestra.run.smithi091.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-03T11:25:22.767 INFO:teuthology.orchestra.run.smithi091.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-03T11:25:22.767 INFO:teuthology.orchestra.run.smithi091.stdout: debug rgw = 20 2023-12-03T11:25:22.767 INFO:teuthology.orchestra.run.smithi091.stdout: rgw bucket counters cache = True 2023-12-03T11:25:22.767 INFO:teuthology.orchestra.run.smithi091.stdout: rgw crypt require ssl = False 2023-12-03T11:25:22.767 INFO:teuthology.orchestra.run.smithi091.stdout: rgw crypt s3 kms backend = testing 2023-12-03T11:25:22.767 INFO:teuthology.orchestra.run.smithi091.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2023-12-03T11:25:22.768 INFO:teuthology.orchestra.run.smithi091.stdout: rgw torrent flag = True 2023-12-03T11:25:22.768 INFO:teuthology.orchestra.run.smithi091.stdout: rgw user counters cache = True 2023-12-03T11:25:22.768 INFO:teuthology.orchestra.run.smithi091.stdout: setgroup = ceph 2023-12-03T11:25:22.768 INFO:teuthology.orchestra.run.smithi091.stdout: setuser = ceph 2023-12-03T11:25:22.768 INFO:teuthology.orchestra.run.smithi091.stdout:[mon.a] 2023-12-03T11:25:22.768 INFO:teuthology.orchestra.run.smithi091.stdout:[mon.c] 2023-12-03T11:25:22.768 INFO:teuthology.orchestra.run.smithi091.stdout:[mon.b] 2023-12-03T11:25:22.768 INFO:teuthology.orchestra.run.smithi044.stdout:[global] 2023-12-03T11:25:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: chdir = "" 2023-12-03T11:25:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-03T11:25:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: auth supported = cephx 2023-12-03T11:25:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: filestore xattr use omap = true 2023-12-03T11:25:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: mon clock drift allowed = 1.000 2023-12-03T11:25:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: osd crush chooseleaf type = 0 2023-12-03T11:25:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: auth debug = true 2023-12-03T11:25:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on old message = true 2023-12-03T11:25:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on bug = true 2023-12-03T11:25:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-03T11:25:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: mon pg warn max object skew = 0 2023-12-03T11:25:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: # disable pg_autoscaler by default for new pools 2023-12-03T11:25:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-03T11:25:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default size = 2 2023-12-03T11:25:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow primary affinity = true 2023-12-03T11:25:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow pg remap = true 2023-12-03T11:25:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on legacy crush tunables = false 2023-12-03T11:25:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on crush straw calc version zero = false 2023-12-03T11:25:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on no sortbitwise = false 2023-12-03T11:25:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on osd down out interval zero = false 2023-12-03T11:25:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on too few osds = false 2023-12-03T11:25:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-03T11:25:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-03T11:25:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: mon_allow_pool_size_one = true 2023-12-03T11:25:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-03T11:25:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: osd default data pool replay window = 5 2023-12-03T11:25:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: mon allow pool delete = true 2023-12-03T11:25:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: mon cluster log file level = debug 2023-12-03T11:25:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: debug asserts on shutdown = true 2023-12-03T11:25:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: mon health detail to clog = false 2023-12-03T11:25:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: mon host = "172.21.15.44,[v2:172.21.15.44:3301,v1:172.21.15.44:6790],172.21.15.91" 2023-12-03T11:25:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: mon client directed command retry = 5 2023-12-03T11:25:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: ms inject socket failures = 5000 2023-12-03T11:25:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: osd_max_pg_log_entries = 10 2023-12-03T11:25:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: osd_min_pg_log_entries = 10 2023-12-03T11:25:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: rgw override bucket index max shards = 1 2023-12-03T11:25:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: fsid = bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:25:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.772 INFO:teuthology.orchestra.run.smithi044.stdout:[osd] 2023-12-03T11:25:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: osd journal size = 100 2023-12-03T11:25:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub load threshold = 5.0 2023-12-03T11:25:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub max interval = 600 2023-12-03T11:25:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: osd mclock profile = high_recovery_ops 2023-12-03T11:25:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: osd recover clone overlap = true 2023-12-03T11:25:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: osd recovery max chunk = 1048576 2023-12-03T11:25:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug shutdown = true 2023-12-03T11:25:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug op order = true 2023-12-03T11:25:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug verify stray on activate = true 2023-12-03T11:25:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug trim objects = true 2023-12-03T11:25:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: osd open classes on start = true 2023-12-03T11:25:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug pg log writeout = true 2023-12-03T11:25:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: osd deep scrub update digest min age = 30 2023-12-03T11:25:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: osd map max advance = 10 2023-12-03T11:25:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: journal zero on create = true 2023-12-03T11:25:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: filestore ondisk finisher threads = 3 2023-12-03T11:25:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: filestore apply finisher threads = 3 2023-12-03T11:25:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: bdev debug aio = true 2023-12-03T11:25:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug misdirected ops = true 2023-12-03T11:25:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: bdev async discard = True 2023-12-03T11:25:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: bdev enable discard = True 2023-12-03T11:25:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore allocator = bitmap 2023-12-03T11:25:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore block size = 96636764160 2023-12-03T11:25:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore fsck on mount = True 2023-12-03T11:25:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluefs = 1/20 2023-12-03T11:25:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluestore = 1/20 2023-12-03T11:25:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2023-12-03T11:25:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: debug osd = 20 2023-12-03T11:25:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: debug rocksdb = 4/10 2023-12-03T11:25:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: lockdep = True 2023-12-03T11:25:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd backfillfull_ratio = 0.85 2023-12-03T11:25:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd full ratio = 0.9 2023-12-03T11:25:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd nearfull ratio = 0.8 2023-12-03T11:25:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: osd failsafe full ratio = 0.95 2023-12-03T11:25:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: osd objectstore = bluestore 2023-12-03T11:25:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: osd shutdown pgref assert = True 2023-12-03T11:25:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.775 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr] 2023-12-03T11:25:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2023-12-03T11:25:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: debug mgr = 20 2023-12-03T11:25:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2023-12-03T11:25:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2023-12-03T11:25:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2023-12-03T11:25:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2023-12-03T11:25:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: mgr/telemetry/nag = false 2023-12-03T11:25:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.776 INFO:teuthology.orchestra.run.smithi044.stdout:[mon] 2023-12-03T11:25:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2023-12-03T11:25:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2023-12-03T11:25:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: debug paxos = 20 2023-12-03T11:25:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2023-12-03T11:25:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: mon data avail warn = 5 2023-12-03T11:25:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: mon mgr mkfs grace = 240 2023-12-03T11:25:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2023-12-03T11:25:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd reporter subtree level = osd 2023-12-03T11:25:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd prime pg temp = true 2023-12-03T11:25:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2023-12-03T11:25:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-03T11:25:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: auth mon ticket ttl = 660 # 11m 2023-12-03T11:25:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: auth service ticket ttl = 240 # 4m 2023-12-03T11:25:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: # don't complain about insecure global_id in the test suite 2023-12-03T11:25:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-03T11:25:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-03T11:25:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: # 1m isn't quite enough 2023-12-03T11:25:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: mon_down_mkfs_grace = 2m 2023-12-03T11:25:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_filestore_osds = false 2023-12-03T11:25:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: lockdep = True 2023-12-03T11:25:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:25:22.778 INFO:teuthology.orchestra.run.smithi044.stdout:[client] 2023-12-03T11:25:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: rgw cache enabled = true 2023-12-03T11:25:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable ops log = true 2023-12-03T11:25:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable usage log = true 2023-12-03T11:25:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-03T11:25:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-03T11:25:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: debug rgw = 20 2023-12-03T11:25:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: rgw bucket counters cache = True 2023-12-03T11:25:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: rgw crypt require ssl = False 2023-12-03T11:25:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: rgw crypt s3 kms backend = testing 2023-12-03T11:25:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2023-12-03T11:25:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: rgw torrent flag = True 2023-12-03T11:25:22.779 INFO:teuthology.orchestra.run.smithi044.stdout: rgw user counters cache = True 2023-12-03T11:25:22.779 INFO:teuthology.orchestra.run.smithi044.stdout: setgroup = ceph 2023-12-03T11:25:22.779 INFO:teuthology.orchestra.run.smithi044.stdout: setuser = ceph 2023-12-03T11:25:22.779 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.a] 2023-12-03T11:25:22.779 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.c] 2023-12-03T11:25:22.779 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.b] 2023-12-03T11:25:22.782 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-03T11:25:22.782 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-03T11:25:22.883 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-03T11:25:22.883 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:25:22.883 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-03T11:25:22.898 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:25:22.898 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-03T11:25:22.953 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi044.front.sepia.ceph.com 2023-12-03T11:25:22.953 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:25:22.953 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-03T11:25:22.953 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-03T11:25:23.039 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:25:23.039 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:25:23.095 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi091.front.sepia.ceph.com 2023-12-03T11:25:23.095 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-03T11:25:23.095 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-03T11:25:23.095 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-03T11:25:23.134 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-03T11:25:23.134 DEBUG:teuthology.orchestra.run.smithi091:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:25:23.188 INFO:tasks.ceph:Setting up mon nodes... 2023-12-03T11:25:23.188 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-03T11:25:23.188 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-03T11:25:23.251 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-03T11:25:23.253 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-03T11:25:23.332 INFO:teuthology.orchestra.run.smithi091.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-03T11:25:23.335 INFO:tasks.ceph:Setting up mds nodes... 2023-12-03T11:25:23.335 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-03T11:25:23.335 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-03T11:25:23.381 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-03T11:25:23.400 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-03T11:25:23.442 INFO:teuthology.orchestra.run.smithi091.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-03T11:25:23.457 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-03T11:25:23.457 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi044.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi091.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-03T11:25:23.457 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-03T11:25:23.488 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-03T11:25:23.488 INFO:tasks.ceph:role: osd.0 2023-12-03T11:25:23.488 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi044.front.sepia.ceph.com 2023-12-03T11:25:23.488 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-03T11:25:23.567 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:25:23.567 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:25:23.567 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:25:23.567 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:25:23.567 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:25:23.567 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:25:23.567 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:25:23.567 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:25:23.567 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:25:23.567 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:25:24.035 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2023-12-03T11:25:24.037 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2023-12-03T11:25:24.037 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-03T11:25:24.154 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-03T11:25:24.193 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-03T11:25:24.263 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-03T11:25:24.264 INFO:tasks.ceph:role: osd.1 2023-12-03T11:25:24.264 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi044.front.sepia.ceph.com 2023-12-03T11:25:24.264 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-03T11:25:24.341 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:25:24.341 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:25:24.342 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:25:24.342 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:25:24.342 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:25:24.342 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:25:24.342 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:25:24.342 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:25:24.342 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:25:24.342 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:25:24.803 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2023-12-03T11:25:24.805 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2023-12-03T11:25:24.805 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-03T11:25:24.898 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-03T11:25:24.933 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-03T11:25:25.005 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-03T11:25:25.006 INFO:tasks.ceph:role: osd.2 2023-12-03T11:25:25.006 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi044.front.sepia.ceph.com 2023-12-03T11:25:25.006 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-03T11:25:25.084 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:25:25.084 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:25:25.085 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:25:25.085 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:25:25.085 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:25:25.085 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:25:25.085 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:25:25.085 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:25:25.085 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:25:25.085 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:25:25.571 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2023-12-03T11:25:25.573 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2023-12-03T11:25:25.574 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-03T11:25:25.698 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-03T11:25:25.736 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-03T11:25:25.810 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-03T11:25:25.810 INFO:tasks.ceph:role: osd.3 2023-12-03T11:25:25.810 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi044.front.sepia.ceph.com 2023-12-03T11:25:25.810 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-03T11:25:25.889 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:25:25.890 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:25:25.890 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:25:25.890 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:25:25.890 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:25:25.890 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:25:25.890 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:25:25.890 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:25:25.890 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:25:25.890 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:25:26.401 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2023-12-03T11:25:26.404 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2023-12-03T11:25:26.404 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-03T11:25:26.525 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-03T11:25:26.563 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:25:26.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:26.664+0000 7fde4bc16500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-03T11:25:26.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:26.665+0000 7fde4bc16500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-03T11:25:26.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:26.665+0000 7fde4bc16500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-03T11:25:26.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:26.665+0000 7fde4bc16500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-03T11:25:26.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:26.665+0000 7fde4bc16500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-03T11:25:26.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:26.665+0000 7fde4bc16500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-03T11:25:29.514 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-03T11:25:29.550 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:25:29.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:29.644+0000 7efd3681a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-03T11:25:29.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:29.645+0000 7efd3681a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-03T11:25:29.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:29.645+0000 7efd3681a500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-03T11:25:29.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:29.645+0000 7efd3681a500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-03T11:25:29.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:29.645+0000 7efd3681a500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-03T11:25:29.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:29.645+0000 7efd3681a500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-03T11:25:32.501 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-03T11:25:32.537 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:25:32.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:32.631+0000 7f9e7fa67500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-03T11:25:32.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:32.631+0000 7f9e7fa67500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-03T11:25:32.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:32.631+0000 7f9e7fa67500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-03T11:25:32.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:32.631+0000 7f9e7fa67500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-03T11:25:32.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:32.631+0000 7f9e7fa67500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-03T11:25:32.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:32.632+0000 7f9e7fa67500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-03T11:25:35.482 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-03T11:25:35.518 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:25:35.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:35.612+0000 7f20fb62a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-03T11:25:35.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:35.612+0000 7f20fb62a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-03T11:25:35.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:35.612+0000 7f20fb62a500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-03T11:25:35.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:35.612+0000 7f20fb62a500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-03T11:25:35.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:35.612+0000 7f20fb62a500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-03T11:25:35.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:25:35.613+0000 7f20fb62a500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-03T11:25:38.475 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-03T11:25:38.512 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-03T11:25:38.544 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-03T11:25:38.544 INFO:tasks.ceph:role: osd.4 2023-12-03T11:25:38.545 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi091.front.sepia.ceph.com 2023-12-03T11:25:38.545 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-03T11:25:38.622 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:25:38.622 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:25:38.622 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:25:38.622 INFO:teuthology.orchestra.run.smithi091.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:25:38.622 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:25:38.622 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:25:38.623 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:25:38.623 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:25:38.623 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:25:38.623 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:25:39.129 INFO:teuthology.orchestra.run.smithi091.stdout:Discarding blocks...Done. 2023-12-03T11:25:39.131 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2023-12-03T11:25:39.131 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-03T11:25:39.275 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-03T11:25:39.316 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-03T11:25:39.386 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-03T11:25:39.387 INFO:tasks.ceph:role: osd.5 2023-12-03T11:25:39.387 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi091.front.sepia.ceph.com 2023-12-03T11:25:39.387 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-03T11:25:39.463 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:25:39.463 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:25:39.463 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:25:39.463 INFO:teuthology.orchestra.run.smithi091.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:25:39.464 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:25:39.464 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:25:39.464 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:25:39.464 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:25:39.464 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:25:39.464 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:25:39.903 INFO:teuthology.orchestra.run.smithi091.stdout:Discarding blocks...Done. 2023-12-03T11:25:39.906 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2023-12-03T11:25:39.906 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-03T11:25:39.998 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-03T11:25:40.029 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-03T11:25:40.096 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-03T11:25:40.096 INFO:tasks.ceph:role: osd.6 2023-12-03T11:25:40.096 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi091.front.sepia.ceph.com 2023-12-03T11:25:40.097 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-03T11:25:40.170 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:25:40.171 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:25:40.171 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:25:40.171 INFO:teuthology.orchestra.run.smithi091.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:25:40.171 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:25:40.171 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:25:40.171 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:25:40.171 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:25:40.171 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:25:40.171 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:25:40.659 INFO:teuthology.orchestra.run.smithi091.stdout:Discarding blocks...Done. 2023-12-03T11:25:40.661 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2023-12-03T11:25:40.661 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-03T11:25:40.807 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-03T11:25:40.840 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-03T11:25:40.907 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-03T11:25:40.907 INFO:tasks.ceph:role: osd.7 2023-12-03T11:25:40.907 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi091.front.sepia.ceph.com 2023-12-03T11:25:40.908 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-03T11:25:40.981 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:25:40.982 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:25:40.982 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:25:40.982 INFO:teuthology.orchestra.run.smithi091.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:25:40.982 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:25:40.982 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:25:40.982 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:25:40.982 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:25:40.982 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:25:40.982 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:25:41.489 INFO:teuthology.orchestra.run.smithi091.stdout:Discarding blocks...Done. 2023-12-03T11:25:41.491 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2023-12-03T11:25:41.491 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-03T11:25:41.640 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-03T11:25:41.672 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:25:41.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:41.790+0000 7fb325c2b500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-03T11:25:41.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:41.790+0000 7fb325c2b500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-03T11:25:41.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:41.790+0000 7fb325c2b500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-03T11:25:41.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:41.790+0000 7fb325c2b500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-03T11:25:41.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:41.790+0000 7fb325c2b500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-03T11:25:41.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:41.791+0000 7fb325c2b500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-03T11:25:44.642 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-03T11:25:44.674 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:25:44.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:44.762+0000 7f4a55907500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-03T11:25:44.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:44.762+0000 7f4a55907500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-03T11:25:44.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:44.762+0000 7f4a55907500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-03T11:25:44.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:44.762+0000 7f4a55907500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-03T11:25:44.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:44.762+0000 7f4a55907500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-03T11:25:44.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:44.763+0000 7f4a55907500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-03T11:25:47.616 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-03T11:25:47.648 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:25:47.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:47.736+0000 7fa62860e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-03T11:25:47.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:47.736+0000 7fa62860e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-03T11:25:47.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:47.736+0000 7fa62860e500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-03T11:25:47.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:47.736+0000 7fa62860e500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-03T11:25:47.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:47.736+0000 7fa62860e500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-03T11:25:47.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:47.737+0000 7fa62860e500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-03T11:25:50.597 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-03T11:25:50.626 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:25:50.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:50.714+0000 7fb4154b2500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-03T11:25:50.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:50.714+0000 7fb4154b2500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-03T11:25:50.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:50.714+0000 7fb4154b2500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-03T11:25:50.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:50.714+0000 7fb4154b2500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-03T11:25:50.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:50.714+0000 7fb4154b2500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-03T11:25:50.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-03T11:25:50.715+0000 7fb4154b2500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-03T11:25:53.578 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-03T11:25:53.609 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-03T11:25:53.609 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:25:53.609 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-03T11:25:53.647 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:25:53.647 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-03T11:25:53.720 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:25:53.721 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-03T11:25:53.793 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:25:53.793 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-03T11:25:53.867 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:25:53.867 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-03T11:25:53.940 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-03T11:25:53.940 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-03T11:25:53.972 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-03T11:25:53.972 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-03T11:25:54.043 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-03T11:25:54.043 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-03T11:25:54.113 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-03T11:25:54.113 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-03T11:25:54.181 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-03T11:25:54.181 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-03T11:25:54.250 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:25:54.250 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-03T11:25:54.265 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-03T11:25:54.265 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-03T11:25:54.307 INFO:tasks.ceph:Adding keys to all mons... 2023-12-03T11:25:54.307 DEBUG:teuthology.orchestra.run.smithi044:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-03T11:25:54.309 DEBUG:teuthology.orchestra.run.smithi091:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-03T11:25:54.350 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.y] 2023-12-03T11:25:54.350 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCjZWxl5AP3DhAAdr4gwVox9gcJC+otTFyy/g== 2023-12-03T11:25:54.350 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.0] 2023-12-03T11:25:54.350 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCmZWxlmoOtJxAAzq3zOGAYh5+7Zy9rA11/Mg== 2023-12-03T11:25:54.350 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.1] 2023-12-03T11:25:54.350 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCpZWxlAR99JhAAseymTMUOOD/wisK/HWewRw== 2023-12-03T11:25:54.350 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.2] 2023-12-03T11:25:54.350 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCsZWxlP4OrJRAA4elZqcsetg7vwz4AfVCtZg== 2023-12-03T11:25:54.350 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.3] 2023-12-03T11:25:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCvZWxlZhuMJBAAVW9lXca33e1DZCbS6B9KOg== 2023-12-03T11:25:54.351 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.x] 2023-12-03T11:25:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCjZWxltGTRExAAKLKIzICZR/FcQSgi+E6hOQ== 2023-12-03T11:25:54.351 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.4] 2023-12-03T11:25:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQC1ZWxlFfkxLxAAfzahdzjOnaGQxwJrivdqQg== 2023-12-03T11:25:54.351 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.5] 2023-12-03T11:25:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQC4ZWxlqm2GLRAAx9tFDAXoBtqe3HKgJQxzZQ== 2023-12-03T11:25:54.351 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.6] 2023-12-03T11:25:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQC7ZWxlh7r/KxAA8mlrz9U0lHozGLbhQMyAvQ== 2023-12-03T11:25:54.351 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.7] 2023-12-03T11:25:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQC+ZWxlJ0+pKhAA47vRxedWeiX/JN+d6zWFWg== 2023-12-03T11:25:54.351 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2023-12-03T11:25:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCjZWxldL28FhAAwmjIOI/nfhm97HpSkY0hwQ== 2023-12-03T11:25:54.351 INFO:teuthology.orchestra.run.smithi044.stdout:[client.1] 2023-12-03T11:25:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCjZWxlHqlaGhAA3ukN835yX3PQt2Dgov1F5A== 2023-12-03T11:25:54.373 INFO:teuthology.orchestra.run.smithi091.stdout:[mgr.y] 2023-12-03T11:25:54.374 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQCjZWxl5AP3DhAAdr4gwVox9gcJC+otTFyy/g== 2023-12-03T11:25:54.374 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.0] 2023-12-03T11:25:54.374 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQCmZWxlmoOtJxAAzq3zOGAYh5+7Zy9rA11/Mg== 2023-12-03T11:25:54.374 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.1] 2023-12-03T11:25:54.374 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQCpZWxlAR99JhAAseymTMUOOD/wisK/HWewRw== 2023-12-03T11:25:54.374 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.2] 2023-12-03T11:25:54.374 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQCsZWxlP4OrJRAA4elZqcsetg7vwz4AfVCtZg== 2023-12-03T11:25:54.374 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.3] 2023-12-03T11:25:54.374 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQCvZWxlZhuMJBAAVW9lXca33e1DZCbS6B9KOg== 2023-12-03T11:25:54.374 INFO:teuthology.orchestra.run.smithi091.stdout:[mgr.x] 2023-12-03T11:25:54.374 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQCjZWxltGTRExAAKLKIzICZR/FcQSgi+E6hOQ== 2023-12-03T11:25:54.375 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.4] 2023-12-03T11:25:54.375 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC1ZWxlFfkxLxAAfzahdzjOnaGQxwJrivdqQg== 2023-12-03T11:25:54.375 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.5] 2023-12-03T11:25:54.375 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC4ZWxlqm2GLRAAx9tFDAXoBtqe3HKgJQxzZQ== 2023-12-03T11:25:54.375 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.6] 2023-12-03T11:25:54.375 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC7ZWxlh7r/KxAA8mlrz9U0lHozGLbhQMyAvQ== 2023-12-03T11:25:54.375 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.7] 2023-12-03T11:25:54.375 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC+ZWxlJ0+pKhAA47vRxedWeiX/JN+d6zWFWg== 2023-12-03T11:25:54.375 INFO:teuthology.orchestra.run.smithi091.stdout:[client.0] 2023-12-03T11:25:54.375 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQCjZWxldL28FhAAwmjIOI/nfhm97HpSkY0hwQ== 2023-12-03T11:25:54.375 INFO:teuthology.orchestra.run.smithi091.stdout:[client.1] 2023-12-03T11:25:54.375 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQCjZWxlHqlaGhAA3ukN835yX3PQt2Dgov1F5A== 2023-12-03T11:25:54.376 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-03T11:25:54.395 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-03T11:25:54.471 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:25:54.473 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:25:54.527 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:25:54.529 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:25:54.583 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:25:54.585 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:25:54.640 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:25:54.642 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:25:54.696 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-03T11:25:54.698 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-03T11:25:54.752 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:25:54.754 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:25:54.808 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:25:54.810 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:25:54.864 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:25:54.866 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:25:54.920 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:25:54.922 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:25:54.976 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-03T11:25:54.978 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-03T11:25:55.035 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-03T11:25:55.037 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-03T11:25:55.093 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-03T11:25:55.094 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-03T11:25:55.124 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-03T11:25:55.226 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-03T11:25:55.256 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-03T11:25:55.327 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-03T11:25:55.430 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-03T11:25:55.460 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-03T11:25:55.488 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-03T11:25:55.586 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-03T11:25:55.612 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:25:55.615 DEBUG:teuthology.orchestra.run.smithi091:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:25:55.667 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-03T11:25:55.668 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-03T11:25:55.668 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-03T11:25:55.670 INFO:tasks.ceph.mon.a:Started 2023-12-03T11:25:55.670 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-03T11:25:55.670 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-03T11:25:55.672 INFO:tasks.ceph.mon.c:Started 2023-12-03T11:25:55.673 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-03T11:25:55.673 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-03T11:25:55.710 INFO:tasks.ceph.mon.b:Started 2023-12-03T11:25:55.710 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-03T11:25:55.710 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-03T11:25:55.711 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-03T11:25:55.713 INFO:tasks.ceph.mgr.y:Started 2023-12-03T11:25:55.713 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-03T11:25:55.713 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-03T11:25:55.715 INFO:tasks.ceph.mgr.x:Started 2023-12-03T11:25:55.715 INFO:tasks.ceph:Setting crush tunables to default 2023-12-03T11:25:55.715 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph osd crush tunables default 2023-12-03T11:26:01.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:01.214+0000 7fc02f7fe640 0 --2- 172.21.15.44:0/2790750161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc01c003970 0x7fc01c003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-12-03T11:26:01.292 INFO:teuthology.orchestra.run.smithi044.stderr:adjusted tunables profile to default 2023-12-03T11:26:01.304 INFO:tasks.ceph:check_enable_crimson: False 2023-12-03T11:26:01.304 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-03T11:26:01.304 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:26:01.304 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-03T11:26:01.337 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:26:01.337 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-03T11:26:01.408 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:26:01.409 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-03T11:26:01.479 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:26:01.479 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-03T11:26:01.500 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:01.498+0000 7f78aaa2e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-03T11:26:01.529 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-03T11:26:01.530 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-03T11:26:01.555 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:01.554+0000 7f78aaa2e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-03T11:26:01.556 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-03T11:26:01.557 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-03T11:26:01.623 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-03T11:26:01.623 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-03T11:26:01.665 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:01.664+0000 7f6befe2f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-03T11:26:01.690 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-03T11:26:01.690 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-03T11:26:01.718 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:01.717+0000 7f6befe2f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-03T11:26:01.744 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph osd new 3f298101-a80f-495c-9f88-f6262635f1b2 0 2023-12-03T11:26:01.987 INFO:teuthology.orchestra.run.smithi091.stdout:0 2023-12-03T11:26:01.998 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph osd new edf70d80-21c7-4c20-80dc-b38e8ed249c6 1 2023-12-03T11:26:02.118 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:02.117+0000 7f78aaa2e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-03T11:26:02.172 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:02.171+0000 7f78aaa2e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-03T11:26:02.184 INFO:teuthology.orchestra.run.smithi091.stdout:1 2023-12-03T11:26:02.195 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph osd new 76d31855-fe4e-4813-880c-9a5881df5fcc 2 2023-12-03T11:26:02.219 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:02.218+0000 7f78aaa2e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-03T11:26:02.275 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:02.274+0000 7f78aaa2e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-03T11:26:02.319 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:02.318+0000 7f78aaa2e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-03T11:26:02.336 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:02.336+0000 7f6befe2f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-03T11:26:02.383 INFO:teuthology.orchestra.run.smithi091.stdout:2 2023-12-03T11:26:02.390 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:02.390+0000 7f6befe2f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-03T11:26:02.394 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph osd new c523559e-a974-4d55-bbc2-6140c75a1f51 3 2023-12-03T11:26:02.425 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:02.424+0000 7f78aaa2e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-03T11:26:02.438 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:02.437+0000 7f6befe2f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-03T11:26:02.493 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:02.493+0000 7f6befe2f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-03T11:26:02.497 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:02.496+0000 7f78aaa2e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-03T11:26:02.537 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:02.536+0000 7f6befe2f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-03T11:26:02.546 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:02.545+0000 7f78aaa2e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-03T11:26:02.579 INFO:teuthology.orchestra.run.smithi091.stdout:3 2023-12-03T11:26:02.590 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph osd new 3203a32c-a384-4326-b7b9-844b9afc6819 4 2023-12-03T11:26:02.601 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:02.600+0000 7f78aaa2e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-03T11:26:02.640 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:02.640+0000 7f6befe2f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-03T11:26:02.650 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:02.649+0000 7f78aaa2e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-03T11:26:02.714 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:02.713+0000 7f6befe2f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-03T11:26:02.762 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:02.761+0000 7f6befe2f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-03T11:26:02.815 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:02.814+0000 7f6befe2f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-03T11:26:02.817 INFO:teuthology.orchestra.run.smithi091.stdout:4 2023-12-03T11:26:02.829 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph osd new c26d0ad4-6df5-425a-8d3d-e5352b9125ec 5 2023-12-03T11:26:02.864 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:02.863+0000 7f6befe2f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-03T11:26:03.047 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:03.046+0000 7f78aaa2e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-03T11:26:03.048 INFO:teuthology.orchestra.run.smithi091.stdout:5 2023-12-03T11:26:03.059 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph osd new 17ef6311-3558-4c27-8c4b-aca4e1fdd42d 6 2023-12-03T11:26:03.189 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:03.188+0000 7f78aaa2e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-03T11:26:03.265 INFO:teuthology.orchestra.run.smithi091.stdout:6 2023-12-03T11:26:03.277 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph osd new dcc50596-7be8-406e-9911-35f704c01c3a 7 2023-12-03T11:26:03.277 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:03.276+0000 7f6befe2f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-03T11:26:03.323 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:03.322+0000 7f78aaa2e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-03T11:26:03.370 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:03.369+0000 7f78aaa2e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-03T11:26:03.417 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:03.417+0000 7f6befe2f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-03T11:26:03.461 INFO:teuthology.orchestra.run.smithi091.stdout:7 2023-12-03T11:26:03.472 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-03T11:26:03.472 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-03T11:26:03.473 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:03.471+0000 7f78aaa2e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-03T11:26:03.474 INFO:tasks.ceph.osd.0:Started 2023-12-03T11:26:03.475 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-03T11:26:03.475 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-03T11:26:03.477 INFO:tasks.ceph.osd.1:Started 2023-12-03T11:26:03.477 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-03T11:26:03.477 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-03T11:26:03.481 INFO:tasks.ceph.osd.2:Started 2023-12-03T11:26:03.481 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-03T11:26:03.481 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-03T11:26:03.483 INFO:tasks.ceph.osd.3:Started 2023-12-03T11:26:03.484 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-03T11:26:03.484 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-03T11:26:03.486 INFO:tasks.ceph.osd.4:Started 2023-12-03T11:26:03.486 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-03T11:26:03.486 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-03T11:26:03.488 INFO:tasks.ceph.osd.5:Started 2023-12-03T11:26:03.488 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-03T11:26:03.488 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-03T11:26:03.490 INFO:tasks.ceph.osd.6:Started 2023-12-03T11:26:03.490 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-03T11:26:03.491 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-03T11:26:03.493 INFO:tasks.ceph.osd.7:Started 2023-12-03T11:26:03.493 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-03T11:26:03.543 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:03.542+0000 7f6befe2f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-03T11:26:03.595 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:03.594+0000 7f6befe2f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-03T11:26:03.612 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:03.611+0000 7f78aaa2e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-03T11:26:03.693 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:03.692+0000 7f6befe2f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-03T11:26:03.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:26:03.701 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":10,"fsid":"bb5d2624-dbc6-4dd8-acfe-13ca5d09896c","created":"2023-12-03T11:26:00.987696+0000","modified":"2023-12-03T11:26:03.456525+0000","last_up_change":"0.000000","last_in_change":"2023-12-03T11:26:03.456525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3f298101-a80f-495c-9f88-f6262635f1b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"edf70d80-21c7-4c20-80dc-b38e8ed249c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"76d31855-fe4e-4813-880c-9a5881df5fcc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c523559e-a974-4d55-bbc2-6140c75a1f51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3203a32c-a384-4326-b7b9-844b9afc6819","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c26d0ad4-6df5-425a-8d3d-e5352b9125ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"17ef6311-3558-4c27-8c4b-aca4e1fdd42d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dcc50596-7be8-406e-9911-35f704c01c3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-03T11:26:03.712 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-03T11:26:03.712 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-03T11:26:03.760 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:03.758+0000 7f78aaa2e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-03T11:26:03.786 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:03.785+0000 7f6befe2f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-03T11:26:03.804 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:03.803+0000 7f78aaa2e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-03T11:26:03.924 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:03.924+0000 7f6befe2f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-03T11:26:03.951 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:03.950+0000 7f78aaa2e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-03T11:26:03.965 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:03.965+0000 7f6befe2f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-03T11:26:04.081 INFO:tasks.ceph.osd.4.smithi091.stderr:2023-12-03T11:26:04.080+0000 7f0790f15500 -1 Falling back to public interface 2023-12-03T11:26:04.093 INFO:tasks.ceph.osd.0.smithi044.stderr:2023-12-03T11:26:04.092+0000 7ff002a2b500 -1 Falling back to public interface 2023-12-03T11:26:04.096 INFO:tasks.ceph.osd.7.smithi091.stderr:2023-12-03T11:26:04.095+0000 7f9eae612500 -1 Falling back to public interface 2023-12-03T11:26:04.097 INFO:tasks.ceph.osd.1.smithi044.stderr:2023-12-03T11:26:04.097+0000 7f0800816500 -1 Falling back to public interface 2023-12-03T11:26:04.101 INFO:tasks.ceph.osd.2.smithi044.stderr:2023-12-03T11:26:04.100+0000 7f2b1ca0d500 -1 Falling back to public interface 2023-12-03T11:26:04.106 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:04.105+0000 7f6befe2f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-03T11:26:04.107 INFO:tasks.ceph.osd.6.smithi091.stderr:2023-12-03T11:26:04.106+0000 7f21eebab500 -1 Falling back to public interface 2023-12-03T11:26:04.110 INFO:tasks.ceph.osd.5.smithi091.stderr:2023-12-03T11:26:04.109+0000 7f046ee16500 -1 Falling back to public interface 2023-12-03T11:26:04.131 INFO:tasks.ceph.osd.3.smithi044.stderr:2023-12-03T11:26:04.130+0000 7fd504912500 -1 Falling back to public interface 2023-12-03T11:26:04.517 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-03T11:26:04.684 INFO:teuthology.misc.health.smithi044.stdout: 2023-12-03T11:26:04.684 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":10,"fsid":"bb5d2624-dbc6-4dd8-acfe-13ca5d09896c","created":"2023-12-03T11:26:00.987696+0000","modified":"2023-12-03T11:26:03.456525+0000","last_up_change":"0.000000","last_in_change":"2023-12-03T11:26:03.456525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3f298101-a80f-495c-9f88-f6262635f1b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"edf70d80-21c7-4c20-80dc-b38e8ed249c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"76d31855-fe4e-4813-880c-9a5881df5fcc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c523559e-a974-4d55-bbc2-6140c75a1f51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3203a32c-a384-4326-b7b9-844b9afc6819","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c26d0ad4-6df5-425a-8d3d-e5352b9125ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"17ef6311-3558-4c27-8c4b-aca4e1fdd42d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dcc50596-7be8-406e-9911-35f704c01c3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-03T11:26:04.694 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-03T11:26:04.793 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:04.792+0000 7f78aaa2e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-03T11:26:04.916 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:04.915+0000 7f6befe2f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-03T11:26:05.078 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:05.077+0000 7f78aaa2e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-03T11:26:05.131 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:05.130+0000 7f78aaa2e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-03T11:26:05.183 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:05.182+0000 7f6befe2f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-03T11:26:05.233 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:05.233+0000 7f6befe2f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-03T11:26:05.239 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:05.238+0000 7f78aaa2e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-03T11:26:05.336 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-03T11:26:05.335+0000 7f6befe2f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-03T11:26:06.266 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:06.265+0000 7f784b59c640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-03T11:26:06.267 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:26:06.266+0000 7f784b59c640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-03T11:26:07.540 INFO:tasks.ceph.osd.0.smithi044.stderr:2023-12-03T11:26:07.539+0000 7ff002a2b500 -1 osd.0 0 log_to_monitors true 2023-12-03T11:26:07.590 INFO:tasks.ceph.osd.2.smithi044.stderr:2023-12-03T11:26:07.589+0000 7f2b1ca0d500 -1 osd.2 0 log_to_monitors true 2023-12-03T11:26:07.590 INFO:tasks.ceph.osd.1.smithi044.stderr:2023-12-03T11:26:07.590+0000 7f0800816500 -1 osd.1 0 log_to_monitors true 2023-12-03T11:26:07.605 INFO:tasks.ceph.osd.4.smithi091.stderr:2023-12-03T11:26:07.604+0000 7f0790f15500 -1 osd.4 0 log_to_monitors true 2023-12-03T11:26:07.612 INFO:tasks.ceph.osd.7.smithi091.stderr:2023-12-03T11:26:07.612+0000 7f9eae612500 -1 osd.7 0 log_to_monitors true 2023-12-03T11:26:07.614 INFO:tasks.ceph.osd.6.smithi091.stderr:2023-12-03T11:26:07.614+0000 7f21eebab500 -1 osd.6 0 log_to_monitors true 2023-12-03T11:26:07.618 INFO:tasks.ceph.osd.5.smithi091.stderr:2023-12-03T11:26:07.617+0000 7f046ee16500 -1 osd.5 0 log_to_monitors true 2023-12-03T11:26:07.626 INFO:tasks.ceph.osd.3.smithi044.stderr:2023-12-03T11:26:07.625+0000 7fd504912500 -1 osd.3 0 log_to_monitors true 2023-12-03T11:26:11.283 INFO:tasks.ceph.osd.1.smithi044.stderr:2023-12-03T11:26:11.282+0000 7f07fb9b1640 -1 osd.1 0 waiting for initial osdmap 2023-12-03T11:26:11.298 INFO:tasks.ceph.osd.1.smithi044.stderr:2023-12-03T11:26:11.297+0000 7f07f3fe9640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:26:11.338 INFO:tasks.ceph.osd.2.smithi044.stderr:2023-12-03T11:26:11.337+0000 7f2b17ba8640 -1 osd.2 0 waiting for initial osdmap 2023-12-03T11:26:11.354 INFO:tasks.ceph.osd.3.smithi044.stderr:2023-12-03T11:26:11.353+0000 7fd50007d640 -1 osd.3 0 waiting for initial osdmap 2023-12-03T11:26:11.355 INFO:tasks.ceph.osd.2.smithi044.stderr:2023-12-03T11:26:11.354+0000 7f2b101e0640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:26:11.367 INFO:tasks.ceph.osd.3.smithi044.stderr:2023-12-03T11:26:11.366+0000 7fd4f86b5640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:26:11.400 INFO:tasks.ceph.osd.6.smithi091.stderr:2023-12-03T11:26:11.399+0000 7f21ea316640 -1 osd.6 0 waiting for initial osdmap 2023-12-03T11:26:11.410 INFO:tasks.ceph.osd.0.smithi044.stderr:2023-12-03T11:26:11.410+0000 7feffd7fe640 -1 osd.0 0 waiting for initial osdmap 2023-12-03T11:26:11.412 INFO:tasks.ceph.osd.7.smithi091.stderr:2023-12-03T11:26:11.412+0000 7f9ea9d7d640 -1 osd.7 0 waiting for initial osdmap 2023-12-03T11:26:11.413 INFO:tasks.ceph.osd.5.smithi091.stderr:2023-12-03T11:26:11.412+0000 7f0469fb1640 -1 osd.5 0 waiting for initial osdmap 2023-12-03T11:26:11.416 INFO:tasks.ceph.osd.6.smithi091.stderr:2023-12-03T11:26:11.415+0000 7f21e294e640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:26:11.421 INFO:tasks.ceph.osd.4.smithi091.stderr:2023-12-03T11:26:11.421+0000 7f078deb8640 -1 osd.4 0 waiting for initial osdmap 2023-12-03T11:26:11.425 INFO:tasks.ceph.osd.0.smithi044.stderr:2023-12-03T11:26:11.424+0000 7feff5e36640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:26:11.429 INFO:tasks.ceph.osd.5.smithi091.stderr:2023-12-03T11:26:11.428+0000 7f04625e9640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:26:11.433 INFO:tasks.ceph.osd.4.smithi091.stderr:2023-12-03T11:26:11.433+0000 7f0784cb8640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:26:11.434 INFO:tasks.ceph.osd.7.smithi091.stderr:2023-12-03T11:26:11.433+0000 7f9ea23b5640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:26:11.500 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-03T11:26:11.782 INFO:teuthology.misc.health.smithi044.stdout: 2023-12-03T11:26:11.782 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":12,"fsid":"bb5d2624-dbc6-4dd8-acfe-13ca5d09896c","created":"2023-12-03T11:26:00.987696+0000","modified":"2023-12-03T11:26:09.266516+0000","last_up_change":"0.000000","last_in_change":"2023-12-03T11:26:03.456525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3f298101-a80f-495c-9f88-f6262635f1b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"edf70d80-21c7-4c20-80dc-b38e8ed249c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"76d31855-fe4e-4813-880c-9a5881df5fcc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c523559e-a974-4d55-bbc2-6140c75a1f51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3203a32c-a384-4326-b7b9-844b9afc6819","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c26d0ad4-6df5-425a-8d3d-e5352b9125ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"17ef6311-3558-4c27-8c4b-aca4e1fdd42d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dcc50596-7be8-406e-9911-35f704c01c3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-03T11:26:11.793 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-03T11:26:18.600 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-03T11:26:18.892 INFO:teuthology.misc.health.smithi044.stdout: 2023-12-03T11:26:18.892 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":16,"fsid":"bb5d2624-dbc6-4dd8-acfe-13ca5d09896c","created":"2023-12-03T11:26:00.987696+0000","modified":"2023-12-03T11:26:15.472371+0000","last_up_change":"2023-12-03T11:26:12.284347+0000","last_in_change":"2023-12-03T11:26:03.456525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-03T11:26:13.317192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f298101-a80f-495c-9f88-f6262635f1b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":4244511941},{"type":"v1","addr":"172.21.15.44:6801","nonce":4244511941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":4244511941},{"type":"v1","addr":"172.21.15.44:6803","nonce":4244511941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":4244511941},{"type":"v1","addr":"172.21.15.44:6807","nonce":4244511941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":4244511941},{"type":"v1","addr":"172.21.15.44:6805","nonce":4244511941}]},"public_addr":"172.21.15.44:6801/4244511941","cluster_addr":"172.21.15.44:6803/4244511941","heartbeat_back_addr":"172.21.15.44:6807/4244511941","heartbeat_front_addr":"172.21.15.44:6805/4244511941","state":["exists","up"]},{"osd":1,"uuid":"edf70d80-21c7-4c20-80dc-b38e8ed249c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1530174506},{"type":"v1","addr":"172.21.15.44:6809","nonce":1530174506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1530174506},{"type":"v1","addr":"172.21.15.44:6811","nonce":1530174506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1530174506},{"type":"v1","addr":"172.21.15.44:6815","nonce":1530174506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1530174506},{"type":"v1","addr":"172.21.15.44:6813","nonce":1530174506}]},"public_addr":"172.21.15.44:6809/1530174506","cluster_addr":"172.21.15.44:6811/1530174506","heartbeat_back_addr":"172.21.15.44:6815/1530174506","heartbeat_front_addr":"172.21.15.44:6813/1530174506","state":["exists","up"]},{"osd":2,"uuid":"76d31855-fe4e-4813-880c-9a5881df5fcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1914741384},{"type":"v1","addr":"172.21.15.44:6817","nonce":1914741384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1914741384},{"type":"v1","addr":"172.21.15.44:6819","nonce":1914741384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1914741384},{"type":"v1","addr":"172.21.15.44:6823","nonce":1914741384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1914741384},{"type":"v1","addr":"172.21.15.44:6821","nonce":1914741384}]},"public_addr":"172.21.15.44:6817/1914741384","cluster_addr":"172.21.15.44:6819/1914741384","heartbeat_back_addr":"172.21.15.44:6823/1914741384","heartbeat_front_addr":"172.21.15.44:6821/1914741384","state":["exists","up"]},{"osd":3,"uuid":"c523559e-a974-4d55-bbc2-6140c75a1f51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1867144922},{"type":"v1","addr":"172.21.15.44:6825","nonce":1867144922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1867144922},{"type":"v1","addr":"172.21.15.44:6827","nonce":1867144922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1867144922},{"type":"v1","addr":"172.21.15.44:6831","nonce":1867144922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1867144922},{"type":"v1","addr":"172.21.15.44:6829","nonce":1867144922}]},"public_addr":"172.21.15.44:6825/1867144922","cluster_addr":"172.21.15.44:6827/1867144922","heartbeat_back_addr":"172.21.15.44:6831/1867144922","heartbeat_front_addr":"172.21.15.44:6829/1867144922","state":["exists","up"]},{"osd":4,"uuid":"3203a32c-a384-4326-b7b9-844b9afc6819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3513356836},{"type":"v1","addr":"172.21.15.91:6801","nonce":3513356836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3513356836},{"type":"v1","addr":"172.21.15.91:6803","nonce":3513356836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3513356836},{"type":"v1","addr":"172.21.15.91:6807","nonce":3513356836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3513356836},{"type":"v1","addr":"172.21.15.91:6805","nonce":3513356836}]},"public_addr":"172.21.15.91:6801/3513356836","cluster_addr":"172.21.15.91:6803/3513356836","heartbeat_back_addr":"172.21.15.91:6807/3513356836","heartbeat_front_addr":"172.21.15.91:6805/3513356836","state":["exists","up"]},{"osd":5,"uuid":"c26d0ad4-6df5-425a-8d3d-e5352b9125ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":4235471279},{"type":"v1","addr":"172.21.15.91:6825","nonce":4235471279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4235471279},{"type":"v1","addr":"172.21.15.91:6827","nonce":4235471279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4235471279},{"type":"v1","addr":"172.21.15.91:6831","nonce":4235471279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4235471279},{"type":"v1","addr":"172.21.15.91:6829","nonce":4235471279}]},"public_addr":"172.21.15.91:6825/4235471279","cluster_addr":"172.21.15.91:6827/4235471279","heartbeat_back_addr":"172.21.15.91:6831/4235471279","heartbeat_front_addr":"172.21.15.91:6829/4235471279","state":["exists","up"]},{"osd":6,"uuid":"17ef6311-3558-4c27-8c4b-aca4e1fdd42d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":2819228480},{"type":"v1","addr":"172.21.15.91:6817","nonce":2819228480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2819228480},{"type":"v1","addr":"172.21.15.91:6819","nonce":2819228480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2819228480},{"type":"v1","addr":"172.21.15.91:6823","nonce":2819228480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2819228480},{"type":"v1","addr":"172.21.15.91:6821","nonce":2819228480}]},"public_addr":"172.21.15.91:6817/2819228480","cluster_addr":"172.21.15.91:6819/2819228480","heartbeat_back_addr":"172.21.15.91:6823/2819228480","heartbeat_front_addr":"172.21.15.91:6821/2819228480","state":["exists","up"]},{"osd":7,"uuid":"dcc50596-7be8-406e-9911-35f704c01c3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":776869758},{"type":"v1","addr":"172.21.15.91:6809","nonce":776869758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":776869758},{"type":"v1","addr":"172.21.15.91:6811","nonce":776869758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":776869758},{"type":"v1","addr":"172.21.15.91:6815","nonce":776869758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":776869758},{"type":"v1","addr":"172.21.15.91:6813","nonce":776869758}]},"public_addr":"172.21.15.91:6809/776869758","cluster_addr":"172.21.15.91:6811/776869758","heartbeat_back_addr":"172.21.15.91:6815/776869758","heartbeat_front_addr":"172.21.15.91:6813/776869758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.555099+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.607429+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.637645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.597795+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.639150+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.627933+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.596751+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.607468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-03T11:26:18.903 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-03T11:26:18.903 INFO:tasks.ceph:Creating RBD pool 2023-12-03T11:26:18.903 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph osd pool create rbd 8 2023-12-03T11:26:19.980 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'rbd' created 2023-12-03T11:26:19.997 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-12-03T11:26:20.982 INFO:teuthology.orchestra.run.smithi044.stderr:enabled application 'rbd' on pool 'rbd' 2023-12-03T11:26:21.000 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-03T11:26:21.000 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-03T11:26:21.000 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-03T11:26:21.001 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-03T11:26:21.001 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-03T11:26:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:26:21.367 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":936700219},{"type":"v1","addr":"172.21.15.44:6833","nonce":936700219}]},"active_addr":"172.21.15.44:6833/936700219","active_change":"2023-12-03T11:26:05.251603+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":3833507708}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":983163810}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":2186902418}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":3406542472}]}]} 2023-12-03T11:26:21.371 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-03T11:26:21.371 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-03T11:26:21.371 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-03T11:26:21.670 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:26:21.670 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":18,"fsid":"bb5d2624-dbc6-4dd8-acfe-13ca5d09896c","created":"2023-12-03T11:26:00.987696+0000","modified":"2023-12-03T11:26:20.976539+0000","last_up_change":"2023-12-03T11:26:12.284347+0000","last_in_change":"2023-12-03T11:26:03.456525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-03T11:26:13.317192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-03T11:26:19.228323+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f298101-a80f-495c-9f88-f6262635f1b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":4244511941},{"type":"v1","addr":"172.21.15.44:6801","nonce":4244511941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":4244511941},{"type":"v1","addr":"172.21.15.44:6803","nonce":4244511941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":4244511941},{"type":"v1","addr":"172.21.15.44:6807","nonce":4244511941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":4244511941},{"type":"v1","addr":"172.21.15.44:6805","nonce":4244511941}]},"public_addr":"172.21.15.44:6801/4244511941","cluster_addr":"172.21.15.44:6803/4244511941","heartbeat_back_addr":"172.21.15.44:6807/4244511941","heartbeat_front_addr":"172.21.15.44:6805/4244511941","state":["exists","up"]},{"osd":1,"uuid":"edf70d80-21c7-4c20-80dc-b38e8ed249c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1530174506},{"type":"v1","addr":"172.21.15.44:6809","nonce":1530174506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1530174506},{"type":"v1","addr":"172.21.15.44:6811","nonce":1530174506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1530174506},{"type":"v1","addr":"172.21.15.44:6815","nonce":1530174506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1530174506},{"type":"v1","addr":"172.21.15.44:6813","nonce":1530174506}]},"public_addr":"172.21.15.44:6809/1530174506","cluster_addr":"172.21.15.44:6811/1530174506","heartbeat_back_addr":"172.21.15.44:6815/1530174506","heartbeat_front_addr":"172.21.15.44:6813/1530174506","state":["exists","up"]},{"osd":2,"uuid":"76d31855-fe4e-4813-880c-9a5881df5fcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1914741384},{"type":"v1","addr":"172.21.15.44:6817","nonce":1914741384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1914741384},{"type":"v1","addr":"172.21.15.44:6819","nonce":1914741384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1914741384},{"type":"v1","addr":"172.21.15.44:6823","nonce":1914741384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1914741384},{"type":"v1","addr":"172.21.15.44:6821","nonce":1914741384}]},"public_addr":"172.21.15.44:6817/1914741384","cluster_addr":"172.21.15.44:6819/1914741384","heartbeat_back_addr":"172.21.15.44:6823/1914741384","heartbeat_front_addr":"172.21.15.44:6821/1914741384","state":["exists","up"]},{"osd":3,"uuid":"c523559e-a974-4d55-bbc2-6140c75a1f51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1867144922},{"type":"v1","addr":"172.21.15.44:6825","nonce":1867144922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1867144922},{"type":"v1","addr":"172.21.15.44:6827","nonce":1867144922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1867144922},{"type":"v1","addr":"172.21.15.44:6831","nonce":1867144922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1867144922},{"type":"v1","addr":"172.21.15.44:6829","nonce":1867144922}]},"public_addr":"172.21.15.44:6825/1867144922","cluster_addr":"172.21.15.44:6827/1867144922","heartbeat_back_addr":"172.21.15.44:6831/1867144922","heartbeat_front_addr":"172.21.15.44:6829/1867144922","state":["exists","up"]},{"osd":4,"uuid":"3203a32c-a384-4326-b7b9-844b9afc6819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3513356836},{"type":"v1","addr":"172.21.15.91:6801","nonce":3513356836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3513356836},{"type":"v1","addr":"172.21.15.91:6803","nonce":3513356836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3513356836},{"type":"v1","addr":"172.21.15.91:6807","nonce":3513356836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3513356836},{"type":"v1","addr":"172.21.15.91:6805","nonce":3513356836}]},"public_addr":"172.21.15.91:6801/3513356836","cluster_addr":"172.21.15.91:6803/3513356836","heartbeat_back_addr":"172.21.15.91:6807/3513356836","heartbeat_front_addr":"172.21.15.91:6805/3513356836","state":["exists","up"]},{"osd":5,"uuid":"c26d0ad4-6df5-425a-8d3d-e5352b9125ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":4235471279},{"type":"v1","addr":"172.21.15.91:6825","nonce":4235471279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4235471279},{"type":"v1","addr":"172.21.15.91:6827","nonce":4235471279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4235471279},{"type":"v1","addr":"172.21.15.91:6831","nonce":4235471279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4235471279},{"type":"v1","addr":"172.21.15.91:6829","nonce":4235471279}]},"public_addr":"172.21.15.91:6825/4235471279","cluster_addr":"172.21.15.91:6827/4235471279","heartbeat_back_addr":"172.21.15.91:6831/4235471279","heartbeat_front_addr":"172.21.15.91:6829/4235471279","state":["exists","up"]},{"osd":6,"uuid":"17ef6311-3558-4c27-8c4b-aca4e1fdd42d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":2819228480},{"type":"v1","addr":"172.21.15.91:6817","nonce":2819228480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2819228480},{"type":"v1","addr":"172.21.15.91:6819","nonce":2819228480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2819228480},{"type":"v1","addr":"172.21.15.91:6823","nonce":2819228480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2819228480},{"type":"v1","addr":"172.21.15.91:6821","nonce":2819228480}]},"public_addr":"172.21.15.91:6817/2819228480","cluster_addr":"172.21.15.91:6819/2819228480","heartbeat_back_addr":"172.21.15.91:6823/2819228480","heartbeat_front_addr":"172.21.15.91:6821/2819228480","state":["exists","up"]},{"osd":7,"uuid":"dcc50596-7be8-406e-9911-35f704c01c3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":776869758},{"type":"v1","addr":"172.21.15.91:6809","nonce":776869758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":776869758},{"type":"v1","addr":"172.21.15.91:6811","nonce":776869758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":776869758},{"type":"v1","addr":"172.21.15.91:6815","nonce":776869758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":776869758},{"type":"v1","addr":"172.21.15.91:6813","nonce":776869758}]},"public_addr":"172.21.15.91:6809/776869758","cluster_addr":"172.21.15.91:6811/776869758","heartbeat_back_addr":"172.21.15.91:6815/776869758","heartbeat_front_addr":"172.21.15.91:6813/776869758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.555099+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.607429+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.637645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.597795+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.639150+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.627933+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.596751+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.607468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-03T11:26:21.682 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-03T11:26:21.682 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-03T11:26:21.975 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:26:21.975 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":18,"fsid":"bb5d2624-dbc6-4dd8-acfe-13ca5d09896c","created":"2023-12-03T11:26:00.987696+0000","modified":"2023-12-03T11:26:20.976539+0000","last_up_change":"2023-12-03T11:26:12.284347+0000","last_in_change":"2023-12-03T11:26:03.456525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-03T11:26:13.317192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-03T11:26:19.228323+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f298101-a80f-495c-9f88-f6262635f1b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":4244511941},{"type":"v1","addr":"172.21.15.44:6801","nonce":4244511941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":4244511941},{"type":"v1","addr":"172.21.15.44:6803","nonce":4244511941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":4244511941},{"type":"v1","addr":"172.21.15.44:6807","nonce":4244511941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":4244511941},{"type":"v1","addr":"172.21.15.44:6805","nonce":4244511941}]},"public_addr":"172.21.15.44:6801/4244511941","cluster_addr":"172.21.15.44:6803/4244511941","heartbeat_back_addr":"172.21.15.44:6807/4244511941","heartbeat_front_addr":"172.21.15.44:6805/4244511941","state":["exists","up"]},{"osd":1,"uuid":"edf70d80-21c7-4c20-80dc-b38e8ed249c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1530174506},{"type":"v1","addr":"172.21.15.44:6809","nonce":1530174506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1530174506},{"type":"v1","addr":"172.21.15.44:6811","nonce":1530174506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1530174506},{"type":"v1","addr":"172.21.15.44:6815","nonce":1530174506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1530174506},{"type":"v1","addr":"172.21.15.44:6813","nonce":1530174506}]},"public_addr":"172.21.15.44:6809/1530174506","cluster_addr":"172.21.15.44:6811/1530174506","heartbeat_back_addr":"172.21.15.44:6815/1530174506","heartbeat_front_addr":"172.21.15.44:6813/1530174506","state":["exists","up"]},{"osd":2,"uuid":"76d31855-fe4e-4813-880c-9a5881df5fcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1914741384},{"type":"v1","addr":"172.21.15.44:6817","nonce":1914741384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1914741384},{"type":"v1","addr":"172.21.15.44:6819","nonce":1914741384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1914741384},{"type":"v1","addr":"172.21.15.44:6823","nonce":1914741384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1914741384},{"type":"v1","addr":"172.21.15.44:6821","nonce":1914741384}]},"public_addr":"172.21.15.44:6817/1914741384","cluster_addr":"172.21.15.44:6819/1914741384","heartbeat_back_addr":"172.21.15.44:6823/1914741384","heartbeat_front_addr":"172.21.15.44:6821/1914741384","state":["exists","up"]},{"osd":3,"uuid":"c523559e-a974-4d55-bbc2-6140c75a1f51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1867144922},{"type":"v1","addr":"172.21.15.44:6825","nonce":1867144922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1867144922},{"type":"v1","addr":"172.21.15.44:6827","nonce":1867144922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1867144922},{"type":"v1","addr":"172.21.15.44:6831","nonce":1867144922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1867144922},{"type":"v1","addr":"172.21.15.44:6829","nonce":1867144922}]},"public_addr":"172.21.15.44:6825/1867144922","cluster_addr":"172.21.15.44:6827/1867144922","heartbeat_back_addr":"172.21.15.44:6831/1867144922","heartbeat_front_addr":"172.21.15.44:6829/1867144922","state":["exists","up"]},{"osd":4,"uuid":"3203a32c-a384-4326-b7b9-844b9afc6819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3513356836},{"type":"v1","addr":"172.21.15.91:6801","nonce":3513356836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3513356836},{"type":"v1","addr":"172.21.15.91:6803","nonce":3513356836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3513356836},{"type":"v1","addr":"172.21.15.91:6807","nonce":3513356836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3513356836},{"type":"v1","addr":"172.21.15.91:6805","nonce":3513356836}]},"public_addr":"172.21.15.91:6801/3513356836","cluster_addr":"172.21.15.91:6803/3513356836","heartbeat_back_addr":"172.21.15.91:6807/3513356836","heartbeat_front_addr":"172.21.15.91:6805/3513356836","state":["exists","up"]},{"osd":5,"uuid":"c26d0ad4-6df5-425a-8d3d-e5352b9125ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":4235471279},{"type":"v1","addr":"172.21.15.91:6825","nonce":4235471279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4235471279},{"type":"v1","addr":"172.21.15.91:6827","nonce":4235471279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4235471279},{"type":"v1","addr":"172.21.15.91:6831","nonce":4235471279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4235471279},{"type":"v1","addr":"172.21.15.91:6829","nonce":4235471279}]},"public_addr":"172.21.15.91:6825/4235471279","cluster_addr":"172.21.15.91:6827/4235471279","heartbeat_back_addr":"172.21.15.91:6831/4235471279","heartbeat_front_addr":"172.21.15.91:6829/4235471279","state":["exists","up"]},{"osd":6,"uuid":"17ef6311-3558-4c27-8c4b-aca4e1fdd42d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":2819228480},{"type":"v1","addr":"172.21.15.91:6817","nonce":2819228480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2819228480},{"type":"v1","addr":"172.21.15.91:6819","nonce":2819228480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2819228480},{"type":"v1","addr":"172.21.15.91:6823","nonce":2819228480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2819228480},{"type":"v1","addr":"172.21.15.91:6821","nonce":2819228480}]},"public_addr":"172.21.15.91:6817/2819228480","cluster_addr":"172.21.15.91:6819/2819228480","heartbeat_back_addr":"172.21.15.91:6823/2819228480","heartbeat_front_addr":"172.21.15.91:6821/2819228480","state":["exists","up"]},{"osd":7,"uuid":"dcc50596-7be8-406e-9911-35f704c01c3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":776869758},{"type":"v1","addr":"172.21.15.91:6809","nonce":776869758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":776869758},{"type":"v1","addr":"172.21.15.91:6811","nonce":776869758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":776869758},{"type":"v1","addr":"172.21.15.91:6815","nonce":776869758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":776869758},{"type":"v1","addr":"172.21.15.91:6813","nonce":776869758}]},"public_addr":"172.21.15.91:6809/776869758","cluster_addr":"172.21.15.91:6811/776869758","heartbeat_back_addr":"172.21.15.91:6815/776869758","heartbeat_front_addr":"172.21.15.91:6813/776869758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.555099+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.607429+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.637645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.597795+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.639150+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.627933+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.596751+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:26:08.607468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-03T11:26:21.988 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-03T11:26:21.988 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-03T11:26:21.988 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-03T11:26:21.989 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-03T11:26:21.989 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-03T11:26:21.990 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-03T11:26:21.990 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-03T11:26:21.991 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-03T11:26:22.249 INFO:teuthology.orchestra.run.smithi044.stdout:55834574854 2023-12-03T11:26:22.249 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-03T11:26:22.253 INFO:teuthology.orchestra.run.smithi044.stdout:55834574853 2023-12-03T11:26:22.253 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-03T11:26:22.254 INFO:teuthology.orchestra.run.smithi044.stdout:55834574853 2023-12-03T11:26:22.255 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-03T11:26:22.256 INFO:teuthology.orchestra.run.smithi044.stdout:55834574853 2023-12-03T11:26:22.256 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-03T11:26:22.257 INFO:teuthology.orchestra.run.smithi044.stdout:55834574854 2023-12-03T11:26:22.257 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-03T11:26:22.258 INFO:teuthology.orchestra.run.smithi044.stdout:55834574852 2023-12-03T11:26:22.259 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-03T11:26:22.260 INFO:teuthology.orchestra.run.smithi044.stdout:55834574855 2023-12-03T11:26:22.260 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-03T11:26:22.261 INFO:teuthology.orchestra.run.smithi044.stdout:55834574854 2023-12-03T11:26:22.262 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-03T11:26:22.823 INFO:teuthology.orchestra.run.smithi044.stdout:55834574853 2023-12-03T11:26:22.833 INFO:teuthology.orchestra.run.smithi044.stdout:55834574852 2023-12-03T11:26:22.843 INFO:teuthology.orchestra.run.smithi044.stdout:55834574852 2023-12-03T11:26:22.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-12-03T11:26:22.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2023-12-03T11:26:22.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2023-12-03T11:26:22.877 INFO:teuthology.orchestra.run.smithi044.stdout:55834574851 2023-12-03T11:26:22.889 INFO:teuthology.orchestra.run.smithi044.stdout:55834574853 2023-12-03T11:26:22.891 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.5 2023-12-03T11:26:22.895 INFO:teuthology.orchestra.run.smithi044.stdout:55834574853 2023-12-03T11:26:22.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-12-03T11:26:22.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-12-03T11:26:22.916 INFO:teuthology.orchestra.run.smithi044.stdout:55834574852 2023-12-03T11:26:22.917 INFO:teuthology.orchestra.run.smithi044.stdout:55834574854 2023-12-03T11:26:22.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2023-12-03T11:26:22.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2023-12-03T11:26:23.846 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-03T11:26:23.854 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-03T11:26:23.865 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-03T11:26:23.892 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-03T11:26:23.903 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-03T11:26:23.909 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-03T11:26:23.934 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-03T11:26:23.935 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-03T11:26:24.424 INFO:teuthology.orchestra.run.smithi044.stdout:55834574854 2023-12-03T11:26:24.444 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-12-03T11:26:24.444 DEBUG:teuthology.parallel:result is None 2023-12-03T11:26:24.496 INFO:teuthology.orchestra.run.smithi044.stdout:55834574854 2023-12-03T11:26:24.496 INFO:teuthology.orchestra.run.smithi044.stdout:55834574853 2023-12-03T11:26:24.505 INFO:teuthology.orchestra.run.smithi044.stdout:55834574853 2023-12-03T11:26:24.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-12-03T11:26:24.513 DEBUG:teuthology.parallel:result is None 2023-12-03T11:26:24.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2023-12-03T11:26:24.517 DEBUG:teuthology.parallel:result is None 2023-12-03T11:26:24.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2023-12-03T11:26:24.523 DEBUG:teuthology.parallel:result is None 2023-12-03T11:26:24.536 INFO:teuthology.orchestra.run.smithi044.stdout:55834574852 2023-12-03T11:26:24.547 INFO:teuthology.orchestra.run.smithi044.stdout:55834574854 2023-12-03T11:26:24.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.5 2023-12-03T11:26:24.550 DEBUG:teuthology.parallel:result is None 2023-12-03T11:26:24.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-12-03T11:26:24.560 DEBUG:teuthology.parallel:result is None 2023-12-03T11:26:24.575 INFO:teuthology.orchestra.run.smithi044.stdout:55834574855 2023-12-03T11:26:24.575 INFO:teuthology.orchestra.run.smithi044.stdout:55834574853 2023-12-03T11:26:24.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2023-12-03T11:26:24.590 DEBUG:teuthology.parallel:result is None 2023-12-03T11:26:24.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2023-12-03T11:26:24.590 DEBUG:teuthology.parallel:result is None 2023-12-03T11:26:24.591 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-03T11:26:24.591 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-03T11:26:24.921 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:26:24.921 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2023-12-03T11:26:24.933 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-12-03T11:26:23.261794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218752,"kb_used_data":2560,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755968,"statfs":{"total":773094113280,"available":772870111232,"internally_reserved":0,"allocated":2621440,"data_stored":1637034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000714"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:26:21.994887+0000","last_change":"2023-12-03T11:26:20.991134+0000","last_active":"2023-12-03T11:26:21.994887+0000","last_peered":"2023-12-03T11:26:21.994887+0000","last_clean":"2023-12-03T11:26:21.994887+0000","last_became_active":"2023-12-03T11:26:20.990846+0000","last_became_peered":"2023-12-03T11:26:20.990846+0000","last_unstale":"2023-12-03T11:26:21.994887+0000","last_undegraded":"2023-12-03T11:26:21.994887+0000","last_fullsized":"2023-12-03T11:26:21.994887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_clean_scrub_stamp":"2023-12-03T11:26:19.971649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T19:29:16.983088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:26:21.994088+0000","last_change":"2023-12-03T11:26:20.990167+0000","last_active":"2023-12-03T11:26:21.994088+0000","last_peered":"2023-12-03T11:26:21.994088+0000","last_clean":"2023-12-03T11:26:21.994088+0000","last_became_active":"2023-12-03T11:26:20.989882+0000","last_became_peered":"2023-12-03T11:26:20.989882+0000","last_unstale":"2023-12-03T11:26:21.994088+0000","last_undegraded":"2023-12-03T11:26:21.994088+0000","last_fullsized":"2023-12-03T11:26:21.994088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_clean_scrub_stamp":"2023-12-03T11:26:19.971649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T19:07:48.887921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:26:21.099807+0000","last_change":"2023-12-03T11:26:21.098668+0000","last_active":"2023-12-03T11:26:21.099807+0000","last_peered":"2023-12-03T11:26:21.099807+0000","last_clean":"2023-12-03T11:26:21.099807+0000","last_became_active":"2023-12-03T11:26:21.098408+0000","last_became_peered":"2023-12-03T11:26:21.098408+0000","last_unstale":"2023-12-03T11:26:21.099807+0000","last_undegraded":"2023-12-03T11:26:21.099807+0000","last_fullsized":"2023-12-03T11:26:21.099807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_clean_scrub_stamp":"2023-12-03T11:26:19.971649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T12:24:49.675145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:26:21.994091+0000","last_change":"2023-12-03T11:26:21.098685+0000","last_active":"2023-12-03T11:26:21.994091+0000","last_peered":"2023-12-03T11:26:21.994091+0000","last_clean":"2023-12-03T11:26:21.994091+0000","last_became_active":"2023-12-03T11:26:21.098398+0000","last_became_peered":"2023-12-03T11:26:21.098398+0000","last_unstale":"2023-12-03T11:26:21.994091+0000","last_undegraded":"2023-12-03T11:26:21.994091+0000","last_fullsized":"2023-12-03T11:26:21.994091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_clean_scrub_stamp":"2023-12-03T11:26:19.971649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T23:03:32.679427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:26:20.990417+0000","last_change":"2023-12-03T11:26:20.988952+0000","last_active":"2023-12-03T11:26:20.990417+0000","last_peered":"2023-12-03T11:26:20.990417+0000","last_clean":"2023-12-03T11:26:20.990417+0000","last_became_active":"2023-12-03T11:26:20.988495+0000","last_became_peered":"2023-12-03T11:26:20.988495+0000","last_unstale":"2023-12-03T11:26:20.990417+0000","last_undegraded":"2023-12-03T11:26:20.990417+0000","last_fullsized":"2023-12-03T11:26:20.990417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_clean_scrub_stamp":"2023-12-03T11:26:19.971649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T19:11:04.788046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:26:21.099130+0000","last_change":"2023-12-03T11:26:21.098671+0000","last_active":"2023-12-03T11:26:21.099130+0000","last_peered":"2023-12-03T11:26:21.099130+0000","last_clean":"2023-12-03T11:26:21.099130+0000","last_became_active":"2023-12-03T11:26:21.098386+0000","last_became_peered":"2023-12-03T11:26:21.098386+0000","last_unstale":"2023-12-03T11:26:21.099130+0000","last_undegraded":"2023-12-03T11:26:21.099130+0000","last_fullsized":"2023-12-03T11:26:21.099130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_clean_scrub_stamp":"2023-12-03T11:26:19.971649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T14:13:19.694333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:26:20.988601+0000","last_change":"2023-12-03T11:26:20.987121+0000","last_active":"2023-12-03T11:26:20.988601+0000","last_peered":"2023-12-03T11:26:20.988601+0000","last_clean":"2023-12-03T11:26:20.988601+0000","last_became_active":"2023-12-03T11:26:20.986854+0000","last_became_peered":"2023-12-03T11:26:20.986854+0000","last_unstale":"2023-12-03T11:26:20.988601+0000","last_undegraded":"2023-12-03T11:26:20.988601+0000","last_fullsized":"2023-12-03T11:26:20.988601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_clean_scrub_stamp":"2023-12-03T11:26:19.971649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T17:21:33.148974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:26:20.990438+0000","last_change":"2023-12-03T11:26:20.989012+0000","last_active":"2023-12-03T11:26:20.990438+0000","last_peered":"2023-12-03T11:26:20.990438+0000","last_clean":"2023-12-03T11:26:20.990438+0000","last_became_active":"2023-12-03T11:26:20.988629+0000","last_became_peered":"2023-12-03T11:26:20.988629+0000","last_unstale":"2023-12-03T11:26:20.990438+0000","last_undegraded":"2023-12-03T11:26:20.990438+0000","last_fullsized":"2023-12-03T11:26:20.990438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_clean_scrub_stamp":"2023-12-03T11:26:19.971649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T16:43:56.194649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-12-03T11:26:19.986501+0000","last_change":"2023-12-03T11:26:14.533339+0000","last_active":"2023-12-03T11:26:19.986501+0000","last_peered":"2023-12-03T11:26:19.986501+0000","last_clean":"2023-12-03T11:26:19.986501+0000","last_became_active":"2023-12-03T11:26:14.532284+0000","last_became_peered":"2023-12-03T11:26:14.532284+0000","last_unstale":"2023-12-03T11:26:19.986501+0000","last_undegraded":"2023-12-03T11:26:19.986501+0000","last_fullsized":"2023-12-03T11:26:19.986501+0000","mapping_epoch":14,"log_start":"16'100","ondisk_log_start":"16'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:26:13.456828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:26:13.456828+0000","last_clean_scrub_stamp":"2023-12-03T11:26:13.456828+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T19:41:24.893010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":176128,"data_stored":56273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":770048,"data_stored":646641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-03T11:26:24.934 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-03T11:26:25.228 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:26:25.229 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2023-12-03T11:26:25.240 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-12-03T11:26:23.261794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218752,"kb_used_data":2560,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755968,"statfs":{"total":773094113280,"available":772870111232,"internally_reserved":0,"allocated":2621440,"data_stored":1637034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000714"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:26:21.994887+0000","last_change":"2023-12-03T11:26:20.991134+0000","last_active":"2023-12-03T11:26:21.994887+0000","last_peered":"2023-12-03T11:26:21.994887+0000","last_clean":"2023-12-03T11:26:21.994887+0000","last_became_active":"2023-12-03T11:26:20.990846+0000","last_became_peered":"2023-12-03T11:26:20.990846+0000","last_unstale":"2023-12-03T11:26:21.994887+0000","last_undegraded":"2023-12-03T11:26:21.994887+0000","last_fullsized":"2023-12-03T11:26:21.994887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_clean_scrub_stamp":"2023-12-03T11:26:19.971649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T19:29:16.983088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:26:21.994088+0000","last_change":"2023-12-03T11:26:20.990167+0000","last_active":"2023-12-03T11:26:21.994088+0000","last_peered":"2023-12-03T11:26:21.994088+0000","last_clean":"2023-12-03T11:26:21.994088+0000","last_became_active":"2023-12-03T11:26:20.989882+0000","last_became_peered":"2023-12-03T11:26:20.989882+0000","last_unstale":"2023-12-03T11:26:21.994088+0000","last_undegraded":"2023-12-03T11:26:21.994088+0000","last_fullsized":"2023-12-03T11:26:21.994088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_clean_scrub_stamp":"2023-12-03T11:26:19.971649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T19:07:48.887921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:26:21.099807+0000","last_change":"2023-12-03T11:26:21.098668+0000","last_active":"2023-12-03T11:26:21.099807+0000","last_peered":"2023-12-03T11:26:21.099807+0000","last_clean":"2023-12-03T11:26:21.099807+0000","last_became_active":"2023-12-03T11:26:21.098408+0000","last_became_peered":"2023-12-03T11:26:21.098408+0000","last_unstale":"2023-12-03T11:26:21.099807+0000","last_undegraded":"2023-12-03T11:26:21.099807+0000","last_fullsized":"2023-12-03T11:26:21.099807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_clean_scrub_stamp":"2023-12-03T11:26:19.971649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T12:24:49.675145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:26:21.994091+0000","last_change":"2023-12-03T11:26:21.098685+0000","last_active":"2023-12-03T11:26:21.994091+0000","last_peered":"2023-12-03T11:26:21.994091+0000","last_clean":"2023-12-03T11:26:21.994091+0000","last_became_active":"2023-12-03T11:26:21.098398+0000","last_became_peered":"2023-12-03T11:26:21.098398+0000","last_unstale":"2023-12-03T11:26:21.994091+0000","last_undegraded":"2023-12-03T11:26:21.994091+0000","last_fullsized":"2023-12-03T11:26:21.994091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_clean_scrub_stamp":"2023-12-03T11:26:19.971649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T23:03:32.679427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:26:20.990417+0000","last_change":"2023-12-03T11:26:20.988952+0000","last_active":"2023-12-03T11:26:20.990417+0000","last_peered":"2023-12-03T11:26:20.990417+0000","last_clean":"2023-12-03T11:26:20.990417+0000","last_became_active":"2023-12-03T11:26:20.988495+0000","last_became_peered":"2023-12-03T11:26:20.988495+0000","last_unstale":"2023-12-03T11:26:20.990417+0000","last_undegraded":"2023-12-03T11:26:20.990417+0000","last_fullsized":"2023-12-03T11:26:20.990417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_clean_scrub_stamp":"2023-12-03T11:26:19.971649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T19:11:04.788046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:26:21.099130+0000","last_change":"2023-12-03T11:26:21.098671+0000","last_active":"2023-12-03T11:26:21.099130+0000","last_peered":"2023-12-03T11:26:21.099130+0000","last_clean":"2023-12-03T11:26:21.099130+0000","last_became_active":"2023-12-03T11:26:21.098386+0000","last_became_peered":"2023-12-03T11:26:21.098386+0000","last_unstale":"2023-12-03T11:26:21.099130+0000","last_undegraded":"2023-12-03T11:26:21.099130+0000","last_fullsized":"2023-12-03T11:26:21.099130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_clean_scrub_stamp":"2023-12-03T11:26:19.971649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T14:13:19.694333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:26:20.988601+0000","last_change":"2023-12-03T11:26:20.987121+0000","last_active":"2023-12-03T11:26:20.988601+0000","last_peered":"2023-12-03T11:26:20.988601+0000","last_clean":"2023-12-03T11:26:20.988601+0000","last_became_active":"2023-12-03T11:26:20.986854+0000","last_became_peered":"2023-12-03T11:26:20.986854+0000","last_unstale":"2023-12-03T11:26:20.988601+0000","last_undegraded":"2023-12-03T11:26:20.988601+0000","last_fullsized":"2023-12-03T11:26:20.988601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_clean_scrub_stamp":"2023-12-03T11:26:19.971649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T17:21:33.148974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:26:20.990438+0000","last_change":"2023-12-03T11:26:20.989012+0000","last_active":"2023-12-03T11:26:20.990438+0000","last_peered":"2023-12-03T11:26:20.990438+0000","last_clean":"2023-12-03T11:26:20.990438+0000","last_became_active":"2023-12-03T11:26:20.988629+0000","last_became_peered":"2023-12-03T11:26:20.988629+0000","last_unstale":"2023-12-03T11:26:20.990438+0000","last_undegraded":"2023-12-03T11:26:20.990438+0000","last_fullsized":"2023-12-03T11:26:20.990438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:26:19.971649+0000","last_clean_scrub_stamp":"2023-12-03T11:26:19.971649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T16:43:56.194649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-12-03T11:26:19.986501+0000","last_change":"2023-12-03T11:26:14.533339+0000","last_active":"2023-12-03T11:26:19.986501+0000","last_peered":"2023-12-03T11:26:19.986501+0000","last_clean":"2023-12-03T11:26:19.986501+0000","last_became_active":"2023-12-03T11:26:14.532284+0000","last_became_peered":"2023-12-03T11:26:14.532284+0000","last_unstale":"2023-12-03T11:26:19.986501+0000","last_undegraded":"2023-12-03T11:26:19.986501+0000","last_fullsized":"2023-12-03T11:26:19.986501+0000","mapping_epoch":14,"log_start":"16'100","ondisk_log_start":"16'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:26:13.456828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:26:13.456828+0000","last_clean_scrub_stamp":"2023-12-03T11:26:13.456828+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T19:41:24.893010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":176128,"data_stored":56273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":770048,"data_stored":646641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-03T11:26:25.242 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-03T11:26:25.242 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-03T11:26:25.242 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-03T11:26:25.242 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-03T11:26:25.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:26:25.575 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-03T11:26:25.587 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-03T11:26:25.587 INFO:teuthology.run_tasks:Running task openssl_keys... 2023-12-03T11:26:25.600 INFO:teuthology.run_tasks:Running task rgw... 2023-12-03T11:26:25.635 DEBUG:tasks.rgw:config is {'client.0': None} 2023-12-03T11:26:25.636 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2023-12-03T11:26:25.636 INFO:tasks.rgw:Creating data pools 2023-12-03T11:26:25.636 DEBUG:tasks.rgw:Obtaining remote for client client.0 2023-12-03T11:26:25.636 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2023-12-03T11:26:26.786 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2023-12-03T11:26:29.010 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'default.rgw.buckets.data' created 2023-12-03T11:26:29.035 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2023-12-03T11:26:30.018 INFO:teuthology.orchestra.run.smithi044.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2023-12-03T11:26:30.061 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2023-12-03T11:26:31.030 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'default.rgw.buckets.index' created 2023-12-03T11:26:31.057 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2023-12-03T11:26:32.037 INFO:teuthology.orchestra.run.smithi044.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2023-12-03T11:26:32.073 DEBUG:tasks.rgw:Pools created 2023-12-03T11:26:32.073 INFO:tasks.rgw:Configuring compression type = random 2023-12-03T11:26:32.073 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2023-12-03T11:26:32.073 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2023-12-03T11:26:32.073 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2023-12-03T11:26:32.164 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:26:32.164 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:26:32.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:32.176+0000 7f0931d25800 20 rados->read ofs=0 len=0 2023-12-03T11:26:34.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.059+0000 7f0931d25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:26:34.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.059+0000 7f0931d25800 20 realm 2023-12-03T11:26:34.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.059+0000 7f0931d25800 20 rados->read ofs=0 len=0 2023-12-03T11:26:34.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.060+0000 7f0931d25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:26:34.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.060+0000 7f0931d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:26:34.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.060+0000 7f0931d25800 20 rados->read ofs=0 len=0 2023-12-03T11:26:34.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.060+0000 7f0931d25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:26:34.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.060+0000 7f0931d25800 20 rados->read ofs=0 len=0 2023-12-03T11:26:34.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.061+0000 7f0931d25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:26:34.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.061+0000 7f0931d25800 20 rados->read ofs=0 len=0 2023-12-03T11:26:34.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.061+0000 7f0931d25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:26:34.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.061+0000 7f0931d25800 20 rados->read ofs=0 len=0 2023-12-03T11:26:34.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.062+0000 7f0931d25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:26:34.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.062+0000 7f0931d25800 10 Creating default zonegroup 2023-12-03T11:26:34.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.062+0000 7f0931d25800 10 couldn't find old data placement pools config, setting up new ones for the zone 2023-12-03T11:26:34.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.073+0000 7f092dab8640 0 -- 172.21.15.44:0/1932076668 >> [v2:172.21.15.44:6800/4244511941,v1:172.21.15.44:6801/4244511941] conn(0x7f092405ee80 msgr2=0x7f092405d470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:26:34.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.075+0000 7f0931d25800 10 WARNING: driver->list_zones() returned r=-2 2023-12-03T11:26:34.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.075+0000 7f0931d25800 20 rados->read ofs=0 len=0 2023-12-03T11:26:34.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.076+0000 7f0931d25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:26:34.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.079+0000 7f0931d25800 20 rados->read ofs=0 len=0 2023-12-03T11:26:34.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.079+0000 7f0931d25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:26:34.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.079+0000 7f0931d25800 10 could not read realm id: (2) No such file or directory 2023-12-03T11:26:34.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.079+0000 7f0931d25800 10 WARNING: failed to set zone as default, r=-22 2023-12-03T11:26:34.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.079+0000 7f0931d25800 20 rados->read ofs=0 len=0 2023-12-03T11:26:34.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.079+0000 7f0931d25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:26:34.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.082+0000 7f0931d25800 20 rados->read ofs=0 len=0 2023-12-03T11:26:34.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.082+0000 7f0931d25800 20 rados_obj.operate() r=0 bl.length=874 2023-12-03T11:26:34.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.082+0000 7f0931d25800 20 rados->read ofs=0 len=0 2023-12-03T11:26:34.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.083+0000 7f0931d25800 20 rados_obj.operate() r=0 bl.length=420 2023-12-03T11:26:34.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.083+0000 7f0931d25800 10 Using default name default 2023-12-03T11:26:34.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.083+0000 7f0931d25800 20 rados->read ofs=0 len=0 2023-12-03T11:26:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.083+0000 7f0931d25800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:26:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.083+0000 7f0931d25800 20 rados->read ofs=0 len=0 2023-12-03T11:26:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.083+0000 7f0931d25800 20 rados_obj.operate() r=0 bl.length=874 2023-12-03T11:26:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.083+0000 7f0931d25800 20 zone default found 2023-12-03T11:26:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.083+0000 7f0931d25800 4 Realm: () 2023-12-03T11:26:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.083+0000 7f0931d25800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:26:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.083+0000 7f0931d25800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:26:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.083+0000 7f0931d25800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:26:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.083+0000 7f0931d25800 20 zonegroup default 2023-12-03T11:26:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.083+0000 7f0931d25800 20 rados->read ofs=0 len=0 2023-12-03T11:26:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.083+0000 7f092dab8640 0 -- 172.21.15.44:0/1932076668 >> [v2:172.21.15.44:6800/4244511941,v1:172.21.15.44:6801/4244511941] conn(0x7f0908074fa0 msgr2=0x7f0908077390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:26:34.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.084+0000 7f0931d25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:26:34.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:34.084+0000 7f0931d25800 20 rados->read ofs=0 len=0 2023-12-03T11:26:36.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:36.059+0000 7f0931d25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:26:36.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:36.059+0000 7f0931d25800 20 rados->read ofs=0 len=0 2023-12-03T11:26:36.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:36.061+0000 7f0931d25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:26:36.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:36.062+0000 7f0931d25800 20 started sync module instance, tier type = 2023-12-03T11:26:36.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:36.062+0000 7f0931d25800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:26:38.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.094+0000 7f0931d25800 20 add_watcher() i=0 2023-12-03T11:26:38.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.094+0000 7f0931d25800 20 add_watcher() i=1 2023-12-03T11:26:38.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.094+0000 7f0931d25800 20 add_watcher() i=2 2023-12-03T11:26:38.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.094+0000 7f0931d25800 20 add_watcher() i=3 2023-12-03T11:26:38.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.094+0000 7f0931d25800 20 add_watcher() i=4 2023-12-03T11:26:38.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.094+0000 7f0931d25800 20 add_watcher() i=5 2023-12-03T11:26:38.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.095+0000 7f0931d25800 20 add_watcher() i=6 2023-12-03T11:26:38.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.096+0000 7f0931d25800 20 add_watcher() i=7 2023-12-03T11:26:38.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.096+0000 7f0931d25800 2 all 8 watchers are set, enabling cache 2023-12-03T11:26:38.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.096+0000 7f0931d25800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2023-12-03T11:26:38.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.096+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2023-12-03T11:26:38.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.096+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.096+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2023-12-03T11:26:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.096+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2023-12-03T11:26:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.096+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.097+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2023-12-03T11:26:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.097+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2023-12-03T11:26:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.097+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.097+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2023-12-03T11:26:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.097+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2023-12-03T11:26:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.097+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.097+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2023-12-03T11:26:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.097+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2023-12-03T11:26:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.097+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.098+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2023-12-03T11:26:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.098+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2023-12-03T11:26:38.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.098+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.098+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2023-12-03T11:26:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.098+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2023-12-03T11:26:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.098+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.098+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2023-12-03T11:26:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.098+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2023-12-03T11:26:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.098+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.099+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2023-12-03T11:26:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.099+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2023-12-03T11:26:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.099+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.099+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2023-12-03T11:26:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.099+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2023-12-03T11:26:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.099+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.099+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2023-12-03T11:26:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.099+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2023-12-03T11:26:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.099+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.099+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2023-12-03T11:26:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.099+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2023-12-03T11:26:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.099+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.100+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2023-12-03T11:26:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.100+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2023-12-03T11:26:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.100+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.100+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2023-12-03T11:26:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.100+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2023-12-03T11:26:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.100+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.100+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2023-12-03T11:26:38.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.100+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2023-12-03T11:26:38.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.100+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.101+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2023-12-03T11:26:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.101+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2023-12-03T11:26:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.101+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.101+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2023-12-03T11:26:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.101+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2023-12-03T11:26:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.101+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.101+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2023-12-03T11:26:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.101+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2023-12-03T11:26:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.101+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.101+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2023-12-03T11:26:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.101+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2023-12-03T11:26:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.101+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.102+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2023-12-03T11:26:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.102+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2023-12-03T11:26:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.102+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.102+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2023-12-03T11:26:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.102+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2023-12-03T11:26:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.102+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.102+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2023-12-03T11:26:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.102+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2023-12-03T11:26:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.102+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.102+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2023-12-03T11:26:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.102+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2023-12-03T11:26:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.102+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.103+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2023-12-03T11:26:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.103+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2023-12-03T11:26:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.103+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.103+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2023-12-03T11:26:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.103+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2023-12-03T11:26:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.103+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.103+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2023-12-03T11:26:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.103+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2023-12-03T11:26:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.103+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.103+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2023-12-03T11:26:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.103+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2023-12-03T11:26:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.103+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.104+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2023-12-03T11:26:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.104+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2023-12-03T11:26:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.104+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.104+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2023-12-03T11:26:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.104+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2023-12-03T11:26:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.104+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.104+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2023-12-03T11:26:38.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.104+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2023-12-03T11:26:38.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.104+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.105+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2023-12-03T11:26:38.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.105+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2023-12-03T11:26:38.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.105+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.105+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2023-12-03T11:26:38.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.105+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2023-12-03T11:26:38.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.105+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.105+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2023-12-03T11:26:38.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.105+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2023-12-03T11:26:38.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.105+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.105+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2023-12-03T11:26:38.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.105+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2023-12-03T11:26:38.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.105+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.106+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2023-12-03T11:26:38.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.106+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2023-12-03T11:26:38.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.106+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.106+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2023-12-03T11:26:38.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.106+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2023-12-03T11:26:38.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.106+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.107+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2023-12-03T11:26:38.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.107+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2023-12-03T11:26:38.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.107+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.107+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2023-12-03T11:26:38.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.107+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2023-12-03T11:26:38.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.107+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.107+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2023-12-03T11:26:38.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.107+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2023-12-03T11:26:38.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.107+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.107+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2023-12-03T11:26:38.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.107+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2023-12-03T11:26:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.107+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.108+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2023-12-03T11:26:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.108+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2023-12-03T11:26:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.108+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.108+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2023-12-03T11:26:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.108+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2023-12-03T11:26:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.108+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.108+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2023-12-03T11:26:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.108+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2023-12-03T11:26:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.108+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.108+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2023-12-03T11:26:38.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.108+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2023-12-03T11:26:38.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.108+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.109+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2023-12-03T11:26:38.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.109+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2023-12-03T11:26:38.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.109+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.109+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2023-12-03T11:26:38.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.109+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2023-12-03T11:26:38.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.109+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.109+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2023-12-03T11:26:38.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.109+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2023-12-03T11:26:38.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.109+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.109+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2023-12-03T11:26:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.109+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2023-12-03T11:26:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.109+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.110+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2023-12-03T11:26:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.110+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2023-12-03T11:26:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.110+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.110+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2023-12-03T11:26:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.110+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2023-12-03T11:26:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.110+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.110+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2023-12-03T11:26:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.110+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2023-12-03T11:26:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.110+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.111+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2023-12-03T11:26:38.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.111+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2023-12-03T11:26:38.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.111+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.111+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2023-12-03T11:26:38.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.111+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2023-12-03T11:26:38.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.111+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.111+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2023-12-03T11:26:38.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.111+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2023-12-03T11:26:38.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.111+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.111+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2023-12-03T11:26:38.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.111+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2023-12-03T11:26:38.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.111+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.111+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2023-12-03T11:26:38.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.111+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2023-12-03T11:26:38.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.111+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.112+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2023-12-03T11:26:38.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.112+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2023-12-03T11:26:38.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.112+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.112+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2023-12-03T11:26:38.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.112+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2023-12-03T11:26:38.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.112+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.112+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2023-12-03T11:26:38.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.112+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2023-12-03T11:26:38.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.112+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.112+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2023-12-03T11:26:38.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.112+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2023-12-03T11:26:38.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.112+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.113+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2023-12-03T11:26:38.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.113+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2023-12-03T11:26:38.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.113+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.113+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2023-12-03T11:26:38.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.113+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2023-12-03T11:26:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.113+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.113+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2023-12-03T11:26:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.113+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2023-12-03T11:26:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.113+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.113+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2023-12-03T11:26:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.113+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2023-12-03T11:26:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.113+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.114+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2023-12-03T11:26:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.114+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2023-12-03T11:26:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.114+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.114+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2023-12-03T11:26:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.114+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2023-12-03T11:26:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.114+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.114+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2023-12-03T11:26:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.114+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2023-12-03T11:26:38.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.114+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.114+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2023-12-03T11:26:38.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.114+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2023-12-03T11:26:38.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.114+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.114+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2023-12-03T11:26:38.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.114+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2023-12-03T11:26:38.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.114+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.115+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2023-12-03T11:26:38.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.115+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2023-12-03T11:26:38.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.115+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.115+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2023-12-03T11:26:38.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.115+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2023-12-03T11:26:38.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.115+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.115+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2023-12-03T11:26:38.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.115+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2023-12-03T11:26:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.115+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.115+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2023-12-03T11:26:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.115+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2023-12-03T11:26:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.115+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.116+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2023-12-03T11:26:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.116+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2023-12-03T11:26:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.116+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.116+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2023-12-03T11:26:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.116+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2023-12-03T11:26:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.116+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.116+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2023-12-03T11:26:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.116+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2023-12-03T11:26:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.116+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.116+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2023-12-03T11:26:38.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.116+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2023-12-03T11:26:38.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.116+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.117+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2023-12-03T11:26:38.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.117+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2023-12-03T11:26:38.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.117+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.117+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2023-12-03T11:26:38.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.117+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2023-12-03T11:26:38.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.117+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.117+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2023-12-03T11:26:38.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.117+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2023-12-03T11:26:38.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.117+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.118+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2023-12-03T11:26:38.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.118+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2023-12-03T11:26:38.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.118+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.118+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2023-12-03T11:26:38.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.118+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2023-12-03T11:26:38.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.118+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.118+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2023-12-03T11:26:38.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.118+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2023-12-03T11:26:38.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.118+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.118+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2023-12-03T11:26:38.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.118+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2023-12-03T11:26:38.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.118+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.119+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2023-12-03T11:26:38.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.119+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2023-12-03T11:26:38.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.119+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.119+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2023-12-03T11:26:38.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.119+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2023-12-03T11:26:38.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.119+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.119+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2023-12-03T11:26:38.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.119+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2023-12-03T11:26:38.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.119+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.120+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2023-12-03T11:26:38.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.120+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2023-12-03T11:26:38.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.120+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.120+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2023-12-03T11:26:38.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.120+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2023-12-03T11:26:38.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.120+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.120+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2023-12-03T11:26:38.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.120+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2023-12-03T11:26:38.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.120+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.120+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2023-12-03T11:26:38.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.120+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2023-12-03T11:26:38.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.120+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.121+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2023-12-03T11:26:38.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.121+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2023-12-03T11:26:38.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.121+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.121+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2023-12-03T11:26:38.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.121+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2023-12-03T11:26:38.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.121+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.121+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2023-12-03T11:26:38.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.121+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2023-12-03T11:26:38.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.121+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.122+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2023-12-03T11:26:38.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.122+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2023-12-03T11:26:38.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.122+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.122+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2023-12-03T11:26:38.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.122+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2023-12-03T11:26:38.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.122+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.122+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2023-12-03T11:26:38.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.122+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2023-12-03T11:26:38.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.122+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.122+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2023-12-03T11:26:38.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.122+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2023-12-03T11:26:38.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.122+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.123+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2023-12-03T11:26:38.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.123+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2023-12-03T11:26:38.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.123+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.123+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2023-12-03T11:26:38.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.123+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2023-12-03T11:26:38.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.123+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.123+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2023-12-03T11:26:38.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.123+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2023-12-03T11:26:38.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.123+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.123+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2023-12-03T11:26:38.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.123+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2023-12-03T11:26:38.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.123+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.124+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2023-12-03T11:26:38.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.124+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2023-12-03T11:26:38.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.124+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.124+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2023-12-03T11:26:38.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.124+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2023-12-03T11:26:38.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.124+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.124+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2023-12-03T11:26:38.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.124+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2023-12-03T11:26:38.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.124+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.124+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2023-12-03T11:26:38.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.124+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2023-12-03T11:26:38.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.124+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.125+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2023-12-03T11:26:38.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.125+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2023-12-03T11:26:38.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.125+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.125+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2023-12-03T11:26:38.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.125+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2023-12-03T11:26:38.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.125+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.125+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2023-12-03T11:26:38.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.125+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2023-12-03T11:26:38.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.125+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.125+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2023-12-03T11:26:38.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.125+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2023-12-03T11:26:38.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.125+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.126+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2023-12-03T11:26:38.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.126+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2023-12-03T11:26:38.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.126+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.126+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2023-12-03T11:26:38.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.126+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2023-12-03T11:26:38.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.126+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.126+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2023-12-03T11:26:38.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.126+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2023-12-03T11:26:38.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.126+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.126+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2023-12-03T11:26:38.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.126+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2023-12-03T11:26:38.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.126+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.127+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2023-12-03T11:26:38.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.127+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2023-12-03T11:26:38.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.127+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.127+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2023-12-03T11:26:38.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.127+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2023-12-03T11:26:38.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.127+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.127+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2023-12-03T11:26:38.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.127+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2023-12-03T11:26:38.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.127+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.127+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2023-12-03T11:26:38.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.127+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2023-12-03T11:26:38.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.127+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.127+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2023-12-03T11:26:38.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.127+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2023-12-03T11:26:38.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.127+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.128+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2023-12-03T11:26:38.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.128+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2023-12-03T11:26:38.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.128+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.128+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2023-12-03T11:26:38.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.128+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2023-12-03T11:26:38.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.128+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.128+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2023-12-03T11:26:38.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.128+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2023-12-03T11:26:38.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.128+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.128+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2023-12-03T11:26:38.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.128+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2023-12-03T11:26:38.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.128+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.129+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2023-12-03T11:26:38.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.129+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2023-12-03T11:26:38.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.129+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.129+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2023-12-03T11:26:38.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.129+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2023-12-03T11:26:38.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.129+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.129+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2023-12-03T11:26:38.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.129+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2023-12-03T11:26:38.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.129+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.129+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2023-12-03T11:26:38.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.129+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2023-12-03T11:26:38.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.129+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.130+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2023-12-03T11:26:38.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.130+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2023-12-03T11:26:38.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.130+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.130+0000 7f0931d25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2023-12-03T11:26:38.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.130+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1210 entering 2023-12-03T11:26:38.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.131+0000 7f0931d25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:26:38.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.137+0000 7f08f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:26:38.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.137+0000 7f0931d25800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:26:38.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:38.137+0000 7f0931d25800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:26:41.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.073+0000 7f0931d25800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2023-12-03T11:26:41.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.073+0000 7f0931d25800 5 note: GC not initialized 2023-12-03T11:26:41.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.074+0000 7f085a7fc640 20 reqs_thread_entry: start 2023-12-03T11:26:41.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.074+0000 7f0931d25800 20 init_complete bucket index max shards: 1 2023-12-03T11:26:41.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.074+0000 7f0931d25800 20 Filter name: none 2023-12-03T11:26:41.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.074+0000 7f084bfff640 20 reqs_thread_entry: start 2023-12-03T11:26:41.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.105+0000 7f08f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:26:41.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.108+0000 7f0931d25800 20 remove_watcher() i=0 2023-12-03T11:26:41.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.108+0000 7f0931d25800 2 removed watcher, disabling cache 2023-12-03T11:26:41.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.109+0000 7f0931d25800 20 remove_watcher() i=1 2023-12-03T11:26:41.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.112+0000 7f0931d25800 20 remove_watcher() i=2 2023-12-03T11:26:41.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.116+0000 7f0931d25800 20 remove_watcher() i=3 2023-12-03T11:26:41.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.118+0000 7f0931d25800 20 remove_watcher() i=4 2023-12-03T11:26:41.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.119+0000 7f0931d25800 20 remove_watcher() i=5 2023-12-03T11:26:41.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.121+0000 7f0931d25800 20 remove_watcher() i=6 2023-12-03T11:26:41.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.122+0000 7f0931d25800 20 remove_watcher() i=7 2023-12-03T11:26:41.138 INFO:teuthology.orchestra.run.smithi044.stdout:[] 2023-12-03T11:26:41.139 DEBUG:tasks.util.rgw: json result: [] 2023-12-03T11:26:41.139 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2023-12-03T11:26:41.139 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2023-12-03T11:26:41.139 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2023-12-03T11:26:41.190 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:26:41.190 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:26:41.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.202+0000 7fb244f3a800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:26:41.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.202+0000 7fb244f3a800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:26:41.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.205+0000 7fb17f7fe640 20 reqs_thread_entry: start 2023-12-03T11:26:41.217 INFO:teuthology.orchestra.run.smithi044.stdout:{"id":"ff414afd-0753-48a7-8bb4-762be6d38c82","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-12-03T11:26:41.217 DEBUG:tasks.util.rgw: json result: {'id': 'ff414afd-0753-48a7-8bb4-762be6d38c82', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-12-03T11:26:41.217 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2023-12-03T11:26:41.217 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2023-12-03T11:26:41.218 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2023-12-03T11:26:41.260 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:26:41.260 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:26:41.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.270+0000 7f2cb1f2c800 20 rados->read ofs=0 len=0 2023-12-03T11:26:41.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.272+0000 7f2cb1f2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:26:41.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.272+0000 7f2cb1f2c800 20 realm 2023-12-03T11:26:41.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.272+0000 7f2cb1f2c800 20 rados->read ofs=0 len=0 2023-12-03T11:26:41.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.272+0000 7f2cb1f2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:26:41.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.272+0000 7f2cb1f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:26:41.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.272+0000 7f2cb1f2c800 20 rados->read ofs=0 len=0 2023-12-03T11:26:41.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.272+0000 7f2cb1f2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:26:41.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.272+0000 7f2cb1f2c800 20 rados->read ofs=0 len=0 2023-12-03T11:26:41.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.273+0000 7f2cb1f2c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:26:41.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.273+0000 7f2cb1f2c800 20 rados->read ofs=0 len=0 2023-12-03T11:26:41.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.274+0000 7f2cb1f2c800 20 rados_obj.operate() r=0 bl.length=890 2023-12-03T11:26:41.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.274+0000 7f2cb1f2c800 20 searching for the correct realm 2023-12-03T11:26:41.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.284+0000 7f2cadcf0640 0 -- 172.21.15.44:0/3697506956 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55e645693350 msgr2=0x55e645695740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:26:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.286+0000 7f2cb1f2c800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:26:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.286+0000 7f2cb1f2c800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:26:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.286+0000 7f2cb1f2c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:26:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.286+0000 7f2cb1f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:26:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.286+0000 7f2cb1f2c800 20 rados->read ofs=0 len=0 2023-12-03T11:26:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.286+0000 7f2cb1f2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:26:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.286+0000 7f2cb1f2c800 20 rados->read ofs=0 len=0 2023-12-03T11:26:41.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.287+0000 7f2cb1f2c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:26:41.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.287+0000 7f2cb1f2c800 20 rados->read ofs=0 len=0 2023-12-03T11:26:41.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.287+0000 7f2cb1f2c800 20 rados_obj.operate() r=0 bl.length=420 2023-12-03T11:26:41.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.287+0000 7f2cb1f2c800 20 zone default found 2023-12-03T11:26:41.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.287+0000 7f2cb1f2c800 4 Realm: () 2023-12-03T11:26:41.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.287+0000 7f2cb1f2c800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:26:41.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.287+0000 7f2cb1f2c800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:26:41.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.287+0000 7f2cb1f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:26:41.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.287+0000 7f2cb1f2c800 20 zonegroup default 2023-12-03T11:26:41.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.287+0000 7f2cb1f2c800 20 rados->read ofs=0 len=0 2023-12-03T11:26:41.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.287+0000 7f2cb1f2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:26:41.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.287+0000 7f2cb1f2c800 20 rados->read ofs=0 len=0 2023-12-03T11:26:41.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.287+0000 7f2cb1f2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:26:41.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.287+0000 7f2cb1f2c800 20 rados->read ofs=0 len=0 2023-12-03T11:26:41.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.288+0000 7f2cb1f2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:26:41.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.288+0000 7f2cb1f2c800 20 started sync module instance, tier type = 2023-12-03T11:26:41.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.288+0000 7f2cb1f2c800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:26:41.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.300+0000 7f2cae4f1640 0 -- 172.21.15.44:0/3697506956 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f2ca400d000 msgr2=0x7f2ca406c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:26:41.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.304+0000 7f2cb1f2c800 20 add_watcher() i=0 2023-12-03T11:26:41.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.304+0000 7f2cb1f2c800 20 add_watcher() i=1 2023-12-03T11:26:41.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.304+0000 7f2cb1f2c800 20 add_watcher() i=2 2023-12-03T11:26:41.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.304+0000 7f2cb1f2c800 20 add_watcher() i=3 2023-12-03T11:26:41.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.304+0000 7f2cb1f2c800 20 add_watcher() i=4 2023-12-03T11:26:41.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.304+0000 7f2cb1f2c800 20 add_watcher() i=5 2023-12-03T11:26:41.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.304+0000 7f2cb1f2c800 20 add_watcher() i=6 2023-12-03T11:26:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.306+0000 7f2cb1f2c800 20 add_watcher() i=7 2023-12-03T11:26:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.306+0000 7f2cb1f2c800 2 all 8 watchers are set, enabling cache 2023-12-03T11:26:41.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.308+0000 7f2c737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:26:41.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.308+0000 7f2cb1f2c800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:26:41.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.308+0000 7f2cb1f2c800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:26:41.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.313+0000 7f2cb1f2c800 5 note: GC not initialized 2023-12-03T11:26:41.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.313+0000 7f2be27fc640 20 reqs_thread_entry: start 2023-12-03T11:26:41.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.313+0000 7f2cb1f2c800 20 init_complete bucket index max shards: 1 2023-12-03T11:26:41.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.314+0000 7f2cb1f2c800 20 Filter name: none 2023-12-03T11:26:41.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.314+0000 7f2bd3fff640 20 reqs_thread_entry: start 2023-12-03T11:26:41.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.324+0000 7f2c737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:26:41.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.326+0000 7f2cb1f2c800 20 remove_watcher() i=0 2023-12-03T11:26:41.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.326+0000 7f2cb1f2c800 2 removed watcher, disabling cache 2023-12-03T11:26:41.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.327+0000 7f2cb1f2c800 20 remove_watcher() i=1 2023-12-03T11:26:41.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.328+0000 7f2cb1f2c800 20 remove_watcher() i=2 2023-12-03T11:26:41.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.329+0000 7f2cb1f2c800 20 remove_watcher() i=3 2023-12-03T11:26:41.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.331+0000 7f2cb1f2c800 20 remove_watcher() i=4 2023-12-03T11:26:41.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.332+0000 7f2cb1f2c800 20 remove_watcher() i=5 2023-12-03T11:26:41.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.333+0000 7f2cb1f2c800 20 remove_watcher() i=6 2023-12-03T11:26:41.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.334+0000 7f2cb1f2c800 20 remove_watcher() i=7 2023-12-03T11:26:41.340 INFO:teuthology.orchestra.run.smithi044.stdout:[] 2023-12-03T11:26:41.340 DEBUG:tasks.util.rgw: json result: [] 2023-12-03T11:26:41.340 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2023-12-03T11:26:41.340 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2023-12-03T11:26:41.340 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2023-12-03T11:26:41.341 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2023-12-03T11:26:41.428 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:26:41.428 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:26:41.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.438+0000 7fc78eb30800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:26:41.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.438+0000 7fc78eb30800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:26:41.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.442+0000 7fc6c3fff640 20 reqs_thread_entry: start 2023-12-03T11:26:41.452 INFO:teuthology.orchestra.run.smithi044.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2023-12-03T11:26:41.452 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2023-12-03T11:26:41.452 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2023-12-03T11:26:41.452 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2023-12-03T11:26:41.452 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2023-12-03T11:26:41.501 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:26:41.501 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:26:41.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.512+0000 7f0792911800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:26:41.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.512+0000 7f0792911800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:26:41.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.515+0000 7f06ce7fc640 20 reqs_thread_entry: start 2023-12-03T11:26:41.526 INFO:teuthology.orchestra.run.smithi044.stdout:{"id":"ff414afd-0753-48a7-8bb4-762be6d38c82","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-12-03T11:26:41.526 DEBUG:tasks.util.rgw: json result: {'id': 'ff414afd-0753-48a7-8bb4-762be6d38c82', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-12-03T11:26:41.527 INFO:tasks.rgw:Configuring storage class type = FROZEN 2023-12-03T11:26:41.527 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2023-12-03T11:26:41.527 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2023-12-03T11:26:41.527 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2023-12-03T11:26:41.575 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:26:41.575 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:26:41.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.586+0000 7f033a810800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:26:41.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.586+0000 7f033a810800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:26:41.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.590+0000 7f02737fe640 20 reqs_thread_entry: start 2023-12-03T11:26:41.600 INFO:teuthology.orchestra.run.smithi044.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2023-12-03T11:26:41.600 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2023-12-03T11:26:41.600 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2023-12-03T11:26:41.600 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2023-12-03T11:26:41.601 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2023-12-03T11:26:41.650 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:26:41.651 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:26:41.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.661+0000 7f60ef531800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:26:41.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.661+0000 7f60ef531800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:26:41.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:26:41.664+0000 7f60417fa640 20 reqs_thread_entry: start 2023-12-03T11:26:41.676 INFO:teuthology.orchestra.run.smithi044.stdout:{"id":"ff414afd-0753-48a7-8bb4-762be6d38c82","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-12-03T11:26:41.677 DEBUG:tasks.util.rgw: json result: {'id': 'ff414afd-0753-48a7-8bb4-762be6d38c82', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-12-03T11:26:41.677 INFO:tasks.rgw:Starting rgw... 2023-12-03T11:26:41.677 INFO:tasks.rgw:rgw client.0 config is {} 2023-12-03T11:26:41.677 INFO:tasks.rgw:Using beast as radosgw frontend 2023-12-03T11:26:41.677 INFO:tasks.rgw.client.0:Restarting daemon 2023-12-03T11:26:41.678 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2023-12-03T11:26:41.680 INFO:tasks.rgw.client.0:Started 2023-12-03T11:26:41.680 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi044.front.sepia.ceph.com:80/ 2023-12-03T11:26:41.680 DEBUG:teuthology.orchestra.run.smithi044:> curl http://smithi044.front.sepia.ceph.com:80/ 2023-12-03T11:26:41.717 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-12-03T11:26:41.717 INFO:teuthology.orchestra.run.smithi044.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-03T11:26:41.717 INFO:teuthology.orchestra.run.smithi044.stderr: Dload Upload Total Spent Left Speed 2023-12-03T11:26:41.717 INFO:teuthology.orchestra.run.smithi044.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-12-03T11:26:41.717 INFO:teuthology.orchestra.run.smithi044.stderr:curl: (7) Failed to connect to smithi044.front.sepia.ceph.com port 80: Connection refused 2023-12-03T11:26:42.718 DEBUG:teuthology.orchestra.run.smithi044:> curl http://smithi044.front.sepia.ceph.com:80/ 2023-12-03T11:26:42.738 INFO:teuthology.orchestra.run.smithi044.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-03T11:26:42.738 INFO:teuthology.orchestra.run.smithi044.stderr: Dload Upload Total Spent Left Speed 2023-12-03T11:26:42.739 INFO:teuthology.orchestra.run.smithi044.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 208k 0 --:--:-- --:--:-- --:--:-- 208k 2023-12-03T11:26:42.739 INFO:teuthology.orchestra.run.smithi044.stdout:anonymous 2023-12-03T11:26:42.740 INFO:teuthology.run_tasks:Running task tox... 2023-12-03T11:26:42.751 INFO:tasks.tox:Deploying tox from pip... 2023-12-03T11:26:42.752 DEBUG:teuthology.orchestra.run.smithi044:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2023-12-03T11:26:45.211 DEBUG:teuthology.orchestra.run.smithi044:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2023-12-03T11:26:45.753 INFO:teuthology.orchestra.run.smithi044.stdout:Collecting tox==3.15.0 2023-12-03T11:26:45.949 INFO:teuthology.orchestra.run.smithi044.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2023-12-03T11:26:46.339 INFO:teuthology.orchestra.run.smithi044.stdout:Collecting py<2,>=1.4.17 2023-12-03T11:26:46.415 INFO:teuthology.orchestra.run.smithi044.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2023-12-03T11:26:46.572 INFO:teuthology.orchestra.run.smithi044.stdout:Collecting pluggy<1,>=0.12.0 2023-12-03T11:26:46.640 INFO:teuthology.orchestra.run.smithi044.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2023-12-03T11:26:46.720 INFO:teuthology.orchestra.run.smithi044.stdout:Collecting toml>=0.9.4 2023-12-03T11:26:46.786 INFO:teuthology.orchestra.run.smithi044.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2023-12-03T11:26:46.902 INFO:teuthology.orchestra.run.smithi044.stdout:Collecting filelock<4,>=3.0.0 2023-12-03T11:26:46.975 INFO:teuthology.orchestra.run.smithi044.stdout: Downloading filelock-3.13.1-py3-none-any.whl (11 kB) 2023-12-03T11:26:47.276 INFO:teuthology.orchestra.run.smithi044.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2023-12-03T11:26:47.340 INFO:teuthology.orchestra.run.smithi044.stdout: Downloading virtualenv-20.25.0-py3-none-any.whl (3.8 MB) 2023-12-03T11:26:48.951 INFO:teuthology.orchestra.run.smithi044.stdout:Collecting packaging>=14 2023-12-03T11:26:49.058 INFO:teuthology.orchestra.run.smithi044.stdout: Downloading packaging-23.2-py3-none-any.whl (53 kB) 2023-12-03T11:26:49.166 INFO:teuthology.orchestra.run.smithi044.stdout:Collecting six<2,>=1.14.0 2023-12-03T11:26:49.263 INFO:teuthology.orchestra.run.smithi044.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2023-12-03T11:26:49.422 INFO:teuthology.orchestra.run.smithi044.stdout:Collecting platformdirs<5,>=3.9.1 2023-12-03T11:26:49.507 INFO:teuthology.orchestra.run.smithi044.stdout: Downloading platformdirs-4.0.0-py3-none-any.whl (17 kB) 2023-12-03T11:26:49.587 INFO:teuthology.orchestra.run.smithi044.stdout:Collecting distlib<1,>=0.3.7 2023-12-03T11:26:49.670 INFO:teuthology.orchestra.run.smithi044.stdout: Downloading distlib-0.3.7-py2.py3-none-any.whl (468 kB) 2023-12-03T11:26:49.975 INFO:teuthology.orchestra.run.smithi044.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2023-12-03T11:26:50.816 INFO:teuthology.orchestra.run.smithi044.stdout:Successfully installed distlib-0.3.7 filelock-3.13.1 packaging-23.2 platformdirs-4.0.0 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.25.0 2023-12-03T11:26:51.378 INFO:teuthology.orchestra.run.smithi044.stderr:WARNING: You are using pip version 21.2.3; however, version 23.3.1 is available. 2023-12-03T11:26:51.379 INFO:teuthology.orchestra.run.smithi044.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2023-12-03T11:26:51.448 INFO:teuthology.run_tasks:Running task workunit... 2023-12-03T11:26:51.466 INFO:tasks.workunit:Pulling workunits from ref bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:26:51.467 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-03T11:26:51.467 DEBUG:teuthology.orchestra.run.smithi044:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:26:51.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:26:51.485 INFO:teuthology.orchestra.run.smithi044.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-12-03T11:26:51.485 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:26:51.540 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-12-03T11:26:51.540 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-12-03T11:26:51.595 INFO:tasks.workunit:timeout=3h 2023-12-03T11:26:51.595 INFO:tasks.workunit:cleanup=True 2023-12-03T11:26:51.595 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:26:51.650 INFO:tasks.workunit.client.0.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-03T11:27:58.727 INFO:tasks.workunit.client.0.smithi044.stderr:Updating files: 95% (11550/12123) Updating files: 96% (11639/12123) Updating files: 97% (11760/12123) Updating files: 98% (11881/12123) Updating files: 99% (12002/12123) Updating files: 100% (12123/12123) Updating files: 100% (12123/12123), done. 2023-12-03T11:27:59.322 INFO:tasks.workunit.client.0.smithi044.stderr:Note: switching to 'bcbf278cf395873c2a482f5a7b2345faf2160319'. 2023-12-03T11:27:59.323 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:27:59.323 INFO:tasks.workunit.client.0.smithi044.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-03T11:27:59.323 INFO:tasks.workunit.client.0.smithi044.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-03T11:27:59.323 INFO:tasks.workunit.client.0.smithi044.stderr:state without impacting any branches by switching back to a branch. 2023-12-03T11:27:59.323 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:27:59.323 INFO:tasks.workunit.client.0.smithi044.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-03T11:27:59.324 INFO:tasks.workunit.client.0.smithi044.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-03T11:27:59.324 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:27:59.324 INFO:tasks.workunit.client.0.smithi044.stderr: git switch -c 2023-12-03T11:27:59.324 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:27:59.324 INFO:tasks.workunit.client.0.smithi044.stderr:Or undo this operation with: 2023-12-03T11:27:59.324 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:27:59.324 INFO:tasks.workunit.client.0.smithi044.stderr: git switch - 2023-12-03T11:27:59.325 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:27:59.325 INFO:tasks.workunit.client.0.smithi044.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-03T11:27:59.325 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:27:59.325 INFO:tasks.workunit.client.0.smithi044.stderr:HEAD is now at bcbf278cf39 RGW:pubsub publish commit with etag populated 2023-12-03T11:27:59.327 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-03T11:27:59.393 INFO:tasks.workunit.client.0.smithi044.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-03T11:27:59.395 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:27:59.395 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-03T11:28:00.073 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-03T11:28:00.146 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-03T11:28:00.187 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:28:00.189 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:28:00.189 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-03T11:28:00.229 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:28:00.232 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:28:00.232 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-03T11:28:00.288 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2023-12-03T11:28:00.290 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2023-12-03T11:28:00.290 DEBUG:teuthology.orchestra.run.smithi044:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2023-12-03T11:28:00.348 INFO:tasks.workunit.client.0.smithi044.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2023-12-03T11:28:00.348 INFO:tasks.workunit.client.0.smithi044.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-12-03T11:28:00.348 INFO:tasks.workunit.client.0.smithi044.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-12-03T11:28:02.803 INFO:tasks.workunit.client.0.smithi044.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2023-12-03T11:28:02.803 INFO:tasks.workunit.client.0.smithi044.stderr:++ deactivate nondestructive 2023-12-03T11:28:02.803 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2023-12-03T11:28:02.803 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2023-12-03T11:28:02.803 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2023-12-03T11:28:02.803 INFO:tasks.workunit.client.0.smithi044.stderr:++ hash -r 2023-12-03T11:28:02.803 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2023-12-03T11:28:02.804 INFO:tasks.workunit.client.0.smithi044.stderr:++ unset VIRTUAL_ENV 2023-12-03T11:28:02.804 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' '!' nondestructive = nondestructive ']' 2023-12-03T11:28:02.804 INFO:tasks.workunit.client.0.smithi044.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-12-03T11:28:02.804 INFO:tasks.workunit.client.0.smithi044.stderr:++ export VIRTUAL_ENV 2023-12-03T11:28:02.804 INFO:tasks.workunit.client.0.smithi044.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-12-03T11:28:02.804 INFO:tasks.workunit.client.0.smithi044.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-12-03T11:28:02.804 INFO:tasks.workunit.client.0.smithi044.stderr:++ export PATH 2023-12-03T11:28:02.804 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2023-12-03T11:28:02.804 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -z '' ']' 2023-12-03T11:28:02.804 INFO:tasks.workunit.client.0.smithi044.stderr:++ _OLD_VIRTUAL_PS1= 2023-12-03T11:28:02.804 INFO:tasks.workunit.client.0.smithi044.stderr:++ PS1='(rgw) ' 2023-12-03T11:28:02.804 INFO:tasks.workunit.client.0.smithi044.stderr:++ export PS1 2023-12-03T11:28:02.804 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2023-12-03T11:28:02.804 INFO:tasks.workunit.client.0.smithi044.stderr:++ hash -r 2023-12-03T11:28:02.804 INFO:tasks.workunit.client.0.smithi044.stderr:+ pip install pip --upgrade 2023-12-03T11:28:03.045 INFO:tasks.workunit.client.0.smithi044.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2023-12-03T11:28:03.681 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting pip 2023-12-03T11:28:04.365 INFO:tasks.workunit.client.0.smithi044.stdout: Downloading pip-23.3.1-py3-none-any.whl (2.1 MB) 2023-12-03T11:28:06.763 INFO:tasks.workunit.client.0.smithi044.stdout:Installing collected packages: pip 2023-12-03T11:28:06.763 INFO:tasks.workunit.client.0.smithi044.stdout: Attempting uninstall: pip 2023-12-03T11:28:06.763 INFO:tasks.workunit.client.0.smithi044.stdout: Found existing installation: pip 21.2.3 2023-12-03T11:28:06.932 INFO:tasks.workunit.client.0.smithi044.stdout: Uninstalling pip-21.2.3: 2023-12-03T11:28:06.938 INFO:tasks.workunit.client.0.smithi044.stdout: Successfully uninstalled pip-21.2.3 2023-12-03T11:28:07.963 INFO:tasks.workunit.client.0.smithi044.stdout:Successfully installed pip-23.3.1 2023-12-03T11:28:08.549 INFO:tasks.workunit.client.0.smithi044.stderr:+ pip install boto3 2023-12-03T11:28:09.444 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting boto3 2023-12-03T11:28:09.674 INFO:tasks.workunit.client.0.smithi044.stdout: Downloading boto3-1.33.6-py3-none-any.whl.metadata (6.7 kB) 2023-12-03T11:28:10.332 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting botocore<1.34.0,>=1.33.6 (from boto3) 2023-12-03T11:28:10.435 INFO:tasks.workunit.client.0.smithi044.stdout: Downloading botocore-1.33.6-py3-none-any.whl.metadata (6.1 kB) 2023-12-03T11:28:10.590 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2023-12-03T11:28:10.690 INFO:tasks.workunit.client.0.smithi044.stdout: Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2023-12-03T11:28:10.837 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting s3transfer<0.9.0,>=0.8.2 (from boto3) 2023-12-03T11:28:10.902 INFO:tasks.workunit.client.0.smithi044.stdout: Downloading s3transfer-0.8.2-py3-none-any.whl.metadata (1.8 kB) 2023-12-03T11:28:11.038 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:28:11.150 INFO:tasks.workunit.client.0.smithi044.stdout: Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) 2023-12-03T11:28:11.600 INFO:tasks.workunit.client.0.smithi044.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 kB 557.9 kB/s eta 0:00:00 2023-12-03T11:28:11.720 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:28:11.817 INFO:tasks.workunit.client.0.smithi044.stdout: Downloading urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2023-12-03T11:28:11.927 INFO:tasks.workunit.client.0.smithi044.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.9/48.9 kB 409.1 kB/s eta 0:00:00 2023-12-03T11:28:12.229 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:28:12.302 INFO:tasks.workunit.client.0.smithi044.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2023-12-03T11:28:12.477 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading boto3-1.33.6-py3-none-any.whl (139 kB) 2023-12-03T11:28:12.695 INFO:tasks.workunit.client.0.smithi044.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 139.3/139.3 kB 632.3 kB/s eta 0:00:00 2023-12-03T11:28:12.763 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading botocore-1.33.6-py3-none-any.whl (11.8 MB) 2023-12-03T11:28:17.055 INFO:tasks.workunit.client.0.smithi044.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.8/11.8 MB 3.4 MB/s eta 0:00:00 2023-12-03T11:28:17.153 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading s3transfer-0.8.2-py3-none-any.whl (82 kB) 2023-12-03T11:28:17.220 INFO:tasks.workunit.client.0.smithi044.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82.0/82.0 kB 1.1 MB/s eta 0:00:00 2023-12-03T11:28:17.316 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2023-12-03T11:28:17.388 INFO:tasks.workunit.client.0.smithi044.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.8/143.8 kB 1.9 MB/s eta 0:00:00 2023-12-03T11:28:17.497 INFO:tasks.workunit.client.0.smithi044.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2023-12-03T11:28:18.580 INFO:tasks.workunit.client.0.smithi044.stdout:Successfully installed boto3-1.33.6 botocore-1.33.6 jmespath-1.0.1 python-dateutil-2.8.2 s3transfer-0.8.2 six-1.16.0 urllib3-1.26.18 2023-12-03T11:28:18.706 INFO:tasks.workunit.client.0.smithi044.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2023-12-03T11:28:18.842 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2023-12-03T11:28:18.875 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:18.875 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:18.890 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.889+0000 7fe1cf137800 20 rados->read ofs=0 len=0 2023-12-03T11:28:18.892 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.891+0000 7fe1cf137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:18.892 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.891+0000 7fe1cf137800 20 realm 2023-12-03T11:28:18.893 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.891+0000 7fe1cf137800 20 rados->read ofs=0 len=0 2023-12-03T11:28:18.893 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.891+0000 7fe1cf137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:18.893 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.891+0000 7fe1cf137800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:18.893 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.891+0000 7fe1cf137800 20 rados->read ofs=0 len=0 2023-12-03T11:28:18.893 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.892+0000 7fe1cf137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:18.893 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.892+0000 7fe1cf137800 20 rados->read ofs=0 len=0 2023-12-03T11:28:18.893 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.892+0000 7fe1cf137800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:18.893 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.893+0000 7fe1cf137800 20 rados->read ofs=0 len=0 2023-12-03T11:28:18.894 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.893+0000 7fe1cf137800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:18.894 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.893+0000 7fe1cf137800 20 searching for the correct realm 2023-12-03T11:28:18.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.902+0000 7fe1caecd640 0 -- 172.21.15.44:0/2849632000 >> [v2:172.21.15.44:6800/4244511941,v1:172.21.15.44:6801/4244511941] conn(0x7fe1c005f7f0 msgr2=0x7fe1c005dde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:18.906 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.905+0000 7fe1cf137800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:18.906 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.905+0000 7fe1cf137800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:18.906 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.905+0000 7fe1cf137800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:18.907 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.905+0000 7fe1cf137800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:18.907 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.905+0000 7fe1cf137800 20 rados->read ofs=0 len=0 2023-12-03T11:28:18.907 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.906+0000 7fe1cf137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:18.907 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.906+0000 7fe1cf137800 20 rados->read ofs=0 len=0 2023-12-03T11:28:18.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.906+0000 7fe1cf137800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:18.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.906+0000 7fe1cf137800 20 rados->read ofs=0 len=0 2023-12-03T11:28:18.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.906+0000 7fe1cf137800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:18.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.906+0000 7fe1cf137800 20 zone default found 2023-12-03T11:28:18.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.906+0000 7fe1cf137800 4 Realm: () 2023-12-03T11:28:18.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.906+0000 7fe1cf137800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:18.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.906+0000 7fe1cf137800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:18.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.906+0000 7fe1cf137800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:18.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.906+0000 7fe1cf137800 20 zonegroup default 2023-12-03T11:28:18.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.906+0000 7fe1cf137800 20 rados->read ofs=0 len=0 2023-12-03T11:28:18.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.907+0000 7fe1cf137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:18.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.907+0000 7fe1cf137800 20 rados->read ofs=0 len=0 2023-12-03T11:28:18.909 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.907+0000 7fe1cf137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:18.909 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.907+0000 7fe1cf137800 20 rados->read ofs=0 len=0 2023-12-03T11:28:18.909 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.907+0000 7fe1cf137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:18.909 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.907+0000 7fe1cf137800 20 started sync module instance, tier type = 2023-12-03T11:28:18.909 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.907+0000 7fe1cf137800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:18.911 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.910+0000 7fe1cb6ce640 0 -- 172.21.15.44:0/2849632000 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7fe1c0056e70 msgr2=0x7fe1c008b0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:18.923 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.921+0000 7fe1cf137800 20 add_watcher() i=0 2023-12-03T11:28:18.923 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.921+0000 7fe1cf137800 20 add_watcher() i=1 2023-12-03T11:28:18.923 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.921+0000 7fe1cf137800 20 add_watcher() i=2 2023-12-03T11:28:18.923 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.921+0000 7fe1cf137800 20 add_watcher() i=3 2023-12-03T11:28:18.923 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.921+0000 7fe1cf137800 20 add_watcher() i=4 2023-12-03T11:28:18.923 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.921+0000 7fe1cf137800 20 add_watcher() i=5 2023-12-03T11:28:18.923 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.922+0000 7fe1cf137800 20 add_watcher() i=6 2023-12-03T11:28:18.923 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.922+0000 7fe1cf137800 20 add_watcher() i=7 2023-12-03T11:28:18.924 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.922+0000 7fe1cf137800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:18.925 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.924+0000 7fe10bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:18.925 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.925+0000 7fe1cf137800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:18.925 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.925+0000 7fe1cf137800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:18.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.931+0000 7fe1cf137800 5 note: GC not initialized 2023-12-03T11:28:18.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.931+0000 7fe102ffd640 20 reqs_thread_entry: start 2023-12-03T11:28:18.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.931+0000 7fe1cf137800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:18.933 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.931+0000 7fe1cf137800 20 Filter name: none 2023-12-03T11:28:18.933 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.931+0000 7fe100ff9640 20 reqs_thread_entry: start 2023-12-03T11:28:18.933 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.931+0000 7fe1cf137800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2023-12-03T11:28:18.933 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.931+0000 7fe1cf137800 20 rados->read ofs=0 len=0 2023-12-03T11:28:18.933 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.932+0000 7fe1cf137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:18.933 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.932+0000 7fe1cf137800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2023-12-03T11:28:18.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.932+0000 7fe1cf137800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2023-12-03T11:28:18.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.932+0000 7fe1cf137800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2023-12-03T11:28:18.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.932+0000 7fe1cf137800 20 rados->read ofs=0 len=0 2023-12-03T11:28:18.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.932+0000 7fe1cf137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:18.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.932+0000 7fe1cf137800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2023-12-03T11:28:18.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.932+0000 7fe1cf137800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2023-12-03T11:28:18.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.932+0000 7fe1cf137800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2023-12-03T11:28:18.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.932+0000 7fe1cf137800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2023-12-03T11:28:18.935 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.934+0000 7fe1cf137800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2023-12-03T11:28:18.935 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.934+0000 7fe1cf137800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2023-12-03T11:28:18.935 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.934+0000 7fe1cf137800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2023-12-03T11:28:18.935 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.934+0000 7fe1b17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 93890129102448 notifier 4662 bl.length()=559 2023-12-03T11:28:18.935 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.934+0000 7fe1b17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2023-12-03T11:28:18.936 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.934+0000 7fe1b17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2023-12-03T11:28:18.937 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.936+0000 7fe1cf137800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2023-12-03T11:28:18.937 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.936+0000 7fe1cf137800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2023-12-03T11:28:18.937 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.936+0000 7fe1cf137800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2023-12-03T11:28:18.937 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.936+0000 7fe1b17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 140607565705216 notifier 4662 bl.length()=186 2023-12-03T11:28:18.938 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.936+0000 7fe1b17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2023-12-03T11:28:18.938 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.936+0000 7fe1b17fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2023-12-03T11:28:18.938 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.938+0000 7fe10bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:18.941 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.940+0000 7fe1cf137800 20 remove_watcher() i=0 2023-12-03T11:28:18.941 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.940+0000 7fe1cf137800 2 removed watcher, disabling cache 2023-12-03T11:28:18.942 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.941+0000 7fe1cf137800 20 remove_watcher() i=1 2023-12-03T11:28:18.943 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.943+0000 7fe1cf137800 20 remove_watcher() i=2 2023-12-03T11:28:18.945 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.944+0000 7fe1cf137800 20 remove_watcher() i=3 2023-12-03T11:28:18.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.945+0000 7fe1cf137800 20 remove_watcher() i=4 2023-12-03T11:28:18.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.946+0000 7fe1cf137800 20 remove_watcher() i=5 2023-12-03T11:28:18.948 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.947+0000 7fe1cf137800 20 remove_watcher() i=6 2023-12-03T11:28:18.949 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:18.948+0000 7fe1cf137800 20 remove_watcher() i=7 2023-12-03T11:28:19.250 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: recalculated bucket check stats are correct 2023-12-03T11:28:19.250 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:28:19.251 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2023-12-03T11:28:19.281 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:19.282 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:19.295 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.294+0000 7fe57352d800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.297 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.296+0000 7fe57352d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:19.297 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.296+0000 7fe57352d800 20 realm 2023-12-03T11:28:19.297 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.296+0000 7fe57352d800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.297 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.296+0000 7fe57352d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:19.297 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.296+0000 7fe57352d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:19.297 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.296+0000 7fe57352d800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.297 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.296+0000 7fe57352d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:19.297 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.296+0000 7fe57352d800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.298 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.297+0000 7fe57352d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:19.298 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.297+0000 7fe57352d800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.299 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.298+0000 7fe57352d800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:19.299 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.298+0000 7fe57352d800 20 searching for the correct realm 2023-12-03T11:28:19.309 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.308+0000 7fe56f268640 0 -- 172.21.15.44:0/1439908638 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55c912cfded0 msgr2=0x55c912d002c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:19.310 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.309+0000 7fe57352d800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:19.310 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.309+0000 7fe57352d800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:19.311 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.309+0000 7fe57352d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:19.311 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.309+0000 7fe57352d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:19.311 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.309+0000 7fe57352d800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.311 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.309+0000 7fe57352d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:19.311 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.309+0000 7fe57352d800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.311 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.310+0000 7fe57352d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:19.311 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.310+0000 7fe57352d800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.313 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.310+0000 7fe57352d800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:19.313 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.310+0000 7fe57352d800 20 zone default found 2023-12-03T11:28:19.313 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.310+0000 7fe57352d800 4 Realm: () 2023-12-03T11:28:19.314 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.310+0000 7fe57352d800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:19.314 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.310+0000 7fe57352d800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:19.314 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.310+0000 7fe57352d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:19.314 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.310+0000 7fe57352d800 20 zonegroup default 2023-12-03T11:28:19.314 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.310+0000 7fe57352d800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.314 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.310+0000 7fe57352d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:19.314 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.310+0000 7fe57352d800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.314 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.310+0000 7fe57352d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:19.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.310+0000 7fe57352d800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.311+0000 7fe57352d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:19.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.311+0000 7fe57352d800 20 started sync module instance, tier type = 2023-12-03T11:28:19.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.311+0000 7fe57352d800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:19.325 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.324+0000 7fe56fa69640 0 -- 172.21.15.44:0/1439908638 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55c912d05ef0 msgr2=0x55c912d083b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:28:19.330 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.329+0000 7fe57352d800 20 add_watcher() i=0 2023-12-03T11:28:19.330 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.329+0000 7fe57352d800 20 add_watcher() i=1 2023-12-03T11:28:19.331 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.329+0000 7fe57352d800 20 add_watcher() i=2 2023-12-03T11:28:19.331 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.329+0000 7fe57352d800 20 add_watcher() i=3 2023-12-03T11:28:19.331 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.329+0000 7fe57352d800 20 add_watcher() i=4 2023-12-03T11:28:19.331 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.329+0000 7fe57352d800 20 add_watcher() i=5 2023-12-03T11:28:19.333 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.332+0000 7fe57352d800 20 add_watcher() i=6 2023-12-03T11:28:19.333 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.332+0000 7fe57352d800 20 add_watcher() i=7 2023-12-03T11:28:19.333 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.332+0000 7fe57352d800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:19.334 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.334+0000 7fe5357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:19.335 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.334+0000 7fe57352d800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:19.335 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.334+0000 7fe57352d800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:19.341 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.340+0000 7fe57352d800 5 note: GC not initialized 2023-12-03T11:28:19.342 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.340+0000 7fe4a3fff640 20 reqs_thread_entry: start 2023-12-03T11:28:19.342 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.340+0000 7fe57352d800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:19.342 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.340+0000 7fe57352d800 20 Filter name: none 2023-12-03T11:28:19.342 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.340+0000 7fe4a1ffb640 20 reqs_thread_entry: start 2023-12-03T11:28:19.342 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.340+0000 7fe57352d800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:28:19.342 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.340+0000 7fe57352d800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.341+0000 7fe57352d800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:19.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.341+0000 7fe57352d800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:28:19.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.341+0000 7fe57352d800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:28:19.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.341+0000 7fe57352d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 : miss 2023-12-03T11:28:19.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.341+0000 7fe57352d800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.342+0000 7fe57352d800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:19.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.342+0000 7fe57352d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 info.flags=0x17 2023-12-03T11:28:19.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.342+0000 7fe57352d800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 to cache LRU end 2023-12-03T11:28:19.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.342+0000 7fe57352d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:28:19.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.342+0000 7fe57352d800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:28:19.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.342+0000 7fe57352d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 2023-12-03T11:28:19.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.342+0000 7fe57352d800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:28:19.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.342+0000 7fe57352d800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:28:19.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.342+0000 7fe57352d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:28:19.345 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.342+0000 7fe57352d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:28:19.345 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.342+0000 7fe57352d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:28:19.345 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.342+0000 7fe57352d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:28:19.346 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.345+0000 7fe5357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:19.348 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.347+0000 7fe57352d800 20 remove_watcher() i=0 2023-12-03T11:28:19.348 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.347+0000 7fe57352d800 2 removed watcher, disabling cache 2023-12-03T11:28:19.350 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.349+0000 7fe57352d800 20 remove_watcher() i=1 2023-12-03T11:28:19.351 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.350+0000 7fe57352d800 20 remove_watcher() i=2 2023-12-03T11:28:19.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.352+0000 7fe57352d800 20 remove_watcher() i=3 2023-12-03T11:28:19.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.353+0000 7fe57352d800 20 remove_watcher() i=4 2023-12-03T11:28:19.355 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.354+0000 7fe57352d800 20 remove_watcher() i=5 2023-12-03T11:28:19.357 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.357+0000 7fe57352d800 20 remove_watcher() i=6 2023-12-03T11:28:19.358 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.358+0000 7fe57352d800 20 remove_watcher() i=7 2023-12-03T11:28:19.365 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket check-bucket 2023-12-03T11:28:19.392 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:19.392 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:19.406 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.405+0000 7f886af27800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.408 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.407+0000 7f886af27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:19.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.407+0000 7f886af27800 20 realm 2023-12-03T11:28:19.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.407+0000 7f886af27800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.407+0000 7f886af27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:19.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.408+0000 7f886af27800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:19.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.408+0000 7f886af27800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.408+0000 7f886af27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:19.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.408+0000 7f886af27800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.409+0000 7f886af27800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:19.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.409+0000 7f886af27800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.409+0000 7f886af27800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:19.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.409+0000 7f886af27800 20 searching for the correct realm 2023-12-03T11:28:19.420 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.419+0000 7f88663f3640 0 -- 172.21.15.44:0/2770268440 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x55f391f00a00 msgr2=0x55f391f02df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:19.421 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.420+0000 7f886af27800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:19.421 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.420+0000 7f886af27800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:19.421 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.420+0000 7f886af27800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:19.421 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.420+0000 7f886af27800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:19.421 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.420+0000 7f886af27800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.421 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.420+0000 7f886af27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:19.422 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.420+0000 7f886af27800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.422 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.420+0000 7f886af27800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:19.422 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.420+0000 7f886af27800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.421+0000 7f886af27800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:19.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.421+0000 7f886af27800 20 zone default found 2023-12-03T11:28:19.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.421+0000 7f886af27800 4 Realm: () 2023-12-03T11:28:19.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.421+0000 7f886af27800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:19.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.421+0000 7f886af27800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:19.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.421+0000 7f886af27800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:19.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.421+0000 7f886af27800 20 zonegroup default 2023-12-03T11:28:19.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.421+0000 7f886af27800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.421+0000 7f886af27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:19.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.421+0000 7f886af27800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.422+0000 7f886af27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:19.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.422+0000 7f886af27800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.422+0000 7f886af27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:19.424 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.422+0000 7f886af27800 20 started sync module instance, tier type = 2023-12-03T11:28:19.424 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.422+0000 7f886af27800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:19.432 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.431+0000 7f88673f5640 0 -- 172.21.15.44:0/2770268440 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55f391f052a0 msgr2=0x55f391f07730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:28:19.442 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.441+0000 7f886af27800 20 add_watcher() i=0 2023-12-03T11:28:19.442 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.441+0000 7f886af27800 20 add_watcher() i=1 2023-12-03T11:28:19.442 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.441+0000 7f886af27800 20 add_watcher() i=2 2023-12-03T11:28:19.442 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.441+0000 7f886af27800 20 add_watcher() i=3 2023-12-03T11:28:19.442 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.441+0000 7f886af27800 20 add_watcher() i=4 2023-12-03T11:28:19.442 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.441+0000 7f886af27800 20 add_watcher() i=5 2023-12-03T11:28:19.442 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.441+0000 7f886af27800 20 add_watcher() i=6 2023-12-03T11:28:19.444 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.443+0000 7f886af27800 20 add_watcher() i=7 2023-12-03T11:28:19.444 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.443+0000 7f886af27800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:19.446 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.445+0000 7f87a7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:19.446 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.445+0000 7f886af27800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:19.446 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.445+0000 7f886af27800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:19.453 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.451+0000 7f886af27800 5 note: GC not initialized 2023-12-03T11:28:19.453 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.451+0000 7f8796ffd640 20 reqs_thread_entry: start 2023-12-03T11:28:19.453 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.451+0000 7f886af27800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:19.453 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.451+0000 7f886af27800 20 Filter name: none 2023-12-03T11:28:19.453 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.452+0000 7f8794ff9640 20 reqs_thread_entry: start 2023-12-03T11:28:19.453 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.452+0000 7f886af27800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.453 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.452+0000 7f886af27800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:19.453 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.452+0000 7f886af27800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.454 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.453+0000 7f886af27800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:19.454 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.453+0000 7f886af27800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:28:19.454 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.453+0000 7f886af27800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.454 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.453+0000 7f886af27800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:19.454 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.453+0000 7f886af27800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.454 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.453+0000 7f886af27800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:19.454 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.453+0000 7f886af27800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:28:19.455 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.454+0000 7f886af27800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.455 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.454+0000 7f886af27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:19.455 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.455+0000 7f87a7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:19.458 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.457+0000 7f886af27800 20 remove_watcher() i=0 2023-12-03T11:28:19.458 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.457+0000 7f886af27800 2 removed watcher, disabling cache 2023-12-03T11:28:19.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.458+0000 7f886af27800 20 remove_watcher() i=1 2023-12-03T11:28:19.460 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.459+0000 7f886af27800 20 remove_watcher() i=2 2023-12-03T11:28:19.461 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.460+0000 7f886af27800 20 remove_watcher() i=3 2023-12-03T11:28:19.462 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.461+0000 7f886af27800 20 remove_watcher() i=4 2023-12-03T11:28:19.463 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.462+0000 7f886af27800 20 remove_watcher() i=5 2023-12-03T11:28:19.464 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.463+0000 7f886af27800 20 remove_watcher() i=6 2023-12-03T11:28:19.465 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.464+0000 7f886af27800 20 remove_watcher() i=7 2023-12-03T11:28:19.470 INFO:tasks.workunit.client.0.smithi044.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 85, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2023-12-03T11:28:19.470 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: bucket check unlinked does not report normal entries 2023-12-03T11:28:19.471 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:28:19.471 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2023-12-03T11:28:19.503 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:19.504 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:19.518 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.517+0000 7f4cf1940800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.520 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.518+0000 7f4cf1940800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:19.521 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.518+0000 7f4cf1940800 20 realm 2023-12-03T11:28:19.521 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.518+0000 7f4cf1940800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.521 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.519+0000 7f4cf1940800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:19.521 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.519+0000 7f4cf1940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:19.521 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.519+0000 7f4cf1940800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.521 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.519+0000 7f4cf1940800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:19.521 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.519+0000 7f4cf1940800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.523 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.520+0000 7f4cf1940800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:19.523 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.520+0000 7f4cf1940800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.523 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.521+0000 7f4cf1940800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:19.523 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.521+0000 7f4cf1940800 20 searching for the correct realm 2023-12-03T11:28:19.531 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.530+0000 7f4cede46640 0 -- 172.21.15.44:0/2817817028 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55cfde140ac0 msgr2=0x55cfde142f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:28:19.534 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.531+0000 7f4cf1940800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:19.535 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.531+0000 7f4cf1940800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:19.535 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.531+0000 7f4cf1940800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:19.535 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.531+0000 7f4cf1940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:19.535 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.531+0000 7f4cf1940800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.535 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.531+0000 7f4cf1940800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:19.535 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.531+0000 7f4cf1940800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.536 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.531+0000 7f4cf1940800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:19.536 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.531+0000 7f4cf1940800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.536 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.532+0000 7f4cf1940800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:19.536 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.532+0000 7f4cf1940800 20 zone default found 2023-12-03T11:28:19.536 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.532+0000 7f4cf1940800 4 Realm: () 2023-12-03T11:28:19.536 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.532+0000 7f4cf1940800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:19.536 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.532+0000 7f4cf1940800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:19.537 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.532+0000 7f4cf1940800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:19.537 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.532+0000 7f4cf1940800 20 zonegroup default 2023-12-03T11:28:19.537 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.532+0000 7f4cf1940800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.537 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.532+0000 7f4cf1940800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:19.537 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.532+0000 7f4cf1940800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.537 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.532+0000 7f4cf1940800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:19.537 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.532+0000 7f4cf1940800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.537 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.533+0000 7f4cf1940800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:19.538 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.533+0000 7f4cf1940800 20 started sync module instance, tier type = 2023-12-03T11:28:19.538 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.533+0000 7f4cf1940800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:19.542 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.541+0000 7f4cede46640 0 -- 172.21.15.44:0/2817817028 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f4cd805f3a0 msgr2=0x7f4cd8058860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:19.544 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.542+0000 7f4cf1940800 20 add_watcher() i=0 2023-12-03T11:28:19.544 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.542+0000 7f4cf1940800 20 add_watcher() i=1 2023-12-03T11:28:19.544 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.542+0000 7f4cf1940800 20 add_watcher() i=2 2023-12-03T11:28:19.544 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.542+0000 7f4cf1940800 20 add_watcher() i=3 2023-12-03T11:28:19.544 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.542+0000 7f4cf1940800 20 add_watcher() i=4 2023-12-03T11:28:19.544 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.542+0000 7f4cf1940800 20 add_watcher() i=5 2023-12-03T11:28:19.545 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.542+0000 7f4cf1940800 20 add_watcher() i=6 2023-12-03T11:28:19.545 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.544+0000 7f4cf1940800 20 add_watcher() i=7 2023-12-03T11:28:19.545 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.544+0000 7f4cf1940800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:19.546 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.545+0000 7f4cb2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:19.546 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.546+0000 7f4cf1940800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:19.547 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.546+0000 7f4cf1940800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:19.553 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.552+0000 7f4cf1940800 5 note: GC not initialized 2023-12-03T11:28:19.553 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.552+0000 7f4c21ffb640 20 reqs_thread_entry: start 2023-12-03T11:28:19.554 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.552+0000 7f4cf1940800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:19.554 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.552+0000 7f4cf1940800 20 Filter name: none 2023-12-03T11:28:19.554 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.552+0000 7f4c137fe640 20 reqs_thread_entry: start 2023-12-03T11:28:19.554 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.552+0000 7f4cf1940800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:28:19.554 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.552+0000 7f4cf1940800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.556 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.553+0000 7f4cf1940800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:19.556 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.553+0000 7f4cf1940800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:28:19.556 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.553+0000 7f4cf1940800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:28:19.556 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.553+0000 7f4cf1940800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 : miss 2023-12-03T11:28:19.556 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.553+0000 7f4cf1940800 20 rados->read ofs=0 len=0 2023-12-03T11:28:19.556 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.553+0000 7f4cf1940800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:19.556 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.553+0000 7f4cf1940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 info.flags=0x17 2023-12-03T11:28:19.556 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.553+0000 7f4cf1940800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 to cache LRU end 2023-12-03T11:28:19.556 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.553+0000 7f4cf1940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:28:19.556 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.553+0000 7f4cf1940800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:28:19.556 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.553+0000 7f4cf1940800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 2023-12-03T11:28:19.556 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.553+0000 7f4cf1940800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:19.557 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.554+0000 7f4cf1940800 1 NOTICE: finished shard 0 (0 entries found) 2023-12-03T11:28:19.557 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.554+0000 7f4cf1940800 1 NOTICE: finished all shards (0 entries found) 2023-12-03T11:28:19.557 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.555+0000 7f4cb2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:19.558 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.557+0000 7f4cf1940800 20 remove_watcher() i=0 2023-12-03T11:28:19.558 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.557+0000 7f4cf1940800 2 removed watcher, disabling cache 2023-12-03T11:28:19.559 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.558+0000 7f4cf1940800 20 remove_watcher() i=1 2023-12-03T11:28:19.560 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.559+0000 7f4cf1940800 20 remove_watcher() i=2 2023-12-03T11:28:19.561 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.560+0000 7f4cf1940800 20 remove_watcher() i=3 2023-12-03T11:28:19.562 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.561+0000 7f4cf1940800 20 remove_watcher() i=4 2023-12-03T11:28:19.563 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.562+0000 7f4cf1940800 20 remove_watcher() i=5 2023-12-03T11:28:19.564 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.563+0000 7f4cf1940800 20 remove_watcher() i=6 2023-12-03T11:28:19.565 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:19.564+0000 7f4cf1940800 20 remove_watcher() i=7 2023-12-03T11:28:19.571 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2023-12-03T11:28:19.962 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2023-12-03T11:28:21.410 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:28:21.412 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object c 2023-12-03T11:28:21.446 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:21.446 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:21.463 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.462+0000 7f2af4725800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.464+0000 7f2af4725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.464+0000 7f2af4725800 20 realm 2023-12-03T11:28:21.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.464+0000 7f2af4725800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.465+0000 7f2af4725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.465+0000 7f2af4725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:21.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.465+0000 7f2af4725800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.465+0000 7f2af4725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.465+0000 7f2af4725800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.467 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.466+0000 7f2af4725800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:21.467 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.466+0000 7f2af4725800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.468 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.467+0000 7f2af4725800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:21.468 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.467+0000 7f2af4725800 20 searching for the correct realm 2023-12-03T11:28:21.479 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.478+0000 7f2af04b8640 0 -- 172.21.15.44:0/3657041839 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x561c72665d40 msgr2=0x561c72668130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:28:21.481 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.480+0000 7f2af4725800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:21.481 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.480+0000 7f2af4725800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:21.481 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.480+0000 7f2af4725800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:21.481 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.480+0000 7f2af4725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:21.481 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.480+0000 7f2af4725800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.482 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.480+0000 7f2af4725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.482 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.480+0000 7f2af4725800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.481+0000 7f2af4725800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:21.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.481+0000 7f2af4725800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.481+0000 7f2af4725800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:21.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.481+0000 7f2af4725800 20 zone default found 2023-12-03T11:28:21.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.481+0000 7f2af4725800 4 Realm: () 2023-12-03T11:28:21.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.481+0000 7f2af4725800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:21.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.481+0000 7f2af4725800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:21.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.481+0000 7f2af4725800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:21.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.481+0000 7f2af4725800 20 zonegroup default 2023-12-03T11:28:21.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.481+0000 7f2af4725800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.481+0000 7f2af4725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.484 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.481+0000 7f2af4725800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.484 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.482+0000 7f2af4725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.484 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.482+0000 7f2af4725800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.484 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.482+0000 7f2af4725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.484 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.482+0000 7f2af4725800 20 started sync module instance, tier type = 2023-12-03T11:28:21.484 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.482+0000 7f2af4725800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:21.491 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.490+0000 7f2af0cb9640 0 -- 172.21.15.44:0/3657041839 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f2ae4070160 msgr2=0x7f2ae406c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:21.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.495+0000 7f2af4725800 20 add_watcher() i=0 2023-12-03T11:28:21.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.495+0000 7f2af4725800 20 add_watcher() i=1 2023-12-03T11:28:21.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.495+0000 7f2af4725800 20 add_watcher() i=2 2023-12-03T11:28:21.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.495+0000 7f2af4725800 20 add_watcher() i=3 2023-12-03T11:28:21.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.495+0000 7f2af4725800 20 add_watcher() i=4 2023-12-03T11:28:21.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.495+0000 7f2af4725800 20 add_watcher() i=5 2023-12-03T11:28:21.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.495+0000 7f2af4725800 20 add_watcher() i=6 2023-12-03T11:28:21.499 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.498+0000 7f2af4725800 20 add_watcher() i=7 2023-12-03T11:28:21.499 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.498+0000 7f2af4725800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:21.501 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.500+0000 7f2ab67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:21.501 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.501+0000 7f2af4725800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:21.501 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.501+0000 7f2af4725800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:21.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.507+0000 7f2af4725800 5 note: GC not initialized 2023-12-03T11:28:21.509 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.507+0000 7f2a257fa640 20 reqs_thread_entry: start 2023-12-03T11:28:21.509 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.507+0000 7f2af4725800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:21.509 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.508+0000 7f2af4725800 20 Filter name: none 2023-12-03T11:28:21.509 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.508+0000 7f2a1effd640 20 reqs_thread_entry: start 2023-12-03T11:28:21.509 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.508+0000 7f2af4725800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.509 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.508+0000 7f2af4725800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:21.509 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.508+0000 7f2af4725800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.510 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.509+0000 7f2af4725800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:21.510 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.509+0000 7f2af4725800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:28:21.510 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.509+0000 7f2af4725800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:28:21.510 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.509+0000 7f2af4725800 20 INFO: main: starting shard=0 2023-12-03T11:28:21.510 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.509+0000 7f2af4725800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:21.511 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.509+0000 7f2af4725800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2023-12-03T11:28:21.511 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.510+0000 7f2af4725800 20 INFO: main: done 2023-12-03T11:28:21.511 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.510+0000 7f2ab67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:21.514 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.513+0000 7f2af4725800 20 remove_watcher() i=0 2023-12-03T11:28:21.514 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.513+0000 7f2af4725800 2 removed watcher, disabling cache 2023-12-03T11:28:21.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.514+0000 7f2af4725800 20 remove_watcher() i=1 2023-12-03T11:28:21.518 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.517+0000 7f2af4725800 20 remove_watcher() i=2 2023-12-03T11:28:21.520 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.519+0000 7f2af4725800 20 remove_watcher() i=3 2023-12-03T11:28:21.521 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.520+0000 7f2af4725800 20 remove_watcher() i=4 2023-12-03T11:28:21.522 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.521+0000 7f2af4725800 20 remove_watcher() i=5 2023-12-03T11:28:21.523 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.523+0000 7f2af4725800 20 remove_watcher() i=6 2023-12-03T11:28:21.525 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.524+0000 7f2af4725800 20 remove_watcher() i=7 2023-12-03T11:28:21.591 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:28:21.592 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object d 2023-12-03T11:28:21.623 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:21.624 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:21.638 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.637+0000 7f5884f33800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.639+0000 7f5884f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.639+0000 7f5884f33800 20 realm 2023-12-03T11:28:21.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.639+0000 7f5884f33800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.639+0000 7f5884f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.639+0000 7f5884f33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:21.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.639+0000 7f5884f33800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.639+0000 7f5884f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.639+0000 7f5884f33800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.640+0000 7f5884f33800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:21.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.640+0000 7f5884f33800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.641+0000 7f5884f33800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:21.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.641+0000 7f5884f33800 20 searching for the correct realm 2023-12-03T11:28:21.652 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.651+0000 7f5880bfb640 0 -- 172.21.15.44:0/1006305366 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x556b2e9f0130 msgr2=0x556b2e9f2520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:21.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.652+0000 7f5884f33800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:21.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.652+0000 7f5884f33800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:21.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.652+0000 7f5884f33800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:21.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.652+0000 7f5884f33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:21.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.652+0000 7f5884f33800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.653+0000 7f5884f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.653+0000 7f5884f33800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.655 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.653+0000 7f5884f33800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:21.655 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.653+0000 7f5884f33800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.655 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.653+0000 7f5884f33800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:21.655 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.653+0000 7f5884f33800 20 zone default found 2023-12-03T11:28:21.655 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.653+0000 7f5884f33800 4 Realm: () 2023-12-03T11:28:21.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.653+0000 7f5884f33800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:21.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.653+0000 7f5884f33800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:21.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.653+0000 7f5884f33800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:21.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.653+0000 7f5884f33800 20 zonegroup default 2023-12-03T11:28:21.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.653+0000 7f5884f33800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.653+0000 7f5884f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.654+0000 7f5884f33800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.654+0000 7f5884f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.654+0000 7f5884f33800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.654+0000 7f5884f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.654+0000 7f5884f33800 20 started sync module instance, tier type = 2023-12-03T11:28:21.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.654+0000 7f5884f33800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:21.661 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.661+0000 7f58803fa640 0 -- 172.21.15.44:0/1006305366 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x556b2e9f38c0 msgr2=0x556b2e9f5cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:21.668 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.667+0000 7f5884f33800 20 add_watcher() i=0 2023-12-03T11:28:21.668 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.667+0000 7f5884f33800 20 add_watcher() i=1 2023-12-03T11:28:21.668 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.667+0000 7f5884f33800 20 add_watcher() i=2 2023-12-03T11:28:21.668 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.667+0000 7f5884f33800 20 add_watcher() i=3 2023-12-03T11:28:21.668 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.667+0000 7f5884f33800 20 add_watcher() i=4 2023-12-03T11:28:21.668 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.667+0000 7f5884f33800 20 add_watcher() i=5 2023-12-03T11:28:21.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.667+0000 7f5884f33800 20 add_watcher() i=6 2023-12-03T11:28:21.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.668+0000 7f5884f33800 20 add_watcher() i=7 2023-12-03T11:28:21.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.668+0000 7f5884f33800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:21.671 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.670+0000 7f5846fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:21.671 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.670+0000 7f5884f33800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:21.671 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.670+0000 7f5884f33800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:21.677 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.676+0000 7f5884f33800 5 note: GC not initialized 2023-12-03T11:28:21.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.676+0000 7f57b5ffb640 20 reqs_thread_entry: start 2023-12-03T11:28:21.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.676+0000 7f5884f33800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:21.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.677+0000 7f5884f33800 20 Filter name: none 2023-12-03T11:28:21.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.677+0000 7f57a77fe640 20 reqs_thread_entry: start 2023-12-03T11:28:21.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.677+0000 7f5884f33800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.679 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.677+0000 7f5884f33800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:21.679 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.677+0000 7f5884f33800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.679 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.678+0000 7f5884f33800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:21.679 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.678+0000 7f5884f33800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:28:21.679 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.678+0000 7f5884f33800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:28:21.679 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.678+0000 7f5884f33800 20 INFO: main: starting shard=0 2023-12-03T11:28:21.679 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.678+0000 7f5884f33800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:21.679 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.678+0000 7f5884f33800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2023-12-03T11:28:21.680 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.678+0000 7f5884f33800 20 INFO: main: done 2023-12-03T11:28:21.680 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.679+0000 7f5846fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:21.682 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.682+0000 7f5884f33800 20 remove_watcher() i=0 2023-12-03T11:28:21.683 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.682+0000 7f5884f33800 2 removed watcher, disabling cache 2023-12-03T11:28:21.683 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.683+0000 7f5884f33800 20 remove_watcher() i=1 2023-12-03T11:28:21.685 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.684+0000 7f5884f33800 20 remove_watcher() i=2 2023-12-03T11:28:21.686 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.685+0000 7f5884f33800 20 remove_watcher() i=3 2023-12-03T11:28:21.687 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.686+0000 7f5884f33800 20 remove_watcher() i=4 2023-12-03T11:28:21.688 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.687+0000 7f5884f33800 20 remove_watcher() i=5 2023-12-03T11:28:21.689 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.688+0000 7f5884f33800 20 remove_watcher() i=6 2023-12-03T11:28:21.690 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.689+0000 7f5884f33800 20 remove_watcher() i=7 2023-12-03T11:28:21.772 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:28:21.773 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object e 2023-12-03T11:28:21.804 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:21.804 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:21.818 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.817+0000 7f78e8d37800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.820 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.819+0000 7f78e8d37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.820 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.819+0000 7f78e8d37800 20 realm 2023-12-03T11:28:21.820 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.819+0000 7f78e8d37800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.820 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.819+0000 7f78e8d37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.821 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.819+0000 7f78e8d37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:21.821 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.819+0000 7f78e8d37800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.821 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.819+0000 7f78e8d37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.821 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.819+0000 7f78e8d37800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.821 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.820+0000 7f78e8d37800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:21.821 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.820+0000 7f78e8d37800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.822 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.821+0000 7f78e8d37800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:21.822 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.821+0000 7f78e8d37800 20 searching for the correct realm 2023-12-03T11:28:21.832 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.831+0000 7f78e5270640 0 -- 172.21.15.44:0/1456745655 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x5650435c39a0 msgr2=0x5650435c5e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:21.833 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.832+0000 7f78e8d37800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:21.833 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.832+0000 7f78e8d37800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:21.833 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.832+0000 7f78e8d37800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:21.833 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.832+0000 7f78e8d37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:21.833 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.832+0000 7f78e8d37800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.834 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.832+0000 7f78e8d37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.834 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.832+0000 7f78e8d37800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.833+0000 7f78e8d37800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:21.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.833+0000 7f78e8d37800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.833+0000 7f78e8d37800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:21.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.833+0000 7f78e8d37800 20 zone default found 2023-12-03T11:28:21.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.833+0000 7f78e8d37800 4 Realm: () 2023-12-03T11:28:21.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.833+0000 7f78e8d37800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:21.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.833+0000 7f78e8d37800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:21.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.833+0000 7f78e8d37800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:21.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.833+0000 7f78e8d37800 20 zonegroup default 2023-12-03T11:28:21.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.833+0000 7f78e8d37800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.833+0000 7f78e8d37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.833+0000 7f78e8d37800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.834+0000 7f78e8d37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.834+0000 7f78e8d37800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.834+0000 7f78e8d37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.834+0000 7f78e8d37800 20 started sync module instance, tier type = 2023-12-03T11:28:21.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.834+0000 7f78e8d37800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:21.846 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.846+0000 7f78e5270640 0 -- 172.21.15.44:0/1456745655 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f78cc05b1e0 msgr2=0x7f78cc07a2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:21.851 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.850+0000 7f78e8d37800 20 add_watcher() i=0 2023-12-03T11:28:21.851 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.850+0000 7f78e8d37800 20 add_watcher() i=1 2023-12-03T11:28:21.851 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.850+0000 7f78e8d37800 20 add_watcher() i=2 2023-12-03T11:28:21.851 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.850+0000 7f78e8d37800 20 add_watcher() i=3 2023-12-03T11:28:21.851 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.850+0000 7f78e8d37800 20 add_watcher() i=4 2023-12-03T11:28:21.852 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.850+0000 7f78e8d37800 20 add_watcher() i=5 2023-12-03T11:28:21.852 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.850+0000 7f78e8d37800 20 add_watcher() i=6 2023-12-03T11:28:21.856 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.855+0000 7f78e8d37800 20 add_watcher() i=7 2023-12-03T11:28:21.856 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.855+0000 7f78e8d37800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:21.858 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.857+0000 7f78ab7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:21.859 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.858+0000 7f78e8d37800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:21.859 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.858+0000 7f78e8d37800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:21.864 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.863+0000 7f78e8d37800 5 note: GC not initialized 2023-12-03T11:28:21.865 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.864+0000 7f781a7fc640 20 reqs_thread_entry: start 2023-12-03T11:28:21.865 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.864+0000 7f78e8d37800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:21.865 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.864+0000 7f78e8d37800 20 Filter name: none 2023-12-03T11:28:21.866 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.864+0000 7f780bfff640 20 reqs_thread_entry: start 2023-12-03T11:28:21.866 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.864+0000 7f78e8d37800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.866 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.864+0000 7f78e8d37800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:21.866 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.864+0000 7f78e8d37800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.865+0000 7f78e8d37800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:21.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.865+0000 7f78e8d37800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:28:21.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.865+0000 7f78e8d37800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:28:21.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.865+0000 7f78e8d37800 20 INFO: main: starting shard=0 2023-12-03T11:28:21.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.865+0000 7f78e8d37800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:21.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.865+0000 7f78e8d37800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:28:21.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.866+0000 7f78e8d37800 20 INFO: main: done 2023-12-03T11:28:21.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.866+0000 7f78ab7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:21.869 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.869+0000 7f78e8d37800 20 remove_watcher() i=0 2023-12-03T11:28:21.869 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.869+0000 7f78e8d37800 2 removed watcher, disabling cache 2023-12-03T11:28:21.871 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.870+0000 7f78e8d37800 20 remove_watcher() i=1 2023-12-03T11:28:21.873 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.873+0000 7f78e8d37800 20 remove_watcher() i=2 2023-12-03T11:28:21.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.875+0000 7f78e8d37800 20 remove_watcher() i=3 2023-12-03T11:28:21.876 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.876+0000 7f78e8d37800 20 remove_watcher() i=4 2023-12-03T11:28:21.877 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.877+0000 7f78e8d37800 20 remove_watcher() i=5 2023-12-03T11:28:21.879 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.878+0000 7f78e8d37800 20 remove_watcher() i=6 2023-12-03T11:28:21.880 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.879+0000 7f78e8d37800 20 remove_watcher() i=7 2023-12-03T11:28:21.942 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:28:21.943 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object f 2023-12-03T11:28:21.973 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:21.973 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:21.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.987+0000 7f2d79146800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.989 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.988+0000 7f2d79146800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.988+0000 7f2d79146800 20 realm 2023-12-03T11:28:21.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.988+0000 7f2d79146800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.988+0000 7f2d79146800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.988+0000 7f2d79146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:21.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.988+0000 7f2d79146800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.989+0000 7f2d79146800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:21.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.989+0000 7f2d79146800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.989+0000 7f2d79146800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:21.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.989+0000 7f2d79146800 20 rados->read ofs=0 len=0 2023-12-03T11:28:21.991 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.990+0000 7f2d79146800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:21.991 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:21.990+0000 7f2d79146800 20 searching for the correct realm 2023-12-03T11:28:22.001 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.000+0000 7f2d74f0a640 0 -- 172.21.15.44:0/421451075 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x5571fc173e70 msgr2=0x5571fc176260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:22.002 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.001+0000 7f2d79146800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:22.002 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.001+0000 7f2d79146800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:22.002 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.001+0000 7f2d79146800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:22.003 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.001+0000 7f2d79146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:22.003 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.001+0000 7f2d79146800 20 rados->read ofs=0 len=0 2023-12-03T11:28:22.003 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.002+0000 7f2d79146800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:22.003 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.002+0000 7f2d79146800 20 rados->read ofs=0 len=0 2023-12-03T11:28:22.004 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.002+0000 7f2d79146800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:22.004 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.002+0000 7f2d79146800 20 rados->read ofs=0 len=0 2023-12-03T11:28:22.004 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.002+0000 7f2d79146800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:22.004 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.002+0000 7f2d79146800 20 zone default found 2023-12-03T11:28:22.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.002+0000 7f2d79146800 4 Realm: () 2023-12-03T11:28:22.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.002+0000 7f2d79146800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:22.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.002+0000 7f2d79146800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:22.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.002+0000 7f2d79146800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:22.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.002+0000 7f2d79146800 20 zonegroup default 2023-12-03T11:28:22.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.002+0000 7f2d79146800 20 rados->read ofs=0 len=0 2023-12-03T11:28:22.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.002+0000 7f2d79146800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:22.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.002+0000 7f2d79146800 20 rados->read ofs=0 len=0 2023-12-03T11:28:22.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.003+0000 7f2d79146800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:22.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.003+0000 7f2d79146800 20 rados->read ofs=0 len=0 2023-12-03T11:28:22.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.003+0000 7f2d79146800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:22.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.003+0000 7f2d79146800 20 started sync module instance, tier type = 2023-12-03T11:28:22.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.003+0000 7f2d79146800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:22.013 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.012+0000 7f2d7570b640 0 -- 172.21.15.44:0/421451075 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f2d6802d120 msgr2=0x7f2d68086230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:22.021 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.020+0000 7f2d79146800 20 add_watcher() i=0 2023-12-03T11:28:22.021 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.020+0000 7f2d79146800 20 add_watcher() i=1 2023-12-03T11:28:22.021 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.020+0000 7f2d79146800 20 add_watcher() i=2 2023-12-03T11:28:22.021 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.020+0000 7f2d79146800 20 add_watcher() i=3 2023-12-03T11:28:22.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.020+0000 7f2d79146800 20 add_watcher() i=4 2023-12-03T11:28:22.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.020+0000 7f2d79146800 20 add_watcher() i=5 2023-12-03T11:28:22.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.020+0000 7f2d79146800 20 add_watcher() i=6 2023-12-03T11:28:22.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.021+0000 7f2d79146800 20 add_watcher() i=7 2023-12-03T11:28:22.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.021+0000 7f2d79146800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:22.024 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.023+0000 7f2d3afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:22.024 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.023+0000 7f2d79146800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:22.024 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.023+0000 7f2d79146800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:22.031 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.029+0000 7f2d79146800 5 note: GC not initialized 2023-12-03T11:28:22.031 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.029+0000 7f2ca9ffb640 20 reqs_thread_entry: start 2023-12-03T11:28:22.031 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.030+0000 7f2d79146800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:22.031 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.030+0000 7f2d79146800 20 Filter name: none 2023-12-03T11:28:22.031 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.030+0000 7f2c9b7fe640 20 reqs_thread_entry: start 2023-12-03T11:28:22.031 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.030+0000 7f2d79146800 20 rados->read ofs=0 len=0 2023-12-03T11:28:22.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.030+0000 7f2d79146800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:22.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.030+0000 7f2d79146800 20 rados->read ofs=0 len=0 2023-12-03T11:28:22.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.031+0000 7f2d79146800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:22.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.031+0000 7f2d79146800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:28:22.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.031+0000 7f2d79146800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:28:22.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.031+0000 7f2d79146800 20 INFO: main: starting shard=0 2023-12-03T11:28:22.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.031+0000 7f2d79146800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:22.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.032+0000 7f2d79146800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:28:22.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.032+0000 7f2d79146800 20 INFO: main: done 2023-12-03T11:28:22.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.033+0000 7f2d3afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:22.036 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.035+0000 7f2d79146800 20 remove_watcher() i=0 2023-12-03T11:28:22.036 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.035+0000 7f2d79146800 2 removed watcher, disabling cache 2023-12-03T11:28:22.037 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.037+0000 7f2d79146800 20 remove_watcher() i=1 2023-12-03T11:28:22.039 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.038+0000 7f2d79146800 20 remove_watcher() i=2 2023-12-03T11:28:22.040 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.039+0000 7f2d79146800 20 remove_watcher() i=3 2023-12-03T11:28:22.041 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.040+0000 7f2d79146800 20 remove_watcher() i=4 2023-12-03T11:28:22.042 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.041+0000 7f2d79146800 20 remove_watcher() i=5 2023-12-03T11:28:22.043 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.043+0000 7f2d79146800 20 remove_watcher() i=6 2023-12-03T11:28:22.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.044+0000 7f2d79146800 20 remove_watcher() i=7 2023-12-03T11:28:22.056 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2023-12-03T11:28:22.450 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2023-12-03T11:28:22.837 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: bucket check unlinked finds unlistable entries 2023-12-03T11:28:22.837 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:28:22.838 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2023-12-03T11:28:22.870 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:22.871 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:22.885 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.884+0000 7f3fd972a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:22.887 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.886+0000 7f3fd972a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:22.887 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.886+0000 7f3fd972a800 20 realm 2023-12-03T11:28:22.887 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.886+0000 7f3fd972a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:22.887 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.886+0000 7f3fd972a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:22.887 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.886+0000 7f3fd972a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:22.887 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.886+0000 7f3fd972a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:22.887 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.886+0000 7f3fd972a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:22.888 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.886+0000 7f3fd972a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:22.888 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.887+0000 7f3fd972a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:22.888 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.887+0000 7f3fd972a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:22.889 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.888+0000 7f3fd972a800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:22.889 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.888+0000 7f3fd972a800 20 searching for the correct realm 2023-12-03T11:28:22.900 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.899+0000 7f3fd5465640 0 -- 172.21.15.44:0/2534772368 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x5575356fbbd0 msgr2=0x5575356fdfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:22.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.901+0000 7f3fd972a800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:22.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.901+0000 7f3fd972a800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:22.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.901+0000 7f3fd972a800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:22.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.901+0000 7f3fd972a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:22.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.901+0000 7f3fd972a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:22.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.901+0000 7f3fd972a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:22.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.901+0000 7f3fd972a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:22.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.901+0000 7f3fd972a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:22.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.901+0000 7f3fd972a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:22.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.901+0000 7f3fd972a800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:22.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.901+0000 7f3fd972a800 20 zone default found 2023-12-03T11:28:22.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.901+0000 7f3fd972a800 4 Realm: () 2023-12-03T11:28:22.904 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.901+0000 7f3fd972a800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:22.904 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.901+0000 7f3fd972a800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:22.904 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.901+0000 7f3fd972a800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:22.904 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.901+0000 7f3fd972a800 20 zonegroup default 2023-12-03T11:28:22.904 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.901+0000 7f3fd972a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:22.904 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.902+0000 7f3fd972a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:22.904 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.902+0000 7f3fd972a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:22.904 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.902+0000 7f3fd972a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:22.904 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.902+0000 7f3fd972a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:22.905 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.902+0000 7f3fd972a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:22.905 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.902+0000 7f3fd972a800 20 started sync module instance, tier type = 2023-12-03T11:28:22.905 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.902+0000 7f3fd972a800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:22.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.914+0000 7f3fd4c64640 0 -- 172.21.15.44:0/2534772368 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x5575356ff210 msgr2=0x557535701600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:22.920 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.919+0000 7f3fd972a800 20 add_watcher() i=0 2023-12-03T11:28:22.920 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.919+0000 7f3fd972a800 20 add_watcher() i=1 2023-12-03T11:28:22.920 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.919+0000 7f3fd972a800 20 add_watcher() i=2 2023-12-03T11:28:22.920 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.919+0000 7f3fd972a800 20 add_watcher() i=3 2023-12-03T11:28:22.920 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.919+0000 7f3fd972a800 20 add_watcher() i=4 2023-12-03T11:28:22.920 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.919+0000 7f3fd972a800 20 add_watcher() i=5 2023-12-03T11:28:22.920 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.919+0000 7f3fd972a800 20 add_watcher() i=6 2023-12-03T11:28:22.921 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.920+0000 7f3fd972a800 20 add_watcher() i=7 2023-12-03T11:28:22.921 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.920+0000 7f3fd972a800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:22.922 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.921+0000 7f3f9afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:22.923 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.922+0000 7f3fd972a800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:22.923 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.922+0000 7f3fd972a800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:22.929 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.928+0000 7f3fd972a800 5 note: GC not initialized 2023-12-03T11:28:22.929 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.928+0000 7f3f09ffb640 20 reqs_thread_entry: start 2023-12-03T11:28:22.929 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.928+0000 7f3fd972a800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:22.929 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.928+0000 7f3fd972a800 20 Filter name: none 2023-12-03T11:28:22.930 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.928+0000 7f3efb7fe640 20 reqs_thread_entry: start 2023-12-03T11:28:22.930 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.928+0000 7f3fd972a800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:28:22.930 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.928+0000 7f3fd972a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:22.930 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.929+0000 7f3fd972a800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:22.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.929+0000 7f3fd972a800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:28:22.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.929+0000 7f3fd972a800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:28:22.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.929+0000 7f3fd972a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 : miss 2023-12-03T11:28:22.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.929+0000 7f3fd972a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:22.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.929+0000 7f3fd972a800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:22.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.929+0000 7f3fd972a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 info.flags=0x17 2023-12-03T11:28:22.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.929+0000 7f3fd972a800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 to cache LRU end 2023-12-03T11:28:22.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.929+0000 7f3fd972a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:28:22.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.929+0000 7f3fd972a800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:28:22.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.929+0000 7f3fd972a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 2023-12-03T11:28:22.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.929+0000 7f3fd972a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:22.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.931+0000 7f3fd972a800 1 NOTICE: finished shard 0 (4 entries found) 2023-12-03T11:28:22.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.931+0000 7f3fd972a800 1 NOTICE: finished all shards (4 entries found) 2023-12-03T11:28:22.933 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.932+0000 7f3f9afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:22.935 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.935+0000 7f3fd972a800 20 remove_watcher() i=0 2023-12-03T11:28:22.936 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.935+0000 7f3fd972a800 2 removed watcher, disabling cache 2023-12-03T11:28:22.937 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.936+0000 7f3fd972a800 20 remove_watcher() i=1 2023-12-03T11:28:22.938 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.937+0000 7f3fd972a800 20 remove_watcher() i=2 2023-12-03T11:28:22.939 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.938+0000 7f3fd972a800 20 remove_watcher() i=3 2023-12-03T11:28:22.940 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.939+0000 7f3fd972a800 20 remove_watcher() i=4 2023-12-03T11:28:22.941 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.940+0000 7f3fd972a800 20 remove_watcher() i=5 2023-12-03T11:28:22.942 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.941+0000 7f3fd972a800 20 remove_watcher() i=6 2023-12-03T11:28:22.943 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:22.942+0000 7f3fd972a800 20 remove_watcher() i=7 2023-12-03T11:28:22.948 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: unlinked entries are not listable 2023-12-03T11:28:22.948 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:28:22.955 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2023-12-03T11:28:22.955 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:28:23.044 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: bucket check unlinked fixes unlistable entries 2023-12-03T11:28:23.044 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:28:23.045 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2023-12-03T11:28:23.080 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:23.080 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:23.095 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.094+0000 7f75b6323800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.097 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.096+0000 7f75b6323800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.097 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.096+0000 7f75b6323800 20 realm 2023-12-03T11:28:23.097 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.096+0000 7f75b6323800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.097 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.096+0000 7f75b6323800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.097 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.096+0000 7f75b6323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:23.097 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.096+0000 7f75b6323800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.097 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.096+0000 7f75b6323800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.097 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.096+0000 7f75b6323800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.098 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.097+0000 7f75b6323800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:23.098 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.097+0000 7f75b6323800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.098 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.098+0000 7f75b6323800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:23.099 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.098+0000 7f75b6323800 20 searching for the correct realm 2023-12-03T11:28:23.109 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.108+0000 7f75b273d640 0 -- 172.21.15.44:0/3105153548 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55c7b07746c0 msgr2=0x55c7b0776b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:23.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.109+0000 7f75b6323800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:23.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.109+0000 7f75b6323800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:23.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.109+0000 7f75b6323800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:23.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.109+0000 7f75b6323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:23.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.109+0000 7f75b6323800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.109+0000 7f75b6323800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.109+0000 7f75b6323800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.111 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.109+0000 7f75b6323800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:23.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.109+0000 7f75b6323800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.110+0000 7f75b6323800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:23.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.110+0000 7f75b6323800 20 zone default found 2023-12-03T11:28:23.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.110+0000 7f75b6323800 4 Realm: () 2023-12-03T11:28:23.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.110+0000 7f75b6323800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:23.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.110+0000 7f75b6323800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:23.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.110+0000 7f75b6323800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:23.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.110+0000 7f75b6323800 20 zonegroup default 2023-12-03T11:28:23.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.110+0000 7f75b6323800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.110+0000 7f75b6323800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.110+0000 7f75b6323800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.110+0000 7f75b6323800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.113 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.110+0000 7f75b6323800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.113 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.111+0000 7f75b6323800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.113 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.111+0000 7f75b6323800 20 started sync module instance, tier type = 2023-12-03T11:28:23.113 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.111+0000 7f75b6323800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:23.120 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.119+0000 7f75b273d640 0 -- 172.21.15.44:0/3105153548 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f75a807cbc0 msgr2=0x7f75a807a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:23.123 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.122+0000 7f75b6323800 20 add_watcher() i=0 2023-12-03T11:28:23.123 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.122+0000 7f75b6323800 20 add_watcher() i=1 2023-12-03T11:28:23.123 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.122+0000 7f75b6323800 20 add_watcher() i=2 2023-12-03T11:28:23.123 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.122+0000 7f75b6323800 20 add_watcher() i=3 2023-12-03T11:28:23.123 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.122+0000 7f75b6323800 20 add_watcher() i=4 2023-12-03T11:28:23.123 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.122+0000 7f75b6323800 20 add_watcher() i=5 2023-12-03T11:28:23.123 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.122+0000 7f75b6323800 20 add_watcher() i=6 2023-12-03T11:28:23.124 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.123+0000 7f75b6323800 20 add_watcher() i=7 2023-12-03T11:28:23.124 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.123+0000 7f75b6323800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:23.125 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.124+0000 7f75777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:23.126 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.125+0000 7f75b6323800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:23.126 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.125+0000 7f75b6323800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:23.132 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.131+0000 7f75b6323800 5 note: GC not initialized 2023-12-03T11:28:23.132 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.131+0000 7f74e67fc640 20 reqs_thread_entry: start 2023-12-03T11:28:23.132 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.131+0000 7f75b6323800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:23.132 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.131+0000 7f75b6323800 20 Filter name: none 2023-12-03T11:28:23.132 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.131+0000 7f74d7fff640 20 reqs_thread_entry: start 2023-12-03T11:28:23.133 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.131+0000 7f75b6323800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:28:23.133 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.131+0000 7f75b6323800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.134 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.132+0000 7f75b6323800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:23.134 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.132+0000 7f75b6323800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:28:23.134 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.132+0000 7f75b6323800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:28:23.134 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.132+0000 7f75b6323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 : miss 2023-12-03T11:28:23.134 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.132+0000 7f75b6323800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.134 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.132+0000 7f75b6323800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:23.134 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.132+0000 7f75b6323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 info.flags=0x17 2023-12-03T11:28:23.135 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.132+0000 7f75b6323800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 to cache LRU end 2023-12-03T11:28:23.135 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.132+0000 7f75b6323800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:28:23.135 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.132+0000 7f75b6323800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:28:23.135 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.132+0000 7f75b6323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 2023-12-03T11:28:23.135 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.132+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.136 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.133+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.134+0000 7f75b6323800 20 get_obj_state: octx=0x7f75a4086000 obj=check-bucket:c state=0x55c7b0822df8 s->prefetch_data=0 2023-12-03T11:28:23.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.134+0000 7f75b6323800 20 get_obj_state: setting s->obj_tag to 0svkzzukyq6mgx3b7j4q0sn81ompwo3v 2023-12-03T11:28:23.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.134+0000 7f75b6323800 20 get_obj_state_impl: setting s->olh_tag to 6i3cxta5ga1yseentv463v5e796bc0oq 2023-12-03T11:28:23.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.134+0000 7f75b6323800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6i3cxta5ga1yseentv463v5e796bc0oq 2023-12-03T11:28:23.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.136+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.139 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.137+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.139 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.137+0000 7f75b6323800 20 olh_log_entry: epoch=3 op=3 key=c[cq.7pK3zzFc3mpR7uC1m0d79CXAdYz7] 2023-12-03T11:28:23.140 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.137+0000 7f75b6323800 20 get_obj_state: octx=0x7f75a4086000 obj=check-bucket:_:cq.7pK3zzFc3mpR7uC1m0d79CXAdYz7_c state=0x55c7b082c498 s->prefetch_data=0 2023-12-03T11:28:23.140 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.138+0000 7f75b6323800 10 manifest: total_size = 22 2023-12-03T11:28:23.140 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.138+0000 7f75b6323800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.10819851000938626666 2023-12-03T11:28:23.140 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.138+0000 7f75b6323800 20 get_obj_state: octx=0x7f75a4086000 obj=check-bucket:_:cq.7pK3zzFc3mpR7uC1m0d79CXAdYz7_c state=0x55c7b082c498 s->prefetch_data=0 2023-12-03T11:28:23.140 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.138+0000 7f75b6323800 20 prepare_atomic_modification: state is not atomic. state=0x55c7b082c498 2023-12-03T11:28:23.140 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.138+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.141+0000 7f7593fff640 20 handle_completion(): completion ok for obj=c[cq.7pK3zzFc3mpR7uC1m0d79CXAdYz7] 2023-12-03T11:28:23.143 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.142+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.143 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.142+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.144 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.143+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.145 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.144+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.145 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.144+0000 7f75b6323800 20 get_obj_state: octx=0x7f75a4086000 obj=check-bucket:d state=0x55c7b0822df8 s->prefetch_data=0 2023-12-03T11:28:23.145 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.144+0000 7f75b6323800 20 get_obj_state: setting s->obj_tag to meupzjl2e577cak27o63xp3lez21a6uv 2023-12-03T11:28:23.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.144+0000 7f75b6323800 20 get_obj_state_impl: setting s->olh_tag to ds3ct15t3hvjia2sp0xxrxre6aicsklb 2023-12-03T11:28:23.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.144+0000 7f75b6323800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ds3ct15t3hvjia2sp0xxrxre6aicsklb 2023-12-03T11:28:23.147 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.146+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.150 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.149+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.149+0000 7f75b6323800 20 olh_log_entry: epoch=3 op=3 key=d[xST93UMIu2Qe1xqhdt7aywfr72NExW7] 2023-12-03T11:28:23.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.149+0000 7f75b6323800 20 get_obj_state: octx=0x7f75a4086000 obj=check-bucket:_:xST93UMIu2Qe1xqhdt7aywfr72NExW7_d state=0x55c7b082d108 s->prefetch_data=0 2023-12-03T11:28:23.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.150+0000 7f75b6323800 10 manifest: total_size = 9 2023-12-03T11:28:23.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.150+0000 7f75b6323800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.3347163604875455542 2023-12-03T11:28:23.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.150+0000 7f75b6323800 20 get_obj_state: octx=0x7f75a4086000 obj=check-bucket:_:xST93UMIu2Qe1xqhdt7aywfr72NExW7_d state=0x55c7b082d108 s->prefetch_data=0 2023-12-03T11:28:23.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.150+0000 7f75b6323800 20 prepare_atomic_modification: state is not atomic. state=0x55c7b082d108 2023-12-03T11:28:23.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.150+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.156+0000 7f75937fe640 20 handle_completion(): completion ok for obj=d[xST93UMIu2Qe1xqhdt7aywfr72NExW7] 2023-12-03T11:28:23.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.156+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.156+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.160 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.159+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.161 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.160+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.161 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.160+0000 7f75b6323800 20 get_obj_state: octx=0x7f75a4012f80 obj=check-bucket:e state=0x55c7b0823e28 s->prefetch_data=0 2023-12-03T11:28:23.161 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.160+0000 7f75b6323800 20 get_obj_state: setting s->obj_tag to lvlfgf6vnqr8x6iu25jcjngt6f1wdbch 2023-12-03T11:28:23.161 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.160+0000 7f75b6323800 20 get_obj_state_impl: setting s->olh_tag to e6uanqtr9nyytlhpvmlg3fsvgp1qxa03 2023-12-03T11:28:23.162 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.160+0000 7f75b6323800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=e6uanqtr9nyytlhpvmlg3fsvgp1qxa03 2023-12-03T11:28:23.163 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.162+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.167 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.165+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.167 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.166+0000 7f75b6323800 20 olh_log_entry: epoch=2 op=2 key=e[] 2023-12-03T11:28:23.167 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.166+0000 7f75b6323800 20 olh_log_entry: epoch=2 op=3 key=e[v5or8Bj7MxzqPfboI4b1I2yNqd8SmUh] 2023-12-03T11:28:23.167 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.166+0000 7f75b6323800 20 get_obj_state: octx=0x7f75a4012f80 obj=check-bucket:_:v5or8Bj7MxzqPfboI4b1I2yNqd8SmUh_e state=0x55c7b082d108 s->prefetch_data=0 2023-12-03T11:28:23.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.166+0000 7f75b6323800 10 manifest: total_size = 11 2023-12-03T11:28:23.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.166+0000 7f75b6323800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.5449551000587960201 2023-12-03T11:28:23.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.166+0000 7f75b6323800 20 get_obj_state: octx=0x7f75a4012f80 obj=check-bucket:_:v5or8Bj7MxzqPfboI4b1I2yNqd8SmUh_e state=0x55c7b082d108 s->prefetch_data=0 2023-12-03T11:28:23.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.166+0000 7f75b6323800 20 prepare_atomic_modification: state is not atomic. state=0x55c7b082d108 2023-12-03T11:28:23.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.166+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.177 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.175+0000 7f7593fff640 20 handle_completion(): completion ok for obj=e[v5or8Bj7MxzqPfboI4b1I2yNqd8SmUh] 2023-12-03T11:28:23.177 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.175+0000 7f75b6323800 20 get_obj_state: octx=0x7f75a4012f80 obj=check-bucket:e state=0x55c7b0823e28 s->prefetch_data=0 2023-12-03T11:28:23.178 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.175+0000 7f75b6323800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=e6uanqtr9nyytlhpvmlg3fsvgp1qxa03 2023-12-03T11:28:23.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.182+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.185 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.185+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.186 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.185+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.186 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.185+0000 7f75b6323800 20 get_obj_state: octx=0x7f75a8061c60 obj=check-bucket:f state=0x55c7b08326f8 s->prefetch_data=0 2023-12-03T11:28:23.186 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.186+0000 7f75b6323800 20 get_obj_state: setting s->obj_tag to cozwmgpwdioxzck0gmdv3gjkr4ju27sq 2023-12-03T11:28:23.187 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.186+0000 7f75b6323800 20 get_obj_state_impl: setting s->olh_tag to c6krgrbqb3f98c2uf17t7wgfvcaa7h5a 2023-12-03T11:28:23.187 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.186+0000 7f75b6323800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=c6krgrbqb3f98c2uf17t7wgfvcaa7h5a 2023-12-03T11:28:23.188 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.187+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.189 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.189+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.189+0000 7f75b6323800 20 olh_log_entry: epoch=2 op=2 key=f[] 2023-12-03T11:28:23.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.189+0000 7f75b6323800 20 olh_log_entry: epoch=2 op=3 key=f[S6yTPdsztYP-DRE3wykkiZ37ttvWnmP] 2023-12-03T11:28:23.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.189+0000 7f75b6323800 20 get_obj_state: octx=0x7f75a8061c60 obj=check-bucket:_:S6yTPdsztYP-DRE3wykkiZ37ttvWnmP_f state=0x55c7b082d108 s->prefetch_data=0 2023-12-03T11:28:23.191 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.189+0000 7f75b6323800 10 manifest: total_size = 9 2023-12-03T11:28:23.191 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.189+0000 7f75b6323800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.13297413352999586278 2023-12-03T11:28:23.191 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.189+0000 7f75b6323800 20 get_obj_state: octx=0x7f75a8061c60 obj=check-bucket:_:S6yTPdsztYP-DRE3wykkiZ37ttvWnmP_f state=0x55c7b082d108 s->prefetch_data=0 2023-12-03T11:28:23.191 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.189+0000 7f75b6323800 20 prepare_atomic_modification: state is not atomic. state=0x55c7b082d108 2023-12-03T11:28:23.191 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.189+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.195 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.195+0000 7f7593fff640 20 handle_completion(): completion ok for obj=f[S6yTPdsztYP-DRE3wykkiZ37ttvWnmP] 2023-12-03T11:28:23.197 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.197+0000 7f75b6323800 20 get_obj_state: octx=0x7f75a8061c60 obj=check-bucket:f state=0x55c7b08326f8 s->prefetch_data=0 2023-12-03T11:28:23.197 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.197+0000 7f75b6323800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=c6krgrbqb3f98c2uf17t7wgfvcaa7h5a 2023-12-03T11:28:23.203 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.202+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.204 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.203+0000 7f75b6323800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.204 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.203+0000 7f75b6323800 1 NOTICE: finished shard 0 (4 entries removed) 2023-12-03T11:28:23.204 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.203+0000 7f75b6323800 1 NOTICE: finished all shards (4 entries removed) 2023-12-03T11:28:23.205 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.204+0000 7f75777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:23.207 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.207+0000 7f75b6323800 20 remove_watcher() i=0 2023-12-03T11:28:23.208 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.207+0000 7f75b6323800 2 removed watcher, disabling cache 2023-12-03T11:28:23.209 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.208+0000 7f75b6323800 20 remove_watcher() i=1 2023-12-03T11:28:23.210 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.209+0000 7f75b6323800 20 remove_watcher() i=2 2023-12-03T11:28:23.211 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.210+0000 7f75b6323800 20 remove_watcher() i=3 2023-12-03T11:28:23.212 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.211+0000 7f75b6323800 20 remove_watcher() i=4 2023-12-03T11:28:23.213 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.212+0000 7f75b6323800 20 remove_watcher() i=5 2023-12-03T11:28:23.215 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.214+0000 7f75b6323800 20 remove_watcher() i=6 2023-12-03T11:28:23.216 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.215+0000 7f75b6323800 20 remove_watcher() i=7 2023-12-03T11:28:23.231 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: bucket check unlinked does not affect normal entries 2023-12-03T11:28:23.231 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:28:23.286 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2023-12-03T11:28:23.287 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:28:23.287 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2023-12-03T11:28:23.320 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:23.320 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:23.335 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.334+0000 7f1378ce4800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.337 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.336+0000 7f1378ce4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.337 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.336+0000 7f1378ce4800 20 realm 2023-12-03T11:28:23.337 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.336+0000 7f1378ce4800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.337 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.336+0000 7f1378ce4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.337 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.336+0000 7f1378ce4800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:23.337 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.336+0000 7f1378ce4800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.337 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.336+0000 7f1378ce4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.337 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.336+0000 7f1378ce4800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.338 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.337+0000 7f1378ce4800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:23.338 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.337+0000 7f1378ce4800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.339 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.338+0000 7f1378ce4800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:23.339 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.338+0000 7f1378ce4800 20 searching for the correct realm 2023-12-03T11:28:23.350 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.348+0000 7f13767e4640 0 -- 172.21.15.44:0/1808100877 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55b238ba65f0 msgr2=0x55b238ba89e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:23.350 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.349+0000 7f1378ce4800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:23.350 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.349+0000 7f1378ce4800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:23.350 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.349+0000 7f1378ce4800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:23.351 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.349+0000 7f1378ce4800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:23.351 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.349+0000 7f1378ce4800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.351 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.349+0000 7f1378ce4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.351 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.349+0000 7f1378ce4800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.351 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.349+0000 7f1378ce4800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:23.351 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.349+0000 7f1378ce4800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.352 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.350+0000 7f1378ce4800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:23.352 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.350+0000 7f1378ce4800 20 zone default found 2023-12-03T11:28:23.352 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.350+0000 7f1378ce4800 4 Realm: () 2023-12-03T11:28:23.352 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.350+0000 7f1378ce4800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:23.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.350+0000 7f1378ce4800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:23.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.350+0000 7f1378ce4800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:23.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.350+0000 7f1378ce4800 20 zonegroup default 2023-12-03T11:28:23.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.350+0000 7f1378ce4800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.350+0000 7f1378ce4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.350+0000 7f1378ce4800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.350+0000 7f1378ce4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.350+0000 7f1378ce4800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.351+0000 7f1378ce4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.351+0000 7f1378ce4800 20 started sync module instance, tier type = 2023-12-03T11:28:23.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.351+0000 7f1378ce4800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:23.364 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.363+0000 7f1376fe5640 0 -- 172.21.15.44:0/1808100877 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55b238bae470 msgr2=0x55b238bb0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:28:23.365 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.365+0000 7f1378ce4800 20 add_watcher() i=0 2023-12-03T11:28:23.366 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.365+0000 7f1378ce4800 20 add_watcher() i=1 2023-12-03T11:28:23.366 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.365+0000 7f1378ce4800 20 add_watcher() i=2 2023-12-03T11:28:23.366 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.365+0000 7f1378ce4800 20 add_watcher() i=3 2023-12-03T11:28:23.366 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.365+0000 7f1378ce4800 20 add_watcher() i=4 2023-12-03T11:28:23.367 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.366+0000 7f1378ce4800 20 add_watcher() i=5 2023-12-03T11:28:23.369 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.368+0000 7f1378ce4800 20 add_watcher() i=6 2023-12-03T11:28:23.369 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.368+0000 7f1378ce4800 20 add_watcher() i=7 2023-12-03T11:28:23.369 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.368+0000 7f1378ce4800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:23.371 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.370+0000 7f133bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:23.371 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.371+0000 7f1378ce4800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:23.372 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.371+0000 7f1378ce4800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:23.378 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.377+0000 7f1378ce4800 5 note: GC not initialized 2023-12-03T11:28:23.378 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.377+0000 7f12aaffd640 20 reqs_thread_entry: start 2023-12-03T11:28:23.378 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.377+0000 7f1378ce4800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:23.378 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.377+0000 7f1378ce4800 20 Filter name: none 2023-12-03T11:28:23.379 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.377+0000 7f12a8ff9640 20 reqs_thread_entry: start 2023-12-03T11:28:23.381 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.377+0000 7f1378ce4800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:28:23.381 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.377+0000 7f1378ce4800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.382 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.378+0000 7f1378ce4800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:23.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.378+0000 7f1378ce4800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:28:23.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.378+0000 7f1378ce4800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:28:23.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.378+0000 7f1378ce4800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 : miss 2023-12-03T11:28:23.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.378+0000 7f1378ce4800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.378+0000 7f1378ce4800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:23.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.378+0000 7f1378ce4800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 info.flags=0x17 2023-12-03T11:28:23.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.378+0000 7f1378ce4800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 to cache LRU end 2023-12-03T11:28:23.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.378+0000 7f1378ce4800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:28:23.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.378+0000 7f1378ce4800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:28:23.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.378+0000 7f1378ce4800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 2023-12-03T11:28:23.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.378+0000 7f1378ce4800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.379+0000 7f1378ce4800 1 NOTICE: finished shard 0 (0 entries found) 2023-12-03T11:28:23.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.379+0000 7f1378ce4800 1 NOTICE: finished all shards (0 entries found) 2023-12-03T11:28:23.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.380+0000 7f133bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:23.384 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.382+0000 7f1378ce4800 20 remove_watcher() i=0 2023-12-03T11:28:23.384 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.382+0000 7f1378ce4800 2 removed watcher, disabling cache 2023-12-03T11:28:23.384 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.383+0000 7f1378ce4800 20 remove_watcher() i=1 2023-12-03T11:28:23.385 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.384+0000 7f1378ce4800 20 remove_watcher() i=2 2023-12-03T11:28:23.386 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.385+0000 7f1378ce4800 20 remove_watcher() i=3 2023-12-03T11:28:23.387 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.387+0000 7f1378ce4800 20 remove_watcher() i=4 2023-12-03T11:28:23.389 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.388+0000 7f1378ce4800 20 remove_watcher() i=5 2023-12-03T11:28:23.390 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.389+0000 7f1378ce4800 20 remove_watcher() i=6 2023-12-03T11:28:23.391 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.390+0000 7f1378ce4800 20 remove_watcher() i=7 2023-12-03T11:28:23.435 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object c 2023-12-03T11:28:23.466 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:23.466 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:23.481 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.480+0000 7ff64e613800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.482+0000 7ff64e613800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.482+0000 7ff64e613800 20 realm 2023-12-03T11:28:23.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.482+0000 7ff64e613800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.482+0000 7ff64e613800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.482+0000 7ff64e613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:23.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.482+0000 7ff64e613800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.482+0000 7ff64e613800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.482+0000 7ff64e613800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.484 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.483+0000 7ff64e613800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:23.484 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.483+0000 7ff64e613800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.485 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.484+0000 7ff64e613800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:23.485 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.484+0000 7ff64e613800 20 searching for the correct realm 2023-12-03T11:28:23.495 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.494+0000 7ff64c113640 0 -- 172.21.15.44:0/341886536 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x56512b27e670 msgr2=0x56512b280a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:23.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.495+0000 7ff64e613800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:23.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.495+0000 7ff64e613800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:23.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.495+0000 7ff64e613800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:23.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.495+0000 7ff64e613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:23.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.495+0000 7ff64e613800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.495+0000 7ff64e613800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.495+0000 7ff64e613800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.495+0000 7ff64e613800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:23.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.495+0000 7ff64e613800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.495+0000 7ff64e613800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:23.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.495+0000 7ff64e613800 20 zone default found 2023-12-03T11:28:23.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.495+0000 7ff64e613800 4 Realm: () 2023-12-03T11:28:23.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.495+0000 7ff64e613800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:23.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.495+0000 7ff64e613800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:23.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.495+0000 7ff64e613800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:23.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.495+0000 7ff64e613800 20 zonegroup default 2023-12-03T11:28:23.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.495+0000 7ff64e613800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.496+0000 7ff64e613800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.496+0000 7ff64e613800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.496+0000 7ff64e613800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.496+0000 7ff64e613800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.496+0000 7ff64e613800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.496+0000 7ff64e613800 20 started sync module instance, tier type = 2023-12-03T11:28:23.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.496+0000 7ff64e613800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:23.505 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.504+0000 7ff64c914640 0 -- 172.21.15.44:0/341886536 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7ff64005d260 msgr2=0x7ff640055a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:23.507 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.507+0000 7ff64e613800 20 add_watcher() i=0 2023-12-03T11:28:23.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.507+0000 7ff64e613800 20 add_watcher() i=1 2023-12-03T11:28:23.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.507+0000 7ff64e613800 20 add_watcher() i=2 2023-12-03T11:28:23.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.507+0000 7ff64e613800 20 add_watcher() i=3 2023-12-03T11:28:23.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.507+0000 7ff64e613800 20 add_watcher() i=4 2023-12-03T11:28:23.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.507+0000 7ff64e613800 20 add_watcher() i=5 2023-12-03T11:28:23.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.507+0000 7ff64e613800 20 add_watcher() i=6 2023-12-03T11:28:23.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.507+0000 7ff64e613800 20 add_watcher() i=7 2023-12-03T11:28:23.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.507+0000 7ff64e613800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:23.510 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.509+0000 7ff6127e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:23.510 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.509+0000 7ff64e613800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:23.510 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.509+0000 7ff64e613800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:23.517 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.515+0000 7ff64e613800 5 note: GC not initialized 2023-12-03T11:28:23.517 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.515+0000 7ff5817fa640 20 reqs_thread_entry: start 2023-12-03T11:28:23.517 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.515+0000 7ff64e613800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:23.517 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.515+0000 7ff64e613800 20 Filter name: none 2023-12-03T11:28:23.517 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.516+0000 7ff57affd640 20 reqs_thread_entry: start 2023-12-03T11:28:23.517 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.516+0000 7ff64e613800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.517 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.516+0000 7ff64e613800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:23.517 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.516+0000 7ff64e613800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.518 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.517+0000 7ff64e613800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:23.519 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.517+0000 7ff64e613800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:28:23.519 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.517+0000 7ff64e613800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:28:23.519 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.517+0000 7ff64e613800 20 INFO: main: starting shard=0 2023-12-03T11:28:23.519 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.517+0000 7ff64e613800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.520 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.517+0000 7ff64e613800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2023-12-03T11:28:23.520 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.517+0000 7ff64e613800 20 INFO: main: done 2023-12-03T11:28:23.520 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.518+0000 7ff6127e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:23.521 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.521+0000 7ff64e613800 20 remove_watcher() i=0 2023-12-03T11:28:23.521 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.521+0000 7ff64e613800 2 removed watcher, disabling cache 2023-12-03T11:28:23.523 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.522+0000 7ff64e613800 20 remove_watcher() i=1 2023-12-03T11:28:23.524 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.523+0000 7ff64e613800 20 remove_watcher() i=2 2023-12-03T11:28:23.525 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.525+0000 7ff64e613800 20 remove_watcher() i=3 2023-12-03T11:28:23.526 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.526+0000 7ff64e613800 20 remove_watcher() i=4 2023-12-03T11:28:23.528 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.527+0000 7ff64e613800 20 remove_watcher() i=5 2023-12-03T11:28:23.529 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.528+0000 7ff64e613800 20 remove_watcher() i=6 2023-12-03T11:28:23.530 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.529+0000 7ff64e613800 20 remove_watcher() i=7 2023-12-03T11:28:23.536 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object d 2023-12-03T11:28:23.566 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:23.566 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:23.580 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.579+0000 7f0f3dd3a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.582 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.581+0000 7f0f3dd3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.582 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.581+0000 7f0f3dd3a800 20 realm 2023-12-03T11:28:23.582 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.581+0000 7f0f3dd3a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.582 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.581+0000 7f0f3dd3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.582 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.581+0000 7f0f3dd3a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:23.582 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.581+0000 7f0f3dd3a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.582 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.581+0000 7f0f3dd3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.582 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.581+0000 7f0f3dd3a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.583 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.582+0000 7f0f3dd3a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:23.583 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.582+0000 7f0f3dd3a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.584 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.583+0000 7f0f3dd3a800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:23.584 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.583+0000 7f0f3dd3a800 20 searching for the correct realm 2023-12-03T11:28:23.592 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.591+0000 7f0f3a207640 0 -- 172.21.15.44:0/1406597677 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55a68db598b0 msgr2=0x55a68db5bd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:23.595 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.593+0000 7f0f3dd3a800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:23.595 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.593+0000 7f0f3dd3a800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:23.595 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.593+0000 7f0f3dd3a800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:23.595 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.593+0000 7f0f3dd3a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:23.595 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.593+0000 7f0f3dd3a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.595 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.593+0000 7f0f3dd3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.595 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.593+0000 7f0f3dd3a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.595 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.594+0000 7f0f3dd3a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:23.595 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.594+0000 7f0f3dd3a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.596 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.594+0000 7f0f3dd3a800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:23.596 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.594+0000 7f0f3dd3a800 20 zone default found 2023-12-03T11:28:23.596 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.594+0000 7f0f3dd3a800 4 Realm: () 2023-12-03T11:28:23.596 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.594+0000 7f0f3dd3a800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:23.596 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.594+0000 7f0f3dd3a800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:23.596 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.594+0000 7f0f3dd3a800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:23.596 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.594+0000 7f0f3dd3a800 20 zonegroup default 2023-12-03T11:28:23.596 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.594+0000 7f0f3dd3a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.596 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.594+0000 7f0f3dd3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.596 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.594+0000 7f0f3dd3a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.594+0000 7f0f3dd3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.594+0000 7f0f3dd3a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.595+0000 7f0f3dd3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.595+0000 7f0f3dd3a800 20 started sync module instance, tier type = 2023-12-03T11:28:23.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.595+0000 7f0f3dd3a800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:23.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.602+0000 7f0f39205640 0 -- 172.21.15.44:0/1406597677 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x55a68db55060 msgr2=0x55a68db57450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:23.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.607+0000 7f0f3dd3a800 20 add_watcher() i=0 2023-12-03T11:28:23.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.607+0000 7f0f3dd3a800 20 add_watcher() i=1 2023-12-03T11:28:23.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.607+0000 7f0f3dd3a800 20 add_watcher() i=2 2023-12-03T11:28:23.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.607+0000 7f0f3dd3a800 20 add_watcher() i=3 2023-12-03T11:28:23.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.607+0000 7f0f3dd3a800 20 add_watcher() i=4 2023-12-03T11:28:23.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.607+0000 7f0f3dd3a800 20 add_watcher() i=5 2023-12-03T11:28:23.609 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.607+0000 7f0f3dd3a800 20 add_watcher() i=6 2023-12-03T11:28:23.609 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.608+0000 7f0f3dd3a800 20 add_watcher() i=7 2023-12-03T11:28:23.609 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.608+0000 7f0f3dd3a800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:23.611 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.610+0000 7f0eff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:23.611 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.610+0000 7f0f3dd3a800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:23.611 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.610+0000 7f0f3dd3a800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:23.617 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.616+0000 7f0f3dd3a800 5 note: GC not initialized 2023-12-03T11:28:23.617 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.616+0000 7f0e6e7fc640 20 reqs_thread_entry: start 2023-12-03T11:28:23.617 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.616+0000 7f0f3dd3a800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:23.618 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.616+0000 7f0f3dd3a800 20 Filter name: none 2023-12-03T11:28:23.618 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.616+0000 7f0e5ffff640 20 reqs_thread_entry: start 2023-12-03T11:28:23.618 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.617+0000 7f0f3dd3a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.618 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.617+0000 7f0f3dd3a800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:23.619 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.617+0000 7f0f3dd3a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.619 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.618+0000 7f0f3dd3a800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:23.619 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.618+0000 7f0f3dd3a800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:28:23.619 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.618+0000 7f0f3dd3a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:28:23.619 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.618+0000 7f0f3dd3a800 20 INFO: main: starting shard=0 2023-12-03T11:28:23.619 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.618+0000 7f0f3dd3a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.619 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.618+0000 7f0f3dd3a800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2023-12-03T11:28:23.619 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.618+0000 7f0f3dd3a800 20 INFO: main: done 2023-12-03T11:28:23.620 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.619+0000 7f0eff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:23.622 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.621+0000 7f0f3dd3a800 20 remove_watcher() i=0 2023-12-03T11:28:23.623 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.621+0000 7f0f3dd3a800 2 removed watcher, disabling cache 2023-12-03T11:28:23.624 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.623+0000 7f0f3dd3a800 20 remove_watcher() i=1 2023-12-03T11:28:23.625 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.624+0000 7f0f3dd3a800 20 remove_watcher() i=2 2023-12-03T11:28:23.626 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.626+0000 7f0f3dd3a800 20 remove_watcher() i=3 2023-12-03T11:28:23.627 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.627+0000 7f0f3dd3a800 20 remove_watcher() i=4 2023-12-03T11:28:23.628 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.628+0000 7f0f3dd3a800 20 remove_watcher() i=5 2023-12-03T11:28:23.629 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.629+0000 7f0f3dd3a800 20 remove_watcher() i=6 2023-12-03T11:28:23.630 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.630+0000 7f0f3dd3a800 20 remove_watcher() i=7 2023-12-03T11:28:23.635 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: bucket check olh finds leftover OLH entries 2023-12-03T11:28:23.635 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:28:23.637 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2023-12-03T11:28:23.666 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:23.666 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:23.680 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.679+0000 7f7dc672c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.682 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.680+0000 7f7dc672c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.682 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.681+0000 7f7dc672c800 20 realm 2023-12-03T11:28:23.682 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.681+0000 7f7dc672c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.682 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.681+0000 7f7dc672c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.682 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.681+0000 7f7dc672c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:23.682 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.681+0000 7f7dc672c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.682 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.681+0000 7f7dc672c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.682 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.681+0000 7f7dc672c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.683 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.682+0000 7f7dc672c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:23.683 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.682+0000 7f7dc672c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.683 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.683+0000 7f7dc672c800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:23.684 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.683+0000 7f7dc672c800 20 searching for the correct realm 2023-12-03T11:28:23.692 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.692+0000 7f7dc1cef640 0 -- 172.21.15.44:0/2706224775 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x5588ecdb97b0 msgr2=0x5588ecdbbba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:28:23.694 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.693+0000 7f7dc672c800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:23.695 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.693+0000 7f7dc672c800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:23.695 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.693+0000 7f7dc672c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:23.695 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.693+0000 7f7dc672c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:23.695 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.693+0000 7f7dc672c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.695 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.694+0000 7f7dc672c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.695 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.694+0000 7f7dc672c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.696 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.694+0000 7f7dc672c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:23.696 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.694+0000 7f7dc672c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.696 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.694+0000 7f7dc672c800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:23.696 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.694+0000 7f7dc672c800 20 zone default found 2023-12-03T11:28:23.696 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.694+0000 7f7dc672c800 4 Realm: () 2023-12-03T11:28:23.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.694+0000 7f7dc672c800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:23.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.694+0000 7f7dc672c800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:23.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.694+0000 7f7dc672c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:23.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.694+0000 7f7dc672c800 20 zonegroup default 2023-12-03T11:28:23.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.694+0000 7f7dc672c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.695+0000 7f7dc672c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.695+0000 7f7dc672c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.695+0000 7f7dc672c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.695+0000 7f7dc672c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.695+0000 7f7dc672c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.695+0000 7f7dc672c800 20 started sync module instance, tier type = 2023-12-03T11:28:23.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.695+0000 7f7dc672c800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:23.702 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.702+0000 7f7dc1cef640 0 -- 172.21.15.44:0/2706224775 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x7f7d9c0773d0 msgr2=0x7f7d9c079800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:28:23.715 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.714+0000 7f7dc672c800 20 add_watcher() i=0 2023-12-03T11:28:23.715 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.714+0000 7f7dc672c800 20 add_watcher() i=1 2023-12-03T11:28:23.715 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.714+0000 7f7dc672c800 20 add_watcher() i=2 2023-12-03T11:28:23.715 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.714+0000 7f7dc672c800 20 add_watcher() i=3 2023-12-03T11:28:23.715 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.714+0000 7f7dc672c800 20 add_watcher() i=4 2023-12-03T11:28:23.715 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.714+0000 7f7dc672c800 20 add_watcher() i=5 2023-12-03T11:28:23.715 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.714+0000 7f7dc672c800 20 add_watcher() i=6 2023-12-03T11:28:23.717 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.716+0000 7f7dc672c800 20 add_watcher() i=7 2023-12-03T11:28:23.717 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.716+0000 7f7dc672c800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:23.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.719+0000 7f7d87fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:23.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.719+0000 7f7dc672c800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:23.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.719+0000 7f7dc672c800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:23.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.726+0000 7f7dc672c800 5 note: GC not initialized 2023-12-03T11:28:23.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.726+0000 7f7cf6ffd640 20 reqs_thread_entry: start 2023-12-03T11:28:23.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.726+0000 7f7dc672c800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:23.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.726+0000 7f7dc672c800 20 Filter name: none 2023-12-03T11:28:23.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.726+0000 7f7cf4ff9640 20 reqs_thread_entry: start 2023-12-03T11:28:23.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.726+0000 7f7dc672c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:28:23.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.726+0000 7f7dc672c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.727+0000 7f7dc672c800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:23.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.727+0000 7f7dc672c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:28:23.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.727+0000 7f7dc672c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:28:23.729 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.727+0000 7f7dc672c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 : miss 2023-12-03T11:28:23.729 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.727+0000 7f7dc672c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.729 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.727+0000 7f7dc672c800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:23.729 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.727+0000 7f7dc672c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 info.flags=0x17 2023-12-03T11:28:23.729 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.727+0000 7f7dc672c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 to cache LRU end 2023-12-03T11:28:23.729 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.727+0000 7f7dc672c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:28:23.729 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.727+0000 7f7dc672c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:28:23.729 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.727+0000 7f7dc672c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 2023-12-03T11:28:23.729 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.727+0000 7f7dc672c800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.730 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.728+0000 7f7dc672c800 1 NOTICE: finished shard 0 (2 entries found) 2023-12-03T11:28:23.730 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.728+0000 7f7dc672c800 1 NOTICE: finished all shards (2 entries found) 2023-12-03T11:28:23.730 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.729+0000 7f7d87fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:23.731 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.731+0000 7f7dc672c800 20 remove_watcher() i=0 2023-12-03T11:28:23.732 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.731+0000 7f7dc672c800 2 removed watcher, disabling cache 2023-12-03T11:28:23.733 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.732+0000 7f7dc672c800 20 remove_watcher() i=1 2023-12-03T11:28:23.734 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.733+0000 7f7dc672c800 20 remove_watcher() i=2 2023-12-03T11:28:23.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.734+0000 7f7dc672c800 20 remove_watcher() i=3 2023-12-03T11:28:23.737 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.735+0000 7f7dc672c800 20 remove_watcher() i=4 2023-12-03T11:28:23.737 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.736+0000 7f7dc672c800 20 remove_watcher() i=5 2023-12-03T11:28:23.738 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.738+0000 7f7dc672c800 20 remove_watcher() i=6 2023-12-03T11:28:23.739 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.739+0000 7f7dc672c800 20 remove_watcher() i=7 2023-12-03T11:28:23.744 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: bucket check olh fixes leftover OLH entries 2023-12-03T11:28:23.744 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:28:23.746 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2023-12-03T11:28:23.777 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:23.777 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:23.793 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.791+0000 7f77d6931800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.794 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.793+0000 7f77d6931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.794 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.793+0000 7f77d6931800 20 realm 2023-12-03T11:28:23.794 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.793+0000 7f77d6931800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.794 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.793+0000 7f77d6931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.794 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.793+0000 7f77d6931800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:23.795 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.793+0000 7f77d6931800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.795 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.793+0000 7f77d6931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.795 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.793+0000 7f77d6931800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.795 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.794+0000 7f77d6931800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:23.795 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.794+0000 7f77d6931800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.796 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.795+0000 7f77d6931800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:23.796 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.795+0000 7f77d6931800 20 searching for the correct realm 2023-12-03T11:28:23.805 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.804+0000 7f77d263c640 0 -- 172.21.15.44:0/1648104470 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55f8b3521c70 msgr2=0x55f8b3524060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:23.807 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.805+0000 7f77d6931800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:23.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.805+0000 7f77d6931800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:23.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.805+0000 7f77d6931800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:23.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.805+0000 7f77d6931800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:23.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.805+0000 7f77d6931800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.805+0000 7f77d6931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.805+0000 7f77d6931800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.806+0000 7f77d6931800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:23.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.806+0000 7f77d6931800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.806+0000 7f77d6931800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:23.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.806+0000 7f77d6931800 20 zone default found 2023-12-03T11:28:23.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.806+0000 7f77d6931800 4 Realm: () 2023-12-03T11:28:23.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.806+0000 7f77d6931800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:23.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.806+0000 7f77d6931800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:23.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.806+0000 7f77d6931800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:23.809 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.806+0000 7f77d6931800 20 zonegroup default 2023-12-03T11:28:23.809 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.806+0000 7f77d6931800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.809 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.806+0000 7f77d6931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.809 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.806+0000 7f77d6931800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.809 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.806+0000 7f77d6931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.809 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.806+0000 7f77d6931800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.809 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.807+0000 7f77d6931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.809 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.807+0000 7f77d6931800 20 started sync module instance, tier type = 2023-12-03T11:28:23.809 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.807+0000 7f77d6931800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:23.817 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.816+0000 7f77d2e3d640 0 -- 172.21.15.44:0/1648104470 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55f8b3529d00 msgr2=0x55f8b352c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:23.822 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.821+0000 7f77d6931800 20 add_watcher() i=0 2023-12-03T11:28:23.822 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.821+0000 7f77d6931800 20 add_watcher() i=1 2023-12-03T11:28:23.822 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.821+0000 7f77d6931800 20 add_watcher() i=2 2023-12-03T11:28:23.822 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.821+0000 7f77d6931800 20 add_watcher() i=3 2023-12-03T11:28:23.823 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.821+0000 7f77d6931800 20 add_watcher() i=4 2023-12-03T11:28:23.823 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.821+0000 7f77d6931800 20 add_watcher() i=5 2023-12-03T11:28:23.825 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.824+0000 7f77d6931800 20 add_watcher() i=6 2023-12-03T11:28:23.825 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.824+0000 7f77d6931800 20 add_watcher() i=7 2023-12-03T11:28:23.825 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.824+0000 7f77d6931800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:23.827 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.826+0000 7f7797fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:23.827 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.827+0000 7f77d6931800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:23.828 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.827+0000 7f77d6931800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:23.834 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.833+0000 7f77d6931800 5 note: GC not initialized 2023-12-03T11:28:23.834 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.833+0000 7f7706ffd640 20 reqs_thread_entry: start 2023-12-03T11:28:23.834 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.833+0000 7f77d6931800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:23.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.833+0000 7f77d6931800 20 Filter name: none 2023-12-03T11:28:23.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.833+0000 7f7704ff9640 20 reqs_thread_entry: start 2023-12-03T11:28:23.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.833+0000 7f77d6931800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:28:23.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.834+0000 7f77d6931800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.834+0000 7f77d6931800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:23.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.834+0000 7f77d6931800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:28:23.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.834+0000 7f77d6931800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:28:23.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.834+0000 7f77d6931800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 : miss 2023-12-03T11:28:23.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.834+0000 7f77d6931800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.834+0000 7f77d6931800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:23.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.834+0000 7f77d6931800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 info.flags=0x17 2023-12-03T11:28:23.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.834+0000 7f77d6931800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 to cache LRU end 2023-12-03T11:28:23.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.834+0000 7f77d6931800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:28:23.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.834+0000 7f77d6931800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:28:23.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.834+0000 7f77d6931800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 2023-12-03T11:28:23.837 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.835+0000 7f77d6931800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.837 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.835+0000 7f77d6931800 20 get_obj_state: octx=0x55f8b32c00f0 obj=check-bucket:c state=0x55f8b35d5778 s->prefetch_data=0 2023-12-03T11:28:23.838 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.835+0000 7f77d6931800 20 get_obj_state: setting s->obj_tag to 0svkzzukyq6mgx3b7j4q0sn81ompwo3v 2023-12-03T11:28:23.838 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.835+0000 7f77d6931800 20 get_obj_state_impl: setting s->olh_tag to 6i3cxta5ga1yseentv463v5e796bc0oq 2023-12-03T11:28:23.838 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.835+0000 7f77d6931800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.838 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.836+0000 7f77d6931800 20 olh_log_entry: epoch=4 op=2 key=c[] 2023-12-03T11:28:23.839 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.836+0000 7f77d6931800 20 olh_log_entry: epoch=4 op=3 key=c[XQGDAn95t0dB0.l9i1z92hdNSNPn9sF] 2023-12-03T11:28:23.839 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.836+0000 7f77d6931800 20 get_obj_state: octx=0x55f8b35d4bf0 obj=check-bucket:_:XQGDAn95t0dB0.l9i1z92hdNSNPn9sF_c state=0x55f8b35df278 s->prefetch_data=0 2023-12-03T11:28:23.839 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.838+0000 7f77d6931800 20 get_obj_state: octx=0x55f8b35d4bf0 obj=check-bucket:c state=0x55f8b35d8208 s->prefetch_data=0 2023-12-03T11:28:23.839 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.838+0000 7f77d6931800 20 get_obj_state: setting s->obj_tag to 0svkzzukyq6mgx3b7j4q0sn81ompwo3v 2023-12-03T11:28:23.839 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.838+0000 7f77d6931800 20 get_obj_state_impl: setting s->olh_tag to 6i3cxta5ga1yseentv463v5e796bc0oq 2023-12-03T11:28:23.839 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.838+0000 7f77d6931800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6i3cxta5ga1yseentv463v5e796bc0oq 2023-12-03T11:28:23.849 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.849+0000 7f77d6931800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.852 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.850+0000 7f77d6931800 20 get_obj_state: octx=0x55f8b32c00f0 obj=check-bucket:d state=0x55f8b35d5778 s->prefetch_data=0 2023-12-03T11:28:23.852 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.850+0000 7f77d6931800 20 get_obj_state: setting s->obj_tag to meupzjl2e577cak27o63xp3lez21a6uv 2023-12-03T11:28:23.852 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.850+0000 7f77d6931800 20 get_obj_state_impl: setting s->olh_tag to ds3ct15t3hvjia2sp0xxrxre6aicsklb 2023-12-03T11:28:23.852 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.850+0000 7f77d6931800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.852 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.851+0000 7f77d6931800 20 olh_log_entry: epoch=4 op=2 key=d[] 2023-12-03T11:28:23.852 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.851+0000 7f77d6931800 20 olh_log_entry: epoch=4 op=3 key=d[G0DaTPFMMxW2M--z.UH1Nzhl90kX28S] 2023-12-03T11:28:23.852 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.851+0000 7f77d6931800 20 get_obj_state: octx=0x55f8b35d4bf0 obj=check-bucket:_:G0DaTPFMMxW2M--z.UH1Nzhl90kX28S_d state=0x55f8b35dfdc8 s->prefetch_data=0 2023-12-03T11:28:23.853 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.853+0000 7f77d6931800 20 get_obj_state: octx=0x55f8b35d4bf0 obj=check-bucket:d state=0x55f8b35d8d58 s->prefetch_data=0 2023-12-03T11:28:23.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.853+0000 7f77d6931800 20 get_obj_state: setting s->obj_tag to meupzjl2e577cak27o63xp3lez21a6uv 2023-12-03T11:28:23.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.853+0000 7f77d6931800 20 get_obj_state_impl: setting s->olh_tag to ds3ct15t3hvjia2sp0xxrxre6aicsklb 2023-12-03T11:28:23.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.853+0000 7f77d6931800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ds3ct15t3hvjia2sp0xxrxre6aicsklb 2023-12-03T11:28:23.862 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.861+0000 7f77d6931800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.867+0000 7f77d6931800 1 NOTICE: finished shard 0 (2 entries removed) 2023-12-03T11:28:23.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.867+0000 7f77d6931800 1 NOTICE: finished all shards (2 entries removed) 2023-12-03T11:28:23.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.868+0000 7f7797fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:23.871 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.870+0000 7f77d6931800 20 remove_watcher() i=0 2023-12-03T11:28:23.871 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.870+0000 7f77d6931800 2 removed watcher, disabling cache 2023-12-03T11:28:23.872 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.871+0000 7f77d6931800 20 remove_watcher() i=1 2023-12-03T11:28:23.874 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.872+0000 7f77d6931800 20 remove_watcher() i=2 2023-12-03T11:28:23.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.874+0000 7f77d6931800 20 remove_watcher() i=3 2023-12-03T11:28:23.876 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.875+0000 7f77d6931800 20 remove_watcher() i=4 2023-12-03T11:28:23.877 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.876+0000 7f77d6931800 20 remove_watcher() i=5 2023-12-03T11:28:23.878 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.877+0000 7f77d6931800 20 remove_watcher() i=6 2023-12-03T11:28:23.879 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.878+0000 7f77d6931800 20 remove_watcher() i=7 2023-12-03T11:28:23.885 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object c 2023-12-03T11:28:23.915 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:23.915 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:23.929 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.928+0000 7fc3e192a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.929+0000 7fc3e192a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.929+0000 7fc3e192a800 20 realm 2023-12-03T11:28:23.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.929+0000 7fc3e192a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.930+0000 7fc3e192a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.930+0000 7fc3e192a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:23.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.930+0000 7fc3e192a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.930+0000 7fc3e192a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.930+0000 7fc3e192a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.931+0000 7fc3e192a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:23.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.931+0000 7fc3e192a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.932+0000 7fc3e192a800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:23.933 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.932+0000 7fc3e192a800 20 searching for the correct realm 2023-12-03T11:28:23.942 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.941+0000 7fc3dd665640 0 -- 172.21.15.44:0/173643233 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x5623db2582f0 msgr2=0x5623db25a700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:28:23.944 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.943+0000 7fc3e192a800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:23.944 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.943+0000 7fc3e192a800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:23.944 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.943+0000 7fc3e192a800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:23.944 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.943+0000 7fc3e192a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:23.944 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.943+0000 7fc3e192a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.943+0000 7fc3e192a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.943+0000 7fc3e192a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.944+0000 7fc3e192a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:23.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.944+0000 7fc3e192a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.944+0000 7fc3e192a800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:23.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.944+0000 7fc3e192a800 20 zone default found 2023-12-03T11:28:23.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.944+0000 7fc3e192a800 4 Realm: () 2023-12-03T11:28:23.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.944+0000 7fc3e192a800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:23.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.944+0000 7fc3e192a800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:23.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.944+0000 7fc3e192a800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:23.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.944+0000 7fc3e192a800 20 zonegroup default 2023-12-03T11:28:23.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.944+0000 7fc3e192a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.944+0000 7fc3e192a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.944+0000 7fc3e192a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.945+0000 7fc3e192a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.945+0000 7fc3e192a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.945+0000 7fc3e192a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:23.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.945+0000 7fc3e192a800 20 started sync module instance, tier type = 2023-12-03T11:28:23.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.945+0000 7fc3e192a800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:23.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.954+0000 7fc3dde66640 0 -- 172.21.15.44:0/173643233 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x5623db260410 msgr2=0x5623db2628d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:23.962 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.962+0000 7fc3e192a800 20 add_watcher() i=0 2023-12-03T11:28:23.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.962+0000 7fc3e192a800 20 add_watcher() i=1 2023-12-03T11:28:23.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.962+0000 7fc3e192a800 20 add_watcher() i=2 2023-12-03T11:28:23.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.962+0000 7fc3e192a800 20 add_watcher() i=3 2023-12-03T11:28:23.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.962+0000 7fc3e192a800 20 add_watcher() i=4 2023-12-03T11:28:23.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.962+0000 7fc3e192a800 20 add_watcher() i=5 2023-12-03T11:28:23.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.962+0000 7fc3e192a800 20 add_watcher() i=6 2023-12-03T11:28:23.965 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.964+0000 7fc3e192a800 20 add_watcher() i=7 2023-12-03T11:28:23.965 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.964+0000 7fc3e192a800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:23.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.966+0000 7fc3a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:23.967 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.966+0000 7fc3e192a800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:23.967 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.966+0000 7fc3e192a800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:23.973 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.972+0000 7fc3e192a800 5 note: GC not initialized 2023-12-03T11:28:23.973 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.972+0000 7fc311ffb640 20 reqs_thread_entry: start 2023-12-03T11:28:23.973 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.972+0000 7fc3e192a800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:23.973 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.972+0000 7fc3e192a800 20 Filter name: none 2023-12-03T11:28:23.974 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.972+0000 7fc3037fe640 20 reqs_thread_entry: start 2023-12-03T11:28:23.974 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.972+0000 7fc3e192a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.975 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.973+0000 7fc3e192a800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:23.975 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.973+0000 7fc3e192a800 20 rados->read ofs=0 len=0 2023-12-03T11:28:23.975 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.973+0000 7fc3e192a800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:23.975 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.973+0000 7fc3e192a800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:28:23.975 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.973+0000 7fc3e192a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:28:23.975 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.973+0000 7fc3e192a800 20 INFO: main: starting shard=0 2023-12-03T11:28:23.975 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.973+0000 7fc3e192a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:23.975 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.974+0000 7fc3e192a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:28:23.976 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.974+0000 7fc3e192a800 20 INFO: main: done 2023-12-03T11:28:23.976 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.975+0000 7fc3a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:23.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.977+0000 7fc3e192a800 20 remove_watcher() i=0 2023-12-03T11:28:23.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.977+0000 7fc3e192a800 2 removed watcher, disabling cache 2023-12-03T11:28:23.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.978+0000 7fc3e192a800 20 remove_watcher() i=1 2023-12-03T11:28:23.980 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.979+0000 7fc3e192a800 20 remove_watcher() i=2 2023-12-03T11:28:23.981 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.980+0000 7fc3e192a800 20 remove_watcher() i=3 2023-12-03T11:28:23.982 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.981+0000 7fc3e192a800 20 remove_watcher() i=4 2023-12-03T11:28:23.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.982+0000 7fc3e192a800 20 remove_watcher() i=5 2023-12-03T11:28:23.984 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.983+0000 7fc3e192a800 20 remove_watcher() i=6 2023-12-03T11:28:23.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:23.984+0000 7fc3e192a800 20 remove_watcher() i=7 2023-12-03T11:28:23.991 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object d 2023-12-03T11:28:24.021 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:24.022 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:24.036 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.035+0000 7fc3167dc800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.038 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.037+0000 7fc3167dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:24.038 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.037+0000 7fc3167dc800 20 realm 2023-12-03T11:28:24.038 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.037+0000 7fc3167dc800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.038 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.037+0000 7fc3167dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:24.038 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.037+0000 7fc3167dc800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:24.038 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.037+0000 7fc3167dc800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.039 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.037+0000 7fc3167dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:24.039 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.037+0000 7fc3167dc800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.039 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.038+0000 7fc3167dc800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:24.039 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.038+0000 7fc3167dc800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.039 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.039+0000 7fc3167dc800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:24.040 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.039+0000 7fc3167dc800 20 searching for the correct realm 2023-12-03T11:28:24.049 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.048+0000 7fc3142dc640 0 -- 172.21.15.44:0/3449911919 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55e02facf5b0 msgr2=0x55e02fad19c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:24.050 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.049+0000 7fc3167dc800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:24.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.049+0000 7fc3167dc800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:24.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.049+0000 7fc3167dc800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:24.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.049+0000 7fc3167dc800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:24.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.049+0000 7fc3167dc800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.050+0000 7fc3167dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:24.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.050+0000 7fc3167dc800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.050+0000 7fc3167dc800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:24.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.050+0000 7fc3167dc800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.052 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.050+0000 7fc3167dc800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:24.052 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.050+0000 7fc3167dc800 20 zone default found 2023-12-03T11:28:24.053 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.050+0000 7fc3167dc800 4 Realm: () 2023-12-03T11:28:24.053 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.050+0000 7fc3167dc800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:24.053 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.050+0000 7fc3167dc800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:24.053 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.050+0000 7fc3167dc800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:24.053 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.050+0000 7fc3167dc800 20 zonegroup default 2023-12-03T11:28:24.054 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.050+0000 7fc3167dc800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.054 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.050+0000 7fc3167dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:24.054 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.050+0000 7fc3167dc800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.054 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.051+0000 7fc3167dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:24.054 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.051+0000 7fc3167dc800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.054 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.051+0000 7fc3167dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:24.054 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.051+0000 7fc3167dc800 20 started sync module instance, tier type = 2023-12-03T11:28:24.054 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.051+0000 7fc3167dc800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:24.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.058+0000 7fc314add640 0 -- 172.21.15.44:0/3449911919 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55e02fad7690 msgr2=0x55e02fad9b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:24.062 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.061+0000 7fc3167dc800 20 add_watcher() i=0 2023-12-03T11:28:24.062 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.061+0000 7fc3167dc800 20 add_watcher() i=1 2023-12-03T11:28:24.062 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.061+0000 7fc3167dc800 20 add_watcher() i=2 2023-12-03T11:28:24.062 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.061+0000 7fc3167dc800 20 add_watcher() i=3 2023-12-03T11:28:24.062 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.061+0000 7fc3167dc800 20 add_watcher() i=4 2023-12-03T11:28:24.062 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.061+0000 7fc3167dc800 20 add_watcher() i=5 2023-12-03T11:28:24.063 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.061+0000 7fc3167dc800 20 add_watcher() i=6 2023-12-03T11:28:24.064 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.062+0000 7fc3167dc800 20 add_watcher() i=7 2023-12-03T11:28:24.064 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.062+0000 7fc3167dc800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:24.065 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.064+0000 7fc2da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:24.065 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.064+0000 7fc3167dc800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:24.065 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.064+0000 7fc3167dc800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:24.072 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.070+0000 7fc3167dc800 5 note: GC not initialized 2023-12-03T11:28:24.072 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.070+0000 7fc2497fa640 20 reqs_thread_entry: start 2023-12-03T11:28:24.072 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.070+0000 7fc3167dc800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:24.072 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.071+0000 7fc3167dc800 20 Filter name: none 2023-12-03T11:28:24.072 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.071+0000 7fc242ffd640 20 reqs_thread_entry: start 2023-12-03T11:28:24.072 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.071+0000 7fc3167dc800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.071+0000 7fc3167dc800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:24.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.071+0000 7fc3167dc800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.072+0000 7fc3167dc800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:24.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.072+0000 7fc3167dc800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:28:24.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.072+0000 7fc3167dc800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:28:24.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.072+0000 7fc3167dc800 20 INFO: main: starting shard=0 2023-12-03T11:28:24.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.072+0000 7fc3167dc800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:24.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.072+0000 7fc3167dc800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:28:24.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.072+0000 7fc3167dc800 20 INFO: main: done 2023-12-03T11:28:24.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.073+0000 7fc2da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:24.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.075+0000 7fc3167dc800 20 remove_watcher() i=0 2023-12-03T11:28:24.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.075+0000 7fc3167dc800 2 removed watcher, disabling cache 2023-12-03T11:28:24.077 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.077+0000 7fc3167dc800 20 remove_watcher() i=1 2023-12-03T11:28:24.079 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.078+0000 7fc3167dc800 20 remove_watcher() i=2 2023-12-03T11:28:24.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.079+0000 7fc3167dc800 20 remove_watcher() i=3 2023-12-03T11:28:24.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.080+0000 7fc3167dc800 20 remove_watcher() i=4 2023-12-03T11:28:24.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.081+0000 7fc3167dc800 20 remove_watcher() i=5 2023-12-03T11:28:24.083 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.082+0000 7fc3167dc800 20 remove_watcher() i=6 2023-12-03T11:28:24.084 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.083+0000 7fc3167dc800 20 remove_watcher() i=7 2023-12-03T11:28:24.089 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2023-12-03T11:28:24.089 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:28:24.090 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2023-12-03T11:28:24.120 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:24.120 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:24.330 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.329+0000 7fd8e65ec640 0 --2- 172.21.15.44:0/2837764436 >> [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] conn(0x5647927ec710 0x5647929196d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-12-03T11:28:24.336 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.335+0000 7fd8eb120800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.338 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.337+0000 7fd8eb120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:24.339 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.337+0000 7fd8eb120800 20 realm 2023-12-03T11:28:24.339 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.337+0000 7fd8eb120800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.339 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.337+0000 7fd8eb120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:24.339 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.337+0000 7fd8eb120800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:24.339 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.337+0000 7fd8eb120800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.339 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.338+0000 7fd8eb120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:24.339 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.338+0000 7fd8eb120800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.339 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.338+0000 7fd8eb120800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:24.339 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.339+0000 7fd8eb120800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.340 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.339+0000 7fd8eb120800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:24.340 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.339+0000 7fd8eb120800 20 searching for the correct realm 2023-12-03T11:28:24.348 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.347+0000 7fd8e6ded640 0 -- 172.21.15.44:0/3426262162 >> [v2:172.21.15.44:6800/4244511941,v1:172.21.15.44:6801/4244511941] conn(0x7fd8dc03d400 msgr2=0x7fd8dc03d880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:24.351 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.350+0000 7fd8eb120800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:24.351 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.350+0000 7fd8eb120800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:24.351 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.350+0000 7fd8eb120800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:24.351 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.350+0000 7fd8eb120800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:24.351 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.350+0000 7fd8eb120800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.351 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.350+0000 7fd8eb120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:24.351 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.350+0000 7fd8eb120800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.350+0000 7fd8eb120800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:24.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.350+0000 7fd8eb120800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.351+0000 7fd8eb120800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:24.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.351+0000 7fd8eb120800 20 zone default found 2023-12-03T11:28:24.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.351+0000 7fd8eb120800 4 Realm: () 2023-12-03T11:28:24.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.351+0000 7fd8eb120800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:24.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.351+0000 7fd8eb120800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:24.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.351+0000 7fd8eb120800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:24.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.351+0000 7fd8eb120800 20 zonegroup default 2023-12-03T11:28:24.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.351+0000 7fd8eb120800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.351+0000 7fd8eb120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:24.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.351+0000 7fd8eb120800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.351+0000 7fd8eb120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:24.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.351+0000 7fd8eb120800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.351+0000 7fd8eb120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:24.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.351+0000 7fd8eb120800 20 started sync module instance, tier type = 2023-12-03T11:28:24.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.351+0000 7fd8eb120800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:24.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.353+0000 7fd8e75ee640 0 -- 172.21.15.44:0/3426262162 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7fd8dc01a970 msgr2=0x7fd8dc028410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:24.364 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.363+0000 7fd8eb120800 20 add_watcher() i=0 2023-12-03T11:28:24.365 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.363+0000 7fd8eb120800 20 add_watcher() i=1 2023-12-03T11:28:24.365 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.363+0000 7fd8eb120800 20 add_watcher() i=2 2023-12-03T11:28:24.365 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.363+0000 7fd8eb120800 20 add_watcher() i=3 2023-12-03T11:28:24.365 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.363+0000 7fd8eb120800 20 add_watcher() i=4 2023-12-03T11:28:24.365 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.363+0000 7fd8eb120800 20 add_watcher() i=5 2023-12-03T11:28:24.365 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.363+0000 7fd8eb120800 20 add_watcher() i=6 2023-12-03T11:28:24.365 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.364+0000 7fd8eb120800 20 add_watcher() i=7 2023-12-03T11:28:24.366 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.364+0000 7fd8eb120800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:24.366 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.366+0000 7fd827fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:24.367 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.366+0000 7fd8eb120800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:24.367 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.366+0000 7fd8eb120800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:24.374 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.372+0000 7fd8eb120800 5 note: GC not initialized 2023-12-03T11:28:24.374 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.372+0000 7fd81effd640 20 reqs_thread_entry: start 2023-12-03T11:28:24.374 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.373+0000 7fd8eb120800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:24.374 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.373+0000 7fd8eb120800 20 Filter name: none 2023-12-03T11:28:24.374 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.373+0000 7fd81cff9640 20 reqs_thread_entry: start 2023-12-03T11:28:24.374 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.373+0000 7fd8eb120800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:28:24.374 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.373+0000 7fd8eb120800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.376 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.373+0000 7fd8eb120800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:24.376 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.373+0000 7fd8eb120800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:28:24.376 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.373+0000 7fd8eb120800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:28:24.376 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.373+0000 7fd8eb120800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 : miss 2023-12-03T11:28:24.376 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.373+0000 7fd8eb120800 20 rados->read ofs=0 len=0 2023-12-03T11:28:24.376 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.374+0000 7fd8eb120800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:24.376 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.374+0000 7fd8eb120800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 info.flags=0x17 2023-12-03T11:28:24.376 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.374+0000 7fd8eb120800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 to cache LRU end 2023-12-03T11:28:24.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.374+0000 7fd8eb120800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:28:24.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.374+0000 7fd8eb120800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:28:24.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.374+0000 7fd8eb120800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 2023-12-03T11:28:24.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.374+0000 7fd8eb120800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:24.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.374+0000 7fd8eb120800 1 NOTICE: finished shard 0 (0 entries found) 2023-12-03T11:28:24.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.374+0000 7fd8eb120800 1 NOTICE: finished all shards (0 entries found) 2023-12-03T11:28:24.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.375+0000 7fd827fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:24.378 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.377+0000 7fd8eb120800 20 remove_watcher() i=0 2023-12-03T11:28:24.378 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.377+0000 7fd8eb120800 2 removed watcher, disabling cache 2023-12-03T11:28:24.379 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.379+0000 7fd8eb120800 20 remove_watcher() i=1 2023-12-03T11:28:24.380 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.380+0000 7fd8eb120800 20 remove_watcher() i=2 2023-12-03T11:28:24.381 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.381+0000 7fd8eb120800 20 remove_watcher() i=3 2023-12-03T11:28:24.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.382+0000 7fd8eb120800 20 remove_watcher() i=4 2023-12-03T11:28:24.384 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.383+0000 7fd8eb120800 20 remove_watcher() i=5 2023-12-03T11:28:24.385 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.384+0000 7fd8eb120800 20 remove_watcher() i=6 2023-12-03T11:28:24.386 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:24.385+0000 7fd8eb120800 20 remove_watcher() i=7 2023-12-03T11:28:24.391 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: verify that bucket check fixes do not affect null version objects 2023-12-03T11:28:24.391 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:28:24.442 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2023-12-03T11:28:24.442 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:28:24.647 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2023-12-03T11:28:25.052 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2023-12-03T11:28:26.503 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:28:26.504 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object c 2023-12-03T11:28:26.538 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:26.539 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:26.555 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.554+0000 7f0eaf322800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.557 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.556+0000 7f0eaf322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:26.557 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.556+0000 7f0eaf322800 20 realm 2023-12-03T11:28:26.557 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.556+0000 7f0eaf322800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.558 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.557+0000 7f0eaf322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:26.558 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.557+0000 7f0eaf322800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:26.558 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.557+0000 7f0eaf322800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.558 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.557+0000 7f0eaf322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:26.558 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.557+0000 7f0eaf322800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.559 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.558+0000 7f0eaf322800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:26.559 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.558+0000 7f0eaf322800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.560 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.559+0000 7f0eaf322800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:26.560 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.559+0000 7f0eaf322800 20 searching for the correct realm 2023-12-03T11:28:26.571 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.570+0000 7f0eaaf1c640 0 -- 172.21.15.44:0/3888367172 >> [v2:172.21.15.44:6800/4244511941,v1:172.21.15.44:6801/4244511941] conn(0x7f0ea0019c10 msgr2=0x7f0ea006e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:26.573 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.572+0000 7f0eaf322800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:26.573 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.572+0000 7f0eaf322800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:26.573 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.572+0000 7f0eaf322800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:26.573 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.572+0000 7f0eaf322800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:26.573 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.572+0000 7f0eaf322800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.574 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.572+0000 7f0eaf322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:26.574 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.572+0000 7f0eaf322800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.574 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.573+0000 7f0eaf322800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:26.574 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.573+0000 7f0eaf322800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.575 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.573+0000 7f0eaf322800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:26.575 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.573+0000 7f0eaf322800 20 zone default found 2023-12-03T11:28:26.575 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.573+0000 7f0eaf322800 4 Realm: () 2023-12-03T11:28:26.575 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.573+0000 7f0eaf322800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:26.575 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.573+0000 7f0eaf322800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:26.575 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.573+0000 7f0eaf322800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:26.575 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.573+0000 7f0eaf322800 20 zonegroup default 2023-12-03T11:28:26.575 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.573+0000 7f0eaf322800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.575 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.573+0000 7f0eaf322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:26.575 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.574+0000 7f0eaf322800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.576 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.574+0000 7f0eaf322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:26.576 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.574+0000 7f0eaf322800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.576 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.574+0000 7f0eaf322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:26.576 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.574+0000 7f0eaf322800 20 started sync module instance, tier type = 2023-12-03T11:28:26.576 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.574+0000 7f0eaf322800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:26.581 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.580+0000 7f0eaa71b640 0 -- 172.21.15.44:0/3888367172 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x5585e9989c90 msgr2=0x5585e998c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:26.587 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.586+0000 7f0eaf322800 20 add_watcher() i=0 2023-12-03T11:28:26.587 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.586+0000 7f0eaf322800 20 add_watcher() i=1 2023-12-03T11:28:26.587 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.586+0000 7f0eaf322800 20 add_watcher() i=2 2023-12-03T11:28:26.587 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.586+0000 7f0eaf322800 20 add_watcher() i=3 2023-12-03T11:28:26.587 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.586+0000 7f0eaf322800 20 add_watcher() i=4 2023-12-03T11:28:26.587 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.586+0000 7f0eaf322800 20 add_watcher() i=5 2023-12-03T11:28:26.587 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.586+0000 7f0eaf322800 20 add_watcher() i=6 2023-12-03T11:28:26.588 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.587+0000 7f0eaf322800 20 add_watcher() i=7 2023-12-03T11:28:26.588 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.587+0000 7f0eaf322800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:26.590 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.589+0000 7f0debfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:26.590 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.589+0000 7f0eaf322800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:26.590 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.589+0000 7f0eaf322800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:26.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.596+0000 7f0eaf322800 5 note: GC not initialized 2023-12-03T11:28:26.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.596+0000 7f0ddaffd640 20 reqs_thread_entry: start 2023-12-03T11:28:26.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.596+0000 7f0eaf322800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:26.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.596+0000 7f0eaf322800 20 Filter name: none 2023-12-03T11:28:26.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.596+0000 7f0dd8ff9640 20 reqs_thread_entry: start 2023-12-03T11:28:26.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.596+0000 7f0eaf322800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.598 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.597+0000 7f0eaf322800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:26.598 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.597+0000 7f0eaf322800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.598 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.597+0000 7f0eaf322800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:26.598 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.597+0000 7f0eaf322800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:28:26.598 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.597+0000 7f0eaf322800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:28:26.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.597+0000 7f0eaf322800 20 INFO: main: starting shard=0 2023-12-03T11:28:26.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.597+0000 7f0eaf322800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:26.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.598+0000 7f0eaf322800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2023-12-03T11:28:26.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.598+0000 7f0eaf322800 20 INFO: main: done 2023-12-03T11:28:26.600 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.599+0000 7f0debfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:26.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.601+0000 7f0eaf322800 20 remove_watcher() i=0 2023-12-03T11:28:26.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.601+0000 7f0eaf322800 2 removed watcher, disabling cache 2023-12-03T11:28:26.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.603+0000 7f0eaf322800 20 remove_watcher() i=1 2023-12-03T11:28:26.604 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.604+0000 7f0eaf322800 20 remove_watcher() i=2 2023-12-03T11:28:26.606 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.605+0000 7f0eaf322800 20 remove_watcher() i=3 2023-12-03T11:28:26.607 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.606+0000 7f0eaf322800 20 remove_watcher() i=4 2023-12-03T11:28:26.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.607+0000 7f0eaf322800 20 remove_watcher() i=5 2023-12-03T11:28:26.609 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.609+0000 7f0eaf322800 20 remove_watcher() i=6 2023-12-03T11:28:26.610 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.610+0000 7f0eaf322800 20 remove_watcher() i=7 2023-12-03T11:28:26.673 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:28:26.674 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object d 2023-12-03T11:28:26.703 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:26.703 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:26.717 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.716+0000 7f3776533800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.718+0000 7f3776533800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:26.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.718+0000 7f3776533800 20 realm 2023-12-03T11:28:26.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.718+0000 7f3776533800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.718+0000 7f3776533800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:26.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.718+0000 7f3776533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:26.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.718+0000 7f3776533800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.718+0000 7f3776533800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:26.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.718+0000 7f3776533800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.719+0000 7f3776533800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:26.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.719+0000 7f3776533800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.720+0000 7f3776533800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:26.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.720+0000 7f3776533800 20 searching for the correct realm 2023-12-03T11:28:26.731 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.730+0000 7f37719fa640 0 -- 172.21.15.44:0/2158356144 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x55e3bb3d7bd0 msgr2=0x55e3bb3d9fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:26.732 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.732+0000 7f3776533800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:26.733 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.732+0000 7f3776533800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:26.733 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.732+0000 7f3776533800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:26.733 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.732+0000 7f3776533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:26.733 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.732+0000 7f3776533800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.733 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.732+0000 7f3776533800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:26.733 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.732+0000 7f3776533800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.734 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.732+0000 7f3776533800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:26.734 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.732+0000 7f3776533800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.734 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.732+0000 7f3776533800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:26.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.732+0000 7f3776533800 20 zone default found 2023-12-03T11:28:26.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.732+0000 7f3776533800 4 Realm: () 2023-12-03T11:28:26.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.732+0000 7f3776533800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:26.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.732+0000 7f3776533800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:26.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.732+0000 7f3776533800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:26.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.732+0000 7f3776533800 20 zonegroup default 2023-12-03T11:28:26.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.732+0000 7f3776533800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.733+0000 7f3776533800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:26.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.733+0000 7f3776533800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.733+0000 7f3776533800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:26.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.733+0000 7f3776533800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.733+0000 7f3776533800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:26.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.733+0000 7f3776533800 20 started sync module instance, tier type = 2023-12-03T11:28:26.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.733+0000 7f3776533800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:26.746 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.745+0000 7f37729fc640 0 -- 172.21.15.44:0/2158356144 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f37680a0d70 msgr2=0x7f3768093a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:28:26.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.753+0000 7f3776533800 20 add_watcher() i=0 2023-12-03T11:28:26.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.753+0000 7f3776533800 20 add_watcher() i=1 2023-12-03T11:28:26.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.753+0000 7f3776533800 20 add_watcher() i=2 2023-12-03T11:28:26.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.753+0000 7f3776533800 20 add_watcher() i=3 2023-12-03T11:28:26.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.753+0000 7f3776533800 20 add_watcher() i=4 2023-12-03T11:28:26.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.753+0000 7f3776533800 20 add_watcher() i=5 2023-12-03T11:28:26.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.753+0000 7f3776533800 20 add_watcher() i=6 2023-12-03T11:28:26.756 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.755+0000 7f3776533800 20 add_watcher() i=7 2023-12-03T11:28:26.756 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.755+0000 7f3776533800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:26.759 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.758+0000 7f3737fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:26.759 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.758+0000 7f3776533800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:26.759 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.758+0000 7f3776533800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:26.766 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.764+0000 7f3776533800 5 note: GC not initialized 2023-12-03T11:28:26.766 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.765+0000 7f36a6ffd640 20 reqs_thread_entry: start 2023-12-03T11:28:26.766 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.765+0000 7f3776533800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:26.766 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.765+0000 7f3776533800 20 Filter name: none 2023-12-03T11:28:26.766 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.765+0000 7f36a4ff9640 20 reqs_thread_entry: start 2023-12-03T11:28:26.766 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.765+0000 7f3776533800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.767 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.765+0000 7f3776533800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:26.767 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.765+0000 7f3776533800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.766+0000 7f3776533800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:26.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.766+0000 7f3776533800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:28:26.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.766+0000 7f3776533800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:28:26.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.766+0000 7f3776533800 20 INFO: main: starting shard=0 2023-12-03T11:28:26.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.766+0000 7f3776533800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:26.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.767+0000 7f3776533800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2023-12-03T11:28:26.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.767+0000 7f3776533800 20 INFO: main: done 2023-12-03T11:28:26.769 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.768+0000 7f3737fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:26.771 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.770+0000 7f3776533800 20 remove_watcher() i=0 2023-12-03T11:28:26.771 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.770+0000 7f3776533800 2 removed watcher, disabling cache 2023-12-03T11:28:26.772 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.771+0000 7f3776533800 20 remove_watcher() i=1 2023-12-03T11:28:26.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.772+0000 7f3776533800 20 remove_watcher() i=2 2023-12-03T11:28:26.774 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.773+0000 7f3776533800 20 remove_watcher() i=3 2023-12-03T11:28:26.775 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.775+0000 7f3776533800 20 remove_watcher() i=4 2023-12-03T11:28:26.777 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.776+0000 7f3776533800 20 remove_watcher() i=5 2023-12-03T11:28:26.779 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.777+0000 7f3776533800 20 remove_watcher() i=6 2023-12-03T11:28:26.779 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.778+0000 7f3776533800 20 remove_watcher() i=7 2023-12-03T11:28:26.843 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:28:26.844 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object e 2023-12-03T11:28:26.874 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:26.874 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:26.889 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.889+0000 7fa84fe11800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.892 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.890+0000 7fa84fe11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:26.892 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.890+0000 7fa84fe11800 20 realm 2023-12-03T11:28:26.892 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.890+0000 7fa84fe11800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.892 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.891+0000 7fa84fe11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:26.892 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.891+0000 7fa84fe11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:26.892 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.891+0000 7fa84fe11800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.892 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.891+0000 7fa84fe11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:26.892 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.891+0000 7fa84fe11800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.892 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.892+0000 7fa84fe11800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:26.893 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.892+0000 7fa84fe11800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.893 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.892+0000 7fa84fe11800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:26.893 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.892+0000 7fa84fe11800 20 searching for the correct realm 2023-12-03T11:28:26.901 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.900+0000 7fa84d911640 0 -- 172.21.15.44:0/350520031 >> [v2:172.21.15.44:6800/4244511941,v1:172.21.15.44:6801/4244511941] conn(0x7fa8440620d0 msgr2=0x7fa8440605f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:26.904 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.903+0000 7fa84e112640 0 -- 172.21.15.44:0/350520031 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x555832aed8d0 msgr2=0x7fa82807eab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:26.905 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.904+0000 7fa84fe11800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:26.905 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.904+0000 7fa84fe11800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:26.905 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.904+0000 7fa84fe11800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:26.905 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.904+0000 7fa84fe11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:26.905 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.904+0000 7fa84fe11800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.905 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.904+0000 7fa84fe11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:26.905 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.904+0000 7fa84fe11800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.906 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.905+0000 7fa84fe11800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:26.906 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.905+0000 7fa84fe11800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.907 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.905+0000 7fa84fe11800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:26.907 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.905+0000 7fa84fe11800 20 zone default found 2023-12-03T11:28:26.907 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.905+0000 7fa84fe11800 4 Realm: () 2023-12-03T11:28:26.907 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.905+0000 7fa84fe11800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:26.907 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.905+0000 7fa84fe11800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:26.907 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.905+0000 7fa84fe11800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:26.907 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.905+0000 7fa84fe11800 20 zonegroup default 2023-12-03T11:28:26.907 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.905+0000 7fa84fe11800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.907 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.906+0000 7fa84fe11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:26.907 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.906+0000 7fa84fe11800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.906+0000 7fa84fe11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:26.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.906+0000 7fa84fe11800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.906+0000 7fa84fe11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:26.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.906+0000 7fa84fe11800 20 started sync module instance, tier type = 2023-12-03T11:28:26.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.906+0000 7fa84fe11800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:26.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.918+0000 7fa84fe11800 20 add_watcher() i=0 2023-12-03T11:28:26.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.918+0000 7fa84fe11800 20 add_watcher() i=1 2023-12-03T11:28:26.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.918+0000 7fa84fe11800 20 add_watcher() i=2 2023-12-03T11:28:26.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.918+0000 7fa84fe11800 20 add_watcher() i=3 2023-12-03T11:28:26.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.918+0000 7fa84fe11800 20 add_watcher() i=4 2023-12-03T11:28:26.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.918+0000 7fa84fe11800 20 add_watcher() i=5 2023-12-03T11:28:26.921 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.920+0000 7fa84fe11800 20 add_watcher() i=6 2023-12-03T11:28:26.921 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.920+0000 7fa84fe11800 20 add_watcher() i=7 2023-12-03T11:28:26.921 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.920+0000 7fa84fe11800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:26.924 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.923+0000 7fa8137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:26.924 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.923+0000 7fa84fe11800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:26.924 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.923+0000 7fa84fe11800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:26.930 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.929+0000 7fa84fe11800 5 note: GC not initialized 2023-12-03T11:28:26.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.929+0000 7fa7827fc640 20 reqs_thread_entry: start 2023-12-03T11:28:26.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.929+0000 7fa84fe11800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:26.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.930+0000 7fa84fe11800 20 Filter name: none 2023-12-03T11:28:26.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.930+0000 7fa773fff640 20 reqs_thread_entry: start 2023-12-03T11:28:26.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.930+0000 7fa84fe11800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.930+0000 7fa84fe11800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:26.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.930+0000 7fa84fe11800 20 rados->read ofs=0 len=0 2023-12-03T11:28:26.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.930+0000 7fa84fe11800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:26.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.930+0000 7fa84fe11800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:28:26.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.930+0000 7fa84fe11800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:28:26.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.930+0000 7fa84fe11800 20 INFO: main: starting shard=0 2023-12-03T11:28:26.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.930+0000 7fa84fe11800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:26.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.931+0000 7fa84fe11800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:28:26.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.931+0000 7fa84fe11800 20 INFO: main: done 2023-12-03T11:28:26.933 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.932+0000 7fa8137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:26.936 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.935+0000 7fa84fe11800 20 remove_watcher() i=0 2023-12-03T11:28:26.936 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.935+0000 7fa84fe11800 2 removed watcher, disabling cache 2023-12-03T11:28:26.937 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.937+0000 7fa84fe11800 20 remove_watcher() i=1 2023-12-03T11:28:26.938 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.938+0000 7fa84fe11800 20 remove_watcher() i=2 2023-12-03T11:28:26.940 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.939+0000 7fa84fe11800 20 remove_watcher() i=3 2023-12-03T11:28:26.941 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.940+0000 7fa84fe11800 20 remove_watcher() i=4 2023-12-03T11:28:26.942 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.941+0000 7fa84fe11800 20 remove_watcher() i=5 2023-12-03T11:28:26.943 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.942+0000 7fa84fe11800 20 remove_watcher() i=6 2023-12-03T11:28:26.944 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:26.943+0000 7fa84fe11800 20 remove_watcher() i=7 2023-12-03T11:28:27.002 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:28:27.003 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object f 2023-12-03T11:28:27.034 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:27.034 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:27.049 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.048+0000 7f939932c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.050+0000 7f939932c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:27.052 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.050+0000 7f939932c800 20 realm 2023-12-03T11:28:27.052 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.050+0000 7f939932c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.052 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.050+0000 7f939932c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:27.052 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.050+0000 7f939932c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:27.052 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.050+0000 7f939932c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.052 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.051+0000 7f939932c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:27.052 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.051+0000 7f939932c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.052 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.052+0000 7f939932c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:27.052 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.052+0000 7f939932c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.053 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.052+0000 7f939932c800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:27.053 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.052+0000 7f939932c800 20 searching for the correct realm 2023-12-03T11:28:27.062 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.061+0000 7f93950f0640 0 -- 172.21.15.44:0/1953238611 >> [v2:172.21.15.44:6800/4244511941,v1:172.21.15.44:6801/4244511941] conn(0x7f938c04e970 msgr2=0x7f938c017430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:27.064 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.063+0000 7f939932c800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:27.064 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.063+0000 7f939932c800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:27.064 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.063+0000 7f939932c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:27.064 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.063+0000 7f939932c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:27.064 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.063+0000 7f939932c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.064 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.063+0000 7f939932c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:27.064 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.063+0000 7f939932c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.064 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.063+0000 7f939932c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:27.064 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.063+0000 7f939932c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.064+0000 7f939932c800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:27.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.064+0000 7f939932c800 20 zone default found 2023-12-03T11:28:27.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.064+0000 7f939932c800 4 Realm: () 2023-12-03T11:28:27.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.064+0000 7f939932c800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:27.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.064+0000 7f939932c800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:27.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.064+0000 7f939932c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:27.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.064+0000 7f939932c800 20 zonegroup default 2023-12-03T11:28:27.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.064+0000 7f939932c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.064+0000 7f939932c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:27.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.064+0000 7f939932c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.064+0000 7f939932c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:27.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.064+0000 7f939932c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.065+0000 7f939932c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:27.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.065+0000 7f939932c800 20 started sync module instance, tier type = 2023-12-03T11:28:27.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.065+0000 7f939932c800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:27.070 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.069+0000 7f93948ef640 0 -- 172.21.15.44:0/1953238611 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x5633ff0b9200 msgr2=0x5633ff0bb5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:27.079 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.078+0000 7f939932c800 20 add_watcher() i=0 2023-12-03T11:28:27.079 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.078+0000 7f939932c800 20 add_watcher() i=1 2023-12-03T11:28:27.079 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.078+0000 7f939932c800 20 add_watcher() i=2 2023-12-03T11:28:27.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.078+0000 7f939932c800 20 add_watcher() i=3 2023-12-03T11:28:27.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.078+0000 7f939932c800 20 add_watcher() i=4 2023-12-03T11:28:27.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.078+0000 7f939932c800 20 add_watcher() i=5 2023-12-03T11:28:27.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.080+0000 7f939932c800 20 add_watcher() i=6 2023-12-03T11:28:27.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.080+0000 7f939932c800 20 add_watcher() i=7 2023-12-03T11:28:27.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.080+0000 7f939932c800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:27.083 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.082+0000 7f935afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:27.083 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.082+0000 7f939932c800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:27.083 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.082+0000 7f939932c800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:27.089 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.088+0000 7f939932c800 5 note: GC not initialized 2023-12-03T11:28:27.090 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.088+0000 7f92c9ffb640 20 reqs_thread_entry: start 2023-12-03T11:28:27.090 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.088+0000 7f939932c800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:27.090 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.088+0000 7f939932c800 20 Filter name: none 2023-12-03T11:28:27.090 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.089+0000 7f92bb7fe640 20 reqs_thread_entry: start 2023-12-03T11:28:27.090 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.089+0000 7f939932c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.089+0000 7f939932c800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:27.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.089+0000 7f939932c800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.090+0000 7f939932c800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:27.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.090+0000 7f939932c800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:28:27.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.090+0000 7f939932c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:28:27.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.090+0000 7f939932c800 20 INFO: main: starting shard=0 2023-12-03T11:28:27.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.090+0000 7f939932c800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:27.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.090+0000 7f939932c800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:28:27.092 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.090+0000 7f939932c800 20 INFO: main: done 2023-12-03T11:28:27.092 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.091+0000 7f935afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:27.094 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.093+0000 7f939932c800 20 remove_watcher() i=0 2023-12-03T11:28:27.094 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.093+0000 7f939932c800 2 removed watcher, disabling cache 2023-12-03T11:28:27.095 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.094+0000 7f939932c800 20 remove_watcher() i=1 2023-12-03T11:28:27.097 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.096+0000 7f939932c800 20 remove_watcher() i=2 2023-12-03T11:28:27.098 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.097+0000 7f939932c800 20 remove_watcher() i=3 2023-12-03T11:28:27.099 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.098+0000 7f939932c800 20 remove_watcher() i=4 2023-12-03T11:28:27.101 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.100+0000 7f939932c800 20 remove_watcher() i=5 2023-12-03T11:28:27.103 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.103+0000 7f939932c800 20 remove_watcher() i=6 2023-12-03T11:28:27.104 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.104+0000 7f939932c800 20 remove_watcher() i=7 2023-12-03T11:28:27.115 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2023-12-03T11:28:27.507 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2023-12-03T11:28:27.900 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2023-12-03T11:28:27.929 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:27.929 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:27.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.946+0000 7fe3b2d22800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.949 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.948+0000 7fe3b2d22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:27.949 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.948+0000 7fe3b2d22800 20 realm 2023-12-03T11:28:27.949 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.948+0000 7fe3b2d22800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.949 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.948+0000 7fe3b2d22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:27.949 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.948+0000 7fe3b2d22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:27.950 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.948+0000 7fe3b2d22800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.950 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.948+0000 7fe3b2d22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:27.950 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.948+0000 7fe3b2d22800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.950 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.949+0000 7fe3b2d22800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:27.951 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.949+0000 7fe3b2d22800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.951 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.950+0000 7fe3b2d22800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:27.951 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.950+0000 7fe3b2d22800 20 searching for the correct realm 2023-12-03T11:28:27.962 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.961+0000 7fe3ae9a6640 0 -- 172.21.15.44:0/3888347816 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x555b58a0fff0 msgr2=0x555b58a123e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:27.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.962+0000 7fe3b2d22800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:27.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.962+0000 7fe3b2d22800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:27.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.962+0000 7fe3b2d22800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:27.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.962+0000 7fe3b2d22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:27.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.962+0000 7fe3b2d22800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.964 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.962+0000 7fe3b2d22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:27.964 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.962+0000 7fe3b2d22800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.965 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.963+0000 7fe3b2d22800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:27.965 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.963+0000 7fe3b2d22800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.965 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.963+0000 7fe3b2d22800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:27.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.963+0000 7fe3b2d22800 20 zone default found 2023-12-03T11:28:27.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.963+0000 7fe3b2d22800 4 Realm: () 2023-12-03T11:28:27.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.963+0000 7fe3b2d22800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:27.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.963+0000 7fe3b2d22800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:27.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.963+0000 7fe3b2d22800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:27.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.963+0000 7fe3b2d22800 20 zonegroup default 2023-12-03T11:28:27.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.963+0000 7fe3b2d22800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.963+0000 7fe3b2d22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:27.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.963+0000 7fe3b2d22800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.964+0000 7fe3b2d22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:27.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.964+0000 7fe3b2d22800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.964+0000 7fe3b2d22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:27.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.964+0000 7fe3b2d22800 20 started sync module instance, tier type = 2023-12-03T11:28:27.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.964+0000 7fe3b2d22800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:27.973 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.972+0000 7fe3af1a7640 0 -- 172.21.15.44:0/3888347816 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x555b58a17ff0 msgr2=0x555b58a1a4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:27.977 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.977+0000 7fe3b2d22800 20 add_watcher() i=0 2023-12-03T11:28:27.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.977+0000 7fe3b2d22800 20 add_watcher() i=1 2023-12-03T11:28:27.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.977+0000 7fe3b2d22800 20 add_watcher() i=2 2023-12-03T11:28:27.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.977+0000 7fe3b2d22800 20 add_watcher() i=3 2023-12-03T11:28:27.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.977+0000 7fe3b2d22800 20 add_watcher() i=4 2023-12-03T11:28:27.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.977+0000 7fe3b2d22800 20 add_watcher() i=5 2023-12-03T11:28:27.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.977+0000 7fe3b2d22800 20 add_watcher() i=6 2023-12-03T11:28:27.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.978+0000 7fe3b2d22800 20 add_watcher() i=7 2023-12-03T11:28:27.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.978+0000 7fe3b2d22800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:27.980 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.979+0000 7fe2effff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:27.981 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.980+0000 7fe3b2d22800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:27.981 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.980+0000 7fe3b2d22800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:27.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.986+0000 7fe3b2d22800 5 note: GC not initialized 2023-12-03T11:28:27.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.986+0000 7fe2deffd640 20 reqs_thread_entry: start 2023-12-03T11:28:27.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.986+0000 7fe3b2d22800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:27.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.986+0000 7fe3b2d22800 20 Filter name: none 2023-12-03T11:28:27.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.986+0000 7fe2dcff9640 20 reqs_thread_entry: start 2023-12-03T11:28:27.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.986+0000 7fe3b2d22800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:28:27.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.986+0000 7fe3b2d22800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.989 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.987+0000 7fe3b2d22800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:27.989 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.987+0000 7fe3b2d22800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:28:27.989 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.987+0000 7fe3b2d22800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:28:27.989 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.987+0000 7fe3b2d22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 : miss 2023-12-03T11:28:27.989 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.987+0000 7fe3b2d22800 20 rados->read ofs=0 len=0 2023-12-03T11:28:27.989 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.987+0000 7fe3b2d22800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:27.989 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.987+0000 7fe3b2d22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 info.flags=0x17 2023-12-03T11:28:27.989 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.987+0000 7fe3b2d22800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 to cache LRU end 2023-12-03T11:28:27.989 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.987+0000 7fe3b2d22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:28:27.989 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.987+0000 7fe3b2d22800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:28:27.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.987+0000 7fe3b2d22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 2023-12-03T11:28:27.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.987+0000 7fe3b2d22800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:28:27.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.987+0000 7fe3b2d22800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:28:27.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.988+0000 7fe3b2d22800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:28:27.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.988+0000 7fe3b2d22800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:28:27.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.988+0000 7fe3b2d22800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:28:27.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.988+0000 7fe3b2d22800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:28:27.992 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.991+0000 7fe2effff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:27.994 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.994+0000 7fe3b2d22800 20 remove_watcher() i=0 2023-12-03T11:28:27.994 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.994+0000 7fe3b2d22800 2 removed watcher, disabling cache 2023-12-03T11:28:27.995 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.995+0000 7fe3b2d22800 20 remove_watcher() i=1 2023-12-03T11:28:27.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.996+0000 7fe3b2d22800 20 remove_watcher() i=2 2023-12-03T11:28:27.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.997+0000 7fe3b2d22800 20 remove_watcher() i=3 2023-12-03T11:28:27.999 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.998+0000 7fe3b2d22800 20 remove_watcher() i=4 2023-12-03T11:28:28.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:27.999+0000 7fe3b2d22800 20 remove_watcher() i=5 2023-12-03T11:28:28.002 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.001+0000 7fe3b2d22800 20 remove_watcher() i=6 2023-12-03T11:28:28.003 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.002+0000 7fe3b2d22800 20 remove_watcher() i=7 2023-12-03T11:28:28.009 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2023-12-03T11:28:28.043 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:28.043 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:28.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.057+0000 7fd29a939800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.059+0000 7fd29a939800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:28.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.059+0000 7fd29a939800 20 realm 2023-12-03T11:28:28.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.059+0000 7fd29a939800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.059+0000 7fd29a939800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:28.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.059+0000 7fd29a939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:28.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.059+0000 7fd29a939800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.061 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.059+0000 7fd29a939800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:28.061 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.059+0000 7fd29a939800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.061 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.060+0000 7fd29a939800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:28.061 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.060+0000 7fd29a939800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.062 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.061+0000 7fd29a939800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:28.062 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.061+0000 7fd29a939800 20 searching for the correct realm 2023-12-03T11:28:28.070 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.069+0000 7fd296e41640 0 -- 172.21.15.44:0/3349147100 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7fd28c06ab20 msgr2=0x7fd28c08e960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:28.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.073+0000 7fd29a939800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:28.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.073+0000 7fd29a939800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:28.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.073+0000 7fd29a939800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:28.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.073+0000 7fd29a939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:28.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.073+0000 7fd29a939800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.073+0000 7fd29a939800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:28.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.073+0000 7fd29a939800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.075 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.073+0000 7fd29a939800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:28.075 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.073+0000 7fd29a939800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.075 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.073+0000 7fd29a939800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:28.075 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.074+0000 7fd29a939800 20 zone default found 2023-12-03T11:28:28.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.074+0000 7fd29a939800 4 Realm: () 2023-12-03T11:28:28.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.074+0000 7fd29a939800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:28.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.074+0000 7fd29a939800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:28.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.074+0000 7fd29a939800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:28.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.074+0000 7fd29a939800 20 zonegroup default 2023-12-03T11:28:28.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.074+0000 7fd29a939800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.074+0000 7fd296640640 0 -- 172.21.15.44:0/3349147100 >> [v2:172.21.15.44:6800/4244511941,v1:172.21.15.44:6801/4244511941] conn(0x7fd28c05baa0 msgr2=0x7fd28c069440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:28:28.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.074+0000 7fd29a939800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:28.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.074+0000 7fd29a939800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.075+0000 7fd29a939800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:28.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.075+0000 7fd29a939800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.077 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.075+0000 7fd29a939800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:28.077 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.075+0000 7fd29a939800 20 started sync module instance, tier type = 2023-12-03T11:28:28.077 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.075+0000 7fd29a939800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:28.087 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.086+0000 7fd29a939800 20 add_watcher() i=0 2023-12-03T11:28:28.087 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.086+0000 7fd29a939800 20 add_watcher() i=1 2023-12-03T11:28:28.087 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.086+0000 7fd29a939800 20 add_watcher() i=2 2023-12-03T11:28:28.087 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.086+0000 7fd29a939800 20 add_watcher() i=3 2023-12-03T11:28:28.087 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.086+0000 7fd29a939800 20 add_watcher() i=4 2023-12-03T11:28:28.087 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.086+0000 7fd29a939800 20 add_watcher() i=5 2023-12-03T11:28:28.090 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.089+0000 7fd29a939800 20 add_watcher() i=6 2023-12-03T11:28:28.090 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.089+0000 7fd29a939800 20 add_watcher() i=7 2023-12-03T11:28:28.090 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.089+0000 7fd29a939800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:28.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.091+0000 7fd25bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:28.092 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.091+0000 7fd29a939800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:28.092 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.091+0000 7fd29a939800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:28.098 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.097+0000 7fd29a939800 5 note: GC not initialized 2023-12-03T11:28:28.098 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.097+0000 7fd1caffd640 20 reqs_thread_entry: start 2023-12-03T11:28:28.098 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.097+0000 7fd29a939800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:28.098 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.097+0000 7fd29a939800 20 Filter name: none 2023-12-03T11:28:28.099 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.097+0000 7fd1c8ff9640 20 reqs_thread_entry: start 2023-12-03T11:28:28.099 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.097+0000 7fd29a939800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:28:28.099 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.097+0000 7fd29a939800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.099 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.098+0000 7fd29a939800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:28.100 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.098+0000 7fd29a939800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:28:28.100 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.098+0000 7fd29a939800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:28:28.100 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.098+0000 7fd29a939800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 : miss 2023-12-03T11:28:28.100 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.098+0000 7fd29a939800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.100 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.098+0000 7fd29a939800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:28.100 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.098+0000 7fd29a939800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 info.flags=0x17 2023-12-03T11:28:28.100 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.098+0000 7fd29a939800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 to cache LRU end 2023-12-03T11:28:28.100 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.098+0000 7fd29a939800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:28:28.100 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.098+0000 7fd29a939800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:28:28.100 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.098+0000 7fd29a939800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1 2023-12-03T11:28:28.100 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.098+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.101 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.100+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.101 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.100+0000 7fd29a939800 20 get_obj_state: octx=0x7fd288022440 obj=check-bucket:c state=0x560162a6c378 s->prefetch_data=0 2023-12-03T11:28:28.101 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.101+0000 7fd29a939800 20 get_obj_state: setting s->obj_tag to dfudbzkxyhwwye6s4tmdtalgxk60moo0 2023-12-03T11:28:28.101 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.101+0000 7fd29a939800 20 get_obj_state_impl: setting s->olh_tag to mg2bt4bq7uteppf3lt07qyhhv50tjtd5 2023-12-03T11:28:28.101 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.101+0000 7fd29a939800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mg2bt4bq7uteppf3lt07qyhhv50tjtd5 2023-12-03T11:28:28.103 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.102+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.104 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.104+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.105 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.104+0000 7fd29a939800 20 olh_log_entry: epoch=3 op=3 key=c[30ppIwyJt35244ThDj816ax6fYQeQQe] 2023-12-03T11:28:28.105 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.104+0000 7fd29a939800 20 get_obj_state: octx=0x7fd288022440 obj=check-bucket:_:30ppIwyJt35244ThDj816ax6fYQeQQe_c state=0x560162a74e48 s->prefetch_data=0 2023-12-03T11:28:28.105 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.104+0000 7fd29a939800 10 manifest: total_size = 12 2023-12-03T11:28:28.105 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.104+0000 7fd29a939800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.16636621830211493455 2023-12-03T11:28:28.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.104+0000 7fd29a939800 20 get_obj_state: octx=0x7fd288022440 obj=check-bucket:_:30ppIwyJt35244ThDj816ax6fYQeQQe_c state=0x560162a74e48 s->prefetch_data=0 2023-12-03T11:28:28.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.104+0000 7fd29a939800 20 prepare_atomic_modification: state is not atomic. state=0x560162a74e48 2023-12-03T11:28:28.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.104+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.109+0000 7fd284ff9640 20 handle_completion(): completion ok for obj=c[30ppIwyJt35244ThDj816ax6fYQeQQe] 2023-12-03T11:28:28.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.109+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.113 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.109+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.110+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.115 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.111+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.115 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.111+0000 7fd29a939800 20 get_obj_state: octx=0x7fd288022440 obj=check-bucket:d state=0x560162a6c378 s->prefetch_data=0 2023-12-03T11:28:28.115 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.111+0000 7fd29a939800 20 get_obj_state: setting s->obj_tag to 3736kkppqhq97qyg4ynawxi57trgoeym 2023-12-03T11:28:28.115 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.111+0000 7fd29a939800 20 get_obj_state_impl: setting s->olh_tag to i612mdbc9kstv5vjvgg3uvg3qu1xnz7t 2023-12-03T11:28:28.115 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.111+0000 7fd29a939800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=i612mdbc9kstv5vjvgg3uvg3qu1xnz7t 2023-12-03T11:28:28.115 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.113+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.116 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.115+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.117 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.116+0000 7fd29a939800 20 olh_log_entry: epoch=3 op=3 key=d[NtN.skKgNaLnFFBQcqtksxUs2bkPG.D] 2023-12-03T11:28:28.117 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.116+0000 7fd29a939800 20 get_obj_state: octx=0x7fd288022440 obj=check-bucket:_:NtN.skKgNaLnFFBQcqtksxUs2bkPG.D_d state=0x560162a751e8 s->prefetch_data=0 2023-12-03T11:28:28.118 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.116+0000 7fd29a939800 10 manifest: total_size = 22 2023-12-03T11:28:28.118 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.116+0000 7fd29a939800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.17557706021929076373 2023-12-03T11:28:28.118 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.116+0000 7fd29a939800 20 get_obj_state: octx=0x7fd288022440 obj=check-bucket:_:NtN.skKgNaLnFFBQcqtksxUs2bkPG.D_d state=0x560162a751e8 s->prefetch_data=0 2023-12-03T11:28:28.118 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.116+0000 7fd29a939800 20 prepare_atomic_modification: state is not atomic. state=0x560162a751e8 2023-12-03T11:28:28.118 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.116+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.121 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.120+0000 7fd277fff640 20 handle_completion(): completion ok for obj=d[NtN.skKgNaLnFFBQcqtksxUs2bkPG.D] 2023-12-03T11:28:28.121 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.120+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.121 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.120+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.123 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.122+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.124 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.123+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.124 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.123+0000 7fd29a939800 20 get_obj_state: octx=0x7fd288007f80 obj=check-bucket:e state=0x560162a6c378 s->prefetch_data=0 2023-12-03T11:28:28.124 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.123+0000 7fd29a939800 20 get_obj_state: setting s->obj_tag to p4dqq6i3z2qtbamzpmqvixlck8ppvzv6 2023-12-03T11:28:28.124 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.123+0000 7fd29a939800 20 get_obj_state_impl: setting s->olh_tag to 21qsvkbmuqkwg0knmlpd1sxw4szshuyv 2023-12-03T11:28:28.124 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.123+0000 7fd29a939800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=21qsvkbmuqkwg0knmlpd1sxw4szshuyv 2023-12-03T11:28:28.125 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.125+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.127 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.126+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.127 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.126+0000 7fd29a939800 20 olh_log_entry: epoch=2 op=2 key=e[] 2023-12-03T11:28:28.127 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.126+0000 7fd29a939800 20 olh_log_entry: epoch=2 op=3 key=e[3XIOcYynUjdfcNi9YI-bIqwMQnHd4C3] 2023-12-03T11:28:28.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.126+0000 7fd29a939800 20 get_obj_state: octx=0x7fd288007f80 obj=check-bucket:_:3XIOcYynUjdfcNi9YI-bIqwMQnHd4C3_e state=0x560162a751a8 s->prefetch_data=0 2023-12-03T11:28:28.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.127+0000 7fd29a939800 10 manifest: total_size = 11 2023-12-03T11:28:28.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.127+0000 7fd29a939800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.3123889243346131369 2023-12-03T11:28:28.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.127+0000 7fd29a939800 20 get_obj_state: octx=0x7fd288007f80 obj=check-bucket:_:3XIOcYynUjdfcNi9YI-bIqwMQnHd4C3_e state=0x560162a751a8 s->prefetch_data=0 2023-12-03T11:28:28.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.127+0000 7fd29a939800 20 prepare_atomic_modification: state is not atomic. state=0x560162a751a8 2023-12-03T11:28:28.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.127+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.132 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.131+0000 7fd284ff9640 20 handle_completion(): completion ok for obj=e[3XIOcYynUjdfcNi9YI-bIqwMQnHd4C3] 2023-12-03T11:28:28.132 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.131+0000 7fd29a939800 20 get_obj_state: octx=0x7fd288007f80 obj=check-bucket:e state=0x560162a6c378 s->prefetch_data=0 2023-12-03T11:28:28.133 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.131+0000 7fd29a939800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=21qsvkbmuqkwg0knmlpd1sxw4szshuyv 2023-12-03T11:28:28.136 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.135+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.136+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.137+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.138 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.137+0000 7fd29a939800 20 get_obj_state: octx=0x7fd28c04f4d0 obj=check-bucket:f state=0x560162a6c378 s->prefetch_data=0 2023-12-03T11:28:28.138 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.137+0000 7fd29a939800 20 get_obj_state: setting s->obj_tag to lii9rf2y0rw2jzar47tdcr6czogk1y0d 2023-12-03T11:28:28.139 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.137+0000 7fd29a939800 20 get_obj_state_impl: setting s->olh_tag to fjqxriiwcdwoctjyo0jvftrqkg3r3f3x 2023-12-03T11:28:28.139 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.137+0000 7fd29a939800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fjqxriiwcdwoctjyo0jvftrqkg3r3f3x 2023-12-03T11:28:28.140 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.139+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.141 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.140+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.140+0000 7fd29a939800 20 olh_log_entry: epoch=2 op=2 key=f[] 2023-12-03T11:28:28.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.140+0000 7fd29a939800 20 olh_log_entry: epoch=2 op=3 key=f[ROB7gQCH00j.v15mqSEN5QQRq.N2HoR] 2023-12-03T11:28:28.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.140+0000 7fd29a939800 20 get_obj_state: octx=0x7fd28c04f4d0 obj=check-bucket:_:ROB7gQCH00j.v15mqSEN5QQRq.N2HoR_f state=0x560162a751a8 s->prefetch_data=0 2023-12-03T11:28:28.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.141+0000 7fd29a939800 10 manifest: total_size = 9 2023-12-03T11:28:28.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.141+0000 7fd29a939800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.2564257196611450115 2023-12-03T11:28:28.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.141+0000 7fd29a939800 20 get_obj_state: octx=0x7fd28c04f4d0 obj=check-bucket:_:ROB7gQCH00j.v15mqSEN5QQRq.N2HoR_f state=0x560162a751a8 s->prefetch_data=0 2023-12-03T11:28:28.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.141+0000 7fd29a939800 20 prepare_atomic_modification: state is not atomic. state=0x560162a751a8 2023-12-03T11:28:28.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.141+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.145+0000 7fd277fff640 20 handle_completion(): completion ok for obj=f[ROB7gQCH00j.v15mqSEN5QQRq.N2HoR] 2023-12-03T11:28:28.150 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.149+0000 7fd29a939800 20 get_obj_state: octx=0x7fd28c04f4d0 obj=check-bucket:f state=0x560162a6c378 s->prefetch_data=0 2023-12-03T11:28:28.150 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.149+0000 7fd29a939800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fjqxriiwcdwoctjyo0jvftrqkg3r3f3x 2023-12-03T11:28:28.163 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.163+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.165 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.164+0000 7fd29a939800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.1.0 2023-12-03T11:28:28.165 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.164+0000 7fd29a939800 1 NOTICE: finished shard 0 (4 entries removed) 2023-12-03T11:28:28.165 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.164+0000 7fd29a939800 1 NOTICE: finished all shards (4 entries removed) 2023-12-03T11:28:28.166 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.165+0000 7fd25bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:28.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.167+0000 7fd29a939800 20 remove_watcher() i=0 2023-12-03T11:28:28.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.167+0000 7fd29a939800 2 removed watcher, disabling cache 2023-12-03T11:28:28.170 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.169+0000 7fd29a939800 20 remove_watcher() i=1 2023-12-03T11:28:28.171 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.170+0000 7fd29a939800 20 remove_watcher() i=2 2023-12-03T11:28:28.172 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.172+0000 7fd29a939800 20 remove_watcher() i=3 2023-12-03T11:28:28.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.173+0000 7fd29a939800 20 remove_watcher() i=4 2023-12-03T11:28:28.175 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.174+0000 7fd29a939800 20 remove_watcher() i=5 2023-12-03T11:28:28.177 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.177+0000 7fd29a939800 20 remove_watcher() i=6 2023-12-03T11:28:28.178 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.178+0000 7fd29a939800 20 remove_watcher() i=7 2023-12-03T11:28:28.243 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket check-bucket 2023-12-03T11:28:28.272 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:28.272 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:28.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.285+0000 7f12a800f800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.287+0000 7f12a800f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:28.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.287+0000 7f12a800f800 20 realm 2023-12-03T11:28:28.289 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.287+0000 7f12a800f800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.289 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.287+0000 7f12a800f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:28.289 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.287+0000 7f12a800f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:28:28.289 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.287+0000 7f12a800f800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.289 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.287+0000 7f12a800f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:28.289 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.287+0000 7f12a800f800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.289 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.288+0000 7f12a800f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:28.289 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.288+0000 7f12a800f800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.290 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.289+0000 7f12a800f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:28:28.290 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.289+0000 7f12a800f800 20 searching for the correct realm 2023-12-03T11:28:28.301 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.299+0000 7f12a3e1b640 0 -- 172.21.15.44:0/563542371 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f128c027020 msgr2=0x7f128c057670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:28.301 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.299+0000 7f12a800f800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:28:28.301 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.299+0000 7f12a800f800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:28:28.301 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.299+0000 7f12a800f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:28:28.301 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.299+0000 7f12a800f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:28:28.301 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.299+0000 7f12a800f800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.301 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.300+0000 7f12a800f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:28.301 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.300+0000 7f12a800f800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.301 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.300+0000 7f12a800f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:28:28.301 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.300+0000 7f12a800f800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.303 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.300+0000 7f12a800f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:28:28.303 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.300+0000 7f12a800f800 20 zone default found 2023-12-03T11:28:28.303 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.300+0000 7f12a800f800 4 Realm: () 2023-12-03T11:28:28.303 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.300+0000 7f12a800f800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:28:28.303 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.300+0000 7f12a800f800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:28:28.303 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.300+0000 7f12a800f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:28:28.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.300+0000 7f12a800f800 20 zonegroup default 2023-12-03T11:28:28.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.300+0000 7f12a800f800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.301+0000 7f12a800f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:28.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.301+0000 7f12a800f800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.301+0000 7f12a800f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:28.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.301+0000 7f12a800f800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.301+0000 7f12a800f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:28.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.301+0000 7f12a800f800 20 started sync module instance, tier type = 2023-12-03T11:28:28.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.301+0000 7f12a800f800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:28:28.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.312+0000 7f12a361a640 0 -- 172.21.15.44:0/563542371 >> [v2:172.21.15.44:6800/4244511941,v1:172.21.15.44:6801/4244511941] conn(0x7f128c00cc20 msgr2=0x7f128c0599a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:28:28.317 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.312+0000 7f12a800f800 20 add_watcher() i=0 2023-12-03T11:28:28.317 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.312+0000 7f12a800f800 20 add_watcher() i=1 2023-12-03T11:28:28.317 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.312+0000 7f12a800f800 20 add_watcher() i=2 2023-12-03T11:28:28.317 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.312+0000 7f12a800f800 20 add_watcher() i=3 2023-12-03T11:28:28.317 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.312+0000 7f12a800f800 20 add_watcher() i=4 2023-12-03T11:28:28.317 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.312+0000 7f12a800f800 20 add_watcher() i=5 2023-12-03T11:28:28.317 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.312+0000 7f12a800f800 20 add_watcher() i=6 2023-12-03T11:28:28.317 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.314+0000 7f12a800f800 20 add_watcher() i=7 2023-12-03T11:28:28.317 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.314+0000 7f12a800f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:28:28.318 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.315+0000 7f12697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:28.318 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.315+0000 7f12a800f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:28:28.318 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.315+0000 7f12a800f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:28:28.323 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.321+0000 7f12a800f800 5 note: GC not initialized 2023-12-03T11:28:28.323 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.321+0000 7f11d7fff640 20 reqs_thread_entry: start 2023-12-03T11:28:28.323 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.322+0000 7f12a800f800 20 init_complete bucket index max shards: 1 2023-12-03T11:28:28.323 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.322+0000 7f12a800f800 20 Filter name: none 2023-12-03T11:28:28.323 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.322+0000 7f11d5ffb640 20 reqs_thread_entry: start 2023-12-03T11:28:28.323 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.322+0000 7f12a800f800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.324 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.322+0000 7f12a800f800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:28.324 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.322+0000 7f12a800f800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.324 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.323+0000 7f12a800f800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:28.324 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.323+0000 7f12a800f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:28:28.324 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.323+0000 7f12a800f800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.324 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.323+0000 7f12a800f800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:28:28.324 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.323+0000 7f12a800f800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.325 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.324+0000 7f12a800f800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:28:28.325 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.324+0000 7f12a800f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:28:28.326 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.324+0000 7f12a800f800 20 rados->read ofs=0 len=0 2023-12-03T11:28:28.326 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.325+0000 7f12a800f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:28:28.329 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.325+0000 7f12697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:28:28.329 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.328+0000 7f12a800f800 20 remove_watcher() i=0 2023-12-03T11:28:28.329 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.328+0000 7f12a800f800 2 removed watcher, disabling cache 2023-12-03T11:28:28.329 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.329+0000 7f12a800f800 20 remove_watcher() i=1 2023-12-03T11:28:28.330 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.330+0000 7f12a800f800 20 remove_watcher() i=2 2023-12-03T11:28:28.332 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.331+0000 7f12a800f800 20 remove_watcher() i=3 2023-12-03T11:28:28.333 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.332+0000 7f12a800f800 20 remove_watcher() i=4 2023-12-03T11:28:28.334 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.333+0000 7f12a800f800 20 remove_watcher() i=5 2023-12-03T11:28:28.335 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.334+0000 7f12a800f800 20 remove_watcher() i=6 2023-12-03T11:28:28.336 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:28:28.335+0000 7f12a800f800 20 remove_watcher() i=7 2023-12-03T11:28:28.340 INFO:tasks.workunit.client.0.smithi044.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2023-12-03T11:28:28.341 INFO:tasks.workunit.client.0.smithi044.stderr:Deleting bucket check-bucket 2023-12-03T11:28:28.361 INFO:tasks.workunit.client.0.smithi044.stderr:Completed bucket check tests 2023-12-03T11:28:28.361 INFO:tasks.workunit.client.0.smithi044.stdout:connected to http://localhost:80 2023-12-03T11:28:28.417 INFO:tasks.workunit.client.0.smithi044.stderr:+ deactivate 2023-12-03T11:28:28.417 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2023-12-03T11:28:28.417 INFO:tasks.workunit.client.0.smithi044.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-12-03T11:28:28.417 INFO:tasks.workunit.client.0.smithi044.stderr:+ export PATH 2023-12-03T11:28:28.417 INFO:tasks.workunit.client.0.smithi044.stderr:+ unset _OLD_VIRTUAL_PATH 2023-12-03T11:28:28.418 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n '' ']' 2023-12-03T11:28:28.418 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2023-12-03T11:28:28.418 INFO:tasks.workunit.client.0.smithi044.stderr:+ hash -r 2023-12-03T11:28:28.418 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n '' ']' 2023-12-03T11:28:28.418 INFO:tasks.workunit.client.0.smithi044.stderr:+ unset VIRTUAL_ENV 2023-12-03T11:28:28.418 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' '!' '' = nondestructive ']' 2023-12-03T11:28:28.418 INFO:tasks.workunit.client.0.smithi044.stderr:+ unset -f deactivate 2023-12-03T11:28:28.418 INFO:tasks.workunit.client.0.smithi044.stderr:+ echo OK. 2023-12-03T11:28:28.419 INFO:tasks.workunit.client.0.smithi044.stdout:OK. 2023-12-03T11:28:28.419 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:28:28.419 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:28:28.490 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2023-12-03T11:28:28.490 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-03T11:28:28.850 DEBUG:teuthology.parallel:result is None 2023-12-03T11:28:28.851 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:28:28.881 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:28:28.881 DEBUG:teuthology.orchestra.run.smithi044:> rmdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:28:28.957 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:28:28.957 INFO:teuthology.run_tasks:Running task workunit... 2023-12-03T11:28:28.967 INFO:tasks.workunit:Pulling workunits from ref bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:28:28.967 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-03T11:28:28.967 DEBUG:teuthology.orchestra.run.smithi044:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:28:29.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:28:29.013 INFO:teuthology.orchestra.run.smithi044.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-12-03T11:28:29.014 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:28:29.069 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-12-03T11:28:29.069 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-12-03T11:28:29.124 INFO:tasks.workunit:timeout=3h 2023-12-03T11:28:29.124 INFO:tasks.workunit:cleanup=True 2023-12-03T11:28:29.124 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:28:29.179 INFO:tasks.workunit.client.0.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-03T11:29:34.499 INFO:tasks.workunit.client.0.smithi044.stderr:Updating files: 96% (11669/12123) Updating files: 97% (11760/12123) Updating files: 98% (11881/12123) Updating files: 99% (12002/12123) Updating files: 100% (12123/12123) Updating files: 100% (12123/12123), done. 2023-12-03T11:29:34.999 INFO:tasks.workunit.client.0.smithi044.stderr:Note: switching to 'bcbf278cf395873c2a482f5a7b2345faf2160319'. 2023-12-03T11:29:34.999 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:29:34.999 INFO:tasks.workunit.client.0.smithi044.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-03T11:29:34.999 INFO:tasks.workunit.client.0.smithi044.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-03T11:29:34.999 INFO:tasks.workunit.client.0.smithi044.stderr:state without impacting any branches by switching back to a branch. 2023-12-03T11:29:34.999 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:29:34.999 INFO:tasks.workunit.client.0.smithi044.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-03T11:29:34.999 INFO:tasks.workunit.client.0.smithi044.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-03T11:29:34.999 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:29:35.000 INFO:tasks.workunit.client.0.smithi044.stderr: git switch -c 2023-12-03T11:29:35.000 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:29:35.000 INFO:tasks.workunit.client.0.smithi044.stderr:Or undo this operation with: 2023-12-03T11:29:35.000 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:29:35.000 INFO:tasks.workunit.client.0.smithi044.stderr: git switch - 2023-12-03T11:29:35.000 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:29:35.000 INFO:tasks.workunit.client.0.smithi044.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-03T11:29:35.000 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:29:35.000 INFO:tasks.workunit.client.0.smithi044.stderr:HEAD is now at bcbf278cf39 RGW:pubsub publish commit with etag populated 2023-12-03T11:29:35.002 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-03T11:29:35.057 INFO:tasks.workunit.client.0.smithi044.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-03T11:29:35.059 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:29:35.059 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-03T11:29:35.110 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-03T11:29:35.159 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-03T11:29:35.200 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:29:35.201 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:29:35.202 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-03T11:29:35.243 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:29:35.245 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:29:35.246 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-03T11:29:35.301 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2023-12-03T11:29:35.302 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2023-12-03T11:29:35.303 DEBUG:teuthology.orchestra.run.smithi044:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2023-12-03T11:29:35.371 INFO:tasks.workunit.client.0.smithi044.stdout:Running main() from gmock_main.cc 2023-12-03T11:29:35.371 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 11 tests from 1 test suite. 2023-12-03T11:29:35.371 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2023-12-03T11:29:35.372 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 11 tests from ClsLock 2023-12-03T11:29:35.372 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsLock.TestMultiLocking 2023-12-03T11:29:37.174 INFO:tasks.workunit.client.0.smithi044.stdout:lock: mylock 2023-12-03T11:29:37.174 INFO:tasks.workunit.client.0.smithi044.stdout: lock_type: exclusive 2023-12-03T11:29:37.174 INFO:tasks.workunit.client.0.smithi044.stdout: tag: 2023-12-03T11:29:37.174 INFO:tasks.workunit.client.0.smithi044.stdout: lockers: 2023-12-03T11:29:37.175 INFO:tasks.workunit.client.0.smithi044.stdout: client.5244 expiration=2023-12-03T11:31:37.164146+0000 addr=v1:172.21.15.44:0/1031155275 cookie= 2023-12-03T11:29:37.180 INFO:tasks.workunit.client.0.smithi044.stdout:lock: mylock 2023-12-03T11:29:37.180 INFO:tasks.workunit.client.0.smithi044.stdout: lock_type: shared 2023-12-03T11:29:37.180 INFO:tasks.workunit.client.0.smithi044.stdout: tag: 2023-12-03T11:29:37.180 INFO:tasks.workunit.client.0.smithi044.stdout: lockers: 2023-12-03T11:29:37.180 INFO:tasks.workunit.client.0.smithi044.stdout: client.5069 expiration=0.000000 addr=v1:172.21.15.44:0/2115072211 cookie= 2023-12-03T11:29:37.180 INFO:tasks.workunit.client.0.smithi044.stdout: client.5244 expiration=2023-12-03T11:31:37.177091+0000 addr=v1:172.21.15.44:0/1031155275 cookie= 2023-12-03T11:29:37.182 INFO:tasks.workunit.client.0.smithi044.stdout:lock: mylock 2023-12-03T11:29:37.182 INFO:tasks.workunit.client.0.smithi044.stdout: lock_type: shared 2023-12-03T11:29:37.182 INFO:tasks.workunit.client.0.smithi044.stdout: tag: 2023-12-03T11:29:37.182 INFO:tasks.workunit.client.0.smithi044.stdout: lockers: 2023-12-03T11:29:37.183 INFO:tasks.workunit.client.0.smithi044.stdout: client.5069 expiration=0.000000 addr=v1:172.21.15.44:0/2115072211 cookie= 2023-12-03T11:29:38.064 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsLock.TestMultiLocking (2693 ms) 2023-12-03T11:29:38.064 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsLock.TestMeta 2023-12-03T11:29:40.511 INFO:tasks.workunit.client.0.smithi044.stdout:lock: mylock 2023-12-03T11:29:40.512 INFO:tasks.workunit.client.0.smithi044.stdout: lock_type: shared 2023-12-03T11:29:40.512 INFO:tasks.workunit.client.0.smithi044.stdout: tag: 2023-12-03T11:29:40.512 INFO:tasks.workunit.client.0.smithi044.stdout: lockers: 2023-12-03T11:29:40.512 INFO:tasks.workunit.client.0.smithi044.stdout: client.5081 expiration=0.000000 addr=v1:172.21.15.44:0/4168519578 cookie= 2023-12-03T11:29:40.514 INFO:tasks.workunit.client.0.smithi044.stdout:lock: mylock 2023-12-03T11:29:40.514 INFO:tasks.workunit.client.0.smithi044.stdout: lock_type: exclusive 2023-12-03T11:29:40.515 INFO:tasks.workunit.client.0.smithi044.stdout: tag: new_tag 2023-12-03T11:29:40.515 INFO:tasks.workunit.client.0.smithi044.stdout: lockers: 2023-12-03T11:29:40.515 INFO:tasks.workunit.client.0.smithi044.stdout: client.5075 expiration=0.000000 addr=v1:172.21.15.44:0/1479267200 cookie= 2023-12-03T11:29:41.083 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsLock.TestMeta (3019 ms) 2023-12-03T11:29:41.084 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsLock.TestCookie 2023-12-03T11:29:43.113 INFO:tasks.workunit.client.0.smithi044.stdout:lock: mylock 2023-12-03T11:29:43.113 INFO:tasks.workunit.client.0.smithi044.stdout: lock_type: exclusive 2023-12-03T11:29:43.113 INFO:tasks.workunit.client.0.smithi044.stdout: tag: 2023-12-03T11:29:43.114 INFO:tasks.workunit.client.0.smithi044.stdout: lockers: 2023-12-03T11:29:43.116 INFO:tasks.workunit.client.0.smithi044.stdout:lock: mylock 2023-12-03T11:29:43.116 INFO:tasks.workunit.client.0.smithi044.stdout: lock_type: shared 2023-12-03T11:29:43.116 INFO:tasks.workunit.client.0.smithi044.stdout: tag: 2023-12-03T11:29:43.116 INFO:tasks.workunit.client.0.smithi044.stdout: lockers: 2023-12-03T11:29:43.116 INFO:tasks.workunit.client.0.smithi044.stdout: client.5080 expiration=0.000000 addr=v1:172.21.15.44:0/4071722720 cookie= 2023-12-03T11:29:43.116 INFO:tasks.workunit.client.0.smithi044.stdout: client.5080 expiration=0.000000 addr=v1:172.21.15.44:0/4071722720 cookie=new cookie 2023-12-03T11:29:44.106 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsLock.TestCookie (3022 ms) 2023-12-03T11:29:44.106 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsLock.TestMultipleLocks 2023-12-03T11:29:47.109 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsLock.TestMultipleLocks (3004 ms) 2023-12-03T11:29:47.110 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsLock.TestLockDuration 2023-12-03T11:29:54.389 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsLock.TestLockDuration (7280 ms) 2023-12-03T11:29:54.389 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsLock.TestAssertLocked 2023-12-03T11:29:57.414 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsLock.TestAssertLocked (3025 ms) 2023-12-03T11:29:57.414 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsLock.TestSetCookie 2023-12-03T11:30:00.430 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsLock.TestSetCookie (3016 ms) 2023-12-03T11:30:00.430 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsLock.TestRenew 2023-12-03T11:30:20.840 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsLock.TestRenew (20409 ms) 2023-12-03T11:30:20.840 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2023-12-03T11:30:27.880 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7040 ms) 2023-12-03T11:30:27.880 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2023-12-03T11:30:35.915 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8036 ms) 2023-12-03T11:30:35.915 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2023-12-03T11:30:44.018 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8103 ms) 2023-12-03T11:30:44.018 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 11 tests from ClsLock (68647 ms total) 2023-12-03T11:30:44.018 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:30:44.018 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2023-12-03T11:30:44.018 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 11 tests from 1 test suite ran. (68647 ms total) 2023-12-03T11:30:44.019 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 11 tests. 2023-12-03T11:30:44.021 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:30:44.021 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:30:44.096 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2023-12-03T11:30:44.098 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2023-12-03T11:30:44.098 DEBUG:teuthology.orchestra.run.smithi044:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2023-12-03T11:30:44.169 INFO:tasks.workunit.client.0.smithi044.stdout:Running main() from gmock_main.cc 2023-12-03T11:30:44.169 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 4 tests from 1 test suite. 2023-12-03T11:30:44.169 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2023-12-03T11:30:44.169 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 4 tests from cls_log 2023-12-03T11:30:44.170 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_log.test_log_add_same_time 2023-12-03T11:30:47.029 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_log.test_log_add_same_time (2859 ms) 2023-12-03T11:30:47.029 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_log.test_log_add_different_time 2023-12-03T11:30:50.056 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_log.test_log_add_different_time (3028 ms) 2023-12-03T11:30:50.056 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_log.trim_by_time 2023-12-03T11:30:53.076 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_log.trim_by_time (3020 ms) 2023-12-03T11:30:53.076 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_log.trim_by_marker 2023-12-03T11:30:56.097 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_log.trim_by_marker (3021 ms) 2023-12-03T11:30:56.098 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 4 tests from cls_log (11928 ms total) 2023-12-03T11:30:56.098 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:30:56.098 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2023-12-03T11:30:56.098 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 4 tests from 1 test suite ran. (11928 ms total) 2023-12-03T11:30:56.098 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 4 tests. 2023-12-03T11:30:56.100 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:30:56.100 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:30:56.176 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2023-12-03T11:30:56.178 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2023-12-03T11:30:56.178 DEBUG:teuthology.orchestra.run.smithi044:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2023-12-03T11:30:56.251 INFO:tasks.workunit.client.0.smithi044.stdout:Running main() from gmock_main.cc 2023-12-03T11:30:56.251 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 10 tests from 1 test suite. 2023-12-03T11:30:56.251 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2023-12-03T11:30:56.251 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 10 tests from cls_refcount 2023-12-03T11:30:56.251 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_refcount.test_implicit 2023-12-03T11:30:59.104 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_refcount.test_implicit (2853 ms) 2023-12-03T11:30:59.104 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2023-12-03T11:31:02.148 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3045 ms) 2023-12-03T11:31:02.148 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_refcount.test_put_snap 2023-12-03T11:31:11.193 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_refcount.test_put_snap (9044 ms) 2023-12-03T11:31:11.193 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_refcount.test_explicit 2023-12-03T11:31:14.226 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_refcount.test_explicit (3034 ms) 2023-12-03T11:31:14.226 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_refcount.set 2023-12-03T11:31:17.244 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_refcount.set (3018 ms) 2023-12-03T11:31:17.244 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_refcount.test_implicit_ec 2023-12-03T11:31:24.267 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_refcount.test_implicit_ec (7023 ms) 2023-12-03T11:31:24.267 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2023-12-03T11:31:31.310 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7043 ms) 2023-12-03T11:31:31.311 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2023-12-03T11:31:44.396 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_refcount.test_put_snap_ec (13085 ms) 2023-12-03T11:31:44.396 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_refcount.test_explicit_ec 2023-12-03T11:31:51.440 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_refcount.test_explicit_ec (7044 ms) 2023-12-03T11:31:51.440 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_refcount.set_ec 2023-12-03T11:31:58.469 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_refcount.set_ec (7029 ms) 2023-12-03T11:31:58.470 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 10 tests from cls_refcount (62219 ms total) 2023-12-03T11:31:58.470 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:31:58.470 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2023-12-03T11:31:58.470 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 10 tests from 1 test suite ran. (62219 ms total) 2023-12-03T11:31:58.470 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 10 tests. 2023-12-03T11:31:58.472 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:31:58.473 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:31:58.549 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2023-12-03T11:31:58.550 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2023-12-03T11:31:58.551 DEBUG:teuthology.orchestra.run.smithi044:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2023-12-03T11:31:58.623 INFO:tasks.workunit.client.0.smithi044.stdout:Running main() from gmock_main.cc 2023-12-03T11:31:58.624 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 16 tests from 1 test suite. 2023-12-03T11:31:58.624 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2023-12-03T11:31:58.624 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 16 tests from cls_rgw 2023-12-03T11:32:00.489 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.index_basic 2023-12-03T11:32:00.537 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.index_basic (49 ms) 2023-12-03T11:32:00.537 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2023-12-03T11:32:00.573 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (36 ms) 2023-12-03T11:32:00.574 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.index_remove_object 2023-12-03T11:32:00.621 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.index_remove_object (47 ms) 2023-12-03T11:32:00.621 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.index_suggest 2023-12-03T11:32:02.125 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.index_suggest (1505 ms) 2023-12-03T11:32:02.125 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.index_suggest_complete 2023-12-03T11:32:02.133 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.index_suggest_complete (8 ms) 2023-12-03T11:32:02.133 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.index_list 2023-12-03T11:32:02.156 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.index_list (23 ms) 2023-12-03T11:32:02.156 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.index_list_delimited 2023-12-03T11:32:22.907 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.index_list_delimited (20751 ms) 2023-12-03T11:32:22.908 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.bi_list 2023-12-03T11:32:22.982 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.bi_list (74 ms) 2023-12-03T11:32:22.982 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.gc_set 2023-12-03T11:32:22.991 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.gc_set (10 ms) 2023-12-03T11:32:22.991 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.gc_list 2023-12-03T11:32:23.000 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.gc_list (9 ms) 2023-12-03T11:32:23.001 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.gc_defer 2023-12-03T11:32:30.897 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.gc_defer (7896 ms) 2023-12-03T11:32:30.897 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.usage_basic 2023-12-03T11:32:31.180 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.usage_basic (284 ms) 2023-12-03T11:32:31.181 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2023-12-03T11:32:31.182 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.usage_clear_no_obj (2 ms) 2023-12-03T11:32:31.182 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.usage_clear 2023-12-03T11:32:31.284 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.usage_clear (102 ms) 2023-12-03T11:32:31.284 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.bi_log_trim 2023-12-03T11:32:31.329 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.bi_log_trim (44 ms) 2023-12-03T11:32:31.329 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.index_racing_removes 2023-12-03T11:32:31.346 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.index_racing_removes (18 ms) 2023-12-03T11:32:31.915 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 16 tests from cls_rgw (30858 ms total) 2023-12-03T11:32:31.915 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:32:31.915 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2023-12-03T11:32:31.915 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 16 tests from 1 test suite ran. (33292 ms total) 2023-12-03T11:32:31.916 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 16 tests. 2023-12-03T11:32:31.918 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:32:31.919 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:32:31.995 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2023-12-03T11:32:31.996 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2023-12-03T11:32:31.997 DEBUG:teuthology.orchestra.run.smithi044:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2023-12-03T11:32:32.072 INFO:tasks.workunit.client.0.smithi044.stdout:Running main() from gmock_main.cc 2023-12-03T11:32:32.073 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 9 tests from 1 test suite. 2023-12-03T11:32:32.073 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2023-12-03T11:32:32.073 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 9 tests from cls_rgw_gc 2023-12-03T11:32:32.073 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw_gc.init 2023-12-03T11:32:33.924 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw_gc.init (1851 ms) 2023-12-03T11:32:33.924 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2023-12-03T11:32:33.940 INFO:tasks.workunit.client.0.smithi044.stderr:[ ] list info tag = chain-0 2023-12-03T11:32:33.940 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (17 ms) 2023-12-03T11:32:33.940 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2023-12-03T11:32:33.946 INFO:tasks.workunit.client.0.smithi044.stderr:[ ] next_marker is: = 0/4263 2023-12-03T11:32:33.946 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (6 ms) 2023-12-03T11:32:33.946 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2023-12-03T11:32:33.959 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (13 ms) 2023-12-03T11:32:33.960 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2023-12-03T11:32:33.966 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (7 ms) 2023-12-03T11:32:33.966 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2023-12-03T11:32:33.978 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (11 ms) 2023-12-03T11:32:33.978 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2023-12-03T11:32:33.986 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (9 ms) 2023-12-03T11:32:33.986 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2023-12-03T11:32:33.993 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (6 ms) 2023-12-03T11:32:33.993 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw_gc.finalize 2023-12-03T11:32:34.933 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw_gc.finalize (939 ms) 2023-12-03T11:32:34.934 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 9 tests from cls_rgw_gc (2859 ms total) 2023-12-03T11:32:34.934 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:32:34.934 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2023-12-03T11:32:34.934 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 9 tests from 1 test suite ran. (2859 ms total) 2023-12-03T11:32:34.934 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 9 tests. 2023-12-03T11:32:34.935 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:32:34.935 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:32:35.013 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2023-12-03T11:32:35.014 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2023-12-03T11:32:35.015 DEBUG:teuthology.orchestra.run.smithi044:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2023-12-03T11:32:35.095 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:32:35.096 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:32:35.096 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 1 test from 1 test suite. 2023-12-03T11:32:35.096 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2023-12-03T11:32:36.939 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 1 test from cls_rgw_stats 2023-12-03T11:32:36.939 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw_stats.simulate 2023-12-03T11:32:36.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.957+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=4AU5K1DZ7R52 type=del size=3611735 2023-12-03T11:32:36.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.959+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=3BLMVOH0BZWI type=write size=169061 2023-12-03T11:32:36.961 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.960+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=FXGY4MOZ28P3 type=del size=1035155 2023-12-03T11:32:36.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.962+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=355WEYOZ3BJU type=write size=364786 2023-12-03T11:32:36.964 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.963+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=ASG76LU33XVM type=del size=1209357 2023-12-03T11:32:36.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.965+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=4DJ8722NZER8 type=del size=2181015 2023-12-03T11:32:36.968 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.967+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~1ZBUGZ3JESST.0 size=1048576 2023-12-03T11:32:36.969 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.969+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~1ZBUGZ3JESST.1 size=84707 2023-12-03T11:32:36.969 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.969+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=1ZBUGZ3JESST tag=61380EPTXH4O type=write size=2181859 2023-12-03T11:32:36.971 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.970+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=N2Y68T1YDZZJ type=del size=2385998 2023-12-03T11:32:36.974 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.973+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~6RRNAPI1R28K.0 size=22041 2023-12-03T11:32:36.974 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.973+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=6RRNAPI1R28K tag=HWEJSJ8H4YR1 type=write size=1070617 2023-12-03T11:32:36.975 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.974+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=V1PBNYEMOKPO type=del size=1923209 2023-12-03T11:32:36.976 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.975+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=Z92WE8HUYINK type=del size=352659 2023-12-03T11:32:36.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.977+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=GGAVDR4RPPRU type=del size=587396 2023-12-03T11:32:36.982 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.979+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~5TY24B2KUQK8.0 size=1048576 2023-12-03T11:32:36.982 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.981+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~5TY24B2KUQK8.1 size=1048576 2023-12-03T11:32:36.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.982+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~5TY24B2KUQK8.2 size=750675 2023-12-03T11:32:36.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.982+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=5TY24B2KUQK8 tag=98YN6TRANN8E type=write size=3896403 2023-12-03T11:32:36.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.984+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~XQ8G4L1Y6M5C.0 size=148678 2023-12-03T11:32:36.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.984+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=XQ8G4L1Y6M5C tag=YVPLEFOT74SM type=write size=1197254 2023-12-03T11:32:36.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.987+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~4S30U99MSC88.0 size=1048576 2023-12-03T11:32:36.989 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.988+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~4S30U99MSC88.1 size=410476 2023-12-03T11:32:36.989 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.988+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=4S30U99MSC88 tag=FT0VSWZ0RAMK type=write size=2507628 2023-12-03T11:32:36.991 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.990+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=R2X6GON3YND3 type=del size=3787349 2023-12-03T11:32:36.992 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.991+0000 7f4d50c67780 1 < completed delete operation key=V0ND3OBFJJUB tag=4AU5K1DZ7R52 type=del 2023-12-03T11:32:36.994 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.994+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~1HL3AS9IXCXJ.0 size=842932 2023-12-03T11:32:36.995 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.994+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=1HL3AS9IXCXJ tag=AMAQ4ACPYCRR type=write size=1891508 2023-12-03T11:32:36.996 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.995+0000 7f4d50c67780 1 < completed write operation key=8J1EO2JDQUQH tag=3BLMVOH0BZWI type=write size=169061 2023-12-03T11:32:36.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:36.996+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=PIPLI20SN8SI type=del size=1843654 2023-12-03T11:32:37.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.000+0000 7f4d50c67780 1 < suggested remove operation key=G0O8EC405LYM tag=FXGY4MOZ28P3 type=del 2023-12-03T11:32:37.003 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.002+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~8DS5FE2ZX0E4.0 size=1048576 2023-12-03T11:32:37.004 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.003+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~8DS5FE2ZX0E4.1 size=183780 2023-12-03T11:32:37.004 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.003+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=8DS5FE2ZX0E4 tag=BVF066B9W3D4 type=write size=2280932 2023-12-03T11:32:37.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.004+0000 7f4d50c67780 1 < canceled operation key=EH4B2QP1C42H tag=355WEYOZ3BJU type=write size=364786 2023-12-03T11:32:37.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.007+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~44OZRGDZDYK8.0 size=717899 2023-12-03T11:32:37.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.007+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=44OZRGDZDYK8 tag=BMM9APG6OI7N type=write size=1766475 2023-12-03T11:32:37.010 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.009+0000 7f4d50c67780 1 < completed delete operation key=WUM939BATDG9 tag=ASG76LU33XVM type=del 2023-12-03T11:32:37.011 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.010+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=63L0PFRFVX21 type=del size=1860632 2023-12-03T11:32:37.014 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.013+0000 7f4d50c67780 1 < suggested update operation key=52E31L45TN7V tag=4DJ8722NZER8 type=del size=2181015 2023-12-03T11:32:37.016 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.015+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~BVLVKW2FB7D8.0 size=606832 2023-12-03T11:32:37.016 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.015+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=BVLVKW2FB7D8 tag=J2JOSZQDIY1V type=write size=1655408 2023-12-03T11:32:37.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.017+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~1ZBUGZ3JESST.0 size=1048576 2023-12-03T11:32:37.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.017+0000 7f4d50c67780 1 < canceled part key=_multipart_7C7UX0231SHV.2~1ZBUGZ3JESST.1 size=84707 2023-12-03T11:32:37.020 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.019+0000 7f4d50c67780 1 < canceled multipart upload key=7C7UX0231SHV upload=1ZBUGZ3JESST tag=61380EPTXH4O type=write size=2181859 2023-12-03T11:32:37.021 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.020+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=8OLB5Z94AY58 type=del size=3576722 2023-12-03T11:32:37.024 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.023+0000 7f4d50c67780 1 < suggested remove operation key=EH4B2QP1C42H tag=N2Y68T1YDZZJ type=del 2023-12-03T11:32:37.026 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.025+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~WT6MKSLW349V.0 size=991852 2023-12-03T11:32:37.026 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.025+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=WT6MKSLW349V tag=HAEJ8J0KXKHQ type=write size=2040428 2023-12-03T11:32:37.027 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.027+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~6RRNAPI1R28K.0 size=22041 2023-12-03T11:32:37.030 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.029+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=6RRNAPI1R28K tag=HWEJSJ8H4YR1 type=write size=1070617 2023-12-03T11:32:37.031 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.030+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=WKXC5Y7LZ3WE type=del size=20218 2023-12-03T11:32:37.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.032+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=V1PBNYEMOKPO type=del 2023-12-03T11:32:37.034 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.033+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=648G93PYTPRT type=del size=797240 2023-12-03T11:32:37.036 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.035+0000 7f4d50c67780 1 < completed delete operation key=YDRAH5EE39R4 tag=Z92WE8HUYINK type=del 2023-12-03T11:32:37.037 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.036+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=6QFPO5NLWXFV type=write size=477564 2023-12-03T11:32:37.038 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.038+0000 7f4d50c67780 1 < completed delete operation key=V0ND3OBFJJUB tag=GGAVDR4RPPRU type=del 2023-12-03T11:32:37.040 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.039+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=PBZ2AJQ6VTIY type=write size=677269 2023-12-03T11:32:37.041 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.040+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~5TY24B2KUQK8.0 size=1048576 2023-12-03T11:32:37.042 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.041+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~5TY24B2KUQK8.1 size=1048576 2023-12-03T11:32:37.043 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.042+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~5TY24B2KUQK8.2 size=750675 2023-12-03T11:32:37.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.044+0000 7f4d50c67780 1 < completed multipart upload key=EAP0BYZTTT2E upload=5TY24B2KUQK8 tag=98YN6TRANN8E type=write size=3896403 2023-12-03T11:32:37.046 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.045+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=6JCOUE3GT8YZ type=del size=874498 2023-12-03T11:32:37.048 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.047+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~XQ8G4L1Y6M5C.0 size=148678 2023-12-03T11:32:37.050 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.049+0000 7f4d50c67780 1 < completed multipart upload key=MLKGLDFFDC3W upload=XQ8G4L1Y6M5C tag=YVPLEFOT74SM type=write size=1197254 2023-12-03T11:32:37.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.051+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=X55N6YK691H1 type=del size=3648298 2023-12-03T11:32:37.053 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.052+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~4S30U99MSC88.0 size=1048576 2023-12-03T11:32:37.054 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.053+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~4S30U99MSC88.1 size=410476 2023-12-03T11:32:37.056 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.055+0000 7f4d50c67780 1 < completed multipart upload key=EAP0BYZTTT2E upload=4S30U99MSC88 tag=FT0VSWZ0RAMK type=write size=2507628 2023-12-03T11:32:37.057 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.056+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=GYFD05QC95XH type=write size=963606 2023-12-03T11:32:37.059 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.058+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=R2X6GON3YND3 type=del 2023-12-03T11:32:37.061 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.060+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~0HZG03BJW8EG.0 size=1048576 2023-12-03T11:32:37.062 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.061+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~0HZG03BJW8EG.1 size=550663 2023-12-03T11:32:37.062 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.061+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=0HZG03BJW8EG tag=JKZC5FT3SQLF type=write size=2647815 2023-12-03T11:32:37.063 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.062+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~1HL3AS9IXCXJ.0 size=842932 2023-12-03T11:32:37.065 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.064+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=1HL3AS9IXCXJ tag=AMAQ4ACPYCRR type=write size=1891508 2023-12-03T11:32:37.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.067+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~TKSELUQOPA3L.0 size=1048576 2023-12-03T11:32:37.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.068+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~TKSELUQOPA3L.1 size=22056 2023-12-03T11:32:37.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.068+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=TKSELUQOPA3L tag=NSH3K5Q32V89 type=write size=2119208 2023-12-03T11:32:37.071 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.070+0000 7f4d50c67780 1 < suggested remove operation key=WUM939BATDG9 tag=PIPLI20SN8SI type=del 2023-12-03T11:32:37.072 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.071+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=RF3ML6GEFZDV type=del size=3963594 2023-12-03T11:32:37.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.073+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~8DS5FE2ZX0E4.0 size=1048576 2023-12-03T11:32:37.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.074+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~8DS5FE2ZX0E4.1 size=183780 2023-12-03T11:32:37.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.076+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=8DS5FE2ZX0E4 tag=BVF066B9W3D4 type=write size=2280932 2023-12-03T11:32:37.078 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.077+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=KOFBNFR284L8 type=del size=1002743 2023-12-03T11:32:37.079 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.078+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~44OZRGDZDYK8.0 size=717899 2023-12-03T11:32:37.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.080+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=44OZRGDZDYK8 tag=BMM9APG6OI7N type=write size=1766475 2023-12-03T11:32:37.084 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.083+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~HG9TZQO41VXZ.0 size=1048576 2023-12-03T11:32:37.084 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.084+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~HG9TZQO41VXZ.1 size=659447 2023-12-03T11:32:37.085 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.084+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=HG9TZQO41VXZ tag=UBINF8VXWFFT type=write size=2756599 2023-12-03T11:32:37.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.085+0000 7f4d50c67780 1 < completed delete operation key=YDRAH5EE39R4 tag=63L0PFRFVX21 type=del 2023-12-03T11:32:37.087 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.086+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=AWS7VG0X35J4 type=write size=637437 2023-12-03T11:32:37.088 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.087+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~BVLVKW2FB7D8.0 size=606832 2023-12-03T11:32:37.090 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.089+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=BVLVKW2FB7D8 tag=J2JOSZQDIY1V type=write size=1655408 2023-12-03T11:32:37.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.090+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=PEQZ7SI4W85C type=del size=906578 2023-12-03T11:32:37.092 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.092+0000 7f4d50c67780 1 < completed delete operation key=QQDBWLVSXIHP tag=8OLB5Z94AY58 type=del 2023-12-03T11:32:37.098 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.093+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=71Q03LQOF4J5 type=del size=25016 2023-12-03T11:32:37.098 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.093+0000 7f4d50c67780 1 < canceled part key=_multipart_EAP0BYZTTT2E.2~WT6MKSLW349V.0 size=991852 2023-12-03T11:32:37.098 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.097+0000 7f4d50c67780 1 < canceled multipart upload key=EAP0BYZTTT2E upload=WT6MKSLW349V tag=HAEJ8J0KXKHQ type=write size=2040428 2023-12-03T11:32:37.098 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.098+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=OO29I305YID8 type=del size=2202958 2023-12-03T11:32:37.099 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.098+0000 7f4d50c67780 -1 < no bi entry to suggest for operation key=WUM939BATDG9 tag=WKXC5Y7LZ3WE type=del size=20218: (2) No such file or directory 2023-12-03T11:32:37.101 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.100+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~35E2V5C7H0WL.0 size=802459 2023-12-03T11:32:37.101 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.100+0000 7f4d50c67780 1 > prepared multipart upload key=JR8CIONID4QC upload=35E2V5C7H0WL tag=HRPPPITW7MD8 type=write size=1851035 2023-12-03T11:32:37.102 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.102+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=648G93PYTPRT type=del 2023-12-03T11:32:37.105 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.104+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~03VWW5MJLTD9.0 size=1048576 2023-12-03T11:32:37.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.105+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~03VWW5MJLTD9.1 size=1048576 2023-12-03T11:32:37.107 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.106+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~03VWW5MJLTD9.2 size=316137 2023-12-03T11:32:37.107 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.106+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=03VWW5MJLTD9 tag=C1ZKACT9SWKW type=write size=3461865 2023-12-03T11:32:37.108 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.107+0000 7f4d50c67780 1 < completed write operation key=U6R5Y9JXKT32 tag=6QFPO5NLWXFV type=write size=477564 2023-12-03T11:32:37.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.109+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~HFDPO79DTJ98.0 size=1048576 2023-12-03T11:32:37.111 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.110+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~HFDPO79DTJ98.1 size=759870 2023-12-03T11:32:37.111 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.110+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=HFDPO79DTJ98 tag=NM2NH9JMUS0R type=write size=2857022 2023-12-03T11:32:37.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.111+0000 7f4d50c67780 1 < canceled operation key=ULLPV2G10BME tag=PBZ2AJQ6VTIY type=write size=677269 2023-12-03T11:32:37.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.113+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~5Z3NWPC73N57.0 size=1048576 2023-12-03T11:32:37.115 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.114+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~5Z3NWPC73N57.1 size=1048576 2023-12-03T11:32:37.116 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.115+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~5Z3NWPC73N57.2 size=296401 2023-12-03T11:32:37.116 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.115+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=5Z3NWPC73N57 tag=RSCGSGM6P180 type=write size=3442129 2023-12-03T11:32:37.117 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.116+0000 7f4d50c67780 1 < canceled operation key=73SL3ZBBDA6Q tag=6JCOUE3GT8YZ type=del size=874498 2023-12-03T11:32:37.119 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.118+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=L05OVB7PBZIO type=del size=3140045 2023-12-03T11:32:37.120 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.119+0000 7f4d50c67780 1 < completed delete operation key=CQPZ0X62207Z tag=X55N6YK691H1 type=del 2023-12-03T11:32:37.122 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.122+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~SQMFMA5JHUHT.0 size=1048576 2023-12-03T11:32:37.123 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.123+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~SQMFMA5JHUHT.1 size=294615 2023-12-03T11:32:37.123 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.123+0000 7f4d50c67780 1 > prepared multipart upload key=ULLPV2G10BME upload=SQMFMA5JHUHT tag=U5M9TTV2DU0O type=write size=2391767 2023-12-03T11:32:37.125 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.124+0000 7f4d50c67780 1 < completed write operation key=BX5POXMMYLB7 tag=GYFD05QC95XH type=write size=963606 2023-12-03T11:32:37.126 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.126+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=MEQIJVLP9TAN type=del size=2686928 2023-12-03T11:32:37.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.127+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~0HZG03BJW8EG.0 size=1048576 2023-12-03T11:32:37.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.127+0000 7f4d50c67780 1 < canceled part key=_multipart_XM5E3D99MXVA.2~0HZG03BJW8EG.1 size=550663 2023-12-03T11:32:37.130 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.129+0000 7f4d50c67780 1 < canceled multipart upload key=XM5E3D99MXVA upload=0HZG03BJW8EG tag=JKZC5FT3SQLF type=write size=2647815 2023-12-03T11:32:37.132 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.131+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=NMX5I1ASE0CB type=del size=2635565 2023-12-03T11:32:37.133 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.132+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~TKSELUQOPA3L.0 size=1048576 2023-12-03T11:32:37.134 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.133+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~TKSELUQOPA3L.1 size=22056 2023-12-03T11:32:37.136 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.135+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=TKSELUQOPA3L tag=NSH3K5Q32V89 type=write size=2119208 2023-12-03T11:32:37.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.136+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=PA47IVK38BCM type=del size=1291535 2023-12-03T11:32:37.139 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.138+0000 7f4d50c67780 1 < suggested remove operation key=CQPZ0X62207Z tag=RF3ML6GEFZDV type=del 2023-12-03T11:32:37.140 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.140+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=587PSWIM6P9K type=write size=603921 2023-12-03T11:32:37.143 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.142+0000 7f4d50c67780 1 < suggested remove operation key=YDRAH5EE39R4 tag=KOFBNFR284L8 type=del 2023-12-03T11:32:37.144 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.143+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=JNEFU6BJFLDC type=write size=257193 2023-12-03T11:32:37.145 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.144+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~HG9TZQO41VXZ.0 size=1048576 2023-12-03T11:32:37.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.145+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~HG9TZQO41VXZ.1 size=659447 2023-12-03T11:32:37.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.147+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=HG9TZQO41VXZ tag=UBINF8VXWFFT type=write size=2756599 2023-12-03T11:32:37.149 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.148+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=RG4X3V959E1U type=write size=101064 2023-12-03T11:32:37.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.150+0000 7f4d50c67780 1 < suggested update operation key=ULLPV2G10BME tag=AWS7VG0X35J4 type=write size=637437 2023-12-03T11:32:37.153 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.152+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=YBWK0ZTQWZZL type=del size=2299221 2023-12-03T11:32:37.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.154+0000 7f4d50c67780 1 < suggested remove operation key=U6R5Y9JXKT32 tag=PEQZ7SI4W85C type=del 2023-12-03T11:32:37.156 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.155+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=BB74LN9JDOZJ type=del size=4090982 2023-12-03T11:32:37.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.156+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=71Q03LQOF4J5 type=del 2023-12-03T11:32:37.158 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.157+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=TM60DEKD1CNY type=del size=53310 2023-12-03T11:32:37.160 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.160+0000 7f4d50c67780 1 < suggested remove operation key=EX93BYX10WJB tag=OO29I305YID8 type=del 2023-12-03T11:32:37.163 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.162+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~5EW172OC3LPC.0 size=1048576 2023-12-03T11:32:37.164 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.163+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~5EW172OC3LPC.1 size=1048576 2023-12-03T11:32:37.165 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.164+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~5EW172OC3LPC.2 size=696757 2023-12-03T11:32:37.165 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.164+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=5EW172OC3LPC tag=2B40I78GT1IV type=write size=3842485 2023-12-03T11:32:37.166 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.165+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~35E2V5C7H0WL.0 size=802459 2023-12-03T11:32:37.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.167+0000 7f4d50c67780 1 < completed multipart upload key=JR8CIONID4QC upload=35E2V5C7H0WL tag=HRPPPITW7MD8 type=write size=1851035 2023-12-03T11:32:37.169 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.168+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=4AHHO0ORYB9H type=del size=210755 2023-12-03T11:32:37.170 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.169+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~03VWW5MJLTD9.0 size=1048576 2023-12-03T11:32:37.171 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.170+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~03VWW5MJLTD9.1 size=1048576 2023-12-03T11:32:37.172 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.171+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~03VWW5MJLTD9.2 size=316137 2023-12-03T11:32:37.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.174+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=03VWW5MJLTD9 tag=C1ZKACT9SWKW type=write size=3461865 2023-12-03T11:32:37.177 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.176+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~BRIG68QB39V0.0 size=1048576 2023-12-03T11:32:37.178 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.177+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~BRIG68QB39V0.1 size=1048576 2023-12-03T11:32:37.179 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.178+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~BRIG68QB39V0.2 size=778274 2023-12-03T11:32:37.179 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.178+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=BRIG68QB39V0 tag=53STFR3KC9HG type=write size=3924002 2023-12-03T11:32:37.180 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.179+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~HFDPO79DTJ98.0 size=1048576 2023-12-03T11:32:37.181 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.180+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~HFDPO79DTJ98.1 size=759870 2023-12-03T11:32:37.183 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.182+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=HFDPO79DTJ98 tag=NM2NH9JMUS0R type=write size=2857022 2023-12-03T11:32:37.185 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.184+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~DHDJ8F0HTVST.0 size=1048576 2023-12-03T11:32:37.186 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.185+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~DHDJ8F0HTVST.1 size=1048576 2023-12-03T11:32:37.187 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.186+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~DHDJ8F0HTVST.2 size=184276 2023-12-03T11:32:37.187 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.186+0000 7f4d50c67780 1 > prepared multipart upload key=ZE19S5UCCZ3C upload=DHDJ8F0HTVST tag=0X234D3DQ4JN type=write size=3330004 2023-12-03T11:32:37.188 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.187+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~5Z3NWPC73N57.0 size=1048576 2023-12-03T11:32:37.189 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.188+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~5Z3NWPC73N57.1 size=1048576 2023-12-03T11:32:37.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.189+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~5Z3NWPC73N57.2 size=296401 2023-12-03T11:32:37.192 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.191+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=5Z3NWPC73N57 tag=RSCGSGM6P180 type=write size=3442129 2023-12-03T11:32:37.194 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.193+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~9MHSIVBTEBSP.0 size=1048576 2023-12-03T11:32:37.195 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.194+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~9MHSIVBTEBSP.1 size=652420 2023-12-03T11:32:37.195 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.194+0000 7f4d50c67780 1 > prepared multipart upload key=YDRAH5EE39R4 upload=9MHSIVBTEBSP tag=DY88TLWZ7WAW type=write size=2749572 2023-12-03T11:32:37.197 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.197+0000 7f4d50c67780 1 < suggested remove operation key=ENMJS0KEVS2S tag=L05OVB7PBZIO type=del 2023-12-03T11:32:37.199 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.198+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=4XBK89Q1GHPW type=del size=3327196 2023-12-03T11:32:37.200 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.199+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~SQMFMA5JHUHT.0 size=1048576 2023-12-03T11:32:37.201 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.200+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~SQMFMA5JHUHT.1 size=294615 2023-12-03T11:32:37.203 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.202+0000 7f4d50c67780 1 < completed multipart upload key=ULLPV2G10BME upload=SQMFMA5JHUHT tag=U5M9TTV2DU0O type=write size=2391767 2023-12-03T11:32:37.204 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.203+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=34KH4VRUIJB0 type=del size=571405 2023-12-03T11:32:37.206 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.206+0000 7f4d50c67780 1 < suggested remove operation key=83I1M5WIVKAA tag=MEQIJVLP9TAN type=del 2023-12-03T11:32:37.209 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.208+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=M2Y31C1IIHLH type=del size=3811134 2023-12-03T11:32:37.210 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.209+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=NMX5I1ASE0CB type=del 2023-12-03T11:32:37.211 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.210+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=1R046U9QXQYY type=del size=1028462 2023-12-03T11:32:37.214 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.213+0000 7f4d50c67780 1 < suggested update operation key=TEIYINZFFG76 tag=PA47IVK38BCM type=del size=1291535 2023-12-03T11:32:37.215 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.214+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=O9JJ9K0UD5RM type=del size=3028157 2023-12-03T11:32:37.216 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.215+0000 7f4d50c67780 -1 < failed to complete operation key=ULLPV2G10BME tag=587PSWIM6P9K type=write size=603921: (22) Invalid argument 2023-12-03T11:32:37.218 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.217+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~L5QQ0MGLM5ZW.0 size=1048576 2023-12-03T11:32:37.219 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.218+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~L5QQ0MGLM5ZW.1 size=931950 2023-12-03T11:32:37.219 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.218+0000 7f4d50c67780 1 > prepared multipart upload key=JR8CIONID4QC upload=L5QQ0MGLM5ZW tag=PCKFXJBQBDD6 type=write size=3029102 2023-12-03T11:32:37.222 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.221+0000 7f4d50c67780 1 < suggested remove operation key=V0ND3OBFJJUB tag=JNEFU6BJFLDC type=write 2023-12-03T11:32:37.223 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.222+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=49FA08DQQXAZ type=write size=520225 2023-12-03T11:32:37.224 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.223+0000 7f4d50c67780 1 < completed write operation key=7C7UX0231SHV tag=RG4X3V959E1U type=write size=101064 2023-12-03T11:32:37.225 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.224+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=HJEEYY105NQC type=write size=1042676 2023-12-03T11:32:37.226 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.226+0000 7f4d50c67780 -1 < failed to complete operation key=V0ND3OBFJJUB tag=YBWK0ZTQWZZL type=del size=2299221: (22) Invalid argument 2023-12-03T11:32:37.229 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.228+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~DHAX2MP1HC9S.0 size=1048576 2023-12-03T11:32:37.229 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.229+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~DHAX2MP1HC9S.1 size=73620 2023-12-03T11:32:37.230 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.229+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=DHAX2MP1HC9S tag=25M3IT31LGBQ type=write size=2170772 2023-12-03T11:32:37.231 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.230+0000 7f4d50c67780 -1 < failed to complete operation key=TEIYINZFFG76 tag=BB74LN9JDOZJ type=del size=4090982: (22) Invalid argument 2023-12-03T11:32:37.233 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.232+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~X2181B0S45NV.0 size=1048576 2023-12-03T11:32:37.234 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.233+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~X2181B0S45NV.1 size=1048576 2023-12-03T11:32:37.235 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.234+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~X2181B0S45NV.2 size=737937 2023-12-03T11:32:37.235 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.234+0000 7f4d50c67780 1 > prepared multipart upload key=ULLPV2G10BME upload=X2181B0S45NV tag=VHS14RY22B3D type=write size=3883665 2023-12-03T11:32:37.236 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.235+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=TM60DEKD1CNY type=del 2023-12-03T11:32:37.237 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.236+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=II1WZDQXRUZ5 type=del size=2411127 2023-12-03T11:32:37.239 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.238+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~5EW172OC3LPC.0 size=1048576 2023-12-03T11:32:37.240 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.239+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~5EW172OC3LPC.1 size=1048576 2023-12-03T11:32:37.240 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.239+0000 7f4d50c67780 1 < canceled part key=_multipart_EY1RBO15PCRR.2~5EW172OC3LPC.2 size=696757 2023-12-03T11:32:37.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.241+0000 7f4d50c67780 1 < canceled multipart upload key=EY1RBO15PCRR upload=5EW172OC3LPC tag=2B40I78GT1IV type=write size=3842485 2023-12-03T11:32:37.244 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.243+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~OLL8TIAM14UY.0 size=1048576 2023-12-03T11:32:37.245 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.244+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~OLL8TIAM14UY.1 size=1041893 2023-12-03T11:32:37.245 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.244+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=OLL8TIAM14UY tag=BDVVTA8G0OEB type=write size=3139045 2023-12-03T11:32:37.246 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.245+0000 7f4d50c67780 1 < completed delete operation key=CQPZ0X62207Z tag=4AHHO0ORYB9H type=del 2023-12-03T11:32:37.247 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.247+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=2SFSN9A8Z94E type=del size=2233155 2023-12-03T11:32:37.249 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.248+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~BRIG68QB39V0.0 size=1048576 2023-12-03T11:32:37.250 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.249+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~BRIG68QB39V0.1 size=1048576 2023-12-03T11:32:37.251 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.250+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~BRIG68QB39V0.2 size=778274 2023-12-03T11:32:37.253 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.252+0000 7f4d50c67780 1 < completed multipart upload key=MLKGLDFFDC3W upload=BRIG68QB39V0 tag=53STFR3KC9HG type=write size=3924002 2023-12-03T11:32:37.255 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.254+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~6X8VT3D9O1AZ.0 size=930693 2023-12-03T11:32:37.255 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.254+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=6X8VT3D9O1AZ tag=1G16LOIZKV9M type=write size=1979269 2023-12-03T11:32:37.256 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.256+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~DHDJ8F0HTVST.0 size=1048576 2023-12-03T11:32:37.257 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.257+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~DHDJ8F0HTVST.1 size=1048576 2023-12-03T11:32:37.258 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.258+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~DHDJ8F0HTVST.2 size=184276 2023-12-03T11:32:37.261 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.260+0000 7f4d50c67780 1 < completed multipart upload key=ZE19S5UCCZ3C upload=DHDJ8F0HTVST tag=0X234D3DQ4JN type=write size=3330004 2023-12-03T11:32:37.262 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.261+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=V2W9H4NZN1HE type=del size=2832073 2023-12-03T11:32:37.263 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.262+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~9MHSIVBTEBSP.0 size=1048576 2023-12-03T11:32:37.264 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.263+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~9MHSIVBTEBSP.1 size=652420 2023-12-03T11:32:37.266 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.265+0000 7f4d50c67780 1 < completed multipart upload key=YDRAH5EE39R4 upload=9MHSIVBTEBSP tag=DY88TLWZ7WAW type=write size=2749572 2023-12-03T11:32:37.267 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.267+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=VQUH7CFQ832Z type=del size=4149709 2023-12-03T11:32:37.269 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.268+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=4XBK89Q1GHPW type=del 2023-12-03T11:32:37.270 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.269+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=4RU3FM4KBPP8 type=del size=1181584 2023-12-03T11:32:37.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.270+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=34KH4VRUIJB0 type=del 2023-12-03T11:32:37.272 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.271+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=S2SQAQ7EGTJN type=del size=1931942 2023-12-03T11:32:37.273 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.273+0000 7f4d50c67780 1 < completed delete operation key=EAP0BYZTTT2E tag=M2Y31C1IIHLH type=del 2023-12-03T11:32:37.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.274+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=5QETI4YO59S3 type=del size=2705192 2023-12-03T11:32:37.276 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.275+0000 7f4d50c67780 1 < completed delete operation key=EY1RBO15PCRR tag=1R046U9QXQYY type=del 2023-12-03T11:32:37.277 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.276+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=LGISJCOVAJ86 type=del size=1368814 2023-12-03T11:32:37.280 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.279+0000 7f4d50c67780 1 < suggested remove operation key=02W4TX7ZCDI6 tag=O9JJ9K0UD5RM type=del 2023-12-03T11:32:37.281 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.280+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=3UZDLOMM7S59 type=del size=450484 2023-12-03T11:32:37.282 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.281+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~L5QQ0MGLM5ZW.0 size=1048576 2023-12-03T11:32:37.283 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.282+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~L5QQ0MGLM5ZW.1 size=931950 2023-12-03T11:32:37.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.284+0000 7f4d50c67780 1 < completed multipart upload key=JR8CIONID4QC upload=L5QQ0MGLM5ZW tag=PCKFXJBQBDD6 type=write size=3029102 2023-12-03T11:32:37.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.285+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=BSYBS6OR14YP type=del size=2062712 2023-12-03T11:32:37.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.287+0000 7f4d50c67780 1 < completed write operation key=YDRAH5EE39R4 tag=49FA08DQQXAZ type=write size=520225 2023-12-03T11:32:37.289 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.288+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=8JKMEUVYEKFD type=del size=1789589 2023-12-03T11:32:37.290 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.289+0000 7f4d50c67780 1 < canceled operation key=EY1RBO15PCRR tag=HJEEYY105NQC type=write size=1042676 2023-12-03T11:32:37.292 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.291+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~09U6HBAOVBSZ.0 size=1048576 2023-12-03T11:32:37.293 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.292+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~09U6HBAOVBSZ.1 size=1048576 2023-12-03T11:32:37.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.293+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~09U6HBAOVBSZ.2 size=21005 2023-12-03T11:32:37.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.293+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=09U6HBAOVBSZ tag=K9JGNRBNDESP type=write size=3166733 2023-12-03T11:32:37.295 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.294+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~DHAX2MP1HC9S.0 size=1048576 2023-12-03T11:32:37.295 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.294+0000 7f4d50c67780 1 < canceled part key=_multipart_7C7UX0231SHV.2~DHAX2MP1HC9S.1 size=73620 2023-12-03T11:32:37.297 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.296+0000 7f4d50c67780 1 < canceled multipart upload key=7C7UX0231SHV upload=DHAX2MP1HC9S tag=25M3IT31LGBQ type=write size=2170772 2023-12-03T11:32:37.298 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.298+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=10O8L1SR619L type=del size=1556961 2023-12-03T11:32:37.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.299+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~X2181B0S45NV.0 size=1048576 2023-12-03T11:32:37.301 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.300+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~X2181B0S45NV.1 size=1048576 2023-12-03T11:32:37.302 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.301+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~X2181B0S45NV.2 size=737937 2023-12-03T11:32:37.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.303+0000 7f4d50c67780 1 < completed multipart upload key=ULLPV2G10BME upload=X2181B0S45NV tag=VHS14RY22B3D type=write size=3883665 2023-12-03T11:32:37.305 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.304+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=GZJNQFU0G0DO type=del size=3446549 2023-12-03T11:32:37.306 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.305+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=II1WZDQXRUZ5 type=del 2023-12-03T11:32:37.308 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.307+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~6E8U2XBK7QUA.0 size=442662 2023-12-03T11:32:37.308 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.307+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=6E8U2XBK7QUA tag=UNH3BTT4HKIQ type=write size=1491238 2023-12-03T11:32:37.309 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.309+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~OLL8TIAM14UY.0 size=1048576 2023-12-03T11:32:37.310 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.309+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~OLL8TIAM14UY.1 size=1041893 2023-12-03T11:32:37.312 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.311+0000 7f4d50c67780 1 < completed multipart upload key=EH4B2QP1C42H upload=OLL8TIAM14UY tag=BDVVTA8G0OEB type=write size=3139045 2023-12-03T11:32:37.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.314+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~A880CMOT90SQ.0 size=1048576 2023-12-03T11:32:37.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.315+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~A880CMOT90SQ.1 size=691727 2023-12-03T11:32:37.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.315+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=A880CMOT90SQ tag=PMEUW19Y1L2G type=write size=2788879 2023-12-03T11:32:37.317 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.316+0000 7f4d50c67780 1 < completed delete operation key=EX93BYX10WJB tag=2SFSN9A8Z94E type=del 2023-12-03T11:32:37.318 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.317+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=190FUEVGRA1I type=write size=710205 2023-12-03T11:32:37.319 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.318+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~6X8VT3D9O1AZ.0 size=930693 2023-12-03T11:32:37.322 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.321+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=6X8VT3D9O1AZ tag=1G16LOIZKV9M type=write size=1979269 2023-12-03T11:32:37.323 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.322+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=FSN53ZSX4IMS type=write size=981304 2023-12-03T11:32:37.324 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.323+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=V2W9H4NZN1HE type=del 2023-12-03T11:32:37.326 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.325+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~LWDIK0I16YFT.0 size=1048576 2023-12-03T11:32:37.327 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.326+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~LWDIK0I16YFT.1 size=656035 2023-12-03T11:32:37.327 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.326+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=LWDIK0I16YFT tag=K0RHBTF071UX type=write size=2753187 2023-12-03T11:32:37.328 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.328+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=VQUH7CFQ832Z type=del 2023-12-03T11:32:37.330 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.329+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=VVKK3I0YTZB3 type=del size=3222988 2023-12-03T11:32:37.331 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.330+0000 7f4d50c67780 1 < completed delete operation key=EY1RBO15PCRR tag=4RU3FM4KBPP8 type=del 2023-12-03T11:32:37.333 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.332+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~BM5GNNPDI3I8.0 size=627773 2023-12-03T11:32:37.333 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.332+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=BM5GNNPDI3I8 tag=IG9O0ZWCQL07 type=write size=1676349 2023-12-03T11:32:37.335 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.334+0000 7f4d50c67780 1 < suggested update operation key=G0O8EC405LYM tag=S2SQAQ7EGTJN type=del size=1931942 2023-12-03T11:32:37.337 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.337+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~2ORESA7JWASG.0 size=1048576 2023-12-03T11:32:37.338 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.337+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~2ORESA7JWASG.1 size=1048576 2023-12-03T11:32:37.339 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.338+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~2ORESA7JWASG.2 size=90234 2023-12-03T11:32:37.339 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.338+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=2ORESA7JWASG tag=UEDKAOS92LJU type=write size=3235962 2023-12-03T11:32:37.340 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.340+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=5QETI4YO59S3 type=del 2023-12-03T11:32:37.342 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.341+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=PKQ4M2GAWDJV type=del size=1225526 2023-12-03T11:32:37.345 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.344+0000 7f4d50c67780 1 < suggested remove operation key=CQPZ0X62207Z tag=LGISJCOVAJ86 type=del 2023-12-03T11:32:37.347 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.346+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~0FTEN2TR04ZQ.0 size=1048576 2023-12-03T11:32:37.348 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.347+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~0FTEN2TR04ZQ.1 size=1048576 2023-12-03T11:32:37.349 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.348+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~0FTEN2TR04ZQ.2 size=1042966 2023-12-03T11:32:37.349 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.348+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=0FTEN2TR04ZQ tag=ZP6DS14V5SRL type=write size=4188694 2023-12-03T11:32:37.351 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.350+0000 7f4d50c67780 1 < completed delete operation key=EH4B2QP1C42H tag=3UZDLOMM7S59 type=del 2023-12-03T11:32:37.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.352+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~P2VJ2SBEAFKO.0 size=1048576 2023-12-03T11:32:37.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.354+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~P2VJ2SBEAFKO.1 size=1048576 2023-12-03T11:32:37.355 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.355+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~P2VJ2SBEAFKO.2 size=378731 2023-12-03T11:32:37.355 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.355+0000 7f4d50c67780 1 > prepared multipart upload key=ZE19S5UCCZ3C upload=P2VJ2SBEAFKO tag=ELRASXGJ7HM4 type=write size=3524459 2023-12-03T11:32:37.358 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.357+0000 7f4d50c67780 1 < suggested remove operation key=G0O8EC405LYM tag=BSYBS6OR14YP type=del 2023-12-03T11:32:37.360 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.359+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=40A98W1DWQU3 type=write size=673597 2023-12-03T11:32:37.361 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.360+0000 7f4d50c67780 1 < completed delete operation key=V0ND3OBFJJUB tag=8JKMEUVYEKFD type=del 2023-12-03T11:32:37.362 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.362+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=L2BS25M809C1 type=write size=436652 2023-12-03T11:32:37.364 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.363+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~09U6HBAOVBSZ.0 size=1048576 2023-12-03T11:32:37.365 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.364+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~09U6HBAOVBSZ.1 size=1048576 2023-12-03T11:32:37.366 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.365+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~09U6HBAOVBSZ.2 size=21005 2023-12-03T11:32:37.368 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.367+0000 7f4d50c67780 1 < completed multipart upload key=WUM939BATDG9 upload=09U6HBAOVBSZ tag=K9JGNRBNDESP type=write size=3166733 2023-12-03T11:32:37.369 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.368+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=TND6D51U7BSD type=write size=702745 2023-12-03T11:32:37.370 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.369+0000 7f4d50c67780 1 < completed delete operation key=52E31L45TN7V tag=10O8L1SR619L type=del 2023-12-03T11:32:37.372 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.372+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~JEI6L9TJRGBR.0 size=1048576 2023-12-03T11:32:37.373 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.373+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~JEI6L9TJRGBR.1 size=1048576 2023-12-03T11:32:37.374 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.373+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~JEI6L9TJRGBR.2 size=263766 2023-12-03T11:32:37.374 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.373+0000 7f4d50c67780 1 > prepared multipart upload key=G0O8EC405LYM upload=JEI6L9TJRGBR tag=P9F4J3KN8QXI type=write size=3409494 2023-12-03T11:32:37.376 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.375+0000 7f4d50c67780 1 < completed delete operation key=MLKGLDFFDC3W tag=GZJNQFU0G0DO type=del 2023-12-03T11:32:37.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.376+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=H7GTOK8OC1NQ type=write size=485021 2023-12-03T11:32:37.378 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.377+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~6E8U2XBK7QUA.0 size=442662 2023-12-03T11:32:37.380 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.379+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=6E8U2XBK7QUA tag=UNH3BTT4HKIQ type=write size=1491238 2023-12-03T11:32:37.381 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.381+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=XJ2UF6Q7WBIO type=del size=2154195 2023-12-03T11:32:37.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.382+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~A880CMOT90SQ.0 size=1048576 2023-12-03T11:32:37.384 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.383+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~A880CMOT90SQ.1 size=691727 2023-12-03T11:32:37.386 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.385+0000 7f4d50c67780 1 < completed multipart upload key=EH4B2QP1C42H upload=A880CMOT90SQ tag=PMEUW19Y1L2G type=write size=2788879 2023-12-03T11:32:37.389 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.387+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~LHG7WV3SLBY5.0 size=297522 2023-12-03T11:32:37.389 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.387+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=LHG7WV3SLBY5 tag=LQQFC6AE643R type=write size=1346098 2023-12-03T11:32:37.390 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.389+0000 7f4d50c67780 1 < completed write operation key=WUM939BATDG9 tag=190FUEVGRA1I type=write size=710205 2023-12-03T11:32:37.391 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.390+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=24FDO6ILDY8J type=del size=1173859 2023-12-03T11:32:37.392 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.391+0000 7f4d50c67780 1 < completed write operation key=ULLPV2G10BME tag=FSN53ZSX4IMS type=write size=981304 2023-12-03T11:32:37.393 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.393+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=TG7DLAU1E2ZW type=del size=3360761 2023-12-03T11:32:37.395 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.394+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~LWDIK0I16YFT.0 size=1048576 2023-12-03T11:32:37.396 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.395+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~LWDIK0I16YFT.1 size=656035 2023-12-03T11:32:37.398 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.397+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=LWDIK0I16YFT tag=K0RHBTF071UX type=write size=2753187 2023-12-03T11:32:37.399 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.399+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=ZLA122JN4FTH type=write size=79565 2023-12-03T11:32:37.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.401+0000 7f4d50c67780 1 < suggested remove operation key=TEIYINZFFG76 tag=VVKK3I0YTZB3 type=del 2023-12-03T11:32:37.404 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.403+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~Z9E693C706UK.0 size=1048576 2023-12-03T11:32:37.405 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.404+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~Z9E693C706UK.1 size=503771 2023-12-03T11:32:37.405 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.404+0000 7f4d50c67780 1 > prepared multipart upload key=TEIYINZFFG76 upload=Z9E693C706UK tag=CSOKMO2MLSLL type=write size=2600923 2023-12-03T11:32:37.407 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.406+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~BM5GNNPDI3I8.0 size=627773 2023-12-03T11:32:37.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.408+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=BM5GNNPDI3I8 tag=IG9O0ZWCQL07 type=write size=1676349 2023-12-03T11:32:37.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.410+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~SOSWEZ0VNIZM.0 size=1048576 2023-12-03T11:32:37.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.411+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~SOSWEZ0VNIZM.1 size=836419 2023-12-03T11:32:37.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.411+0000 7f4d50c67780 1 > prepared multipart upload key=ZE19S5UCCZ3C upload=SOSWEZ0VNIZM tag=VEWTDL3Z4KBW type=write size=2933571 2023-12-03T11:32:37.413 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.412+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~2ORESA7JWASG.0 size=1048576 2023-12-03T11:32:37.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.414+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~2ORESA7JWASG.1 size=1048576 2023-12-03T11:32:37.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.415+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~2ORESA7JWASG.2 size=90234 2023-12-03T11:32:37.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.417+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=2ORESA7JWASG tag=UEDKAOS92LJU type=write size=3235962 2023-12-03T11:32:37.419 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.418+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=DHU32K5SFXL5 type=del size=2943619 2023-12-03T11:32:37.420 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.419+0000 7f4d50c67780 1 < completed delete operation key=EX93BYX10WJB tag=PKQ4M2GAWDJV type=del 2023-12-03T11:32:37.421 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.420+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=V5LPATURROJA type=write size=610253 2023-12-03T11:32:37.422 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.421+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~0FTEN2TR04ZQ.0 size=1048576 2023-12-03T11:32:37.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.422+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~0FTEN2TR04ZQ.1 size=1048576 2023-12-03T11:32:37.424 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.423+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~0FTEN2TR04ZQ.2 size=1042966 2023-12-03T11:32:37.426 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.425+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=0FTEN2TR04ZQ tag=ZP6DS14V5SRL type=write size=4188694 2023-12-03T11:32:37.429 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.428+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~SO46F3YOQX2R.0 size=1006443 2023-12-03T11:32:37.429 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.428+0000 7f4d50c67780 1 > prepared multipart upload key=ULLPV2G10BME upload=SO46F3YOQX2R tag=OALN0TGGZWGI type=write size=2055019 2023-12-03T11:32:37.430 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.429+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~P2VJ2SBEAFKO.0 size=1048576 2023-12-03T11:32:37.431 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.430+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~P2VJ2SBEAFKO.1 size=1048576 2023-12-03T11:32:37.432 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.431+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~P2VJ2SBEAFKO.2 size=378731 2023-12-03T11:32:37.434 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.433+0000 7f4d50c67780 1 < completed multipart upload key=ZE19S5UCCZ3C upload=P2VJ2SBEAFKO tag=ELRASXGJ7HM4 type=write size=3524459 2023-12-03T11:32:37.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.435+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~HYZQPN9LAO5R.0 size=505680 2023-12-03T11:32:37.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.435+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=HYZQPN9LAO5R tag=52EXJHVKVCXL type=write size=1554256 2023-12-03T11:32:37.438 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.437+0000 7f4d50c67780 1 < completed write operation key=JBL6IOJC4TT0 tag=40A98W1DWQU3 type=write size=673597 2023-12-03T11:32:37.440 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.439+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~00DRVYJLHB16.0 size=1014089 2023-12-03T11:32:37.440 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.439+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=00DRVYJLHB16 tag=A0GHX9BL1AXP type=write size=2062665 2023-12-03T11:32:37.442 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.442+0000 7f4d50c67780 1 < suggested update operation key=02W4TX7ZCDI6 tag=L2BS25M809C1 type=write size=436652 2023-12-03T11:32:37.445 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.444+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~WEWQMY0XB7X6.0 size=133683 2023-12-03T11:32:37.445 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.444+0000 7f4d50c67780 1 > prepared multipart upload key=73SL3ZBBDA6Q upload=WEWQMY0XB7X6 tag=5INH2NE0W5V9 type=write size=1182259 2023-12-03T11:32:37.447 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.446+0000 7f4d50c67780 1 < suggested update operation key=YDRAH5EE39R4 tag=TND6D51U7BSD type=write size=702745 2023-12-03T11:32:37.449 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.449+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~9OTW81CHWGFW.0 size=1048576 2023-12-03T11:32:37.450 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.450+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~9OTW81CHWGFW.1 size=757166 2023-12-03T11:32:37.450 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.450+0000 7f4d50c67780 1 > prepared multipart upload key=TEIYINZFFG76 upload=9OTW81CHWGFW tag=CH2T1ZUA44PH type=write size=2854318 2023-12-03T11:32:37.452 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.451+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~JEI6L9TJRGBR.0 size=1048576 2023-12-03T11:32:37.453 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.452+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~JEI6L9TJRGBR.1 size=1048576 2023-12-03T11:32:37.454 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.453+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~JEI6L9TJRGBR.2 size=263766 2023-12-03T11:32:37.456 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.455+0000 7f4d50c67780 1 < completed multipart upload key=G0O8EC405LYM upload=JEI6L9TJRGBR tag=P9F4J3KN8QXI type=write size=3409494 2023-12-03T11:32:37.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.456+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=M9BXWNJQ8AET type=write size=70222 2023-12-03T11:32:37.458 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.457+0000 7f4d50c67780 -1 < failed to complete operation key=YDRAH5EE39R4 tag=H7GTOK8OC1NQ type=write size=485021: (22) Invalid argument 2023-12-03T11:32:37.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.459+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=DY4DQUC6YZ10 type=del size=3950274 2023-12-03T11:32:37.462 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.461+0000 7f4d50c67780 1 < suggested remove operation key=EY1RBO15PCRR tag=XJ2UF6Q7WBIO type=del 2023-12-03T11:32:37.463 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.462+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=SPWUWJY7QYW7 type=write size=604986 2023-12-03T11:32:37.464 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.463+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~LHG7WV3SLBY5.0 size=297522 2023-12-03T11:32:37.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.466+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=LHG7WV3SLBY5 tag=LQQFC6AE643R type=write size=1346098 2023-12-03T11:32:37.468 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.467+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=PSY7GDJZCXMD type=del size=465583 2023-12-03T11:32:37.469 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.468+0000 7f4d50c67780 1 < completed delete operation key=73SL3ZBBDA6Q tag=24FDO6ILDY8J type=del 2023-12-03T11:32:37.470 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.469+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=GCZ8Q8NWDMBJ type=del size=93190 2023-12-03T11:32:37.471 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.470+0000 7f4d50c67780 1 < completed delete operation key=EX93BYX10WJB tag=TG7DLAU1E2ZW type=del 2023-12-03T11:32:37.473 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.472+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=8OH9JN0M48YJ type=del size=428894 2023-12-03T11:32:37.475 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.474+0000 7f4d50c67780 1 < suggested remove operation key=XM5E3D99MXVA tag=ZLA122JN4FTH type=write 2023-12-03T11:32:37.476 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.475+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=IWH89FEE7O3O type=del size=992756 2023-12-03T11:32:37.478 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.477+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~Z9E693C706UK.0 size=1048576 2023-12-03T11:32:37.478 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.478+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~Z9E693C706UK.1 size=503771 2023-12-03T11:32:37.481 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.480+0000 7f4d50c67780 1 < completed multipart upload key=TEIYINZFFG76 upload=Z9E693C706UK tag=CSOKMO2MLSLL type=write size=2600923 2023-12-03T11:32:37.482 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.481+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=LHID032ET70I type=del size=3100558 2023-12-03T11:32:37.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.482+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~SOSWEZ0VNIZM.0 size=1048576 2023-12-03T11:32:37.484 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.483+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~SOSWEZ0VNIZM.1 size=836419 2023-12-03T11:32:37.486 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.486+0000 7f4d50c67780 1 < completed multipart upload key=ZE19S5UCCZ3C upload=SOSWEZ0VNIZM tag=VEWTDL3Z4KBW type=write size=2933571 2023-12-03T11:32:37.489 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.488+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~7IG4IDZBD284.0 size=264766 2023-12-03T11:32:37.489 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.488+0000 7f4d50c67780 1 > prepared multipart upload key=U6R5Y9JXKT32 upload=7IG4IDZBD284 tag=PCOY676XOP2Y type=write size=1313342 2023-12-03T11:32:37.490 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.489+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=DHU32K5SFXL5 type=del 2023-12-03T11:32:37.492 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.491+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~6HKYWLM7FPJ5.0 size=1048576 2023-12-03T11:32:37.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.492+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~6HKYWLM7FPJ5.1 size=783159 2023-12-03T11:32:37.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.492+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=6HKYWLM7FPJ5 tag=0XN776KNV2S7 type=write size=2880311 2023-12-03T11:32:37.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.495+0000 7f4d50c67780 1 < suggested update operation key=JBL6IOJC4TT0 tag=V5LPATURROJA type=write size=610253 2023-12-03T11:32:37.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.496+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=SS55U1BSMKPF type=del size=1199039 2023-12-03T11:32:37.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.497+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~SO46F3YOQX2R.0 size=1006443 2023-12-03T11:32:37.500 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.499+0000 7f4d50c67780 1 < completed multipart upload key=ULLPV2G10BME upload=SO46F3YOQX2R tag=OALN0TGGZWGI type=write size=2055019 2023-12-03T11:32:37.502 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.502+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~ICRP76IEG13M.0 size=1048576 2023-12-03T11:32:37.503 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.503+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~ICRP76IEG13M.1 size=60481 2023-12-03T11:32:37.504 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.503+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=ICRP76IEG13M tag=2BOPU1VJOOXH type=write size=2157633 2023-12-03T11:32:37.505 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.504+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~HYZQPN9LAO5R.0 size=505680 2023-12-03T11:32:37.507 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.506+0000 7f4d50c67780 1 < completed multipart upload key=83I1M5WIVKAA upload=HYZQPN9LAO5R tag=52EXJHVKVCXL type=write size=1554256 2023-12-03T11:32:37.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.507+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=A6G3JMWUIPL1 type=del size=1542744 2023-12-03T11:32:37.509 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.508+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~00DRVYJLHB16.0 size=1014089 2023-12-03T11:32:37.511 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.510+0000 7f4d50c67780 1 < completed multipart upload key=K7YVVH7SAKMC upload=00DRVYJLHB16 tag=A0GHX9BL1AXP type=write size=2062665 2023-12-03T11:32:37.512 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.511+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=2UAHAOTXOPHO type=del size=2780130 2023-12-03T11:32:37.514 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.513+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~WEWQMY0XB7X6.0 size=133683 2023-12-03T11:32:37.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.515+0000 7f4d50c67780 1 < completed multipart upload key=73SL3ZBBDA6Q upload=WEWQMY0XB7X6 tag=5INH2NE0W5V9 type=write size=1182259 2023-12-03T11:32:37.517 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.516+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=G3RTG2G85V0A type=del size=321459 2023-12-03T11:32:37.518 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.517+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~9OTW81CHWGFW.0 size=1048576 2023-12-03T11:32:37.519 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.518+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~9OTW81CHWGFW.1 size=757166 2023-12-03T11:32:37.521 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.520+0000 7f4d50c67780 1 < completed multipart upload key=TEIYINZFFG76 upload=9OTW81CHWGFW tag=CH2T1ZUA44PH type=write size=2854318 2023-12-03T11:32:37.523 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.522+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~N5AMP9WXBLOZ.0 size=1016849 2023-12-03T11:32:37.523 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.522+0000 7f4d50c67780 1 > prepared multipart upload key=ZE19S5UCCZ3C upload=N5AMP9WXBLOZ tag=7NB7T18B7EP3 type=write size=2065425 2023-12-03T11:32:37.525 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.525+0000 7f4d50c67780 1 < suggested remove operation key=2H6AFQ362OGP tag=M9BXWNJQ8AET type=write 2023-12-03T11:32:37.527 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.526+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=TYY4U6FWPXUF type=del size=2271454 2023-12-03T11:32:37.529 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.528+0000 7f4d50c67780 1 < suggested update operation key=8J1EO2JDQUQH tag=DY4DQUC6YZ10 type=del size=3950274 2023-12-03T11:32:37.531 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.530+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~8PD6HDFRMCG5.0 size=166571 2023-12-03T11:32:37.531 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.530+0000 7f4d50c67780 1 > prepared multipart upload key=ENMJS0KEVS2S upload=8PD6HDFRMCG5 tag=OKB7RL1OMAGZ type=write size=1215147 2023-12-03T11:32:37.532 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.531+0000 7f4d50c67780 1 < completed write operation key=52E31L45TN7V tag=SPWUWJY7QYW7 type=write size=604986 2023-12-03T11:32:37.534 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.534+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~ED5BGATHW8NN.0 size=1048576 2023-12-03T11:32:37.535 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.534+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~ED5BGATHW8NN.1 size=927814 2023-12-03T11:32:37.535 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.534+0000 7f4d50c67780 1 > prepared multipart upload key=TEIYINZFFG76 upload=ED5BGATHW8NN tag=41XWG3S9D3NH type=write size=3024966 2023-12-03T11:32:37.536 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.536+0000 7f4d50c67780 -1 < failed to complete operation key=8J1EO2JDQUQH tag=PSY7GDJZCXMD type=del size=465583: (22) Invalid argument 2023-12-03T11:32:37.539 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.538+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~HDUZBGC1EBBL.0 size=38385 2023-12-03T11:32:37.539 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.538+0000 7f4d50c67780 1 > prepared multipart upload key=RF2Q24GI24HJ upload=HDUZBGC1EBBL tag=QSP0P7N31FNA type=write size=1086961 2023-12-03T11:32:37.540 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.539+0000 7f4d50c67780 1 < canceled operation key=0M6ZAD39I852 tag=GCZ8Q8NWDMBJ type=del size=93190 2023-12-03T11:32:37.541 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.540+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=NSSODLRZ2QUY type=del size=507725 2023-12-03T11:32:37.542 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.541+0000 7f4d50c67780 1 < completed delete operation key=EX93BYX10WJB tag=8OH9JN0M48YJ type=del 2023-12-03T11:32:37.543 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.542+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=IFMH79XQY0KU type=del size=1751888 2023-12-03T11:32:37.546 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.545+0000 7f4d50c67780 1 < suggested remove operation key=JR8CIONID4QC tag=IWH89FEE7O3O type=del 2023-12-03T11:32:37.547 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.546+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=GPUM2NJ9U2HO type=del size=148157 2023-12-03T11:32:37.548 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.547+0000 7f4d50c67780 -1 < failed to complete operation key=2H6AFQ362OGP tag=LHID032ET70I type=del size=3100558: (22) Invalid argument 2023-12-03T11:32:37.549 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.548+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=RICEYXN1DTVT type=del size=3950483 2023-12-03T11:32:37.549 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.548+0000 7f4d50c67780 1 < canceled part key=_multipart_U6R5Y9JXKT32.2~7IG4IDZBD284.0 size=264766 2023-12-03T11:32:37.552 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.551+0000 7f4d50c67780 1 < canceled multipart upload key=U6R5Y9JXKT32 upload=7IG4IDZBD284 tag=PCOY676XOP2Y type=write size=1313342 2023-12-03T11:32:37.554 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.553+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~WP2T9K13MKFJ.0 size=409118 2023-12-03T11:32:37.554 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.553+0000 7f4d50c67780 1 > prepared multipart upload key=ZE19S5UCCZ3C upload=WP2T9K13MKFJ tag=4DEHZ75IL0Q3 type=write size=1457694 2023-12-03T11:32:37.555 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.554+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~6HKYWLM7FPJ5.0 size=1048576 2023-12-03T11:32:37.556 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.555+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~6HKYWLM7FPJ5.1 size=783159 2023-12-03T11:32:37.558 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.557+0000 7f4d50c67780 1 < completed multipart upload key=CQPZ0X62207Z upload=6HKYWLM7FPJ5 tag=0XN776KNV2S7 type=write size=2880311 2023-12-03T11:32:37.559 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.559+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=UK4AMFPZJF8G type=del size=3898495 2023-12-03T11:32:37.562 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.561+0000 7f4d50c67780 1 < suggested update operation key=ENMJS0KEVS2S tag=SS55U1BSMKPF type=del size=1199039 2023-12-03T11:32:37.563 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.562+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=63M2QQT209MX type=del size=3611993 2023-12-03T11:32:37.564 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.563+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~ICRP76IEG13M.0 size=1048576 2023-12-03T11:32:37.565 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.564+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~ICRP76IEG13M.1 size=60481 2023-12-03T11:32:37.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.567+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=ICRP76IEG13M tag=2BOPU1VJOOXH type=write size=2157633 2023-12-03T11:32:37.570 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.569+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~QU7PB8FP7BPM.0 size=1048576 2023-12-03T11:32:37.570 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.570+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~QU7PB8FP7BPM.1 size=1048576 2023-12-03T11:32:37.571 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.571+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~QU7PB8FP7BPM.2 size=925647 2023-12-03T11:32:37.572 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.571+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=QU7PB8FP7BPM tag=GBNBUKQU3LMR type=write size=4071375 2023-12-03T11:32:37.573 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.572+0000 7f4d50c67780 1 < completed delete operation key=7C7UX0231SHV tag=A6G3JMWUIPL1 type=del 2023-12-03T11:32:37.574 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.573+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=626JGXSCG55W type=del size=574038 2023-12-03T11:32:37.575 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.574+0000 7f4d50c67780 -1 < failed to complete operation key=2H6AFQ362OGP tag=2UAHAOTXOPHO type=del size=2780130: (22) Invalid argument 2023-12-03T11:32:37.577 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.576+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~2CS73EAHL41P.0 size=1048576 2023-12-03T11:32:37.578 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.577+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~2CS73EAHL41P.1 size=1048576 2023-12-03T11:32:37.579 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.578+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~2CS73EAHL41P.2 size=1013519 2023-12-03T11:32:37.579 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.578+0000 7f4d50c67780 1 > prepared multipart upload key=ENMJS0KEVS2S upload=2CS73EAHL41P tag=CC11BGKJUFAJ type=write size=4159247 2023-12-03T11:32:37.581 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.580+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=G3RTG2G85V0A type=del 2023-12-03T11:32:37.582 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.581+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=AS32042V025B type=del size=5660 2023-12-03T11:32:37.583 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.582+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~N5AMP9WXBLOZ.0 size=1016849 2023-12-03T11:32:37.585 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.584+0000 7f4d50c67780 1 < completed multipart upload key=ZE19S5UCCZ3C upload=N5AMP9WXBLOZ tag=7NB7T18B7EP3 type=write size=2065425 2023-12-03T11:32:37.586 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.586+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=3D4XVF6GKO8U type=del size=888696 2023-12-03T11:32:37.589 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.588+0000 7f4d50c67780 1 < suggested update operation key=WUM939BATDG9 tag=TYY4U6FWPXUF type=del size=2271454 2023-12-03T11:32:37.591 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.590+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~940NR01DIO1N.0 size=1048576 2023-12-03T11:32:37.592 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.591+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~940NR01DIO1N.1 size=605857 2023-12-03T11:32:37.592 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.591+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=940NR01DIO1N tag=FMY0BUHL2V4T type=write size=2703009 2023-12-03T11:32:37.592 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.592+0000 7f4d50c67780 1 < canceled part key=_multipart_ENMJS0KEVS2S.2~8PD6HDFRMCG5.0 size=166571 2023-12-03T11:32:37.594 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.594+0000 7f4d50c67780 1 < canceled multipart upload key=ENMJS0KEVS2S upload=8PD6HDFRMCG5 tag=OKB7RL1OMAGZ type=write size=1215147 2023-12-03T11:32:37.596 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.595+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=2LNGK7K2HOTP type=del size=3906718 2023-12-03T11:32:37.596 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.595+0000 7f4d50c67780 1 < canceled part key=_multipart_TEIYINZFFG76.2~ED5BGATHW8NN.0 size=1048576 2023-12-03T11:32:37.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.596+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~ED5BGATHW8NN.1 size=927814 2023-12-03T11:32:37.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.598+0000 7f4d50c67780 1 < canceled multipart upload key=TEIYINZFFG76 upload=ED5BGATHW8NN tag=41XWG3S9D3NH type=write size=3024966 2023-12-03T11:32:37.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.600+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=710EN5ZGU4L0 type=write size=782610 2023-12-03T11:32:37.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.601+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~HDUZBGC1EBBL.0 size=38385 2023-12-03T11:32:37.604 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.603+0000 7f4d50c67780 1 < completed multipart upload key=RF2Q24GI24HJ upload=HDUZBGC1EBBL tag=QSP0P7N31FNA type=write size=1086961 2023-12-03T11:32:37.606 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.606+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~3DKBFPBBALKS.0 size=1048576 2023-12-03T11:32:37.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.607+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~3DKBFPBBALKS.1 size=1048576 2023-12-03T11:32:37.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.608+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~3DKBFPBBALKS.2 size=1019596 2023-12-03T11:32:37.609 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.608+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=3DKBFPBBALKS tag=IQ34TJLJP3OL type=write size=4165324 2023-12-03T11:32:37.611 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.610+0000 7f4d50c67780 1 < suggested remove operation key=EX93BYX10WJB tag=NSSODLRZ2QUY type=del 2023-12-03T11:32:37.612 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.611+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=K5KEA3O13UTT type=del size=1425391 2023-12-03T11:32:37.613 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.613+0000 7f4d50c67780 1 < completed delete operation key=02W4TX7ZCDI6 tag=IFMH79XQY0KU type=del 2023-12-03T11:32:37.616 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.615+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~URNI34SLLW7M.0 size=1048576 2023-12-03T11:32:37.617 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.616+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~URNI34SLLW7M.1 size=1046482 2023-12-03T11:32:37.617 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.616+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=URNI34SLLW7M tag=J3PHOV5J6U1V type=write size=3143634 2023-12-03T11:32:37.619 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.618+0000 7f4d50c67780 1 < suggested remove operation key=83I1M5WIVKAA tag=GPUM2NJ9U2HO type=del 2023-12-03T11:32:37.620 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.619+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=8PSVBSUP8K2L type=del size=1457919 2023-12-03T11:32:37.621 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.621+0000 7f4d50c67780 1 < completed delete operation key=EAP0BYZTTT2E tag=RICEYXN1DTVT type=del 2023-12-03T11:32:37.624 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.623+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~WWK3G1LBD1UK.0 size=341211 2023-12-03T11:32:37.624 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.623+0000 7f4d50c67780 1 > prepared multipart upload key=QQDBWLVSXIHP upload=WWK3G1LBD1UK tag=J3SVP07729XV type=write size=1389787 2023-12-03T11:32:37.625 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.624+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~WP2T9K13MKFJ.0 size=409118 2023-12-03T11:32:37.627 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.626+0000 7f4d50c67780 1 < completed multipart upload key=ZE19S5UCCZ3C upload=WP2T9K13MKFJ tag=4DEHZ75IL0Q3 type=write size=1457694 2023-12-03T11:32:37.628 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.627+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=968M7R5QZ325 type=del size=1331010 2023-12-03T11:32:37.630 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.629+0000 7f4d50c67780 1 < canceled operation key=QQDBWLVSXIHP tag=UK4AMFPZJF8G type=del size=3898495 2023-12-03T11:32:37.632 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.631+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~KZUIVY8HJN9G.0 size=1048576 2023-12-03T11:32:37.633 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.632+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~KZUIVY8HJN9G.1 size=474786 2023-12-03T11:32:37.633 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.632+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=KZUIVY8HJN9G tag=UD9HZ93ACZRL type=write size=2571938 2023-12-03T11:32:37.635 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.634+0000 7f4d50c67780 -1 < failed to complete operation key=WUM939BATDG9 tag=63M2QQT209MX type=del size=3611993: (22) Invalid argument 2023-12-03T11:32:37.636 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.635+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=FWGJDT4687CB type=write size=561512 2023-12-03T11:32:37.638 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.637+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~QU7PB8FP7BPM.0 size=1048576 2023-12-03T11:32:37.639 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.638+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~QU7PB8FP7BPM.1 size=1048576 2023-12-03T11:32:37.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.639+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~QU7PB8FP7BPM.2 size=925647 2023-12-03T11:32:37.643 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.642+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=QU7PB8FP7BPM tag=GBNBUKQU3LMR type=write size=4071375 2023-12-03T11:32:37.644 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.643+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=GM59AX5HGQVW type=write size=114937 2023-12-03T11:32:37.645 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.644+0000 7f4d50c67780 1 < completed delete operation key=7C7UX0231SHV tag=626JGXSCG55W type=del 2023-12-03T11:32:37.646 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.646+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=HSA1C1YXW9KL type=del size=795343 2023-12-03T11:32:37.648 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.647+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~2CS73EAHL41P.0 size=1048576 2023-12-03T11:32:37.649 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.648+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~2CS73EAHL41P.1 size=1048576 2023-12-03T11:32:37.650 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.649+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~2CS73EAHL41P.2 size=1013519 2023-12-03T11:32:37.652 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.651+0000 7f4d50c67780 1 < completed multipart upload key=ENMJS0KEVS2S upload=2CS73EAHL41P tag=CC11BGKJUFAJ type=write size=4159247 2023-12-03T11:32:37.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.653+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~5YWVYY65E00Z.0 size=977866 2023-12-03T11:32:37.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.653+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=5YWVYY65E00Z tag=MFTN018FRT1P type=write size=2026442 2023-12-03T11:32:37.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.655+0000 7f4d50c67780 1 < suggested remove operation key=EAP0BYZTTT2E tag=AS32042V025B type=del 2023-12-03T11:32:37.657 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.657+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=BQ8R57QAACH3 type=write size=603509 2023-12-03T11:32:37.659 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.658+0000 7f4d50c67780 1 < completed delete operation key=EY1RBO15PCRR tag=3D4XVF6GKO8U type=del 2023-12-03T11:32:37.660 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.659+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=2JVVU1VNBTQK type=del size=1321298 2023-12-03T11:32:37.661 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.660+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~940NR01DIO1N.0 size=1048576 2023-12-03T11:32:37.662 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.661+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~940NR01DIO1N.1 size=605857 2023-12-03T11:32:37.664 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.663+0000 7f4d50c67780 1 < completed multipart upload key=EH4B2QP1C42H upload=940NR01DIO1N tag=FMY0BUHL2V4T type=write size=2703009 2023-12-03T11:32:37.665 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.665+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=MNA1LAQZIPCK type=write size=116789 2023-12-03T11:32:37.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.666+0000 7f4d50c67780 1 < canceled operation key=0M6ZAD39I852 tag=2LNGK7K2HOTP type=del size=3906718 2023-12-03T11:32:37.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.668+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=84QJO89MU6BA type=write size=116473 2023-12-03T11:32:37.670 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.669+0000 7f4d50c67780 1 < completed write operation key=TEIYINZFFG76 tag=710EN5ZGU4L0 type=write size=782610 2023-12-03T11:32:37.671 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.671+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=KM71O3E3NPBG type=del size=1140721 2023-12-03T11:32:37.672 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.671+0000 7f4d50c67780 1 < canceled part key=_multipart_WUM939BATDG9.2~3DKBFPBBALKS.0 size=1048576 2023-12-03T11:32:37.673 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.672+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~3DKBFPBBALKS.1 size=1048576 2023-12-03T11:32:37.674 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.673+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~3DKBFPBBALKS.2 size=1019596 2023-12-03T11:32:37.676 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.675+0000 7f4d50c67780 1 < canceled multipart upload key=WUM939BATDG9 upload=3DKBFPBBALKS tag=IQ34TJLJP3OL type=write size=4165324 2023-12-03T11:32:37.677 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.676+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=5PTM2Y5BA2Q8 type=del size=1687834 2023-12-03T11:32:37.680 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.679+0000 7f4d50c67780 1 < suggested update operation key=XM5E3D99MXVA tag=K5KEA3O13UTT type=del size=1425391 2023-12-03T11:32:37.681 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.680+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=6RJN3PNS3QHG type=del size=1557118 2023-12-03T11:32:37.682 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.682+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~URNI34SLLW7M.0 size=1048576 2023-12-03T11:32:37.683 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.683+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~URNI34SLLW7M.1 size=1046482 2023-12-03T11:32:37.686 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.685+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=URNI34SLLW7M tag=J3PHOV5J6U1V type=write size=3143634 2023-12-03T11:32:37.687 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.686+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=S55TBC694GA6 type=del size=912345 2023-12-03T11:32:37.689 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.688+0000 7f4d50c67780 1 < completed delete operation key=EX93BYX10WJB tag=8PSVBSUP8K2L type=del 2023-12-03T11:32:37.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.690+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~PYE6QD0BEM5U.0 size=994185 2023-12-03T11:32:37.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.690+0000 7f4d50c67780 1 > prepared multipart upload key=52E31L45TN7V upload=PYE6QD0BEM5U tag=LGY6FSPNUYZN type=write size=2042761 2023-12-03T11:32:37.692 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.691+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~WWK3G1LBD1UK.0 size=341211 2023-12-03T11:32:37.694 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.693+0000 7f4d50c67780 1 < completed multipart upload key=QQDBWLVSXIHP upload=WWK3G1LBD1UK tag=J3SVP07729XV type=write size=1389787 2023-12-03T11:32:37.695 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.695+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=X2460ZE44RT9 type=write size=697392 2023-12-03T11:32:37.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.696+0000 7f4d50c67780 1 < canceled operation key=YDRAH5EE39R4 tag=968M7R5QZ325 type=del size=1331010 2023-12-03T11:32:37.698 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.697+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=VGRECNLGQOM1 type=del size=4074449 2023-12-03T11:32:37.699 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.698+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~KZUIVY8HJN9G.0 size=1048576 2023-12-03T11:32:37.699 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.698+0000 7f4d50c67780 1 < canceled part key=_multipart_EAP0BYZTTT2E.2~KZUIVY8HJN9G.1 size=474786 2023-12-03T11:32:37.701 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.700+0000 7f4d50c67780 1 < canceled multipart upload key=EAP0BYZTTT2E upload=KZUIVY8HJN9G tag=UD9HZ93ACZRL type=write size=2571938 2023-12-03T11:32:37.702 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.702+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=E9IG8D69EI3V type=del size=2139584 2023-12-03T11:32:37.704 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.703+0000 7f4d50c67780 1 < completed write operation key=BX5POXMMYLB7 tag=FWGJDT4687CB type=write size=561512 2023-12-03T11:32:37.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.704+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=L8LQ0TOFOBEM type=del size=3209016 2023-12-03T11:32:37.706 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.705+0000 7f4d50c67780 1 < completed write operation key=EH4B2QP1C42H tag=GM59AX5HGQVW type=write size=114937 2023-12-03T11:32:37.708 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.708+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~R0L5MNT6BLYE.0 size=160186 2023-12-03T11:32:37.709 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.708+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=R0L5MNT6BLYE tag=Q56AP3I72ZR4 type=write size=1208762 2023-12-03T11:32:37.711 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.710+0000 7f4d50c67780 1 < suggested update operation key=0M6ZAD39I852 tag=HSA1C1YXW9KL type=del size=795343 2023-12-03T11:32:37.712 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.711+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=76NXP2DO25PE type=del size=740783 2023-12-03T11:32:37.714 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.713+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~5YWVYY65E00Z.0 size=977866 2023-12-03T11:32:37.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.715+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=5YWVYY65E00Z tag=MFTN018FRT1P type=write size=2026442 2023-12-03T11:32:37.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.717+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~RH4TRI94NZI6.0 size=1048576 2023-12-03T11:32:37.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.718+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~RH4TRI94NZI6.1 size=1048576 2023-12-03T11:32:37.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.719+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~RH4TRI94NZI6.2 size=418001 2023-12-03T11:32:37.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.719+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=RH4TRI94NZI6 tag=COUJSRXELFYI type=write size=3563729 2023-12-03T11:32:37.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.720+0000 7f4d50c67780 1 < completed write operation key=TEIYINZFFG76 tag=BQ8R57QAACH3 type=write size=603509 2023-12-03T11:32:37.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.721+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=G1SEOYX5RVD8 type=del size=4153384 2023-12-03T11:32:37.723 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.723+0000 7f4d50c67780 1 < completed delete operation key=V0ND3OBFJJUB tag=2JVVU1VNBTQK type=del 2023-12-03T11:32:37.725 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.724+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=1V3RS7OUJZVJ type=del size=233002 2023-12-03T11:32:37.726 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.725+0000 7f4d50c67780 1 < completed write operation key=EAP0BYZTTT2E tag=MNA1LAQZIPCK type=write size=116789 2023-12-03T11:32:37.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.727+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~FLNKH7LWNOMV.0 size=1048576 2023-12-03T11:32:37.729 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.728+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~FLNKH7LWNOMV.1 size=137274 2023-12-03T11:32:37.729 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.728+0000 7f4d50c67780 1 > prepared multipart upload key=JR8CIONID4QC upload=FLNKH7LWNOMV tag=XZ1O4KUH5BI5 type=write size=2234426 2023-12-03T11:32:37.730 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.730+0000 7f4d50c67780 1 < canceled operation key=2H6AFQ362OGP tag=84QJO89MU6BA type=write size=116473 2023-12-03T11:32:37.732 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.731+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=S20OXG9RVIMN type=write size=503238 2023-12-03T11:32:37.733 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.732+0000 7f4d50c67780 -1 < failed to complete operation key=0M6ZAD39I852 tag=KM71O3E3NPBG type=del size=1140721: (22) Invalid argument 2023-12-03T11:32:37.734 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.733+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=WG21SEYJ8UTO type=write size=1028216 2023-12-03T11:32:37.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.736+0000 7f4d50c67780 1 < suggested update operation key=JR8CIONID4QC tag=5PTM2Y5BA2Q8 type=del size=1687834 2023-12-03T11:32:37.738 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.737+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=2TKCWF405PEA type=del size=2531557 2023-12-03T11:32:37.739 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.738+0000 7f4d50c67780 1 < completed delete operation key=52E31L45TN7V tag=6RJN3PNS3QHG type=del 2023-12-03T11:32:37.740 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.739+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=Y12630RV7PB4 type=write size=731995 2023-12-03T11:32:37.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.740+0000 7f4d50c67780 1 < completed delete operation key=QQDBWLVSXIHP tag=S55TBC694GA6 type=del 2023-12-03T11:32:37.743 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.742+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~CPOAKLNM3AWY.0 size=1048576 2023-12-03T11:32:37.744 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.743+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~CPOAKLNM3AWY.1 size=1004803 2023-12-03T11:32:37.744 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.743+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=CPOAKLNM3AWY tag=CRIL2SB83ZLK type=write size=3101955 2023-12-03T11:32:37.745 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.745+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~PYE6QD0BEM5U.0 size=994185 2023-12-03T11:32:37.747 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.747+0000 7f4d50c67780 1 < completed multipart upload key=52E31L45TN7V upload=PYE6QD0BEM5U tag=LGY6FSPNUYZN type=write size=2042761 2023-12-03T11:32:37.750 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.749+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~062U5QNWH1V8.0 size=544293 2023-12-03T11:32:37.750 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.749+0000 7f4d50c67780 1 > prepared multipart upload key=ENMJS0KEVS2S upload=062U5QNWH1V8 tag=22IHOB2N1L5T type=write size=1592869 2023-12-03T11:32:37.751 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.750+0000 7f4d50c67780 1 < completed write operation key=XM5E3D99MXVA tag=X2460ZE44RT9 type=write size=697392 2023-12-03T11:32:37.752 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.751+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=CY3MTYP7ED2U type=write size=844642 2023-12-03T11:32:37.753 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.752+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=VGRECNLGQOM1 type=del 2023-12-03T11:32:37.756 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.755+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~9JVTZC41MB25.0 size=1048576 2023-12-03T11:32:37.756 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.755+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~9JVTZC41MB25.1 size=1048576 2023-12-03T11:32:37.757 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.756+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~9JVTZC41MB25.2 size=1003730 2023-12-03T11:32:37.757 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.756+0000 7f4d50c67780 1 > prepared multipart upload key=52E31L45TN7V upload=9JVTZC41MB25 tag=YTT1B9KMAIV6 type=write size=4149458 2023-12-03T11:32:37.758 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.758+0000 7f4d50c67780 1 < completed delete operation key=V0ND3OBFJJUB tag=E9IG8D69EI3V type=del 2023-12-03T11:32:37.761 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.760+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~UD4GPBABN45Z.0 size=1048576 2023-12-03T11:32:37.761 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.761+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~UD4GPBABN45Z.1 size=1048576 2023-12-03T11:32:37.762 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.761+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~UD4GPBABN45Z.2 size=278367 2023-12-03T11:32:37.762 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.761+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=UD4GPBABN45Z tag=F3ZHH13BL3B0 type=write size=3424095 2023-12-03T11:32:37.763 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.763+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=L8LQ0TOFOBEM type=del 2023-12-03T11:32:37.766 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.765+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~1KUV7SVL4UY9.0 size=1048576 2023-12-03T11:32:37.767 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.766+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~1KUV7SVL4UY9.1 size=1048576 2023-12-03T11:32:37.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.767+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~1KUV7SVL4UY9.2 size=981636 2023-12-03T11:32:37.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.767+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=1KUV7SVL4UY9 tag=M61OIDXL56LV type=write size=4127364 2023-12-03T11:32:37.769 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.768+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~R0L5MNT6BLYE.0 size=160186 2023-12-03T11:32:37.771 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.770+0000 7f4d50c67780 1 < completed multipart upload key=MLKGLDFFDC3W upload=R0L5MNT6BLYE tag=Q56AP3I72ZR4 type=write size=1208762 2023-12-03T11:32:37.772 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.771+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=FBAI5EXGKNLD type=del size=913834 2023-12-03T11:32:37.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.772+0000 7f4d50c67780 1 < completed delete operation key=0M6ZAD39I852 tag=76NXP2DO25PE type=del 2023-12-03T11:32:37.774 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.774+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=D5KGKWZK3YYH type=del size=2222248 2023-12-03T11:32:37.776 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.775+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~RH4TRI94NZI6.0 size=1048576 2023-12-03T11:32:37.777 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.776+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~RH4TRI94NZI6.1 size=1048576 2023-12-03T11:32:37.778 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.777+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~RH4TRI94NZI6.2 size=418001 2023-12-03T11:32:37.780 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.779+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=RH4TRI94NZI6 tag=COUJSRXELFYI type=write size=3563729 2023-12-03T11:32:37.782 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.782+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~RCHK4VRYXB50.0 size=247571 2023-12-03T11:32:37.782 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.782+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=RCHK4VRYXB50 tag=IW5PMUTAP6ZO type=write size=1296147 2023-12-03T11:32:37.784 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.783+0000 7f4d50c67780 1 < completed delete operation key=QQDBWLVSXIHP tag=G1SEOYX5RVD8 type=del 2023-12-03T11:32:37.785 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.785+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=9IDQD2O0H9WY type=del size=1613482 2023-12-03T11:32:37.787 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.786+0000 7f4d50c67780 1 < completed delete operation key=0M6ZAD39I852 tag=1V3RS7OUJZVJ type=del 2023-12-03T11:32:37.788 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.787+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=ZWRL1T7GFZC0 type=write size=390085 2023-12-03T11:32:37.788 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.787+0000 7f4d50c67780 1 < canceled part key=_multipart_JR8CIONID4QC.2~FLNKH7LWNOMV.0 size=1048576 2023-12-03T11:32:37.789 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.788+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~FLNKH7LWNOMV.1 size=137274 2023-12-03T11:32:37.791 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.790+0000 7f4d50c67780 1 < canceled multipart upload key=JR8CIONID4QC upload=FLNKH7LWNOMV tag=XZ1O4KUH5BI5 type=write size=2234426 2023-12-03T11:32:37.792 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.791+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=P80EZXB105ZX type=del size=1222614 2023-12-03T11:32:37.793 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.793+0000 7f4d50c67780 1 < completed write operation key=BX5POXMMYLB7 tag=S20OXG9RVIMN type=write size=503238 2023-12-03T11:32:37.795 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.794+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=8RPYZWR6NA2E type=del size=1890076 2023-12-03T11:32:37.796 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.795+0000 7f4d50c67780 1 < completed write operation key=EY1RBO15PCRR tag=WG21SEYJ8UTO type=write size=1028216 2023-12-03T11:32:37.797 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.796+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=PWXDX0C9YQ27 type=write size=638417 2023-12-03T11:32:37.800 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.799+0000 7f4d50c67780 1 < suggested remove operation key=WUM939BATDG9 tag=2TKCWF405PEA type=del 2023-12-03T11:32:37.801 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.800+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=U4XKG0685XVQ type=del size=2210189 2023-12-03T11:32:37.803 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.803+0000 7f4d50c67780 1 < suggested update operation key=ULLPV2G10BME tag=Y12630RV7PB4 type=write size=731995 2023-12-03T11:32:37.805 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.804+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=MRL5R5SR025C type=del size=1304897 2023-12-03T11:32:37.806 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.805+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~CPOAKLNM3AWY.0 size=1048576 2023-12-03T11:32:37.806 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.805+0000 7f4d50c67780 1 < canceled part key=_multipart_83I1M5WIVKAA.2~CPOAKLNM3AWY.1 size=1004803 2023-12-03T11:32:37.809 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.808+0000 7f4d50c67780 1 < canceled multipart upload key=83I1M5WIVKAA upload=CPOAKLNM3AWY tag=CRIL2SB83ZLK type=write size=3101955 2023-12-03T11:32:37.810 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.809+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=JRTF58YCYSN2 type=del size=517030 2023-12-03T11:32:37.812 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.811+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~062U5QNWH1V8.0 size=544293 2023-12-03T11:32:37.814 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.813+0000 7f4d50c67780 1 < completed multipart upload key=ENMJS0KEVS2S upload=062U5QNWH1V8 tag=22IHOB2N1L5T type=write size=1592869 2023-12-03T11:32:37.817 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.816+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~89RHDHUPN1VJ.0 size=864799 2023-12-03T11:32:37.817 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.816+0000 7f4d50c67780 1 > prepared multipart upload key=ZE19S5UCCZ3C upload=89RHDHUPN1VJ tag=C8YUXENMFW5A type=write size=1913375 2023-12-03T11:32:37.820 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.819+0000 7f4d50c67780 1 < suggested update operation key=GTLP2WZUX7U8 tag=CY3MTYP7ED2U type=write size=844642 2023-12-03T11:32:37.822 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.821+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~B9K87P8XFYEV.0 size=1048576 2023-12-03T11:32:37.823 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.822+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~B9K87P8XFYEV.1 size=479494 2023-12-03T11:32:37.823 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.822+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=B9K87P8XFYEV tag=803CMQA7BP09 type=write size=2576646 2023-12-03T11:32:37.825 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.824+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~9JVTZC41MB25.0 size=1048576 2023-12-03T11:32:37.826 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.825+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~9JVTZC41MB25.1 size=1048576 2023-12-03T11:32:37.827 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.826+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~9JVTZC41MB25.2 size=1003730 2023-12-03T11:32:37.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.829+0000 7f4d50c67780 1 < completed multipart upload key=52E31L45TN7V upload=9JVTZC41MB25 tag=YTT1B9KMAIV6 type=write size=4149458 2023-12-03T11:32:37.832 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.831+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~TJC0FM74P9MZ.0 size=1048576 2023-12-03T11:32:37.833 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.832+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~TJC0FM74P9MZ.1 size=1047032 2023-12-03T11:32:37.833 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.832+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=TJC0FM74P9MZ tag=4NVJ911B1GV4 type=write size=3144184 2023-12-03T11:32:37.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.834+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~UD4GPBABN45Z.0 size=1048576 2023-12-03T11:32:37.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.835+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~UD4GPBABN45Z.1 size=1048576 2023-12-03T11:32:37.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.835+0000 7f4d50c67780 1 < canceled part key=_multipart_WUM939BATDG9.2~UD4GPBABN45Z.2 size=278367 2023-12-03T11:32:37.838 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.837+0000 7f4d50c67780 1 < canceled multipart upload key=WUM939BATDG9 upload=UD4GPBABN45Z tag=F3ZHH13BL3B0 type=write size=3424095 2023-12-03T11:32:37.839 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.838+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=Z4GTEJKAOS4K type=del size=3258224 2023-12-03T11:32:37.840 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.839+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~1KUV7SVL4UY9.0 size=1048576 2023-12-03T11:32:37.840 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.839+0000 7f4d50c67780 1 < canceled part key=_multipart_0M6ZAD39I852.2~1KUV7SVL4UY9.1 size=1048576 2023-12-03T11:32:37.841 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.839+0000 7f4d50c67780 1 < canceled part key=_multipart_0M6ZAD39I852.2~1KUV7SVL4UY9.2 size=981636 2023-12-03T11:32:37.842 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.842+0000 7f4d50c67780 1 < canceled multipart upload key=0M6ZAD39I852 upload=1KUV7SVL4UY9 tag=M61OIDXL56LV type=write size=4127364 2023-12-03T11:32:37.844 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.843+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=JAF4OT0APLA5 type=write size=742819 2023-12-03T11:32:37.845 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.844+0000 7f4d50c67780 1 < completed delete operation key=JR8CIONID4QC tag=FBAI5EXGKNLD type=del 2023-12-03T11:32:37.847 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.846+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~C6GTGQU5KLP7.0 size=1048576 2023-12-03T11:32:37.848 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.847+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~C6GTGQU5KLP7.1 size=1048576 2023-12-03T11:32:37.849 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.848+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~C6GTGQU5KLP7.2 size=81722 2023-12-03T11:32:37.849 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.848+0000 7f4d50c67780 1 > prepared multipart upload key=73SL3ZBBDA6Q upload=C6GTGQU5KLP7 tag=XIROAL9QD0YW type=write size=3227450 2023-12-03T11:32:37.850 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.849+0000 7f4d50c67780 1 < completed delete operation key=7C7UX0231SHV tag=D5KGKWZK3YYH type=del 2023-12-03T11:32:37.852 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.852+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~O56L52WFYN99.0 size=1048576 2023-12-03T11:32:37.853 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.853+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~O56L52WFYN99.1 size=1048576 2023-12-03T11:32:37.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.853+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~O56L52WFYN99.2 size=330007 2023-12-03T11:32:37.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.853+0000 7f4d50c67780 1 > prepared multipart upload key=QQDBWLVSXIHP upload=O56L52WFYN99 tag=DRP96UQUQE46 type=write size=3475735 2023-12-03T11:32:37.856 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.855+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~RCHK4VRYXB50.0 size=247571 2023-12-03T11:32:37.857 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.857+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=RCHK4VRYXB50 tag=IW5PMUTAP6ZO type=write size=1296147 2023-12-03T11:32:37.859 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.858+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=NYP54665DL5T type=write size=610379 2023-12-03T11:32:37.860 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.859+0000 7f4d50c67780 1 < canceled operation key=0M6ZAD39I852 tag=9IDQD2O0H9WY type=del size=1613482 2023-12-03T11:32:37.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.860+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=OIELUK08X00K type=del size=892203 2023-12-03T11:32:37.864 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.863+0000 7f4d50c67780 1 < suggested update operation key=U6R5Y9JXKT32 tag=ZWRL1T7GFZC0 type=write size=390085 2023-12-03T11:32:37.866 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.865+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~Q07W4AXED1C7.0 size=1048576 2023-12-03T11:32:37.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.866+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~Q07W4AXED1C7.1 size=1048576 2023-12-03T11:32:37.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.867+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~Q07W4AXED1C7.2 size=25875 2023-12-03T11:32:37.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.867+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=Q07W4AXED1C7 tag=4TO3L643T534 type=write size=3171603 2023-12-03T11:32:37.870 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.869+0000 7f4d50c67780 1 < suggested update operation key=73SL3ZBBDA6Q tag=P80EZXB105ZX type=del size=1222614 2023-12-03T11:32:37.871 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.871+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=ZG6SF9GQ9CBX type=del size=3579533 2023-12-03T11:32:37.873 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.872+0000 7f4d50c67780 1 < completed delete operation key=EAP0BYZTTT2E tag=8RPYZWR6NA2E type=del 2023-12-03T11:32:37.874 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.873+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=9BCZXK3A089S type=del size=4177878 2023-12-03T11:32:37.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.874+0000 7f4d50c67780 1 < completed write operation key=ZE19S5UCCZ3C tag=PWXDX0C9YQ27 type=write size=638417 2023-12-03T11:32:37.876 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.875+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=0X95SF24S0F9 type=del size=1059002 2023-12-03T11:32:37.878 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.878+0000 7f4d50c67780 1 < suggested remove operation key=0M6ZAD39I852 tag=U4XKG0685XVQ type=del 2023-12-03T11:32:37.880 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.879+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=Q9DO5HWI1QIG type=del size=1968195 2023-12-03T11:32:37.881 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.880+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=MRL5R5SR025C type=del 2023-12-03T11:32:37.882 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.881+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=KNHFNF2S784V type=del size=1896048 2023-12-03T11:32:37.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.882+0000 7f4d50c67780 1 < completed delete operation key=V0ND3OBFJJUB tag=JRTF58YCYSN2 type=del 2023-12-03T11:32:37.885 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.884+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=I5KKJYIHDDKC type=del size=1294330 2023-12-03T11:32:37.886 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.885+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~89RHDHUPN1VJ.0 size=864799 2023-12-03T11:32:37.888 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.887+0000 7f4d50c67780 1 < completed multipart upload key=ZE19S5UCCZ3C upload=89RHDHUPN1VJ tag=C8YUXENMFW5A type=write size=1913375 2023-12-03T11:32:37.889 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.888+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=BMAOL6AULJ28 type=del size=1291303 2023-12-03T11:32:37.890 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.889+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~B9K87P8XFYEV.0 size=1048576 2023-12-03T11:32:37.891 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.891+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~B9K87P8XFYEV.1 size=479494 2023-12-03T11:32:37.894 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.893+0000 7f4d50c67780 1 < completed multipart upload key=CQPZ0X62207Z upload=B9K87P8XFYEV tag=803CMQA7BP09 type=write size=2576646 2023-12-03T11:32:37.895 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.894+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=QJ2W123GZOAB type=write size=763888 2023-12-03T11:32:37.896 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.895+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~TJC0FM74P9MZ.0 size=1048576 2023-12-03T11:32:37.897 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.896+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~TJC0FM74P9MZ.1 size=1047032 2023-12-03T11:32:37.899 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.898+0000 7f4d50c67780 1 < completed multipart upload key=V0ND3OBFJJUB upload=TJC0FM74P9MZ tag=4NVJ911B1GV4 type=write size=3144184 2023-12-03T11:32:37.900 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.899+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=FCPXQ3VVBXL8 type=del size=1894065 2023-12-03T11:32:37.901 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.900+0000 7f4d50c67780 1 < completed delete operation key=EY1RBO15PCRR tag=Z4GTEJKAOS4K type=del 2023-12-03T11:32:37.905 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.904+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~1NVLY4NBLSA0.0 size=1048576 2023-12-03T11:32:37.905 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.905+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~1NVLY4NBLSA0.1 size=1048576 2023-12-03T11:32:37.906 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.906+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~1NVLY4NBLSA0.2 size=427803 2023-12-03T11:32:37.907 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.906+0000 7f4d50c67780 1 > prepared multipart upload key=U6R5Y9JXKT32 upload=1NVLY4NBLSA0 tag=8L2CFWJWCSUV type=write size=3573531 2023-12-03T11:32:37.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.907+0000 7f4d50c67780 1 < completed write operation key=RF2Q24GI24HJ tag=JAF4OT0APLA5 type=write size=742819 2023-12-03T11:32:37.910 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.909+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~MLZV52D1275P.0 size=224090 2023-12-03T11:32:37.910 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.909+0000 7f4d50c67780 1 > prepared multipart upload key=RF2Q24GI24HJ upload=MLZV52D1275P tag=W8BVHTEVIU90 type=write size=1272666 2023-12-03T11:32:37.911 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.911+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~C6GTGQU5KLP7.0 size=1048576 2023-12-03T11:32:37.912 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.912+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~C6GTGQU5KLP7.1 size=1048576 2023-12-03T11:32:37.914 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.913+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~C6GTGQU5KLP7.2 size=81722 2023-12-03T11:32:37.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.915+0000 7f4d50c67780 1 < completed multipart upload key=73SL3ZBBDA6Q upload=C6GTGQU5KLP7 tag=XIROAL9QD0YW type=write size=3227450 2023-12-03T11:32:37.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.916+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=1V9LAKE0TZKN type=del size=1547974 2023-12-03T11:32:37.918 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.917+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~O56L52WFYN99.0 size=1048576 2023-12-03T11:32:37.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.918+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~O56L52WFYN99.1 size=1048576 2023-12-03T11:32:37.920 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.919+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~O56L52WFYN99.2 size=330007 2023-12-03T11:32:37.922 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.922+0000 7f4d50c67780 1 < completed multipart upload key=QQDBWLVSXIHP upload=O56L52WFYN99 tag=DRP96UQUQE46 type=write size=3475735 2023-12-03T11:32:37.924 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.923+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=IPZBGM4BQODH type=write size=864118 2023-12-03T11:32:37.925 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.924+0000 7f4d50c67780 1 < completed write operation key=ZE19S5UCCZ3C tag=NYP54665DL5T type=write size=610379 2023-12-03T11:32:37.927 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.926+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~NS3H0TYAXE7B.0 size=1048576 2023-12-03T11:32:37.928 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.927+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~NS3H0TYAXE7B.1 size=1048576 2023-12-03T11:32:37.929 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.928+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~NS3H0TYAXE7B.2 size=942871 2023-12-03T11:32:37.929 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.928+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=NS3H0TYAXE7B tag=BADI35GYN86N type=write size=4088599 2023-12-03T11:32:37.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.930+0000 7f4d50c67780 1 < completed delete operation key=TEIYINZFFG76 tag=OIELUK08X00K type=del 2023-12-03T11:32:37.933 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.932+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~LA394FQFSD7X.0 size=1048576 2023-12-03T11:32:37.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.933+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~LA394FQFSD7X.1 size=660838 2023-12-03T11:32:37.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.933+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=LA394FQFSD7X tag=VMDOIVPBR16X type=write size=2757990 2023-12-03T11:32:37.935 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.934+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~Q07W4AXED1C7.0 size=1048576 2023-12-03T11:32:37.936 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.936+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~Q07W4AXED1C7.1 size=1048576 2023-12-03T11:32:37.937 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.937+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~Q07W4AXED1C7.2 size=25875 2023-12-03T11:32:37.940 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.939+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=Q07W4AXED1C7 tag=4TO3L643T534 type=write size=3171603 2023-12-03T11:32:37.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.946+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=AWHCJOIJE2RV type=del size=3758586 2023-12-03T11:32:37.951 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.950+0000 7f4d50c67780 1 < completed delete operation key=YDRAH5EE39R4 tag=ZG6SF9GQ9CBX type=del 2023-12-03T11:32:37.952 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.951+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=2W50A82NP7HJ type=del size=3280760 2023-12-03T11:32:37.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.953+0000 7f4d50c67780 1 < completed delete operation key=73SL3ZBBDA6Q tag=9BCZXK3A089S type=del 2023-12-03T11:32:37.955 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.954+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=SXEHPEL1MEVA type=del size=2770126 2023-12-03T11:32:37.956 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.955+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=0X95SF24S0F9 type=del 2023-12-03T11:32:37.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.958+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~MWATLPKNK1GZ.0 size=1048576 2023-12-03T11:32:37.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.959+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~MWATLPKNK1GZ.1 size=1048576 2023-12-03T11:32:37.961 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.960+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~MWATLPKNK1GZ.2 size=393325 2023-12-03T11:32:37.961 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.960+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=MWATLPKNK1GZ tag=AZJU6TBDKPWX type=write size=3539053 2023-12-03T11:32:37.962 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.961+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=Q9DO5HWI1QIG type=del 2023-12-03T11:32:37.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.962+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=QL5V0FQ7MTEC type=del size=535733 2023-12-03T11:32:37.965 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.964+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=KNHFNF2S784V type=del 2023-12-03T11:32:37.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.965+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=SFFP4D1WQA0H type=del size=3441185 2023-12-03T11:32:37.968 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.967+0000 7f4d50c67780 1 < suggested remove operation key=02W4TX7ZCDI6 tag=I5KKJYIHDDKC type=del 2023-12-03T11:32:37.971 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.970+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~12Y94UWFFXXS.0 size=937095 2023-12-03T11:32:37.971 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.970+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=12Y94UWFFXXS tag=FJJVNJX3V646 type=write size=1985671 2023-12-03T11:32:37.971 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.970+0000 7f4d50c67780 -1 < no bi entry to suggest for operation key=02W4TX7ZCDI6 tag=BMAOL6AULJ28 type=del size=1291303: (2) No such file or directory 2023-12-03T11:32:37.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.972+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=IZU50OOMRL7I type=del size=3545235 2023-12-03T11:32:37.974 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.973+0000 7f4d50c67780 1 < completed write operation key=2H6AFQ362OGP tag=QJ2W123GZOAB type=write size=763888 2023-12-03T11:32:37.975 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.974+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=QQA3O3CRFV09 type=write size=538145 2023-12-03T11:32:37.977 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.977+0000 7f4d50c67780 1 < suggested update operation key=K7YVVH7SAKMC tag=FCPXQ3VVBXL8 type=del size=1894065 2023-12-03T11:32:37.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.978+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=7YGHLNLIQYUR type=del size=1591689 2023-12-03T11:32:37.980 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.979+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~1NVLY4NBLSA0.0 size=1048576 2023-12-03T11:32:37.981 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.980+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~1NVLY4NBLSA0.1 size=1048576 2023-12-03T11:32:37.982 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.981+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~1NVLY4NBLSA0.2 size=427803 2023-12-03T11:32:37.984 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.983+0000 7f4d50c67780 1 < completed multipart upload key=U6R5Y9JXKT32 upload=1NVLY4NBLSA0 tag=8L2CFWJWCSUV type=write size=3573531 2023-12-03T11:32:37.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.984+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=GCW2VET8G42T type=del size=3978326 2023-12-03T11:32:37.986 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.985+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~MLZV52D1275P.0 size=224090 2023-12-03T11:32:37.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.987+0000 7f4d50c67780 1 < completed multipart upload key=RF2Q24GI24HJ upload=MLZV52D1275P tag=W8BVHTEVIU90 type=write size=1272666 2023-12-03T11:32:37.989 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.989+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=1VIT2DPVS9RZ type=del size=3449250 2023-12-03T11:32:37.991 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.990+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=1V9LAKE0TZKN type=del 2023-12-03T11:32:37.992 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.991+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=EA0EFS0XRE0B type=del size=3554583 2023-12-03T11:32:37.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.992+0000 7f4d50c67780 1 < completed write operation key=EX93BYX10WJB tag=IPZBGM4BQODH type=write size=864118 2023-12-03T11:32:37.995 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.994+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~1BTJ8B7LP242.0 size=1048576 2023-12-03T11:32:37.996 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.995+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~1BTJ8B7LP242.1 size=566595 2023-12-03T11:32:37.996 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.995+0000 7f4d50c67780 1 > prepared multipart upload key=ZE19S5UCCZ3C upload=1BTJ8B7LP242 tag=7ABDNI0I7QIC type=write size=2663747 2023-12-03T11:32:37.996 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.996+0000 7f4d50c67780 1 < canceled part key=_multipart_02W4TX7ZCDI6.2~NS3H0TYAXE7B.0 size=1048576 2023-12-03T11:32:37.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.996+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~NS3H0TYAXE7B.1 size=1048576 2023-12-03T11:32:37.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.996+0000 7f4d50c67780 1 < canceled part key=_multipart_02W4TX7ZCDI6.2~NS3H0TYAXE7B.2 size=942871 2023-12-03T11:32:37.999 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:37.998+0000 7f4d50c67780 1 < canceled multipart upload key=02W4TX7ZCDI6 upload=NS3H0TYAXE7B tag=BADI35GYN86N type=write size=4088599 2023-12-03T11:32:38.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.000+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=PXWPC90SGZOD type=del size=1025987 2023-12-03T11:32:38.002 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.001+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~LA394FQFSD7X.0 size=1048576 2023-12-03T11:32:38.003 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.002+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~LA394FQFSD7X.1 size=660838 2023-12-03T11:32:38.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.004+0000 7f4d50c67780 1 < completed multipart upload key=EH4B2QP1C42H upload=LA394FQFSD7X tag=VMDOIVPBR16X type=write size=2757990 2023-12-03T11:32:38.006 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.005+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=LV37AOPYFI06 type=write size=1028920 2023-12-03T11:32:38.007 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.006+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=AWHCJOIJE2RV type=del 2023-12-03T11:32:38.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.007+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=IS025QZTPPDV type=del size=1710633 2023-12-03T11:32:38.010 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.009+0000 7f4d50c67780 1 < suggested remove operation key=BX5POXMMYLB7 tag=2W50A82NP7HJ type=del 2023-12-03T11:32:38.012 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.011+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~90RMX00SWB6V.0 size=603674 2023-12-03T11:32:38.012 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.011+0000 7f4d50c67780 1 > prepared multipart upload key=YDRAH5EE39R4 upload=90RMX00SWB6V tag=HFGWATVO3CQ9 type=write size=1652250 2023-12-03T11:32:38.013 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.013+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=SXEHPEL1MEVA type=del 2023-12-03T11:32:38.015 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.014+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=WDN5GK98MW1I type=del size=3373220 2023-12-03T11:32:38.016 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.015+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~MWATLPKNK1GZ.0 size=1048576 2023-12-03T11:32:38.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.016+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~MWATLPKNK1GZ.1 size=1048576 2023-12-03T11:32:38.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.017+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~MWATLPKNK1GZ.2 size=393325 2023-12-03T11:32:38.020 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.019+0000 7f4d50c67780 1 < completed multipart upload key=V0ND3OBFJJUB upload=MWATLPKNK1GZ tag=AZJU6TBDKPWX type=write size=3539053 2023-12-03T11:32:38.021 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.020+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=TJPJWO86YRDJ type=del size=781986 2023-12-03T11:32:38.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.021+0000 7f4d50c67780 1 < completed delete operation key=EH4B2QP1C42H tag=QL5V0FQ7MTEC type=del 2023-12-03T11:32:38.024 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.023+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=J5V77LZQLAQX type=del size=2555435 2023-12-03T11:32:38.025 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.024+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=SFFP4D1WQA0H type=del 2023-12-03T11:32:38.026 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.025+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=WA7UF4QF5D13 type=del size=2749578 2023-12-03T11:32:38.028 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.027+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~12Y94UWFFXXS.0 size=937095 2023-12-03T11:32:38.030 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.029+0000 7f4d50c67780 1 < completed multipart upload key=WUM939BATDG9 upload=12Y94UWFFXXS tag=FJJVNJX3V646 type=write size=1985671 2023-12-03T11:32:38.031 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.031+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=KD7F5K10OGSP type=del size=2683189 2023-12-03T11:32:38.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.032+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=IZU50OOMRL7I type=del 2023-12-03T11:32:38.034 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.033+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=VC2ELAW4ZE93 type=del size=203502 2023-12-03T11:32:38.035 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.034+0000 7f4d50c67780 -1 < failed to complete operation key=K7YVVH7SAKMC tag=QQA3O3CRFV09 type=write size=538145: (22) Invalid argument 2023-12-03T11:32:38.036 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.035+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=F2GX1VSR1GPW type=del size=3913387 2023-12-03T11:32:38.037 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.037+0000 7f4d50c67780 1 < completed delete operation key=0M6ZAD39I852 tag=7YGHLNLIQYUR type=del 2023-12-03T11:32:38.039 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.038+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=00390SB59AWA type=del size=2729686 2023-12-03T11:32:38.040 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.039+0000 7f4d50c67780 1 < completed delete operation key=02W4TX7ZCDI6 tag=GCW2VET8G42T type=del 2023-12-03T11:32:38.041 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.040+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=VANFD97893P6 type=write size=297319 2023-12-03T11:32:38.042 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.041+0000 7f4d50c67780 1 < canceled operation key=2H6AFQ362OGP tag=1VIT2DPVS9RZ type=del size=3449250 2023-12-03T11:32:38.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.044+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~GTEA763OLYCH.0 size=500993 2023-12-03T11:32:38.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.044+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=GTEA763OLYCH tag=YN9CFJ8Q0WI4 type=write size=1549569 2023-12-03T11:32:38.048 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.047+0000 7f4d50c67780 1 < suggested update operation key=02W4TX7ZCDI6 tag=EA0EFS0XRE0B type=del size=3554583 2023-12-03T11:32:38.049 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.048+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=3SQMDET1P58N type=del size=4158333 2023-12-03T11:32:38.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.050+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~1BTJ8B7LP242.0 size=1048576 2023-12-03T11:32:38.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.050+0000 7f4d50c67780 1 < canceled part key=_multipart_ZE19S5UCCZ3C.2~1BTJ8B7LP242.1 size=566595 2023-12-03T11:32:38.053 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.052+0000 7f4d50c67780 1 < canceled multipart upload key=ZE19S5UCCZ3C upload=1BTJ8B7LP242 tag=7ABDNI0I7QIC type=write size=2663747 2023-12-03T11:32:38.054 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.053+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=5H5GZVELIEV6 type=del size=3615723 2023-12-03T11:32:38.057 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.057+0000 7f4d50c67780 1 < suggested remove operation key=XM5E3D99MXVA tag=PXWPC90SGZOD type=del 2023-12-03T11:32:38.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.059+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~FDALU3QX6S13.0 size=1048576 2023-12-03T11:32:38.061 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.060+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~FDALU3QX6S13.1 size=891942 2023-12-03T11:32:38.061 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.060+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=FDALU3QX6S13 tag=Y2T7PF6RULVK type=write size=2989094 2023-12-03T11:32:38.063 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.062+0000 7f4d50c67780 1 < suggested remove operation key=ULLPV2G10BME tag=LV37AOPYFI06 type=write 2023-12-03T11:32:38.064 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.063+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=LEQJNFJHRMCB type=write size=725990 2023-12-03T11:32:38.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.065+0000 7f4d50c67780 1 < completed delete operation key=JR8CIONID4QC tag=IS025QZTPPDV type=del 2023-12-03T11:32:38.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.066+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=J9ZFOFG9EYGY type=del size=550699 2023-12-03T11:32:38.068 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.067+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~90RMX00SWB6V.0 size=603674 2023-12-03T11:32:38.070 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.069+0000 7f4d50c67780 1 < completed multipart upload key=YDRAH5EE39R4 upload=90RMX00SWB6V tag=HFGWATVO3CQ9 type=write size=1652250 2023-12-03T11:32:38.071 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.071+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=NKANE6AY114U type=del size=4129553 2023-12-03T11:32:38.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.073+0000 7f4d50c67780 1 < suggested remove operation key=WUM939BATDG9 tag=WDN5GK98MW1I type=del 2023-12-03T11:32:38.075 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.074+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=KW50N5QT5VDH type=del size=1511195 2023-12-03T11:32:38.077 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.076+0000 7f4d50c67780 1 < completed delete operation key=TEIYINZFFG76 tag=TJPJWO86YRDJ type=del 2023-12-03T11:32:38.079 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.078+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~1FFQIPXL1IOW.0 size=1048576 2023-12-03T11:32:38.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.079+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~1FFQIPXL1IOW.1 size=187311 2023-12-03T11:32:38.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.079+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=1FFQIPXL1IOW tag=A99X601800LC type=write size=2284463 2023-12-03T11:32:38.083 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.082+0000 7f4d50c67780 1 < suggested update operation key=JR8CIONID4QC tag=J5V77LZQLAQX type=del size=2555435 2023-12-03T11:32:38.085 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.085+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~O6NFYG6Y6XZ0.0 size=548288 2023-12-03T11:32:38.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.085+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=O6NFYG6Y6XZ0 tag=MVTN2R8RBM9W type=write size=1596864 2023-12-03T11:32:38.088 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.087+0000 7f4d50c67780 1 < suggested remove operation key=CQPZ0X62207Z tag=WA7UF4QF5D13 type=del 2023-12-03T11:32:38.089 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.088+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=6SQPEEVUPN3F type=write size=319494 2023-12-03T11:32:38.090 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.089+0000 7f4d50c67780 1 < completed delete operation key=V0ND3OBFJJUB tag=KD7F5K10OGSP type=del 2023-12-03T11:32:38.092 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.092+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~G9VZE7IOK8Q2.0 size=1048576 2023-12-03T11:32:38.093 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.093+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~G9VZE7IOK8Q2.1 size=1048576 2023-12-03T11:32:38.094 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.093+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~G9VZE7IOK8Q2.2 size=993774 2023-12-03T11:32:38.094 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.093+0000 7f4d50c67780 1 > prepared multipart upload key=TEIYINZFFG76 upload=G9VZE7IOK8Q2 tag=BXQYCTU78EL3 type=write size=4139502 2023-12-03T11:32:38.096 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.095+0000 7f4d50c67780 1 < canceled operation key=0M6ZAD39I852 tag=VC2ELAW4ZE93 type=del size=203502 2023-12-03T11:32:38.097 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.096+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=VDESGAEARLPQ type=del size=341828 2023-12-03T11:32:38.098 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.097+0000 7f4d50c67780 1 < canceled operation key=G0O8EC405LYM tag=F2GX1VSR1GPW type=del size=3913387 2023-12-03T11:32:38.099 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.098+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=AJMQCMVY7VFH type=write size=631490 2023-12-03T11:32:38.101 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.100+0000 7f4d50c67780 1 < completed delete operation key=YDRAH5EE39R4 tag=00390SB59AWA type=del 2023-12-03T11:32:38.102 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.101+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=MJGTJGAXG13H type=del size=1130456 2023-12-03T11:32:38.103 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.102+0000 7f4d50c67780 1 < canceled operation key=RF2Q24GI24HJ tag=VANFD97893P6 type=write size=297319 2023-12-03T11:32:38.105 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.104+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~I3009R4FNZDW.0 size=1048576 2023-12-03T11:32:38.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.105+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~I3009R4FNZDW.1 size=743057 2023-12-03T11:32:38.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.105+0000 7f4d50c67780 1 > prepared multipart upload key=ENMJS0KEVS2S upload=I3009R4FNZDW tag=79AEHJTSH0PN type=write size=2840209 2023-12-03T11:32:38.107 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.106+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~GTEA763OLYCH.0 size=500993 2023-12-03T11:32:38.109 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.108+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=GTEA763OLYCH tag=YN9CFJ8Q0WI4 type=write size=1549569 2023-12-03T11:32:38.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.109+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=G061GKO3QOZ3 type=del size=1610317 2023-12-03T11:32:38.111 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.110+0000 7f4d50c67780 1 < canceled operation key=EY1RBO15PCRR tag=3SQMDET1P58N type=del size=4158333 2023-12-03T11:32:38.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.111+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=7C7SU69L035H type=del size=3448143 2023-12-03T11:32:38.113 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.112+0000 7f4d50c67780 -1 < failed to complete operation key=JR8CIONID4QC tag=5H5GZVELIEV6 type=del size=3615723: (22) Invalid argument 2023-12-03T11:32:38.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.114+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=R90R4A8J8XW3 type=del size=481003 2023-12-03T11:32:38.116 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.116+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~FDALU3QX6S13.0 size=1048576 2023-12-03T11:32:38.117 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.116+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~FDALU3QX6S13.1 size=891942 2023-12-03T11:32:38.119 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.118+0000 7f4d50c67780 1 < completed multipart upload key=MLKGLDFFDC3W upload=FDALU3QX6S13 tag=Y2T7PF6RULVK type=write size=2989094 2023-12-03T11:32:38.120 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.120+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=X277JW76786U type=del size=4146804 2023-12-03T11:32:38.123 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.122+0000 7f4d50c67780 1 < suggested remove operation key=EX93BYX10WJB tag=LEQJNFJHRMCB type=write 2023-12-03T11:32:38.124 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.123+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=J0AZ17917BW0 type=del size=2948780 2023-12-03T11:32:38.125 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.124+0000 7f4d50c67780 1 < completed delete operation key=QQDBWLVSXIHP tag=J9ZFOFG9EYGY type=del 2023-12-03T11:32:38.126 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.126+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=XSNJ9YTLSF15 type=del size=456626 2023-12-03T11:32:38.129 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.128+0000 7f4d50c67780 1 < suggested update operation key=8J1EO2JDQUQH tag=NKANE6AY114U type=del size=4129553 2023-12-03T11:32:38.130 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.129+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=P4GT1ACA5VGJ type=del size=2185126 2023-12-03T11:32:38.131 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.130+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=KW50N5QT5VDH type=del 2023-12-03T11:32:38.132 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.131+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=4FQEFL7H772K type=del size=3609987 2023-12-03T11:32:38.135 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.133+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~1FFQIPXL1IOW.0 size=1048576 2023-12-03T11:32:38.135 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.134+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~1FFQIPXL1IOW.1 size=187311 2023-12-03T11:32:38.136 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.136+0000 7f4d50c67780 1 < completed multipart upload key=CQPZ0X62207Z upload=1FFQIPXL1IOW tag=A99X601800LC type=write size=2284463 2023-12-03T11:32:38.138 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.137+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=MD8GHOKEYMXB type=del size=1089033 2023-12-03T11:32:38.139 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.138+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~O6NFYG6Y6XZ0.0 size=548288 2023-12-03T11:32:38.141 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.140+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=O6NFYG6Y6XZ0 tag=MVTN2R8RBM9W type=write size=1596864 2023-12-03T11:32:38.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.141+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=SEHJ6L7URDFN type=del size=3764196 2023-12-03T11:32:38.143 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.142+0000 7f4d50c67780 1 < canceled operation key=WUM939BATDG9 tag=6SQPEEVUPN3F type=write size=319494 2023-12-03T11:32:38.144 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.143+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=4EKIYHPC4UQP type=del size=4053715 2023-12-03T11:32:38.145 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.144+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~G9VZE7IOK8Q2.0 size=1048576 2023-12-03T11:32:38.147 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.146+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~G9VZE7IOK8Q2.1 size=1048576 2023-12-03T11:32:38.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.147+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~G9VZE7IOK8Q2.2 size=993774 2023-12-03T11:32:38.150 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.149+0000 7f4d50c67780 1 < completed multipart upload key=TEIYINZFFG76 upload=G9VZE7IOK8Q2 tag=BXQYCTU78EL3 type=write size=4139502 2023-12-03T11:32:38.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.150+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=O9WKOW3R5DU2 type=del size=3187955 2023-12-03T11:32:38.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.151+0000 7f4d50c67780 1 < completed delete operation key=YDRAH5EE39R4 tag=VDESGAEARLPQ type=del 2023-12-03T11:32:38.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.154+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~06HGIEGGDYAR.0 size=1048576 2023-12-03T11:32:38.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.154+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~06HGIEGGDYAR.1 size=940959 2023-12-03T11:32:38.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.154+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=06HGIEGGDYAR tag=DW0DCWISI345 type=write size=3038111 2023-12-03T11:32:38.158 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.157+0000 7f4d50c67780 1 < suggested remove operation key=RF2Q24GI24HJ tag=AJMQCMVY7VFH type=write 2023-12-03T11:32:38.159 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.158+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=01D0A26OUOZQ type=del size=2526291 2023-12-03T11:32:38.160 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.159+0000 7f4d50c67780 1 < completed delete operation key=02W4TX7ZCDI6 tag=MJGTJGAXG13H type=del 2023-12-03T11:32:38.162 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.161+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~W2WJ62ZMRBUF.0 size=1048576 2023-12-03T11:32:38.163 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.162+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~W2WJ62ZMRBUF.1 size=557264 2023-12-03T11:32:38.163 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.162+0000 7f4d50c67780 1 > prepared multipart upload key=ENMJS0KEVS2S upload=W2WJ62ZMRBUF tag=91A46YPISNG0 type=write size=2654416 2023-12-03T11:32:38.164 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.163+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~I3009R4FNZDW.0 size=1048576 2023-12-03T11:32:38.165 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.164+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~I3009R4FNZDW.1 size=743057 2023-12-03T11:32:38.167 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.166+0000 7f4d50c67780 1 < completed multipart upload key=ENMJS0KEVS2S upload=I3009R4FNZDW tag=79AEHJTSH0PN type=write size=2840209 2023-12-03T11:32:38.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.167+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=FIU6HQZ3FE8X type=del size=3247909 2023-12-03T11:32:38.171 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.170+0000 7f4d50c67780 1 < suggested remove operation key=YDRAH5EE39R4 tag=G061GKO3QOZ3 type=del 2023-12-03T11:32:38.172 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.171+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=G3A510V755UF type=del size=1582194 2023-12-03T11:32:38.173 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.172+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=7C7SU69L035H type=del 2023-12-03T11:32:38.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.173+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=O00UMT053Z9C type=del size=2883727 2023-12-03T11:32:38.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.175+0000 7f4d50c67780 1 < completed delete operation key=52E31L45TN7V tag=R90R4A8J8XW3 type=del 2023-12-03T11:32:38.178 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.177+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~C6STI7V9FE8F.0 size=1007911 2023-12-03T11:32:38.178 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.177+0000 7f4d50c67780 1 > prepared multipart upload key=RF2Q24GI24HJ upload=C6STI7V9FE8F tag=O2ZGH3RRDKZ8 type=write size=2056487 2023-12-03T11:32:38.179 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.178+0000 7f4d50c67780 1 < completed delete operation key=TEIYINZFFG76 tag=X277JW76786U type=del 2023-12-03T11:32:38.181 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.180+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~DVAVDQCG2C7F.0 size=1048576 2023-12-03T11:32:38.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.181+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~DVAVDQCG2C7F.1 size=1048576 2023-12-03T11:32:38.183 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.182+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~DVAVDQCG2C7F.2 size=180823 2023-12-03T11:32:38.183 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.182+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=DVAVDQCG2C7F tag=S9C115DWWL2K type=write size=3326551 2023-12-03T11:32:38.184 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.184+0000 7f4d50c67780 -1 < failed to complete operation key=YDRAH5EE39R4 tag=J0AZ17917BW0 type=del size=2948780: (22) Invalid argument 2023-12-03T11:32:38.186 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.185+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=50HBNZKU1MC6 type=del size=2524756 2023-12-03T11:32:38.188 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.187+0000 7f4d50c67780 1 < suggested update operation key=83I1M5WIVKAA tag=XSNJ9YTLSF15 type=del size=456626 2023-12-03T11:32:38.189 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.189+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=03D07L0RT5VC type=write size=321581 2023-12-03T11:32:38.191 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.190+0000 7f4d50c67780 -1 < failed to complete operation key=YDRAH5EE39R4 tag=P4GT1ACA5VGJ type=del size=2185126: (22) Invalid argument 2023-12-03T11:32:38.192 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.191+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=7SUXO1N52E0H type=write size=904585 2023-12-03T11:32:38.193 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.192+0000 7f4d50c67780 1 < completed delete operation key=JR8CIONID4QC tag=4FQEFL7H772K type=del 2023-12-03T11:32:38.196 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.195+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~1WK3GYT17XI9.0 size=1048576 2023-12-03T11:32:38.197 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.196+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~1WK3GYT17XI9.1 size=1048576 2023-12-03T11:32:38.198 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.197+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~1WK3GYT17XI9.2 size=633773 2023-12-03T11:32:38.198 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.197+0000 7f4d50c67780 1 > prepared multipart upload key=ULLPV2G10BME upload=1WK3GYT17XI9 tag=056L24RQ6GKW type=write size=3779501 2023-12-03T11:32:38.200 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.199+0000 7f4d50c67780 1 < suggested remove operation key=WUM939BATDG9 tag=MD8GHOKEYMXB type=del 2023-12-03T11:32:38.201 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.200+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=LYY1A28FVYW9 type=del size=2396840 2023-12-03T11:32:38.203 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.202+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=SEHJ6L7URDFN type=del 2023-12-03T11:32:38.204 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.203+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=61TJ5DPNB6FG type=del size=189453 2023-12-03T11:32:38.205 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.204+0000 7f4d50c67780 1 < completed delete operation key=EY1RBO15PCRR tag=4EKIYHPC4UQP type=del 2023-12-03T11:32:38.207 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.207+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~7FVRKM2JUP7A.0 size=1048576 2023-12-03T11:32:38.208 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.207+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~7FVRKM2JUP7A.1 size=913341 2023-12-03T11:32:38.208 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.207+0000 7f4d50c67780 1 > prepared multipart upload key=QQDBWLVSXIHP upload=7FVRKM2JUP7A tag=UU3K7KE8LS7L type=write size=3010493 2023-12-03T11:32:38.209 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.209+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=O9WKOW3R5DU2 type=del 2023-12-03T11:32:38.211 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.210+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=AAHLQVCUPR3K type=del size=842194 2023-12-03T11:32:38.212 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.211+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~06HGIEGGDYAR.0 size=1048576 2023-12-03T11:32:38.213 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.212+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~06HGIEGGDYAR.1 size=940959 2023-12-03T11:32:38.215 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.214+0000 7f4d50c67780 1 < completed multipart upload key=02W4TX7ZCDI6 upload=06HGIEGGDYAR tag=DW0DCWISI345 type=write size=3038111 2023-12-03T11:32:38.216 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.215+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=29O474VKOAKJ type=del size=2760798 2023-12-03T11:32:38.219 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.218+0000 7f4d50c67780 1 < suggested update operation key=G0O8EC405LYM tag=01D0A26OUOZQ type=del size=2526291 2023-12-03T11:32:38.220 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.219+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=K7UJS6U2OMK0 type=write size=492119 2023-12-03T11:32:38.221 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.220+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~W2WJ62ZMRBUF.0 size=1048576 2023-12-03T11:32:38.222 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.221+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~W2WJ62ZMRBUF.1 size=557264 2023-12-03T11:32:38.224 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.223+0000 7f4d50c67780 1 < completed multipart upload key=ENMJS0KEVS2S upload=W2WJ62ZMRBUF tag=91A46YPISNG0 type=write size=2654416 2023-12-03T11:32:38.225 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.225+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=MWIU06MI3PU6 type=write size=116050 2023-12-03T11:32:38.228 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.227+0000 7f4d50c67780 1 < suggested update operation key=JR8CIONID4QC tag=FIU6HQZ3FE8X type=del size=3247909 2023-12-03T11:32:38.229 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.228+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=1X33AWH36EQP type=del size=1836695 2023-12-03T11:32:38.230 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.229+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=G3A510V755UF type=del 2023-12-03T11:32:38.232 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.231+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~9ZX9E69MIRL7.0 size=74636 2023-12-03T11:32:38.232 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.231+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=9ZX9E69MIRL7 tag=CD3LDYDOV16T type=write size=1123212 2023-12-03T11:32:38.233 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.232+0000 7f4d50c67780 1 < canceled operation key=73SL3ZBBDA6Q tag=O00UMT053Z9C type=del size=2883727 2023-12-03T11:32:38.234 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.233+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=NYJCQBDMBI17 type=del size=1174800 2023-12-03T11:32:38.235 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.234+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~C6STI7V9FE8F.0 size=1007911 2023-12-03T11:32:38.237 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.236+0000 7f4d50c67780 1 < completed multipart upload key=RF2Q24GI24HJ upload=C6STI7V9FE8F tag=O2ZGH3RRDKZ8 type=write size=2056487 2023-12-03T11:32:38.239 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.238+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~PF0XOLSYJJHP.0 size=638515 2023-12-03T11:32:38.239 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.238+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=PF0XOLSYJJHP tag=HCY9R3PKK6OU type=write size=1687091 2023-12-03T11:32:38.240 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.240+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~DVAVDQCG2C7F.0 size=1048576 2023-12-03T11:32:38.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.240+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~DVAVDQCG2C7F.1 size=1048576 2023-12-03T11:32:38.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.241+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~DVAVDQCG2C7F.2 size=180823 2023-12-03T11:32:38.244 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.243+0000 7f4d50c67780 1 < completed multipart upload key=EH4B2QP1C42H upload=DVAVDQCG2C7F tag=S9C115DWWL2K type=write size=3326551 2023-12-03T11:32:38.245 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.244+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=MIPBEWR2E0V3 type=del size=2378821 2023-12-03T11:32:38.247 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.246+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=50HBNZKU1MC6 type=del 2023-12-03T11:32:38.249 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.248+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~Q15GDYUZTFRT.0 size=1048576 2023-12-03T11:32:38.249 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.249+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~Q15GDYUZTFRT.1 size=148225 2023-12-03T11:32:38.250 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.249+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=Q15GDYUZTFRT tag=A6HL6SCL5Q7S type=write size=2245377 2023-12-03T11:32:38.251 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.250+0000 7f4d50c67780 1 < completed write operation key=0M6ZAD39I852 tag=03D07L0RT5VC type=write size=321581 2023-12-03T11:32:38.253 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.252+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~ED31BGHPELEB.0 size=345333 2023-12-03T11:32:38.253 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.252+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=ED31BGHPELEB tag=2EDLB2GP0JUM type=write size=1393909 2023-12-03T11:32:38.254 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.253+0000 7f4d50c67780 1 < completed write operation key=RF2Q24GI24HJ tag=7SUXO1N52E0H type=write size=904585 2023-12-03T11:32:38.256 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.255+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~TERB8IOMWZQK.0 size=1048576 2023-12-03T11:32:38.257 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.256+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~TERB8IOMWZQK.1 size=772145 2023-12-03T11:32:38.257 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.256+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=TERB8IOMWZQK tag=X5TB4HD18SFH type=write size=2869297 2023-12-03T11:32:38.259 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.258+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~1WK3GYT17XI9.0 size=1048576 2023-12-03T11:32:38.259 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.258+0000 7f4d50c67780 1 < canceled part key=_multipart_ULLPV2G10BME.2~1WK3GYT17XI9.1 size=1048576 2023-12-03T11:32:38.260 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.259+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~1WK3GYT17XI9.2 size=633773 2023-12-03T11:32:38.262 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.261+0000 7f4d50c67780 1 < canceled multipart upload key=ULLPV2G10BME upload=1WK3GYT17XI9 tag=056L24RQ6GKW type=write size=3779501 2023-12-03T11:32:38.263 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.262+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=B7F0JRURTG1K type=write size=135459 2023-12-03T11:32:38.265 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.264+0000 7f4d50c67780 1 < completed delete operation key=WUM939BATDG9 tag=LYY1A28FVYW9 type=del 2023-12-03T11:32:38.267 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.266+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~S2ZZP9BI7JJG.0 size=1048576 2023-12-03T11:32:38.268 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.267+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~S2ZZP9BI7JJG.1 size=1048576 2023-12-03T11:32:38.269 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.268+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~S2ZZP9BI7JJG.2 size=18703 2023-12-03T11:32:38.269 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.268+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=S2ZZP9BI7JJG tag=JO2RV807J11K type=write size=3164431 2023-12-03T11:32:38.270 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.269+0000 7f4d50c67780 -1 < failed to complete operation key=JR8CIONID4QC tag=61TJ5DPNB6FG type=del size=189453: (22) Invalid argument 2023-12-03T11:32:38.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.270+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=CHOH0X8AJORC type=del size=3912484 2023-12-03T11:32:38.272 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.271+0000 7f4d50c67780 1 < canceled part key=_multipart_QQDBWLVSXIHP.2~7FVRKM2JUP7A.0 size=1048576 2023-12-03T11:32:38.273 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.272+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~7FVRKM2JUP7A.1 size=913341 2023-12-03T11:32:38.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.274+0000 7f4d50c67780 1 < canceled multipart upload key=QQDBWLVSXIHP upload=7FVRKM2JUP7A tag=UU3K7KE8LS7L type=write size=3010493 2023-12-03T11:32:38.277 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.276+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~3P79AWID04H7.0 size=1048576 2023-12-03T11:32:38.278 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.277+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~3P79AWID04H7.1 size=654047 2023-12-03T11:32:38.278 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.277+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=3P79AWID04H7 tag=1YQMJ9U0HS4O type=write size=2751199 2023-12-03T11:32:38.280 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.279+0000 7f4d50c67780 1 < completed delete operation key=WUM939BATDG9 tag=AAHLQVCUPR3K type=del 2023-12-03T11:32:38.282 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.281+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~VK6XMUDVYCUC.0 size=1048576 2023-12-03T11:32:38.283 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.282+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~VK6XMUDVYCUC.1 size=1048576 2023-12-03T11:32:38.284 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.283+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~VK6XMUDVYCUC.2 size=111934 2023-12-03T11:32:38.284 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.283+0000 7f4d50c67780 1 > prepared multipart upload key=52E31L45TN7V upload=VK6XMUDVYCUC tag=0QNWF8PCJJTQ type=write size=3257662 2023-12-03T11:32:38.287 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.286+0000 7f4d50c67780 1 < suggested remove operation key=G0O8EC405LYM tag=29O474VKOAKJ type=del 2023-12-03T11:32:38.289 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.288+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~JRW30SLCWGJ0.0 size=1048576 2023-12-03T11:32:38.290 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.290+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~JRW30SLCWGJ0.1 size=1036678 2023-12-03T11:32:38.290 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.290+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=JRW30SLCWGJ0 tag=SKOKMIL1PRC0 type=write size=3133830 2023-12-03T11:32:38.292 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.291+0000 7f4d50c67780 1 < canceled operation key=ENMJS0KEVS2S tag=K7UJS6U2OMK0 type=write size=492119 2023-12-03T11:32:38.293 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.292+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=GNJGNCH0GCCM type=del size=1602520 2023-12-03T11:32:38.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.293+0000 7f4d50c67780 1 < completed write operation key=52E31L45TN7V tag=MWIU06MI3PU6 type=write size=116050 2023-12-03T11:32:38.296 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.295+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=NBJEOTDFEOTD type=del size=1116776 2023-12-03T11:32:38.298 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.297+0000 7f4d50c67780 1 < suggested remove operation key=QQDBWLVSXIHP tag=1X33AWH36EQP type=del 2023-12-03T11:32:38.299 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.298+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=C356OFS35YNY type=del size=4188165 2023-12-03T11:32:38.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.299+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~9ZX9E69MIRL7.0 size=74636 2023-12-03T11:32:38.302 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.301+0000 7f4d50c67780 1 < completed multipart upload key=02W4TX7ZCDI6 upload=9ZX9E69MIRL7 tag=CD3LDYDOV16T type=write size=1123212 2023-12-03T11:32:38.305 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.304+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~RT0M21J72UGF.0 size=1048576 2023-12-03T11:32:38.306 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.305+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~RT0M21J72UGF.1 size=1048576 2023-12-03T11:32:38.307 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.306+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~RT0M21J72UGF.2 size=744466 2023-12-03T11:32:38.307 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.306+0000 7f4d50c67780 1 > prepared multipart upload key=YDRAH5EE39R4 upload=RT0M21J72UGF tag=SK23IYQ96JPZ type=write size=3890194 2023-12-03T11:32:38.309 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.308+0000 7f4d50c67780 1 < completed delete operation key=ZE19S5UCCZ3C tag=NYJCQBDMBI17 type=del 2023-12-03T11:32:38.311 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.310+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~O5OLI9YG1X7W.0 size=1048576 2023-12-03T11:32:38.312 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.311+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~O5OLI9YG1X7W.1 size=1048576 2023-12-03T11:32:38.313 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.313+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~O5OLI9YG1X7W.2 size=145316 2023-12-03T11:32:38.313 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.313+0000 7f4d50c67780 1 > prepared multipart upload key=JBL6IOJC4TT0 upload=O5OLI9YG1X7W tag=F0M0KUODF2K7 type=write size=3291044 2023-12-03T11:32:38.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.314+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~PF0XOLSYJJHP.0 size=638515 2023-12-03T11:32:38.317 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.316+0000 7f4d50c67780 1 < completed multipart upload key=83I1M5WIVKAA upload=PF0XOLSYJJHP tag=HCY9R3PKK6OU type=write size=1687091 2023-12-03T11:32:38.319 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.319+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~690Q9UEDYVG9.0 size=1048576 2023-12-03T11:32:38.320 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.320+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~690Q9UEDYVG9.1 size=1048576 2023-12-03T11:32:38.321 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.321+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~690Q9UEDYVG9.2 size=544341 2023-12-03T11:32:38.322 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.321+0000 7f4d50c67780 1 > prepared multipart upload key=TEIYINZFFG76 upload=690Q9UEDYVG9 tag=SX591PJ1KFJS type=write size=3690069 2023-12-03T11:32:38.323 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.322+0000 7f4d50c67780 1 < completed delete operation key=TEIYINZFFG76 tag=MIPBEWR2E0V3 type=del 2023-12-03T11:32:38.324 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.323+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=H0GKJ0I9K0GQ type=del size=1927833 2023-12-03T11:32:38.325 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.324+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~Q15GDYUZTFRT.0 size=1048576 2023-12-03T11:32:38.326 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.325+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~Q15GDYUZTFRT.1 size=148225 2023-12-03T11:32:38.328 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.327+0000 7f4d50c67780 1 < completed multipart upload key=02W4TX7ZCDI6 upload=Q15GDYUZTFRT tag=A6HL6SCL5Q7S type=write size=2245377 2023-12-03T11:32:38.330 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.329+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=PF4TEEV178OH type=del size=1199492 2023-12-03T11:32:38.330 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.329+0000 7f4d50c67780 1 < canceled part key=_multipart_MLKGLDFFDC3W.2~ED31BGHPELEB.0 size=345333 2023-12-03T11:32:38.332 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.331+0000 7f4d50c67780 1 < canceled multipart upload key=MLKGLDFFDC3W upload=ED31BGHPELEB tag=2EDLB2GP0JUM type=write size=1393909 2023-12-03T11:32:38.334 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.333+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=8WSXO0AOBVPE type=del size=556982 2023-12-03T11:32:38.335 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.334+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~TERB8IOMWZQK.0 size=1048576 2023-12-03T11:32:38.336 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.335+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~TERB8IOMWZQK.1 size=772145 2023-12-03T11:32:38.338 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.337+0000 7f4d50c67780 1 < completed multipart upload key=83I1M5WIVKAA upload=TERB8IOMWZQK tag=X5TB4HD18SFH type=write size=2869297 2023-12-03T11:32:38.339 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.338+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=EA2432QC6KNO type=del size=729043 2023-12-03T11:32:38.340 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.339+0000 7f4d50c67780 1 < completed write operation key=EH4B2QP1C42H tag=B7F0JRURTG1K type=write size=135459 2023-12-03T11:32:38.342 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.341+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~CNC0JU20ET2V.0 size=1048576 2023-12-03T11:32:38.343 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.342+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~CNC0JU20ET2V.1 size=458889 2023-12-03T11:32:38.343 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.342+0000 7f4d50c67780 1 > prepared multipart upload key=ENMJS0KEVS2S upload=CNC0JU20ET2V tag=368S3VPKBHDQ type=write size=2556041 2023-12-03T11:32:38.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.343+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~S2ZZP9BI7JJG.0 size=1048576 2023-12-03T11:32:38.345 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.345+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~S2ZZP9BI7JJG.1 size=1048576 2023-12-03T11:32:38.346 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.346+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~S2ZZP9BI7JJG.2 size=18703 2023-12-03T11:32:38.349 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.348+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=S2ZZP9BI7JJG tag=JO2RV807J11K type=write size=3164431 2023-12-03T11:32:38.350 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.349+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=08Q2KN71QOMK type=del size=1149050 2023-12-03T11:32:38.351 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.350+0000 7f4d50c67780 1 < completed delete operation key=7C7UX0231SHV tag=CHOH0X8AJORC type=del 2023-12-03T11:32:38.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.352+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=EH7S6UFUQODE type=del size=2853577 2023-12-03T11:32:38.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.353+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~3P79AWID04H7.0 size=1048576 2023-12-03T11:32:38.355 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.354+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~3P79AWID04H7.1 size=654047 2023-12-03T11:32:38.357 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.356+0000 7f4d50c67780 1 < completed multipart upload key=K7YVVH7SAKMC upload=3P79AWID04H7 tag=1YQMJ9U0HS4O type=write size=2751199 2023-12-03T11:32:38.359 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.358+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~6XFMMKMV7RTW.0 size=1048576 2023-12-03T11:32:38.360 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.359+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~6XFMMKMV7RTW.1 size=1048576 2023-12-03T11:32:38.361 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.360+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~6XFMMKMV7RTW.2 size=558087 2023-12-03T11:32:38.361 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.360+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=6XFMMKMV7RTW tag=JPOLZBSEPQP0 type=write size=3703815 2023-12-03T11:32:38.362 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.361+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~VK6XMUDVYCUC.0 size=1048576 2023-12-03T11:32:38.363 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.362+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~VK6XMUDVYCUC.1 size=1048576 2023-12-03T11:32:38.364 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.363+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~VK6XMUDVYCUC.2 size=111934 2023-12-03T11:32:38.366 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.365+0000 7f4d50c67780 1 < completed multipart upload key=52E31L45TN7V upload=VK6XMUDVYCUC tag=0QNWF8PCJJTQ type=write size=3257662 2023-12-03T11:32:38.368 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.367+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~VYARJEVFFPGU.0 size=957743 2023-12-03T11:32:38.368 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.367+0000 7f4d50c67780 1 > prepared multipart upload key=G0O8EC405LYM upload=VYARJEVFFPGU tag=ASYC25I1JNUJ type=write size=2006319 2023-12-03T11:32:38.369 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.368+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~JRW30SLCWGJ0.0 size=1048576 2023-12-03T11:32:38.370 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.369+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~JRW30SLCWGJ0.1 size=1036678 2023-12-03T11:32:38.372 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.371+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=JRW30SLCWGJ0 tag=SKOKMIL1PRC0 type=write size=3133830 2023-12-03T11:32:38.374 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.373+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=7AID1AN2RZ95 type=del size=1284618 2023-12-03T11:32:38.375 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.374+0000 7f4d50c67780 1 < completed delete operation key=YDRAH5EE39R4 tag=GNJGNCH0GCCM type=del 2023-12-03T11:32:38.376 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.375+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=MPO6VYWQZ2FB type=del size=3617510 2023-12-03T11:32:38.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.377+0000 7f4d50c67780 1 < completed delete operation key=TEIYINZFFG76 tag=NBJEOTDFEOTD type=del 2023-12-03T11:32:38.379 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.378+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=5NXX7111SIU6 type=del size=3396978 2023-12-03T11:32:38.380 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.379+0000 7f4d50c67780 1 < completed delete operation key=GTLP2WZUX7U8 tag=C356OFS35YNY type=del 2023-12-03T11:32:38.381 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.380+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=I9NFAYMNHP4O type=del size=2874049 2023-12-03T11:32:38.382 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.381+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~RT0M21J72UGF.0 size=1048576 2023-12-03T11:32:38.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.383+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~RT0M21J72UGF.1 size=1048576 2023-12-03T11:32:38.384 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.384+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~RT0M21J72UGF.2 size=744466 2023-12-03T11:32:38.387 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.386+0000 7f4d50c67780 1 < completed multipart upload key=YDRAH5EE39R4 upload=RT0M21J72UGF tag=SK23IYQ96JPZ type=write size=3890194 2023-12-03T11:32:38.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.387+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=XSSIRFBKF3OI type=del size=2355406 2023-12-03T11:32:38.389 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.388+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~O5OLI9YG1X7W.0 size=1048576 2023-12-03T11:32:38.390 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.389+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~O5OLI9YG1X7W.1 size=1048576 2023-12-03T11:32:38.391 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.390+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~O5OLI9YG1X7W.2 size=145316 2023-12-03T11:32:38.393 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.392+0000 7f4d50c67780 1 < completed multipart upload key=JBL6IOJC4TT0 upload=O5OLI9YG1X7W tag=F0M0KUODF2K7 type=write size=3291044 2023-12-03T11:32:38.394 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.393+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=CY63Q2T2BG7Y type=del size=3938576 2023-12-03T11:32:38.395 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.395+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~690Q9UEDYVG9.0 size=1048576 2023-12-03T11:32:38.396 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.396+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~690Q9UEDYVG9.1 size=1048576 2023-12-03T11:32:38.397 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.397+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~690Q9UEDYVG9.2 size=544341 2023-12-03T11:32:38.399 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.399+0000 7f4d50c67780 1 < completed multipart upload key=TEIYINZFFG76 upload=690Q9UEDYVG9 tag=SX591PJ1KFJS type=write size=3690069 2023-12-03T11:32:38.401 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.400+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=HX3903P7DI5U type=del size=4099453 2023-12-03T11:32:38.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.401+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=H0GKJ0I9K0GQ type=del 2023-12-03T11:32:38.403 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.402+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=7H0N1DNI0B7X type=del size=3395051 2023-12-03T11:32:38.404 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.403+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=PF4TEEV178OH type=del 2023-12-03T11:32:38.405 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.404+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=U5M3IVJCTEZD type=write size=648104 2023-12-03T11:32:38.406 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.406+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=8WSXO0AOBVPE type=del 2023-12-03T11:32:38.408 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.407+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~GE6MBZE605XN.0 size=1048576 2023-12-03T11:32:38.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.408+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~GE6MBZE605XN.1 size=1048576 2023-12-03T11:32:38.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.409+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~GE6MBZE605XN.2 size=21164 2023-12-03T11:32:38.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.409+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=GE6MBZE605XN tag=NHLZR9V908F8 type=write size=3166892 2023-12-03T11:32:38.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.411+0000 7f4d50c67780 1 < suggested remove operation key=EY1RBO15PCRR tag=EA2432QC6KNO type=del 2023-12-03T11:32:38.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.414+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~XR2K9K1YDP5Y.0 size=1048576 2023-12-03T11:32:38.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.415+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~XR2K9K1YDP5Y.1 size=926607 2023-12-03T11:32:38.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.415+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=XR2K9K1YDP5Y tag=C6F2EP9XV0IQ type=write size=3023759 2023-12-03T11:32:38.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.416+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~CNC0JU20ET2V.0 size=1048576 2023-12-03T11:32:38.418 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.417+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~CNC0JU20ET2V.1 size=458889 2023-12-03T11:32:38.420 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.419+0000 7f4d50c67780 1 < completed multipart upload key=ENMJS0KEVS2S upload=CNC0JU20ET2V tag=368S3VPKBHDQ type=write size=2556041 2023-12-03T11:32:38.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.422+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~IL35TMEZPM72.0 size=896325 2023-12-03T11:32:38.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.422+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=IL35TMEZPM72 tag=VKIGY8IWCZAU type=write size=1944901 2023-12-03T11:32:38.425 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.424+0000 7f4d50c67780 1 < suggested update operation key=2H6AFQ362OGP tag=08Q2KN71QOMK type=del size=1149050 2023-12-03T11:32:38.426 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.425+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=R45GNYMZKB3K type=del size=814125 2023-12-03T11:32:38.427 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.427+0000 7f4d50c67780 1 < completed delete operation key=0M6ZAD39I852 tag=EH7S6UFUQODE type=del 2023-12-03T11:32:38.429 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.428+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=0TTACXE4IF8L type=del size=3388976 2023-12-03T11:32:38.430 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.429+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~6XFMMKMV7RTW.0 size=1048576 2023-12-03T11:32:38.431 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.430+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~6XFMMKMV7RTW.1 size=1048576 2023-12-03T11:32:38.432 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.431+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~6XFMMKMV7RTW.2 size=558087 2023-12-03T11:32:38.434 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.433+0000 7f4d50c67780 1 < completed multipart upload key=MLKGLDFFDC3W upload=6XFMMKMV7RTW tag=JPOLZBSEPQP0 type=write size=3703815 2023-12-03T11:32:38.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.435+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~BOBATJ838ZE5.0 size=359265 2023-12-03T11:32:38.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.435+0000 7f4d50c67780 1 > prepared multipart upload key=JR8CIONID4QC upload=BOBATJ838ZE5 tag=LIVNO5IHN2C2 type=write size=1407841 2023-12-03T11:32:38.438 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.437+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~VYARJEVFFPGU.0 size=957743 2023-12-03T11:32:38.440 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.439+0000 7f4d50c67780 1 < completed multipart upload key=G0O8EC405LYM upload=VYARJEVFFPGU tag=ASYC25I1JNUJ type=write size=2006319 2023-12-03T11:32:38.441 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.440+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=MV9VH2U05FME type=del size=3305347 2023-12-03T11:32:38.442 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.441+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=7AID1AN2RZ95 type=del 2023-12-03T11:32:38.444 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.444+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~HQ7S2KA1I98S.0 size=460775 2023-12-03T11:32:38.445 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.444+0000 7f4d50c67780 1 > prepared multipart upload key=U6R5Y9JXKT32 upload=HQ7S2KA1I98S tag=VHYYU0MO0FN2 type=write size=1509351 2023-12-03T11:32:38.446 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.445+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=MPO6VYWQZ2FB type=del 2023-12-03T11:32:38.447 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.446+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=S7XXCSH5LDWA type=del size=2774520 2023-12-03T11:32:38.448 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.447+0000 7f4d50c67780 1 < canceled operation key=EH4B2QP1C42H tag=5NXX7111SIU6 type=del size=3396978 2023-12-03T11:32:38.449 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.448+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=ZQQYM9DJRUG0 type=del size=3567161 2023-12-03T11:32:38.450 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.450+0000 7f4d50c67780 1 < canceled operation key=CQPZ0X62207Z tag=I9NFAYMNHP4O type=del size=2874049 2023-12-03T11:32:38.453 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.452+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~8B6YP4D1WWOH.0 size=9375 2023-12-03T11:32:38.453 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.452+0000 7f4d50c67780 1 > prepared multipart upload key=JR8CIONID4QC upload=8B6YP4D1WWOH tag=3L1BE38VONKS type=write size=1057951 2023-12-03T11:32:38.454 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.453+0000 7f4d50c67780 1 < canceled operation key=02W4TX7ZCDI6 tag=XSSIRFBKF3OI type=del size=2355406 2023-12-03T11:32:38.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.456+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~O021Y9F5I0YS.0 size=729334 2023-12-03T11:32:38.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.456+0000 7f4d50c67780 1 > prepared multipart upload key=ZE19S5UCCZ3C upload=O021Y9F5I0YS tag=7KCUACPQCHQG type=write size=1777910 2023-12-03T11:32:38.458 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.457+0000 7f4d50c67780 1 < completed delete operation key=YDRAH5EE39R4 tag=CY63Q2T2BG7Y type=del 2023-12-03T11:32:38.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.458+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=GBX0SLK6FEUY type=del size=3096144 2023-12-03T11:32:38.460 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.460+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=HX3903P7DI5U type=del 2023-12-03T11:32:38.463 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.462+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~9XD85Z6BDUC1.0 size=185874 2023-12-03T11:32:38.463 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.462+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=9XD85Z6BDUC1 tag=OA3D2AZCQ3ZR type=write size=1234450 2023-12-03T11:32:38.464 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.463+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=7H0N1DNI0B7X type=del 2023-12-03T11:32:38.465 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.464+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=QUN1CF3D08UL type=del size=4124215 2023-12-03T11:32:38.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.465+0000 7f4d50c67780 1 < completed write operation key=02W4TX7ZCDI6 tag=U5M3IVJCTEZD type=write size=648104 2023-12-03T11:32:38.467 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.467+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=TOWCZ8TKLL3R type=del size=4151724 2023-12-03T11:32:38.469 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.468+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~GE6MBZE605XN.0 size=1048576 2023-12-03T11:32:38.470 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.469+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~GE6MBZE605XN.1 size=1048576 2023-12-03T11:32:38.471 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.470+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~GE6MBZE605XN.2 size=21164 2023-12-03T11:32:38.473 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.472+0000 7f4d50c67780 1 < completed multipart upload key=V0ND3OBFJJUB upload=GE6MBZE605XN tag=NHLZR9V908F8 type=write size=3166892 2023-12-03T11:32:38.474 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.473+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=DRC4U19O3Z11 type=del size=329955 2023-12-03T11:32:38.475 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.474+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~XR2K9K1YDP5Y.0 size=1048576 2023-12-03T11:32:38.476 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.475+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~XR2K9K1YDP5Y.1 size=926607 2023-12-03T11:32:38.479 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.478+0000 7f4d50c67780 1 < completed multipart upload key=83I1M5WIVKAA upload=XR2K9K1YDP5Y tag=C6F2EP9XV0IQ type=write size=3023759 2023-12-03T11:32:38.480 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.479+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=9FZP9E4U8CUQ type=del size=2723236 2023-12-03T11:32:38.481 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.481+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~IL35TMEZPM72.0 size=896325 2023-12-03T11:32:38.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.483+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=IL35TMEZPM72 tag=VKIGY8IWCZAU type=write size=1944901 2023-12-03T11:32:38.485 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.484+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=00D86PUG7GZF type=del size=2223880 2023-12-03T11:32:38.486 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.485+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=R45GNYMZKB3K type=del 2023-12-03T11:32:38.489 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.488+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~CVO3394YN680.0 size=1048576 2023-12-03T11:32:38.490 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.490+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~CVO3394YN680.1 size=660747 2023-12-03T11:32:38.490 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.490+0000 7f4d50c67780 1 > prepared multipart upload key=73SL3ZBBDA6Q upload=CVO3394YN680 tag=G82VKQXUX47V type=write size=2757899 2023-12-03T11:32:38.492 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.491+0000 7f4d50c67780 1 < completed delete operation key=MLKGLDFFDC3W tag=0TTACXE4IF8L type=del 2023-12-03T11:32:38.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.492+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=8GCO1H4AW0JB type=del size=942343 2023-12-03T11:32:38.494 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.493+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~BOBATJ838ZE5.0 size=359265 2023-12-03T11:32:38.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.495+0000 7f4d50c67780 1 < completed multipart upload key=JR8CIONID4QC upload=BOBATJ838ZE5 tag=LIVNO5IHN2C2 type=write size=1407841 2023-12-03T11:32:38.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.497+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=COT5IFY2L44X type=del size=2454657 2023-12-03T11:32:38.499 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.498+0000 7f4d50c67780 1 < completed delete operation key=ZE19S5UCCZ3C tag=MV9VH2U05FME type=del 2023-12-03T11:32:38.500 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.499+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=SS4MKCKAMRBA type=del size=3145078 2023-12-03T11:32:38.500 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.499+0000 7f4d50c67780 1 < canceled part key=_multipart_U6R5Y9JXKT32.2~HQ7S2KA1I98S.0 size=460775 2023-12-03T11:32:38.502 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.501+0000 7f4d50c67780 1 < canceled multipart upload key=U6R5Y9JXKT32 upload=HQ7S2KA1I98S tag=VHYYU0MO0FN2 type=write size=1509351 2023-12-03T11:32:38.504 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.503+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=VOGW6YY2GXSK type=write size=440664 2023-12-03T11:32:38.505 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.504+0000 7f4d50c67780 1 < completed delete operation key=TEIYINZFFG76 tag=S7XXCSH5LDWA type=del 2023-12-03T11:32:38.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.505+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=J9XW577VC9AH type=del size=676456 2023-12-03T11:32:38.507 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.506+0000 7f4d50c67780 1 < completed delete operation key=EH4B2QP1C42H tag=ZQQYM9DJRUG0 type=del 2023-12-03T11:32:38.509 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.508+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=W3SIB0FVG4HO type=write size=93324 2023-12-03T11:32:38.510 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.509+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~8B6YP4D1WWOH.0 size=9375 2023-12-03T11:32:38.512 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.511+0000 7f4d50c67780 1 < completed multipart upload key=JR8CIONID4QC upload=8B6YP4D1WWOH tag=3L1BE38VONKS type=write size=1057951 2023-12-03T11:32:38.514 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.514+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~YR4GCX27N84K.0 size=801711 2023-12-03T11:32:38.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.514+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=YR4GCX27N84K tag=7I0LM8CTIQV9 type=write size=1850287 2023-12-03T11:32:38.516 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.515+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~O021Y9F5I0YS.0 size=729334 2023-12-03T11:32:38.518 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.517+0000 7f4d50c67780 1 < completed multipart upload key=ZE19S5UCCZ3C upload=O021Y9F5I0YS tag=7KCUACPQCHQG type=write size=1777910 2023-12-03T11:32:38.519 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.519+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=74W2E15O30WY type=write size=57914 2023-12-03T11:32:38.521 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.520+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=GBX0SLK6FEUY type=del 2023-12-03T11:32:38.522 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.521+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=WL1UXZ829DGA type=del size=424931 2023-12-03T11:32:38.523 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.523+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~9XD85Z6BDUC1.0 size=185874 2023-12-03T11:32:38.526 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.525+0000 7f4d50c67780 1 < completed multipart upload key=EH4B2QP1C42H upload=9XD85Z6BDUC1 tag=OA3D2AZCQ3ZR type=write size=1234450 2023-12-03T11:32:38.527 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.526+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=5ESQIB90683H type=write size=339409 2023-12-03T11:32:38.528 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.527+0000 7f4d50c67780 1 < completed delete operation key=EY1RBO15PCRR tag=QUN1CF3D08UL type=del 2023-12-03T11:32:38.531 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.530+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~5UYQTISYSZ4Y.0 size=1048576 2023-12-03T11:32:38.531 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.531+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~5UYQTISYSZ4Y.1 size=1048576 2023-12-03T11:32:38.532 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.532+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~5UYQTISYSZ4Y.2 size=398575 2023-12-03T11:32:38.533 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.532+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=5UYQTISYSZ4Y tag=LXNGXXNF33JF type=write size=3544303 2023-12-03T11:32:38.534 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.533+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=TOWCZ8TKLL3R type=del 2023-12-03T11:32:38.535 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.534+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=GLI9B9Z1925R type=del size=4150058 2023-12-03T11:32:38.538 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.537+0000 7f4d50c67780 1 < suggested remove operation key=RF2Q24GI24HJ tag=DRC4U19O3Z11 type=del 2023-12-03T11:32:38.540 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.539+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~AMYWA3XPOFL7.0 size=934304 2023-12-03T11:32:38.540 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.539+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=AMYWA3XPOFL7 tag=PKXOIC0HY4JD type=write size=1982880 2023-12-03T11:32:38.541 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.541+0000 7f4d50c67780 1 < canceled operation key=8J1EO2JDQUQH tag=9FZP9E4U8CUQ type=del size=2723236 2023-12-03T11:32:38.544 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.543+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~J7R5V4LM9PQA.0 size=1048576 2023-12-03T11:32:38.545 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.544+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~J7R5V4LM9PQA.1 size=1048576 2023-12-03T11:32:38.546 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.545+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~J7R5V4LM9PQA.2 size=758181 2023-12-03T11:32:38.546 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.545+0000 7f4d50c67780 1 > prepared multipart upload key=52E31L45TN7V upload=J7R5V4LM9PQA tag=IVV5BDQFH8U2 type=write size=3903909 2023-12-03T11:32:38.547 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.546+0000 7f4d50c67780 1 < completed delete operation key=EH4B2QP1C42H tag=00D86PUG7GZF type=del 2023-12-03T11:32:38.548 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.547+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=U5YSYUPLNU5B type=del size=3816304 2023-12-03T11:32:38.549 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.549+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~CVO3394YN680.0 size=1048576 2023-12-03T11:32:38.550 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.550+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~CVO3394YN680.1 size=660747 2023-12-03T11:32:38.552 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.552+0000 7f4d50c67780 1 < completed multipart upload key=73SL3ZBBDA6Q upload=CVO3394YN680 tag=G82VKQXUX47V type=write size=2757899 2023-12-03T11:32:38.554 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.553+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=BAMH13E1XIK5 type=write size=650713 2023-12-03T11:32:38.555 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.554+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=8GCO1H4AW0JB type=del 2023-12-03T11:32:38.557 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.556+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~YQ0XVOS1C6C8.0 size=1048576 2023-12-03T11:32:38.558 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.557+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~YQ0XVOS1C6C8.1 size=414182 2023-12-03T11:32:38.558 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.557+0000 7f4d50c67780 1 > prepared multipart upload key=U6R5Y9JXKT32 upload=YQ0XVOS1C6C8 tag=F0UT6PWO9M5A type=write size=2511334 2023-12-03T11:32:38.559 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.558+0000 7f4d50c67780 1 < completed delete operation key=52E31L45TN7V tag=COT5IFY2L44X type=del 2023-12-03T11:32:38.561 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.560+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~QENFCSJUK2PM.0 size=766506 2023-12-03T11:32:38.561 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.560+0000 7f4d50c67780 1 > prepared multipart upload key=U6R5Y9JXKT32 upload=QENFCSJUK2PM tag=X63NDVQ2KR9J type=write size=1815082 2023-12-03T11:32:38.562 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.562+0000 7f4d50c67780 1 < canceled operation key=TEIYINZFFG76 tag=SS4MKCKAMRBA type=del size=3145078 2023-12-03T11:32:38.564 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.563+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=I9YITGI1Y1MS type=del size=1543038 2023-12-03T11:32:38.565 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.564+0000 7f4d50c67780 -1 < failed to complete operation key=RF2Q24GI24HJ tag=VOGW6YY2GXSK type=write size=440664: (22) Invalid argument 2023-12-03T11:32:38.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.566+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~V9YYE40GZRLX.0 size=1048576 2023-12-03T11:32:38.568 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.567+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~V9YYE40GZRLX.1 size=1048576 2023-12-03T11:32:38.569 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.568+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~V9YYE40GZRLX.2 size=49134 2023-12-03T11:32:38.569 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.568+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=V9YYE40GZRLX tag=NNTWTK7QTSEB type=write size=3194862 2023-12-03T11:32:38.571 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.570+0000 7f4d50c67780 1 < suggested update operation key=TOGV2BZ99FRF tag=J9XW577VC9AH type=del size=676456 2023-12-03T11:32:38.572 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.572+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=2L2P2V6UTHUS type=del size=1176352 2023-12-03T11:32:38.574 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.573+0000 7f4d50c67780 1 < completed write operation key=ENMJS0KEVS2S tag=W3SIB0FVG4HO type=write size=93324 2023-12-03T11:32:38.576 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.575+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~I0VGKBQZ998A.0 size=628394 2023-12-03T11:32:38.576 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.575+0000 7f4d50c67780 1 > prepared multipart upload key=RF2Q24GI24HJ upload=I0VGKBQZ998A tag=9XOLV9ZNUVDY type=write size=1676970 2023-12-03T11:32:38.577 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.577+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~YR4GCX27N84K.0 size=801711 2023-12-03T11:32:38.579 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.578+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=YR4GCX27N84K tag=7I0LM8CTIQV9 type=write size=1850287 2023-12-03T11:32:38.581 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.581+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~N22R9P5QHYMM.0 size=1048576 2023-12-03T11:32:38.582 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.581+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~N22R9P5QHYMM.1 size=386187 2023-12-03T11:32:38.582 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.581+0000 7f4d50c67780 1 > prepared multipart upload key=52E31L45TN7V upload=N22R9P5QHYMM tag=MNTD1QVUO933 type=write size=2483339 2023-12-03T11:32:38.583 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.583+0000 7f4d50c67780 1 < completed write operation key=ZE19S5UCCZ3C tag=74W2E15O30WY type=write size=57914 2023-12-03T11:32:38.585 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.584+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=2JPUFEXP15AH type=del size=2529044 2023-12-03T11:32:38.586 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.585+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=WL1UXZ829DGA type=del 2023-12-03T11:32:38.588 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.587+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~B5GJ2BTSSGFO.0 size=1048576 2023-12-03T11:32:38.589 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.588+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~B5GJ2BTSSGFO.1 size=866363 2023-12-03T11:32:38.589 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.588+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=B5GJ2BTSSGFO tag=WCGBIKXATH8U type=write size=2963515 2023-12-03T11:32:38.590 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.589+0000 7f4d50c67780 1 < completed write operation key=83I1M5WIVKAA tag=5ESQIB90683H type=write size=339409 2023-12-03T11:32:38.592 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.591+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~2S0MC5E6B6JY.0 size=1048576 2023-12-03T11:32:38.593 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.592+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~2S0MC5E6B6JY.1 size=1048576 2023-12-03T11:32:38.594 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.593+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~2S0MC5E6B6JY.2 size=383247 2023-12-03T11:32:38.594 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.593+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=2S0MC5E6B6JY tag=Q0EXDP546MZB type=write size=3528975 2023-12-03T11:32:38.595 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.594+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~5UYQTISYSZ4Y.0 size=1048576 2023-12-03T11:32:38.596 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.595+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~5UYQTISYSZ4Y.1 size=1048576 2023-12-03T11:32:38.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.596+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~5UYQTISYSZ4Y.2 size=398575 2023-12-03T11:32:38.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.599+0000 7f4d50c67780 1 < completed multipart upload key=02W4TX7ZCDI6 upload=5UYQTISYSZ4Y tag=LXNGXXNF33JF type=write size=3544303 2023-12-03T11:32:38.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.601+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~ELPURSO9MPG7.0 size=1048576 2023-12-03T11:32:38.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.602+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~ELPURSO9MPG7.1 size=180489 2023-12-03T11:32:38.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.602+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=ELPURSO9MPG7 tag=MYNDMAVLY034 type=write size=2277641 2023-12-03T11:32:38.605 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.604+0000 7f4d50c67780 1 < completed delete operation key=EY1RBO15PCRR tag=GLI9B9Z1925R type=del 2023-12-03T11:32:38.607 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.606+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~217ZVTB7VRV1.0 size=46554 2023-12-03T11:32:38.607 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.606+0000 7f4d50c67780 1 > prepared multipart upload key=TEIYINZFFG76 upload=217ZVTB7VRV1 tag=E1IJS6UVMWB8 type=write size=1095130 2023-12-03T11:32:38.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.607+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~AMYWA3XPOFL7.0 size=934304 2023-12-03T11:32:38.610 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.609+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=AMYWA3XPOFL7 tag=PKXOIC0HY4JD type=write size=1982880 2023-12-03T11:32:38.612 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.611+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~47ONCBLHW1FY.0 size=241931 2023-12-03T11:32:38.612 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.611+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=47ONCBLHW1FY tag=LCC2TQ20BWO8 type=write size=1290507 2023-12-03T11:32:38.613 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.612+0000 7f4d50c67780 1 < canceled part key=_multipart_52E31L45TN7V.2~J7R5V4LM9PQA.0 size=1048576 2023-12-03T11:32:38.613 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.613+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~J7R5V4LM9PQA.1 size=1048576 2023-12-03T11:32:38.614 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.614+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~J7R5V4LM9PQA.2 size=758181 2023-12-03T11:32:38.616 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.616+0000 7f4d50c67780 1 < canceled multipart upload key=52E31L45TN7V upload=J7R5V4LM9PQA tag=IVV5BDQFH8U2 type=write size=3903909 2023-12-03T11:32:38.618 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.617+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=5W7J3KH8NKV2 type=del size=113277 2023-12-03T11:32:38.619 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.618+0000 7f4d50c67780 1 < canceled operation key=8J1EO2JDQUQH tag=U5YSYUPLNU5B type=del size=3816304 2023-12-03T11:32:38.621 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.620+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~ZXBRD3R25FO6.0 size=1048576 2023-12-03T11:32:38.622 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.621+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~ZXBRD3R25FO6.1 size=701289 2023-12-03T11:32:38.622 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.621+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=ZXBRD3R25FO6 tag=RRNU16855R73 type=write size=2798441 2023-12-03T11:32:38.623 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.622+0000 7f4d50c67780 1 < completed write operation key=V0ND3OBFJJUB tag=BAMH13E1XIK5 type=write size=650713 2023-12-03T11:32:38.624 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.623+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=MY653FOLR9PJ type=del size=2715158 2023-12-03T11:32:38.626 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.625+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~YQ0XVOS1C6C8.0 size=1048576 2023-12-03T11:32:38.627 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.626+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~YQ0XVOS1C6C8.1 size=414182 2023-12-03T11:32:38.628 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.628+0000 7f4d50c67780 1 < completed multipart upload key=U6R5Y9JXKT32 upload=YQ0XVOS1C6C8 tag=F0UT6PWO9M5A type=write size=2511334 2023-12-03T11:32:38.631 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.630+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~2EH9GWOQDNTK.0 size=1048576 2023-12-03T11:32:38.631 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.631+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~2EH9GWOQDNTK.1 size=877527 2023-12-03T11:32:38.632 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.631+0000 7f4d50c67780 1 > prepared multipart upload key=TOGV2BZ99FRF upload=2EH9GWOQDNTK tag=GBZ86Z7PGKMZ type=write size=2974679 2023-12-03T11:32:38.633 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.632+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~QENFCSJUK2PM.0 size=766506 2023-12-03T11:32:38.635 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.634+0000 7f4d50c67780 1 < completed multipart upload key=U6R5Y9JXKT32 upload=QENFCSJUK2PM tag=X63NDVQ2KR9J type=write size=1815082 2023-12-03T11:32:38.637 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.636+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~GTHHPA42V34P.0 size=1048576 2023-12-03T11:32:38.638 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.637+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~GTHHPA42V34P.1 size=1048576 2023-12-03T11:32:38.639 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.638+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~GTHHPA42V34P.2 size=961555 2023-12-03T11:32:38.639 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.638+0000 7f4d50c67780 1 > prepared multipart upload key=52E31L45TN7V upload=GTHHPA42V34P tag=O3CES3BHPY11 type=write size=4107283 2023-12-03T11:32:38.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.641+0000 7f4d50c67780 1 < suggested update operation key=02W4TX7ZCDI6 tag=I9YITGI1Y1MS type=del size=1543038 2023-12-03T11:32:38.643 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.642+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=LYC1PP9YM7J7 type=write size=257412 2023-12-03T11:32:38.644 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.643+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~V9YYE40GZRLX.0 size=1048576 2023-12-03T11:32:38.644 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.643+0000 7f4d50c67780 1 < canceled part key=_multipart_WUM939BATDG9.2~V9YYE40GZRLX.1 size=1048576 2023-12-03T11:32:38.645 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.644+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~V9YYE40GZRLX.2 size=49134 2023-12-03T11:32:38.647 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.646+0000 7f4d50c67780 1 < canceled multipart upload key=WUM939BATDG9 upload=V9YYE40GZRLX tag=NNTWTK7QTSEB type=write size=3194862 2023-12-03T11:32:38.648 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.647+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=VAY5DEIVX74Y type=del size=2916281 2023-12-03T11:32:38.650 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.649+0000 7f4d50c67780 1 < canceled operation key=TOGV2BZ99FRF tag=2L2P2V6UTHUS type=del size=1176352 2023-12-03T11:32:38.651 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.650+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=ATD2NXZH2IPL type=del size=2898035 2023-12-03T11:32:38.651 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.650+0000 7f4d50c67780 1 < canceled part key=_multipart_RF2Q24GI24HJ.2~I0VGKBQZ998A.0 size=628394 2023-12-03T11:32:38.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.652+0000 7f4d50c67780 1 < canceled multipart upload key=RF2Q24GI24HJ upload=I0VGKBQZ998A tag=9XOLV9ZNUVDY type=write size=1676970 2023-12-03T11:32:38.655 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.654+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~3PMR42RXMDXY.0 size=1048576 2023-12-03T11:32:38.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.655+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~3PMR42RXMDXY.1 size=324470 2023-12-03T11:32:38.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.655+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=3PMR42RXMDXY tag=HK3HK5BQ0SF3 type=write size=2421622 2023-12-03T11:32:38.657 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.657+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~N22R9P5QHYMM.0 size=1048576 2023-12-03T11:32:38.658 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.657+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~N22R9P5QHYMM.1 size=386187 2023-12-03T11:32:38.660 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.659+0000 7f4d50c67780 1 < completed multipart upload key=52E31L45TN7V upload=N22R9P5QHYMM tag=MNTD1QVUO933 type=write size=2483339 2023-12-03T11:32:38.662 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.662+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~AJD3FXUVUPON.0 size=1048576 2023-12-03T11:32:38.663 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.662+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~AJD3FXUVUPON.1 size=757355 2023-12-03T11:32:38.663 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.662+0000 7f4d50c67780 1 > prepared multipart upload key=ZE19S5UCCZ3C upload=AJD3FXUVUPON tag=B69PG14YE5GZ type=write size=2854507 2023-12-03T11:32:38.664 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.664+0000 7f4d50c67780 1 < completed delete operation key=MLKGLDFFDC3W tag=2JPUFEXP15AH type=del 2023-12-03T11:32:38.666 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.665+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=P359PMNYC6KN type=write size=724443 2023-12-03T11:32:38.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.666+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~B5GJ2BTSSGFO.0 size=1048576 2023-12-03T11:32:38.668 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.667+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~B5GJ2BTSSGFO.1 size=866363 2023-12-03T11:32:38.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.669+0000 7f4d50c67780 1 < completed multipart upload key=83I1M5WIVKAA upload=B5GJ2BTSSGFO tag=WCGBIKXATH8U type=write size=2963515 2023-12-03T11:32:38.672 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.671+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~5I04DH6O76RR.0 size=1048576 2023-12-03T11:32:38.673 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.672+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~5I04DH6O76RR.1 size=508439 2023-12-03T11:32:38.673 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.672+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=5I04DH6O76RR tag=MPI7AAJH07KF type=write size=2605591 2023-12-03T11:32:38.674 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.673+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~2S0MC5E6B6JY.0 size=1048576 2023-12-03T11:32:38.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.674+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~2S0MC5E6B6JY.1 size=1048576 2023-12-03T11:32:38.676 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.675+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~2S0MC5E6B6JY.2 size=383247 2023-12-03T11:32:38.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.677+0000 7f4d50c67780 1 < completed multipart upload key=K7YVVH7SAKMC upload=2S0MC5E6B6JY tag=Q0EXDP546MZB type=write size=3528975 2023-12-03T11:32:38.680 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.679+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~DEBBM4B44QPX.0 size=122739 2023-12-03T11:32:38.680 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.679+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=DEBBM4B44QPX tag=3WSHCUYFKPQH type=write size=1171315 2023-12-03T11:32:38.681 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.680+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~ELPURSO9MPG7.0 size=1048576 2023-12-03T11:32:38.681 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.680+0000 7f4d50c67780 1 < canceled part key=_multipart_GTLP2WZUX7U8.2~ELPURSO9MPG7.1 size=180489 2023-12-03T11:32:38.683 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.682+0000 7f4d50c67780 1 < canceled multipart upload key=GTLP2WZUX7U8 upload=ELPURSO9MPG7 tag=MYNDMAVLY034 type=write size=2277641 2023-12-03T11:32:38.685 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.684+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~ASGVIRJ5BS02.0 size=1048576 2023-12-03T11:32:38.686 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.685+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~ASGVIRJ5BS02.1 size=1048576 2023-12-03T11:32:38.687 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.686+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~ASGVIRJ5BS02.2 size=835397 2023-12-03T11:32:38.687 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.686+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=ASGVIRJ5BS02 tag=Y0CBIE91KK5K type=write size=3981125 2023-12-03T11:32:38.689 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.688+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~217ZVTB7VRV1.0 size=46554 2023-12-03T11:32:38.690 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.690+0000 7f4d50c67780 1 < completed multipart upload key=TEIYINZFFG76 upload=217ZVTB7VRV1 tag=E1IJS6UVMWB8 type=write size=1095130 2023-12-03T11:32:38.692 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.691+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=EYPY99IIT0TB type=del size=3161312 2023-12-03T11:32:38.693 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.692+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~47ONCBLHW1FY.0 size=241931 2023-12-03T11:32:38.695 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.694+0000 7f4d50c67780 1 < completed multipart upload key=K7YVVH7SAKMC upload=47ONCBLHW1FY tag=LCC2TQ20BWO8 type=write size=1290507 2023-12-03T11:32:38.696 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.695+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=TC4S4706X26Q type=del size=1975350 2023-12-03T11:32:38.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.696+0000 7f4d50c67780 -1 < failed to complete operation key=02W4TX7ZCDI6 tag=5W7J3KH8NKV2 type=del size=113277: (22) Invalid argument 2023-12-03T11:32:38.698 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.698+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=OTDISMDNASI2 type=del size=3678458 2023-12-03T11:32:38.700 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.699+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~ZXBRD3R25FO6.0 size=1048576 2023-12-03T11:32:38.701 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.700+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~ZXBRD3R25FO6.1 size=701289 2023-12-03T11:32:38.703 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.702+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=ZXBRD3R25FO6 tag=RRNU16855R73 type=write size=2798441 2023-12-03T11:32:38.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.704+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~KTGICG181MIB.0 size=1048576 2023-12-03T11:32:38.706 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.705+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~KTGICG181MIB.1 size=866771 2023-12-03T11:32:38.706 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.705+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=KTGICG181MIB tag=FMVI3OK99H7I type=write size=2963923 2023-12-03T11:32:38.707 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.706+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=MY653FOLR9PJ type=del 2023-12-03T11:32:38.709 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.709+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~LELFVQC65KJQ.0 size=62504 2023-12-03T11:32:38.709 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.709+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=LELFVQC65KJQ tag=L3MUB2JS8A1R type=write size=1111080 2023-12-03T11:32:38.711 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.710+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~2EH9GWOQDNTK.0 size=1048576 2023-12-03T11:32:38.712 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.711+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~2EH9GWOQDNTK.1 size=877527 2023-12-03T11:32:38.714 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.714+0000 7f4d50c67780 1 < completed multipart upload key=TOGV2BZ99FRF upload=2EH9GWOQDNTK tag=GBZ86Z7PGKMZ type=write size=2974679 2023-12-03T11:32:38.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.715+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=76ENC4YZ892D type=del size=2447844 2023-12-03T11:32:38.717 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.716+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~GTHHPA42V34P.0 size=1048576 2023-12-03T11:32:38.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.717+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~GTHHPA42V34P.1 size=1048576 2023-12-03T11:32:38.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.718+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~GTHHPA42V34P.2 size=961555 2023-12-03T11:32:38.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.720+0000 7f4d50c67780 1 < completed multipart upload key=52E31L45TN7V upload=GTHHPA42V34P tag=O3CES3BHPY11 type=write size=4107283 2023-12-03T11:32:38.724 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.723+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~GU9AND63XAGO.0 size=1048576 2023-12-03T11:32:38.724 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.724+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~GU9AND63XAGO.1 size=1048576 2023-12-03T11:32:38.726 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.725+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~GU9AND63XAGO.2 size=1027611 2023-12-03T11:32:38.726 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.725+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=GU9AND63XAGO tag=KHJBG0D0HQ9G type=write size=4173339 2023-12-03T11:32:38.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.726+0000 7f4d50c67780 1 < completed write operation key=TEIYINZFFG76 tag=LYC1PP9YM7J7 type=write size=257412 2023-12-03T11:32:38.729 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.728+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~E9B2YWS8G4UD.0 size=1048576 2023-12-03T11:32:38.730 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.729+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~E9B2YWS8G4UD.1 size=1048576 2023-12-03T11:32:38.731 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.730+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~E9B2YWS8G4UD.2 size=232284 2023-12-03T11:32:38.731 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.730+0000 7f4d50c67780 1 > prepared multipart upload key=JBL6IOJC4TT0 upload=E9B2YWS8G4UD tag=G95M5K0CFGXQ type=write size=3378012 2023-12-03T11:32:38.732 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.731+0000 7f4d50c67780 1 < completed delete operation key=ZE19S5UCCZ3C tag=VAY5DEIVX74Y type=del 2023-12-03T11:32:38.733 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.732+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=AKBIK5RU2IRE type=del size=873824 2023-12-03T11:32:38.734 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.734+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=ATD2NXZH2IPL type=del 2023-12-03T11:32:38.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.735+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=8EUFCWM17457 type=write size=109241 2023-12-03T11:32:38.737 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.736+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~3PMR42RXMDXY.0 size=1048576 2023-12-03T11:32:38.738 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.737+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~3PMR42RXMDXY.1 size=324470 2023-12-03T11:32:38.740 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.739+0000 7f4d50c67780 1 < completed multipart upload key=EH4B2QP1C42H upload=3PMR42RXMDXY tag=HK3HK5BQ0SF3 type=write size=2421622 2023-12-03T11:32:38.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.740+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=1QS583QB9WID type=del size=325997 2023-12-03T11:32:38.742 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.742+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~AJD3FXUVUPON.0 size=1048576 2023-12-03T11:32:38.744 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.743+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~AJD3FXUVUPON.1 size=757355 2023-12-03T11:32:38.745 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.745+0000 7f4d50c67780 1 < completed multipart upload key=ZE19S5UCCZ3C upload=AJD3FXUVUPON tag=B69PG14YE5GZ type=write size=2854507 2023-12-03T11:32:38.747 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.746+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=BRW8B1ZN6H3V type=write size=653453 2023-12-03T11:32:38.748 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.747+0000 7f4d50c67780 1 < completed write operation key=YDRAH5EE39R4 tag=P359PMNYC6KN type=write size=724443 2023-12-03T11:32:38.749 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.748+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=WAY9250OE5KW type=del size=1519787 2023-12-03T11:32:38.749 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.748+0000 7f4d50c67780 1 < canceled part key=_multipart_2H6AFQ362OGP.2~5I04DH6O76RR.0 size=1048576 2023-12-03T11:32:38.750 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.749+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~5I04DH6O76RR.1 size=508439 2023-12-03T11:32:38.752 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.751+0000 7f4d50c67780 1 < canceled multipart upload key=2H6AFQ362OGP upload=5I04DH6O76RR tag=MPI7AAJH07KF type=write size=2605591 2023-12-03T11:32:38.753 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.752+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=R198S20XSGMQ type=del size=3419170 2023-12-03T11:32:38.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.753+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~DEBBM4B44QPX.0 size=122739 2023-12-03T11:32:38.756 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.755+0000 7f4d50c67780 1 < completed multipart upload key=K7YVVH7SAKMC upload=DEBBM4B44QPX tag=3WSHCUYFKPQH type=write size=1171315 2023-12-03T11:32:38.758 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.757+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~BNO88OEJ21CR.0 size=626217 2023-12-03T11:32:38.758 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.757+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=BNO88OEJ21CR tag=BZJ6TSOU3AAO type=write size=1674793 2023-12-03T11:32:38.759 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.759+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~ASGVIRJ5BS02.0 size=1048576 2023-12-03T11:32:38.760 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.760+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~ASGVIRJ5BS02.1 size=1048576 2023-12-03T11:32:38.761 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.760+0000 7f4d50c67780 1 < canceled part key=_multipart_V0ND3OBFJJUB.2~ASGVIRJ5BS02.2 size=835397 2023-12-03T11:32:38.762 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.762+0000 7f4d50c67780 1 < canceled multipart upload key=V0ND3OBFJJUB upload=ASGVIRJ5BS02 tag=Y0CBIE91KK5K type=write size=3981125 2023-12-03T11:32:38.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.764+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~65V68GKS0WVY.0 size=170487 2023-12-03T11:32:38.765 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.764+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=65V68GKS0WVY tag=N4RUM6QNU0LZ type=write size=1219063 2023-12-03T11:32:38.766 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.765+0000 7f4d50c67780 1 < completed delete operation key=K7YVVH7SAKMC tag=EYPY99IIT0TB type=del 2023-12-03T11:32:38.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.767+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~UGW6BLRC1R9K.0 size=1048576 2023-12-03T11:32:38.769 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.768+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~UGW6BLRC1R9K.1 size=1048576 2023-12-03T11:32:38.769 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.769+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~UGW6BLRC1R9K.2 size=408470 2023-12-03T11:32:38.770 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.769+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=UGW6BLRC1R9K tag=IT9DBPVBSMHT type=write size=3554198 2023-12-03T11:32:38.772 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.771+0000 7f4d50c67780 1 < suggested remove operation key=K7YVVH7SAKMC tag=TC4S4706X26Q type=del 2023-12-03T11:32:38.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.772+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=3Q5Z0LQPOJ53 type=del size=740373 2023-12-03T11:32:38.774 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.773+0000 7f4d50c67780 1 < completed delete operation key=WUM939BATDG9 tag=OTDISMDNASI2 type=del 2023-12-03T11:32:38.775 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.774+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=SD93S0NY6R2P type=write size=690765 2023-12-03T11:32:38.776 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.775+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~KTGICG181MIB.0 size=1048576 2023-12-03T11:32:38.777 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.776+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~KTGICG181MIB.1 size=866771 2023-12-03T11:32:38.779 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.778+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=KTGICG181MIB tag=FMVI3OK99H7I type=write size=2963923 2023-12-03T11:32:38.780 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.779+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=2AZT60YDH995 type=del size=2864566 2023-12-03T11:32:38.781 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.780+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~LELFVQC65KJQ.0 size=62504 2023-12-03T11:32:38.784 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.783+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=LELFVQC65KJQ tag=L3MUB2JS8A1R type=write size=1111080 2023-12-03T11:32:38.786 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.785+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~E47T87R81PM8.0 size=859564 2023-12-03T11:32:38.786 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.785+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=E47T87R81PM8 tag=R837FYSLRWZ7 type=write size=1908140 2023-12-03T11:32:38.789 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.788+0000 7f4d50c67780 1 < suggested update operation key=JR8CIONID4QC tag=76ENC4YZ892D type=del size=2447844 2023-12-03T11:32:38.791 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.790+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~FE22N0XDGEBV.0 size=1048576 2023-12-03T11:32:38.792 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.791+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~FE22N0XDGEBV.1 size=240755 2023-12-03T11:32:38.792 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.791+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=FE22N0XDGEBV tag=97V3RTOQJAUL type=write size=2337907 2023-12-03T11:32:38.794 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.793+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~GU9AND63XAGO.0 size=1048576 2023-12-03T11:32:38.795 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.794+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~GU9AND63XAGO.1 size=1048576 2023-12-03T11:32:38.796 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.795+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~GU9AND63XAGO.2 size=1027611 2023-12-03T11:32:38.798 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.797+0000 7f4d50c67780 1 < completed multipart upload key=EAP0BYZTTT2E upload=GU9AND63XAGO tag=KHJBG0D0HQ9G type=write size=4173339 2023-12-03T11:32:38.799 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.798+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=5QQ3Y977THZT type=del size=678530 2023-12-03T11:32:38.800 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.800+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~E9B2YWS8G4UD.0 size=1048576 2023-12-03T11:32:38.801 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.801+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~E9B2YWS8G4UD.1 size=1048576 2023-12-03T11:32:38.802 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.802+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~E9B2YWS8G4UD.2 size=232284 2023-12-03T11:32:38.805 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.804+0000 7f4d50c67780 1 < completed multipart upload key=JBL6IOJC4TT0 upload=E9B2YWS8G4UD tag=G95M5K0CFGXQ type=write size=3378012 2023-12-03T11:32:38.806 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.805+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=8L6PEFXBNTAZ type=del size=2038579 2023-12-03T11:32:38.807 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.806+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=AKBIK5RU2IRE type=del 2023-12-03T11:32:38.809 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.809+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~6W2F7J6MWGEN.0 size=181399 2023-12-03T11:32:38.809 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.809+0000 7f4d50c67780 1 > prepared multipart upload key=52E31L45TN7V upload=6W2F7J6MWGEN tag=4HON84AC437Q type=write size=1229975 2023-12-03T11:32:38.811 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.810+0000 7f4d50c67780 1 < canceled operation key=ULLPV2G10BME tag=8EUFCWM17457 type=write size=109241 2023-12-03T11:32:38.813 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.812+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~T2NSM188OQWX.0 size=1048576 2023-12-03T11:32:38.813 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.813+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~T2NSM188OQWX.1 size=1048194 2023-12-03T11:32:38.814 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.813+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=T2NSM188OQWX tag=AH0KE9P25LM7 type=write size=3145346 2023-12-03T11:32:38.815 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.814+0000 7f4d50c67780 1 < canceled operation key=2H6AFQ362OGP tag=1QS583QB9WID type=del size=325997 2023-12-03T11:32:38.816 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.815+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=FWMW5TFF0TJS type=del size=2084977 2023-12-03T11:32:38.817 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.816+0000 7f4d50c67780 1 < completed write operation key=CQPZ0X62207Z tag=BRW8B1ZN6H3V type=write size=653453 2023-12-03T11:32:38.819 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.818+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~S3GWVWXK4CT0.0 size=1048576 2023-12-03T11:32:38.820 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.819+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~S3GWVWXK4CT0.1 size=1048576 2023-12-03T11:32:38.821 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.820+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~S3GWVWXK4CT0.2 size=651261 2023-12-03T11:32:38.821 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.820+0000 7f4d50c67780 1 > prepared multipart upload key=ULLPV2G10BME upload=S3GWVWXK4CT0 tag=QP81PN20FFUO type=write size=3796989 2023-12-03T11:32:38.824 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.823+0000 7f4d50c67780 1 < suggested remove operation key=02W4TX7ZCDI6 tag=WAY9250OE5KW type=del 2023-12-03T11:32:38.825 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.824+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=3T1MIKL3SM8H type=del size=1865311 2023-12-03T11:32:38.826 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.825+0000 7f4d50c67780 1 < completed delete operation key=CQPZ0X62207Z tag=R198S20XSGMQ type=del 2023-12-03T11:32:38.827 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.827+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=2OHD9BX08BMZ type=del size=1749766 2023-12-03T11:32:38.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.828+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~BNO88OEJ21CR.0 size=626217 2023-12-03T11:32:38.830 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.830+0000 7f4d50c67780 1 < completed multipart upload key=V0ND3OBFJJUB upload=BNO88OEJ21CR tag=BZJ6TSOU3AAO type=write size=1674793 2023-12-03T11:32:38.831 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.831+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=1AB9D9LZFDEB type=del size=1098407 2023-12-03T11:32:38.833 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.832+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~65V68GKS0WVY.0 size=170487 2023-12-03T11:32:38.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.834+0000 7f4d50c67780 1 < completed multipart upload key=EAP0BYZTTT2E upload=65V68GKS0WVY tag=N4RUM6QNU0LZ type=write size=1219063 2023-12-03T11:32:38.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.835+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=1T8A2RGJ0QLF type=del size=533398 2023-12-03T11:32:38.837 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.837+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~UGW6BLRC1R9K.0 size=1048576 2023-12-03T11:32:38.839 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.838+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~UGW6BLRC1R9K.1 size=1048576 2023-12-03T11:32:38.839 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.839+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~UGW6BLRC1R9K.2 size=408470 2023-12-03T11:32:38.842 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.841+0000 7f4d50c67780 1 < completed multipart upload key=K7YVVH7SAKMC upload=UGW6BLRC1R9K tag=IT9DBPVBSMHT type=write size=3554198 2023-12-03T11:32:38.843 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.842+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=28ZPPP3V0N3X type=del size=2535694 2023-12-03T11:32:38.844 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.844+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=3Q5Z0LQPOJ53 type=del 2023-12-03T11:32:38.847 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.846+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~A6F6BT1V6CUG.0 size=1048576 2023-12-03T11:32:38.848 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.847+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~A6F6BT1V6CUG.1 size=225152 2023-12-03T11:32:38.848 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.847+0000 7f4d50c67780 1 > prepared multipart upload key=QQDBWLVSXIHP upload=A6F6BT1V6CUG tag=Z3Y8R0DULWAG type=write size=2322304 2023-12-03T11:32:38.849 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.848+0000 7f4d50c67780 1 < completed write operation key=EAP0BYZTTT2E tag=SD93S0NY6R2P type=write size=690765 2023-12-03T11:32:38.851 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.850+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~OQMWHPASM19Z.0 size=886982 2023-12-03T11:32:38.851 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.850+0000 7f4d50c67780 1 > prepared multipart upload key=QQDBWLVSXIHP upload=OQMWHPASM19Z tag=BUGC7UIU9VRG type=write size=1935558 2023-12-03T11:32:38.853 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.852+0000 7f4d50c67780 -1 < failed to complete operation key=JR8CIONID4QC tag=2AZT60YDH995 type=del size=2864566: (22) Invalid argument 2023-12-03T11:32:38.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.853+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=M3Z712R7E5TJ type=del size=2131523 2023-12-03T11:32:38.855 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.854+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~E47T87R81PM8.0 size=859564 2023-12-03T11:32:38.857 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.856+0000 7f4d50c67780 1 < completed multipart upload key=CQPZ0X62207Z upload=E47T87R81PM8 tag=R837FYSLRWZ7 type=write size=1908140 2023-12-03T11:32:38.858 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.857+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=ZIE6HIT6SXI5 type=del size=4032604 2023-12-03T11:32:38.859 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.859+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~FE22N0XDGEBV.0 size=1048576 2023-12-03T11:32:38.860 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.860+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~FE22N0XDGEBV.1 size=240755 2023-12-03T11:32:38.862 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.862+0000 7f4d50c67780 1 < completed multipart upload key=EAP0BYZTTT2E upload=FE22N0XDGEBV tag=97V3RTOQJAUL type=write size=2337907 2023-12-03T11:32:38.863 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.863+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=URYURSYEBQCO type=del size=2705008 2023-12-03T11:32:38.865 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.864+0000 7f4d50c67780 1 < canceled operation key=8J1EO2JDQUQH tag=5QQ3Y977THZT type=del size=678530 2023-12-03T11:32:38.866 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.865+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=F21ZJRPRU5DW type=del size=672781 2023-12-03T11:32:38.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.866+0000 7f4d50c67780 1 < completed delete operation key=K7YVVH7SAKMC tag=8L6PEFXBNTAZ type=del 2023-12-03T11:32:38.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.867+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=6AB2MP0EI3P1 type=del size=3254996 2023-12-03T11:32:38.869 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.869+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~6W2F7J6MWGEN.0 size=181399 2023-12-03T11:32:38.871 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.871+0000 7f4d50c67780 1 < completed multipart upload key=52E31L45TN7V upload=6W2F7J6MWGEN tag=4HON84AC437Q type=write size=1229975 2023-12-03T11:32:38.872 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.872+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=TI2TZV4YX08M type=del size=1651336 2023-12-03T11:32:38.874 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.873+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~T2NSM188OQWX.0 size=1048576 2023-12-03T11:32:38.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.874+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~T2NSM188OQWX.1 size=1048194 2023-12-03T11:32:38.877 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.876+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=T2NSM188OQWX tag=AH0KE9P25LM7 type=write size=3145346 2023-12-03T11:32:38.879 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.878+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~A8DXA8PGSFGF.0 size=1048576 2023-12-03T11:32:38.880 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.879+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~A8DXA8PGSFGF.1 size=553113 2023-12-03T11:32:38.880 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.879+0000 7f4d50c67780 1 > prepared multipart upload key=JBL6IOJC4TT0 upload=A8DXA8PGSFGF tag=NG3JHXCSMMAL type=write size=2650265 2023-12-03T11:32:38.882 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.882+0000 7f4d50c67780 1 < suggested update operation key=BX5POXMMYLB7 tag=FWMW5TFF0TJS type=del size=2084977 2023-12-03T11:32:38.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.883+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=Z93SF7L04Z80 type=del size=3926367 2023-12-03T11:32:38.885 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.884+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~S3GWVWXK4CT0.0 size=1048576 2023-12-03T11:32:38.886 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.885+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~S3GWVWXK4CT0.1 size=1048576 2023-12-03T11:32:38.886 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.886+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~S3GWVWXK4CT0.2 size=651261 2023-12-03T11:32:38.888 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.888+0000 7f4d50c67780 1 < completed multipart upload key=ULLPV2G10BME upload=S3GWVWXK4CT0 tag=QP81PN20FFUO type=write size=3796989 2023-12-03T11:32:38.890 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.889+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=YSSP4G25AZ1F type=del size=2365834 2023-12-03T11:32:38.891 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.890+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=3T1MIKL3SM8H type=del 2023-12-03T11:32:38.893 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.892+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~1PYRGYR2U251.0 size=1048576 2023-12-03T11:32:38.894 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.893+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~1PYRGYR2U251.1 size=410842 2023-12-03T11:32:38.894 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.893+0000 7f4d50c67780 1 > prepared multipart upload key=RF2Q24GI24HJ upload=1PYRGYR2U251 tag=6107DNQKG0Z7 type=write size=2507994 2023-12-03T11:32:38.896 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.895+0000 7f4d50c67780 1 < suggested update operation key=ENMJS0KEVS2S tag=2OHD9BX08BMZ type=del size=1749766 2023-12-03T11:32:38.897 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.896+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=KZ0IC7A11JYD type=del size=2703789 2023-12-03T11:32:38.900 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.899+0000 7f4d50c67780 1 < suggested update operation key=WUM939BATDG9 tag=1AB9D9LZFDEB type=del size=1098407 2023-12-03T11:32:38.902 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.901+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~EZRDL442BP7J.0 size=1048576 2023-12-03T11:32:38.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.902+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~EZRDL442BP7J.1 size=1048576 2023-12-03T11:32:38.904 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.903+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~EZRDL442BP7J.2 size=493643 2023-12-03T11:32:38.904 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.903+0000 7f4d50c67780 1 > prepared multipart upload key=52E31L45TN7V upload=EZRDL442BP7J tag=2UQRTQOD5IW2 type=write size=3639371 2023-12-03T11:32:38.905 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.904+0000 7f4d50c67780 -1 < failed to complete operation key=BX5POXMMYLB7 tag=1T8A2RGJ0QLF type=del size=533398: (22) Invalid argument 2023-12-03T11:32:38.906 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.905+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=AKKSRRVW9OCH type=del size=1725681 2023-12-03T11:32:38.907 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.906+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=28ZPPP3V0N3X type=del 2023-12-03T11:32:38.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.908+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=WFZ1SEXUVWIV type=del size=1785172 2023-12-03T11:32:38.910 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.909+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~A6F6BT1V6CUG.0 size=1048576 2023-12-03T11:32:38.911 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.910+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~A6F6BT1V6CUG.1 size=225152 2023-12-03T11:32:38.913 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.912+0000 7f4d50c67780 1 < completed multipart upload key=QQDBWLVSXIHP upload=A6F6BT1V6CUG tag=Z3Y8R0DULWAG type=write size=2322304 2023-12-03T11:32:38.914 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.913+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=K0IOLCJK16GO type=write size=692104 2023-12-03T11:32:38.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.915+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~OQMWHPASM19Z.0 size=886982 2023-12-03T11:32:38.918 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.917+0000 7f4d50c67780 1 < completed multipart upload key=QQDBWLVSXIHP upload=OQMWHPASM19Z tag=BUGC7UIU9VRG type=write size=1935558 2023-12-03T11:32:38.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.918+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=PZBR5ET80MCC type=del size=902264 2023-12-03T11:32:38.921 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.920+0000 7f4d50c67780 1 < completed delete operation key=EX93BYX10WJB tag=M3Z712R7E5TJ type=del 2023-12-03T11:32:38.923 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.923+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~XPHGXSLEKVSB.0 size=1048576 2023-12-03T11:32:38.925 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.924+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~XPHGXSLEKVSB.1 size=1048576 2023-12-03T11:32:38.926 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.925+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~XPHGXSLEKVSB.2 size=140875 2023-12-03T11:32:38.926 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.925+0000 7f4d50c67780 1 > prepared multipart upload key=G0O8EC405LYM upload=XPHGXSLEKVSB tag=I2RR7MD12DLX type=write size=3286603 2023-12-03T11:32:38.927 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.927+0000 7f4d50c67780 1 < canceled operation key=QQDBWLVSXIHP tag=ZIE6HIT6SXI5 type=del size=4032604 2023-12-03T11:32:38.929 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.928+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=F2W9TPOYZNGR type=del size=2832928 2023-12-03T11:32:38.930 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.930+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=URYURSYEBQCO type=del 2023-12-03T11:32:38.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.931+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=12AL0P0DJKLG type=del size=2100688 2023-12-03T11:32:38.935 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.934+0000 7f4d50c67780 1 < suggested remove operation key=73SL3ZBBDA6Q tag=F21ZJRPRU5DW type=del 2023-12-03T11:32:38.938 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.937+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~4N2ZZT0GHEVX.0 size=1048576 2023-12-03T11:32:38.939 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.938+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~4N2ZZT0GHEVX.1 size=359733 2023-12-03T11:32:38.939 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.938+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=4N2ZZT0GHEVX tag=H9N5T7174TB5 type=write size=2456885 2023-12-03T11:32:38.942 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.941+0000 7f4d50c67780 1 < completed delete operation key=02W4TX7ZCDI6 tag=6AB2MP0EI3P1 type=del 2023-12-03T11:32:38.944 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.944+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~9VXPSWHBCBE8.0 size=939195 2023-12-03T11:32:38.944 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.944+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=9VXPSWHBCBE8 tag=CJB23BVC2UCC type=write size=1987771 2023-12-03T11:32:38.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.945+0000 7f4d50c67780 1 < completed delete operation key=JR8CIONID4QC tag=TI2TZV4YX08M type=del 2023-12-03T11:32:38.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.946+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=613ZF8L4IPXR type=del size=2050437 2023-12-03T11:32:38.948 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.947+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~A8DXA8PGSFGF.0 size=1048576 2023-12-03T11:32:38.949 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.948+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~A8DXA8PGSFGF.1 size=553113 2023-12-03T11:32:38.951 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.951+0000 7f4d50c67780 1 < completed multipart upload key=JBL6IOJC4TT0 upload=A8DXA8PGSFGF tag=NG3JHXCSMMAL type=write size=2650265 2023-12-03T11:32:38.953 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.952+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=Y3G95H0QNWY6 type=del size=33617 2023-12-03T11:32:38.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.953+0000 7f4d50c67780 1 < completed delete operation key=V0ND3OBFJJUB tag=Z93SF7L04Z80 type=del 2023-12-03T11:32:38.956 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.955+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~DC8OSLKV8HB2.0 size=1048576 2023-12-03T11:32:38.957 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.956+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~DC8OSLKV8HB2.1 size=7730 2023-12-03T11:32:38.957 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.956+0000 7f4d50c67780 1 > prepared multipart upload key=TOGV2BZ99FRF upload=DC8OSLKV8HB2 tag=45E5YD0MX5PF type=write size=2104882 2023-12-03T11:32:38.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.958+0000 7f4d50c67780 1 < canceled operation key=XM5E3D99MXVA tag=YSSP4G25AZ1F type=del size=2365834 2023-12-03T11:32:38.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.959+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=809OBIFZWQTD type=del size=2995386 2023-12-03T11:32:38.961 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.960+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~1PYRGYR2U251.0 size=1048576 2023-12-03T11:32:38.962 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.961+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~1PYRGYR2U251.1 size=410842 2023-12-03T11:32:38.964 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.963+0000 7f4d50c67780 1 < completed multipart upload key=RF2Q24GI24HJ upload=1PYRGYR2U251 tag=6107DNQKG0Z7 type=write size=2507994 2023-12-03T11:32:38.965 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.964+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=4928EJPNGI04 type=del size=4110758 2023-12-03T11:32:38.967 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.966+0000 7f4d50c67780 1 < canceled operation key=JBL6IOJC4TT0 tag=KZ0IC7A11JYD type=del size=2703789 2023-12-03T11:32:38.968 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.967+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=HHMTOPS9407E type=del size=3642235 2023-12-03T11:32:38.969 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.968+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~EZRDL442BP7J.0 size=1048576 2023-12-03T11:32:38.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.969+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~EZRDL442BP7J.1 size=1048576 2023-12-03T11:32:38.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.969+0000 7f4d50c67780 1 < canceled part key=_multipart_52E31L45TN7V.2~EZRDL442BP7J.2 size=493643 2023-12-03T11:32:38.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.971+0000 7f4d50c67780 1 < canceled multipart upload key=52E31L45TN7V upload=EZRDL442BP7J tag=2UQRTQOD5IW2 type=write size=3639371 2023-12-03T11:32:38.974 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.974+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~F1CNIJQNDR8D.0 size=1048576 2023-12-03T11:32:38.975 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.974+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~F1CNIJQNDR8D.1 size=904978 2023-12-03T11:32:38.975 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.974+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=F1CNIJQNDR8D tag=FS0QZLPJW7WO type=write size=3002130 2023-12-03T11:32:38.976 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.976+0000 7f4d50c67780 1 < completed delete operation key=ZE19S5UCCZ3C tag=AKKSRRVW9OCH type=del 2023-12-03T11:32:38.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.977+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=ZT0LSKEE2FZJ type=del size=239426 2023-12-03T11:32:38.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.978+0000 7f4d50c67780 1 < completed delete operation key=JR8CIONID4QC tag=WFZ1SEXUVWIV type=del 2023-12-03T11:32:38.981 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.980+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~S2FAPUKJG7X1.0 size=1048576 2023-12-03T11:32:38.982 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.981+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~S2FAPUKJG7X1.1 size=480970 2023-12-03T11:32:38.982 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.981+0000 7f4d50c67780 1 > prepared multipart upload key=ULLPV2G10BME upload=S2FAPUKJG7X1 tag=Z0SIZVXJOB5Z type=write size=2578122 2023-12-03T11:32:38.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.982+0000 7f4d50c67780 1 < completed write operation key=ZE19S5UCCZ3C tag=K0IOLCJK16GO type=write size=692104 2023-12-03T11:32:38.984 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.983+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=B4YCB82JUC05 type=del size=38418 2023-12-03T11:32:38.986 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.985+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=PZBR5ET80MCC type=del 2023-12-03T11:32:38.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.986+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=M9V823JCRIC6 type=del size=204721 2023-12-03T11:32:38.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.987+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~XPHGXSLEKVSB.0 size=1048576 2023-12-03T11:32:38.989 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.988+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~XPHGXSLEKVSB.1 size=1048576 2023-12-03T11:32:38.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.989+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~XPHGXSLEKVSB.2 size=140875 2023-12-03T11:32:38.992 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.991+0000 7f4d50c67780 1 < completed multipart upload key=G0O8EC405LYM upload=XPHGXSLEKVSB tag=I2RR7MD12DLX type=write size=3286603 2023-12-03T11:32:38.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.993+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=GW1QZSIVCBIQ type=write size=391225 2023-12-03T11:32:38.995 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.994+0000 7f4d50c67780 1 < completed delete operation key=0M6ZAD39I852 tag=F2W9TPOYZNGR type=del 2023-12-03T11:32:38.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.996+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~PEMR3665OD58.0 size=1048576 2023-12-03T11:32:38.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.997+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~PEMR3665OD58.1 size=139329 2023-12-03T11:32:38.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.997+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=PEMR3665OD58 tag=BF585TMO8XS9 type=write size=2236481 2023-12-03T11:32:38.999 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:38.998+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=12AL0P0DJKLG type=del 2023-12-03T11:32:39.001 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.000+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~4CZM0ULJALQ8.0 size=1048576 2023-12-03T11:32:39.002 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.001+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~4CZM0ULJALQ8.1 size=110738 2023-12-03T11:32:39.002 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.001+0000 7f4d50c67780 1 > prepared multipart upload key=JBL6IOJC4TT0 upload=4CZM0ULJALQ8 tag=T3RXWL1DKR1J type=write size=2207890 2023-12-03T11:32:39.003 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.002+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~4N2ZZT0GHEVX.0 size=1048576 2023-12-03T11:32:39.004 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.003+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~4N2ZZT0GHEVX.1 size=359733 2023-12-03T11:32:39.006 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.005+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=4N2ZZT0GHEVX tag=H9N5T7174TB5 type=write size=2456885 2023-12-03T11:32:39.007 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.007+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=IJWD9WL4FOFV type=del size=107492 2023-12-03T11:32:39.009 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.008+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~9VXPSWHBCBE8.0 size=939195 2023-12-03T11:32:39.011 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.010+0000 7f4d50c67780 1 < completed multipart upload key=V0ND3OBFJJUB upload=9VXPSWHBCBE8 tag=CJB23BVC2UCC type=write size=1987771 2023-12-03T11:32:39.012 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.011+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=XE3I0G3IXNU5 type=del size=3681112 2023-12-03T11:32:39.013 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.012+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=613ZF8L4IPXR type=del 2023-12-03T11:32:39.014 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.013+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=PQ7US6BWZ3TC type=del size=2282036 2023-12-03T11:32:39.015 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.015+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=Y3G95H0QNWY6 type=del 2023-12-03T11:32:39.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.016+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=217ZD6U0AXGS type=del size=1628582 2023-12-03T11:32:39.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.017+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~DC8OSLKV8HB2.0 size=1048576 2023-12-03T11:32:39.019 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.018+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~DC8OSLKV8HB2.1 size=7730 2023-12-03T11:32:39.021 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.020+0000 7f4d50c67780 1 < completed multipart upload key=TOGV2BZ99FRF upload=DC8OSLKV8HB2 tag=45E5YD0MX5PF type=write size=2104882 2023-12-03T11:32:39.023 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.022+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~Y70N6ADK4ZNG.0 size=624056 2023-12-03T11:32:39.023 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.022+0000 7f4d50c67780 1 > prepared multipart upload key=JR8CIONID4QC upload=Y70N6ADK4ZNG tag=MDY6D42ATLP6 type=write size=1672632 2023-12-03T11:32:39.024 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.023+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=809OBIFZWQTD type=del 2023-12-03T11:32:39.025 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.025+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=QDWKTWVKO9HH type=del size=2188478 2023-12-03T11:32:39.027 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.026+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=4928EJPNGI04 type=del 2023-12-03T11:32:39.028 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.027+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=1AUEIJY8O0V2 type=del size=826171 2023-12-03T11:32:39.029 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.028+0000 7f4d50c67780 1 < canceled operation key=EH4B2QP1C42H tag=HHMTOPS9407E type=del size=3642235 2023-12-03T11:32:39.030 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.029+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=WXLK154U36Z2 type=del size=575388 2023-12-03T11:32:39.031 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.030+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~F1CNIJQNDR8D.0 size=1048576 2023-12-03T11:32:39.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.031+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~F1CNIJQNDR8D.1 size=904978 2023-12-03T11:32:39.034 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.033+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=F1CNIJQNDR8D tag=FS0QZLPJW7WO type=write size=3002130 2023-12-03T11:32:39.036 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.035+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=32CECP88X14W type=del size=1000813 2023-12-03T11:32:39.037 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.036+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=ZT0LSKEE2FZJ type=del 2023-12-03T11:32:39.038 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.037+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=LNQM2VY5TOGF type=del size=509040 2023-12-03T11:32:39.039 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.038+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~S2FAPUKJG7X1.0 size=1048576 2023-12-03T11:32:39.040 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.039+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~S2FAPUKJG7X1.1 size=480970 2023-12-03T11:32:39.042 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.041+0000 7f4d50c67780 1 < completed multipart upload key=ULLPV2G10BME upload=S2FAPUKJG7X1 tag=Z0SIZVXJOB5Z type=write size=2578122 2023-12-03T11:32:39.043 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.043+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=TYLY6YAUDPJQ type=del size=767221 2023-12-03T11:32:39.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.044+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=B4YCB82JUC05 type=del 2023-12-03T11:32:39.047 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.046+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~93HJ0Z0FUTYZ.0 size=1048576 2023-12-03T11:32:39.048 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.047+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~93HJ0Z0FUTYZ.1 size=1048576 2023-12-03T11:32:39.049 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.048+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~93HJ0Z0FUTYZ.2 size=270169 2023-12-03T11:32:39.049 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.048+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=93HJ0Z0FUTYZ tag=ISR3UD4YOESI type=write size=3415897 2023-12-03T11:32:39.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.050+0000 7f4d50c67780 1 < suggested update operation key=MLKGLDFFDC3W tag=M9V823JCRIC6 type=del size=204721 2023-12-03T11:32:39.052 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.051+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=KWXJFEF3NWX0 type=write size=729537 2023-12-03T11:32:39.053 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.053+0000 7f4d50c67780 1 < completed write operation key=ZE19S5UCCZ3C tag=GW1QZSIVCBIQ type=write size=391225 2023-12-03T11:32:39.055 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.055+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=3RLZP3OIYVQD type=write size=515273 2023-12-03T11:32:39.057 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.056+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~PEMR3665OD58.0 size=1048576 2023-12-03T11:32:39.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.057+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~PEMR3665OD58.1 size=139329 2023-12-03T11:32:39.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.059+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=PEMR3665OD58 tag=BF585TMO8XS9 type=write size=2236481 2023-12-03T11:32:39.061 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.060+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=30V8JL40ZD9T type=del size=295788 2023-12-03T11:32:39.062 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.062+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~4CZM0ULJALQ8.0 size=1048576 2023-12-03T11:32:39.064 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.063+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~4CZM0ULJALQ8.1 size=110738 2023-12-03T11:32:39.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.065+0000 7f4d50c67780 1 < completed multipart upload key=JBL6IOJC4TT0 upload=4CZM0ULJALQ8 tag=T3RXWL1DKR1J type=write size=2207890 2023-12-03T11:32:39.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.066+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=PHY1T37OJY8J type=del size=2192248 2023-12-03T11:32:39.068 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.067+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=IJWD9WL4FOFV type=del 2023-12-03T11:32:39.070 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.069+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=A21ODHZYVS9Q type=del size=2618105 2023-12-03T11:32:39.071 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.070+0000 7f4d50c67780 1 < completed delete operation key=K7YVVH7SAKMC tag=XE3I0G3IXNU5 type=del 2023-12-03T11:32:39.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.072+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~AJAZSSO6DMCK.0 size=17589 2023-12-03T11:32:39.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.072+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=AJAZSSO6DMCK tag=3Y9Y2CY7NZ4Q type=write size=1066165 2023-12-03T11:32:39.075 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.074+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=PQ7US6BWZ3TC type=del 2023-12-03T11:32:39.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.075+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=SEENUVAG510L type=del size=1188939 2023-12-03T11:32:39.077 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.076+0000 7f4d50c67780 1 < completed delete operation key=52E31L45TN7V tag=217ZD6U0AXGS type=del 2023-12-03T11:32:39.079 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.078+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~F455ZWN0BVKI.0 size=893006 2023-12-03T11:32:39.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.078+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=F455ZWN0BVKI tag=YR5AD1Y3DQYB type=write size=1941582 2023-12-03T11:32:39.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.080+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~Y70N6ADK4ZNG.0 size=624056 2023-12-03T11:32:39.083 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.082+0000 7f4d50c67780 1 < completed multipart upload key=JR8CIONID4QC upload=Y70N6ADK4ZNG tag=MDY6D42ATLP6 type=write size=1672632 2023-12-03T11:32:39.084 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.083+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=LDVVV5GNWZQA type=write size=1005166 2023-12-03T11:32:39.085 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.084+0000 7f4d50c67780 1 < completed delete operation key=EY1RBO15PCRR tag=QDWKTWVKO9HH type=del 2023-12-03T11:32:39.087 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.086+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~SN2JIBMCTOEO.0 size=1048576 2023-12-03T11:32:39.088 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.087+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~SN2JIBMCTOEO.1 size=750158 2023-12-03T11:32:39.089 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.087+0000 7f4d50c67780 1 > prepared multipart upload key=RF2Q24GI24HJ upload=SN2JIBMCTOEO tag=GSCXA4AAIHKG type=write size=2847310 2023-12-03T11:32:39.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.090+0000 7f4d50c67780 1 < suggested update operation key=TEIYINZFFG76 tag=1AUEIJY8O0V2 type=del size=826171 2023-12-03T11:32:39.093 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.092+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~8KD1FWE0STPE.0 size=1048576 2023-12-03T11:32:39.094 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.093+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~8KD1FWE0STPE.1 size=1048576 2023-12-03T11:32:39.095 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.094+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~8KD1FWE0STPE.2 size=854888 2023-12-03T11:32:39.095 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.094+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=8KD1FWE0STPE tag=Z0VIFT47BB8E type=write size=4000616 2023-12-03T11:32:39.096 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.095+0000 7f4d50c67780 1 < completed delete operation key=7C7UX0231SHV tag=WXLK154U36Z2 type=del 2023-12-03T11:32:39.097 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.096+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=W51O4DV4ZNDY type=del size=937421 2023-12-03T11:32:39.099 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.098+0000 7f4d50c67780 1 < canceled operation key=73SL3ZBBDA6Q tag=32CECP88X14W type=del size=1000813 2023-12-03T11:32:39.101 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.100+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~U1JV7YMF2MOZ.0 size=900641 2023-12-03T11:32:39.101 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.100+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=U1JV7YMF2MOZ tag=GZAYTE1TQB6N type=write size=1949217 2023-12-03T11:32:39.102 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.101+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=LNQM2VY5TOGF type=del 2023-12-03T11:32:39.103 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.102+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=3KXUFCSSV1PI type=del size=977854 2023-12-03T11:32:39.104 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.103+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=TYLY6YAUDPJQ type=del 2023-12-03T11:32:39.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.106+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~B4L7UF5FFKJ3.0 size=1048576 2023-12-03T11:32:39.107 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.106+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~B4L7UF5FFKJ3.1 size=74555 2023-12-03T11:32:39.107 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.106+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=B4L7UF5FFKJ3 tag=DU29CTXG26W6 type=write size=2171707 2023-12-03T11:32:39.108 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.108+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~93HJ0Z0FUTYZ.0 size=1048576 2023-12-03T11:32:39.109 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.109+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~93HJ0Z0FUTYZ.1 size=1048576 2023-12-03T11:32:39.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.109+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~93HJ0Z0FUTYZ.2 size=270169 2023-12-03T11:32:39.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.111+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=93HJ0Z0FUTYZ tag=ISR3UD4YOESI type=write size=3415897 2023-12-03T11:32:39.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.113+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=YAH045T9UP6I type=del size=3430134 2023-12-03T11:32:39.115 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.114+0000 7f4d50c67780 1 < canceled operation key=JR8CIONID4QC tag=KWXJFEF3NWX0 type=write size=729537 2023-12-03T11:32:39.117 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.116+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~QSUQJRBGR6RL.0 size=170864 2023-12-03T11:32:39.117 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.116+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=QSUQJRBGR6RL tag=JTEGXRXNLWOQ type=write size=1219440 2023-12-03T11:32:39.118 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.117+0000 7f4d50c67780 1 < completed write operation key=V0ND3OBFJJUB tag=3RLZP3OIYVQD type=write size=515273 2023-12-03T11:32:39.119 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.118+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=U88BXZSI0DYI type=del size=1310006 2023-12-03T11:32:39.120 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.119+0000 7f4d50c67780 1 < canceled operation key=JBL6IOJC4TT0 tag=30V8JL40ZD9T type=del size=295788 2023-12-03T11:32:39.121 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.121+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=13RPXG3OGPN3 type=del size=2596089 2023-12-03T11:32:39.123 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.122+0000 7f4d50c67780 1 < completed delete operation key=V0ND3OBFJJUB tag=PHY1T37OJY8J type=del 2023-12-03T11:32:39.124 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.123+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=9LXOJJDUY002 type=del size=3062269 2023-12-03T11:32:39.125 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.124+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=A21ODHZYVS9Q type=del 2023-12-03T11:32:39.126 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.125+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=1DK8VC5LJNHI type=write size=781731 2023-12-03T11:32:39.127 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.127+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~AJAZSSO6DMCK.0 size=17589 2023-12-03T11:32:39.129 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.129+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=AJAZSSO6DMCK tag=3Y9Y2CY7NZ4Q type=write size=1066165 2023-12-03T11:32:39.132 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.131+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~5M16JNH2ECXG.0 size=1048576 2023-12-03T11:32:39.132 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.132+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~5M16JNH2ECXG.1 size=1048576 2023-12-03T11:32:39.133 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.133+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~5M16JNH2ECXG.2 size=544223 2023-12-03T11:32:39.134 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.133+0000 7f4d50c67780 1 > prepared multipart upload key=73SL3ZBBDA6Q upload=5M16JNH2ECXG tag=VY0J6DA9Z696 type=write size=3689951 2023-12-03T11:32:39.136 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.135+0000 7f4d50c67780 1 < suggested update operation key=YDRAH5EE39R4 tag=SEENUVAG510L type=del size=1188939 2023-12-03T11:32:39.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.136+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=5JCWSF6YZTQ3 type=write size=184858 2023-12-03T11:32:39.138 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.137+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~F455ZWN0BVKI.0 size=893006 2023-12-03T11:32:39.140 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.139+0000 7f4d50c67780 1 < completed multipart upload key=7C7UX0231SHV upload=F455ZWN0BVKI tag=YR5AD1Y3DQYB type=write size=1941582 2023-12-03T11:32:39.141 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.141+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=QIO56TNLZ5VS type=del size=1942829 2023-12-03T11:32:39.143 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.142+0000 7f4d50c67780 -1 < failed to complete operation key=TEIYINZFFG76 tag=LDVVV5GNWZQA type=write size=1005166: (22) Invalid argument 2023-12-03T11:32:39.144 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.143+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=3BEHOHSEPOWB type=del size=272157 2023-12-03T11:32:39.145 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.145+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~SN2JIBMCTOEO.0 size=1048576 2023-12-03T11:32:39.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.146+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~SN2JIBMCTOEO.1 size=750158 2023-12-03T11:32:39.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.148+0000 7f4d50c67780 1 < completed multipart upload key=RF2Q24GI24HJ upload=SN2JIBMCTOEO tag=GSCXA4AAIHKG type=write size=2847310 2023-12-03T11:32:39.150 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.149+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=3C9W8GX4UUYW type=del size=4125373 2023-12-03T11:32:39.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.150+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~8KD1FWE0STPE.0 size=1048576 2023-12-03T11:32:39.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.151+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~8KD1FWE0STPE.1 size=1048576 2023-12-03T11:32:39.153 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.152+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~8KD1FWE0STPE.2 size=854888 2023-12-03T11:32:39.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.154+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=8KD1FWE0STPE tag=Z0VIFT47BB8E type=write size=4000616 2023-12-03T11:32:39.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.156+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=2S89P0C8C1V9 type=del size=274843 2023-12-03T11:32:39.159 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.158+0000 7f4d50c67780 1 < suggested update operation key=CQPZ0X62207Z tag=W51O4DV4ZNDY type=del size=937421 2023-12-03T11:32:39.161 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.160+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~NQM5FQ0DR1U5.0 size=1048576 2023-12-03T11:32:39.162 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.161+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~NQM5FQ0DR1U5.1 size=251631 2023-12-03T11:32:39.162 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.161+0000 7f4d50c67780 1 > prepared multipart upload key=QQDBWLVSXIHP upload=NQM5FQ0DR1U5 tag=3WL04ZHACK7O type=write size=2348783 2023-12-03T11:32:39.163 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.162+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~U1JV7YMF2MOZ.0 size=900641 2023-12-03T11:32:39.165 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.164+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=U1JV7YMF2MOZ tag=GZAYTE1TQB6N type=write size=1949217 2023-12-03T11:32:39.167 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.167+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~XUO0WN1TPHK3.0 size=1048576 2023-12-03T11:32:39.169 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.168+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~XUO0WN1TPHK3.1 size=162750 2023-12-03T11:32:39.169 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.168+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=XUO0WN1TPHK3 tag=M3RL14YJA4WJ type=write size=2259902 2023-12-03T11:32:39.170 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.170+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=3KXUFCSSV1PI type=del 2023-12-03T11:32:39.172 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.171+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=V76C66MDG3L3 type=write size=455643 2023-12-03T11:32:39.173 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.172+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~B4L7UF5FFKJ3.0 size=1048576 2023-12-03T11:32:39.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.174+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~B4L7UF5FFKJ3.1 size=74555 2023-12-03T11:32:39.177 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.176+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=B4L7UF5FFKJ3 tag=DU29CTXG26W6 type=write size=2171707 2023-12-03T11:32:39.179 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.178+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~UFA38BXS4ZZ4.0 size=1048576 2023-12-03T11:32:39.180 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.179+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~UFA38BXS4ZZ4.1 size=1048576 2023-12-03T11:32:39.181 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.180+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~UFA38BXS4ZZ4.2 size=701089 2023-12-03T11:32:39.181 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.180+0000 7f4d50c67780 1 > prepared multipart upload key=YDRAH5EE39R4 upload=UFA38BXS4ZZ4 tag=BA6M89MS8R69 type=write size=3846817 2023-12-03T11:32:39.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.181+0000 7f4d50c67780 1 < completed delete operation key=EX93BYX10WJB tag=YAH045T9UP6I type=del 2023-12-03T11:32:39.185 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.184+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~JZ3O9HTH59XF.0 size=1048576 2023-12-03T11:32:39.186 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.185+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~JZ3O9HTH59XF.1 size=800028 2023-12-03T11:32:39.186 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.185+0000 7f4d50c67780 1 > prepared multipart upload key=ULLPV2G10BME upload=JZ3O9HTH59XF tag=O2SXTKSB5XPG type=write size=2897180 2023-12-03T11:32:39.187 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.186+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~QSUQJRBGR6RL.0 size=170864 2023-12-03T11:32:39.189 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.188+0000 7f4d50c67780 1 < completed multipart upload key=WUM939BATDG9 upload=QSUQJRBGR6RL tag=JTEGXRXNLWOQ type=write size=1219440 2023-12-03T11:32:39.192 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.191+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~LXUQ6AAUOC1G.0 size=1048576 2023-12-03T11:32:39.192 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.192+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~LXUQ6AAUOC1G.1 size=533243 2023-12-03T11:32:39.193 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.192+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=LXUQ6AAUOC1G tag=3FTWJ31HLJIJ type=write size=2630395 2023-12-03T11:32:39.194 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.193+0000 7f4d50c67780 1 < completed delete operation key=0M6ZAD39I852 tag=U88BXZSI0DYI type=del 2023-12-03T11:32:39.195 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.194+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=BPLOEYLAMW77 type=write size=509039 2023-12-03T11:32:39.196 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.196+0000 7f4d50c67780 1 < completed delete operation key=V0ND3OBFJJUB tag=13RPXG3OGPN3 type=del 2023-12-03T11:32:39.199 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.198+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~08TUCM1DEFJ8.0 size=1048576 2023-12-03T11:32:39.200 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.199+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~08TUCM1DEFJ8.1 size=1040550 2023-12-03T11:32:39.200 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.199+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=08TUCM1DEFJ8 tag=T1GAARWTEOW5 type=write size=3137702 2023-12-03T11:32:39.201 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.200+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=9LXOJJDUY002 type=del 2023-12-03T11:32:39.203 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.203+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~4OOPKDCQAST4.0 size=1048576 2023-12-03T11:32:39.204 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.203+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~4OOPKDCQAST4.1 size=1048576 2023-12-03T11:32:39.205 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.204+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~4OOPKDCQAST4.2 size=104123 2023-12-03T11:32:39.205 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.204+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=4OOPKDCQAST4 tag=B2611X62E4BA type=write size=3249851 2023-12-03T11:32:39.206 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.206+0000 7f4d50c67780 1 < canceled operation key=JR8CIONID4QC tag=1DK8VC5LJNHI type=write size=781731 2023-12-03T11:32:39.209 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.208+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~YJPG0AD1J4IC.0 size=1048576 2023-12-03T11:32:39.209 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.209+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~YJPG0AD1J4IC.1 size=1048576 2023-12-03T11:32:39.210 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.210+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~YJPG0AD1J4IC.2 size=710504 2023-12-03T11:32:39.211 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.210+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=YJPG0AD1J4IC tag=2NQAFNBXIF8I type=write size=3856232 2023-12-03T11:32:39.212 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.211+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~5M16JNH2ECXG.0 size=1048576 2023-12-03T11:32:39.213 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.212+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~5M16JNH2ECXG.1 size=1048576 2023-12-03T11:32:39.214 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.213+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~5M16JNH2ECXG.2 size=544223 2023-12-03T11:32:39.215 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.215+0000 7f4d50c67780 1 < completed multipart upload key=73SL3ZBBDA6Q upload=5M16JNH2ECXG tag=VY0J6DA9Z696 type=write size=3689951 2023-12-03T11:32:39.218 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.217+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~4OY90DLBO5RN.0 size=582949 2023-12-03T11:32:39.218 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.217+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=4OY90DLBO5RN tag=5QEULFYUJLA3 type=write size=1631525 2023-12-03T11:32:39.219 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.218+0000 7f4d50c67780 1 < completed write operation key=YDRAH5EE39R4 tag=5JCWSF6YZTQ3 type=write size=184858 2023-12-03T11:32:39.221 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.220+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~15B1HPN0FFDN.0 size=757965 2023-12-03T11:32:39.221 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.220+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=15B1HPN0FFDN tag=XCSHK3PHVA0K type=write size=1806541 2023-12-03T11:32:39.222 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.221+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=QIO56TNLZ5VS type=del 2023-12-03T11:32:39.223 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.223+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=PQBBZT1O4B88 type=del size=1332069 2023-12-03T11:32:39.225 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.224+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=3BEHOHSEPOWB type=del 2023-12-03T11:32:39.226 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.225+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=1K16QBQ87GPK type=del size=3364359 2023-12-03T11:32:39.227 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.227+0000 7f4d50c67780 1 < completed delete operation key=EAP0BYZTTT2E tag=3C9W8GX4UUYW type=del 2023-12-03T11:32:39.230 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.229+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~19Z2ARLD9AL6.0 size=1031969 2023-12-03T11:32:39.230 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.229+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=19Z2ARLD9AL6 tag=YFCTVC9SPI6W type=write size=2080545 2023-12-03T11:32:39.231 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.230+0000 7f4d50c67780 1 < completed delete operation key=YDRAH5EE39R4 tag=2S89P0C8C1V9 type=del 2023-12-03T11:32:39.232 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.231+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=8HYNRDCYA1V4 type=del size=1143076 2023-12-03T11:32:39.233 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.232+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~NQM5FQ0DR1U5.0 size=1048576 2023-12-03T11:32:39.234 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.233+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~NQM5FQ0DR1U5.1 size=251631 2023-12-03T11:32:39.236 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.235+0000 7f4d50c67780 1 < completed multipart upload key=QQDBWLVSXIHP upload=NQM5FQ0DR1U5 tag=3WL04ZHACK7O type=write size=2348783 2023-12-03T11:32:39.238 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.237+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~J3LV30JA6THD.0 size=1048576 2023-12-03T11:32:39.239 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.238+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~J3LV30JA6THD.1 size=1048576 2023-12-03T11:32:39.240 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.239+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~J3LV30JA6THD.2 size=588987 2023-12-03T11:32:39.240 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.239+0000 7f4d50c67780 1 > prepared multipart upload key=JR8CIONID4QC upload=J3LV30JA6THD tag=EJ5CXQMMHB54 type=write size=3734715 2023-12-03T11:32:39.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.241+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~XUO0WN1TPHK3.0 size=1048576 2023-12-03T11:32:39.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.242+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~XUO0WN1TPHK3.1 size=162750 2023-12-03T11:32:39.245 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.244+0000 7f4d50c67780 1 < completed multipart upload key=WUM939BATDG9 upload=XUO0WN1TPHK3 tag=M3RL14YJA4WJ type=write size=2259902 2023-12-03T11:32:39.246 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.245+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=3ZPBCRH1ZLK4 type=del size=606415 2023-12-03T11:32:39.249 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.248+0000 7f4d50c67780 1 < suggested remove operation key=EX93BYX10WJB tag=V76C66MDG3L3 type=write 2023-12-03T11:32:39.250 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.249+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=VIKH4O57V4NK type=del size=3666651 2023-12-03T11:32:39.251 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.251+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~UFA38BXS4ZZ4.0 size=1048576 2023-12-03T11:32:39.252 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.252+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~UFA38BXS4ZZ4.1 size=1048576 2023-12-03T11:32:39.254 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.253+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~UFA38BXS4ZZ4.2 size=701089 2023-12-03T11:32:39.256 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.255+0000 7f4d50c67780 1 < completed multipart upload key=YDRAH5EE39R4 upload=UFA38BXS4ZZ4 tag=BA6M89MS8R69 type=write size=3846817 2023-12-03T11:32:39.258 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.258+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~13EHKTJPW0FN.0 size=16786 2023-12-03T11:32:39.258 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.258+0000 7f4d50c67780 1 > prepared multipart upload key=52E31L45TN7V upload=13EHKTJPW0FN tag=YLXUXH3UMIS1 type=write size=1065362 2023-12-03T11:32:39.260 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.259+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~JZ3O9HTH59XF.0 size=1048576 2023-12-03T11:32:39.261 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.260+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~JZ3O9HTH59XF.1 size=800028 2023-12-03T11:32:39.263 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.262+0000 7f4d50c67780 1 < completed multipart upload key=ULLPV2G10BME upload=JZ3O9HTH59XF tag=O2SXTKSB5XPG type=write size=2897180 2023-12-03T11:32:39.265 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.264+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~WBG3NFGH0EAG.0 size=1048576 2023-12-03T11:32:39.267 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.266+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~WBG3NFGH0EAG.1 size=385863 2023-12-03T11:32:39.267 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.266+0000 7f4d50c67780 1 > prepared multipart upload key=73SL3ZBBDA6Q upload=WBG3NFGH0EAG tag=JDB24X417S4M type=write size=2483015 2023-12-03T11:32:39.268 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.267+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~LXUQ6AAUOC1G.0 size=1048576 2023-12-03T11:32:39.269 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.268+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~LXUQ6AAUOC1G.1 size=533243 2023-12-03T11:32:39.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.270+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=LXUQ6AAUOC1G tag=3FTWJ31HLJIJ type=write size=2630395 2023-12-03T11:32:39.272 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.271+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=CC655ER11AFQ type=del size=1815287 2023-12-03T11:32:39.274 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.273+0000 7f4d50c67780 1 < completed write operation key=RF2Q24GI24HJ tag=BPLOEYLAMW77 type=write size=509039 2023-12-03T11:32:39.276 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.275+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~D38TDDA82SVP.0 size=83342 2023-12-03T11:32:39.276 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.275+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=D38TDDA82SVP tag=GRIG9KRKTE41 type=write size=1131918 2023-12-03T11:32:39.277 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.277+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~08TUCM1DEFJ8.0 size=1048576 2023-12-03T11:32:39.278 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.278+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~08TUCM1DEFJ8.1 size=1040550 2023-12-03T11:32:39.280 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.280+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=08TUCM1DEFJ8 tag=T1GAARWTEOW5 type=write size=3137702 2023-12-03T11:32:39.282 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.281+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=W4KAZJ34QYTI type=del size=531350 2023-12-03T11:32:39.282 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.281+0000 7f4d50c67780 1 < canceled part key=_multipart_XM5E3D99MXVA.2~4OOPKDCQAST4.0 size=1048576 2023-12-03T11:32:39.283 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.282+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~4OOPKDCQAST4.1 size=1048576 2023-12-03T11:32:39.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.284+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~4OOPKDCQAST4.2 size=104123 2023-12-03T11:32:39.287 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.286+0000 7f4d50c67780 1 < canceled multipart upload key=XM5E3D99MXVA upload=4OOPKDCQAST4 tag=B2611X62E4BA type=write size=3249851 2023-12-03T11:32:39.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.288+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=O809RKPCXF3K type=write size=479801 2023-12-03T11:32:39.290 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.289+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~YJPG0AD1J4IC.0 size=1048576 2023-12-03T11:32:39.290 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.289+0000 7f4d50c67780 1 < canceled part key=_multipart_0M6ZAD39I852.2~YJPG0AD1J4IC.1 size=1048576 2023-12-03T11:32:39.291 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.290+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~YJPG0AD1J4IC.2 size=710504 2023-12-03T11:32:39.293 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.292+0000 7f4d50c67780 1 < canceled multipart upload key=0M6ZAD39I852 upload=YJPG0AD1J4IC tag=2NQAFNBXIF8I type=write size=3856232 2023-12-03T11:32:39.295 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.294+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~WZHVC2WOQV41.0 size=274951 2023-12-03T11:32:39.295 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.294+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=WZHVC2WOQV41 tag=HAXGGYQX9IBS type=write size=1323527 2023-12-03T11:32:39.296 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.296+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~4OY90DLBO5RN.0 size=582949 2023-12-03T11:32:39.298 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.298+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=4OY90DLBO5RN tag=5QEULFYUJLA3 type=write size=1631525 2023-12-03T11:32:39.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.299+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=9XWIETI538GJ type=del size=3618923 2023-12-03T11:32:39.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.299+0000 7f4d50c67780 1 < canceled part key=_multipart_CQPZ0X62207Z.2~15B1HPN0FFDN.0 size=757965 2023-12-03T11:32:39.302 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.301+0000 7f4d50c67780 1 < canceled multipart upload key=CQPZ0X62207Z upload=15B1HPN0FFDN tag=XCSHK3PHVA0K type=write size=1806541 2023-12-03T11:32:39.303 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.302+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=VRGJFRGF3OXG type=del size=3797603 2023-12-03T11:32:39.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.304+0000 7f4d50c67780 1 < completed delete operation key=GTLP2WZUX7U8 tag=PQBBZT1O4B88 type=del 2023-12-03T11:32:39.307 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.306+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~UI1X7QKNGYEZ.0 size=1048576 2023-12-03T11:32:39.308 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.307+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~UI1X7QKNGYEZ.1 size=1048576 2023-12-03T11:32:39.309 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.308+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~UI1X7QKNGYEZ.2 size=638236 2023-12-03T11:32:39.309 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.308+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=UI1X7QKNGYEZ tag=VNMY1G6NZ7JH type=write size=3783964 2023-12-03T11:32:39.311 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.310+0000 7f4d50c67780 1 < suggested update operation key=U6R5Y9JXKT32 tag=1K16QBQ87GPK type=del size=3364359 2023-12-03T11:32:39.312 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.311+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=N6D3HCY9KU36 type=del size=2656101 2023-12-03T11:32:39.314 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.313+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~19Z2ARLD9AL6.0 size=1031969 2023-12-03T11:32:39.316 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.315+0000 7f4d50c67780 1 < completed multipart upload key=EH4B2QP1C42H upload=19Z2ARLD9AL6 tag=YFCTVC9SPI6W type=write size=2080545 2023-12-03T11:32:39.317 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.316+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=AW11KH4BSLZ2 type=del size=3498609 2023-12-03T11:32:39.318 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.317+0000 7f4d50c67780 1 < completed delete operation key=V0ND3OBFJJUB tag=8HYNRDCYA1V4 type=del 2023-12-03T11:32:39.320 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.319+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~UNBH7D5Q2RT0.0 size=1048576 2023-12-03T11:32:39.321 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.320+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~UNBH7D5Q2RT0.1 size=1048576 2023-12-03T11:32:39.322 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.321+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~UNBH7D5Q2RT0.2 size=528504 2023-12-03T11:32:39.322 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.321+0000 7f4d50c67780 1 > prepared multipart upload key=U6R5Y9JXKT32 upload=UNBH7D5Q2RT0 tag=ACE3X9HQ6ECU type=write size=3674232 2023-12-03T11:32:39.323 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.322+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~J3LV30JA6THD.0 size=1048576 2023-12-03T11:32:39.324 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.323+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~J3LV30JA6THD.1 size=1048576 2023-12-03T11:32:39.325 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.324+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~J3LV30JA6THD.2 size=588987 2023-12-03T11:32:39.327 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.326+0000 7f4d50c67780 1 < completed multipart upload key=JR8CIONID4QC upload=J3LV30JA6THD tag=EJ5CXQMMHB54 type=write size=3734715 2023-12-03T11:32:39.329 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.328+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=VMM3059HQ1X2 type=del size=1828153 2023-12-03T11:32:39.331 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.330+0000 7f4d50c67780 1 < suggested remove operation key=U6R5Y9JXKT32 tag=3ZPBCRH1ZLK4 type=del 2023-12-03T11:32:39.332 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.331+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=VJ11C9OI7KN1 type=del size=2518238 2023-12-03T11:32:39.334 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.333+0000 7f4d50c67780 1 < suggested update operation key=V0ND3OBFJJUB tag=VIKH4O57V4NK type=del size=3666651 2023-12-03T11:32:39.335 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.334+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=GRKWP7ZGJ7JM type=del size=3287226 2023-12-03T11:32:39.336 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.335+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~13EHKTJPW0FN.0 size=16786 2023-12-03T11:32:39.338 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.337+0000 7f4d50c67780 1 < completed multipart upload key=52E31L45TN7V upload=13EHKTJPW0FN tag=YLXUXH3UMIS1 type=write size=1065362 2023-12-03T11:32:39.340 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.339+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~BRYORK2S0CG8.0 size=606008 2023-12-03T11:32:39.340 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.339+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=BRYORK2S0CG8 tag=V4KY1LS4KMEP type=write size=1654584 2023-12-03T11:32:39.341 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.341+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~WBG3NFGH0EAG.0 size=1048576 2023-12-03T11:32:39.342 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.341+0000 7f4d50c67780 1 < canceled part key=_multipart_73SL3ZBBDA6Q.2~WBG3NFGH0EAG.1 size=385863 2023-12-03T11:32:39.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.343+0000 7f4d50c67780 1 < canceled multipart upload key=73SL3ZBBDA6Q upload=WBG3NFGH0EAG tag=JDB24X417S4M type=write size=2483015 2023-12-03T11:32:39.345 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.344+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=SICG91QL5PHU type=del size=3874145 2023-12-03T11:32:39.346 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.345+0000 7f4d50c67780 1 < completed delete operation key=52E31L45TN7V tag=CC655ER11AFQ type=del 2023-12-03T11:32:39.347 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.346+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=JTZ9UGU7V5GG type=del size=1793179 2023-12-03T11:32:39.348 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.348+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~D38TDDA82SVP.0 size=83342 2023-12-03T11:32:39.350 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.350+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=D38TDDA82SVP tag=GRIG9KRKTE41 type=write size=1131918 2023-12-03T11:32:39.352 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.351+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=U5MF9MW3IJLX type=write size=347179 2023-12-03T11:32:39.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.352+0000 7f4d50c67780 1 < completed delete operation key=EY1RBO15PCRR tag=W4KAZJ34QYTI type=del 2023-12-03T11:32:39.355 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.354+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~4UH2A689SMXL.0 size=74654 2023-12-03T11:32:39.355 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.354+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=4UH2A689SMXL tag=U9I1X97NP735 type=write size=1123230 2023-12-03T11:32:39.358 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.357+0000 7f4d50c67780 1 < suggested update operation key=0M6ZAD39I852 tag=O809RKPCXF3K type=write size=479801 2023-12-03T11:32:39.360 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.359+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~7EM55GI76XJP.0 size=1048576 2023-12-03T11:32:39.361 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.360+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~7EM55GI76XJP.1 size=825113 2023-12-03T11:32:39.361 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.360+0000 7f4d50c67780 1 > prepared multipart upload key=ULLPV2G10BME upload=7EM55GI76XJP tag=YBIWZU5I7QM7 type=write size=2922265 2023-12-03T11:32:39.362 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.361+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~WZHVC2WOQV41.0 size=274951 2023-12-03T11:32:39.364 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.363+0000 7f4d50c67780 1 < completed multipart upload key=CQPZ0X62207Z upload=WZHVC2WOQV41 tag=HAXGGYQX9IBS type=write size=1323527 2023-12-03T11:32:39.367 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.366+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~U4BGUAXH9MA6.0 size=1048576 2023-12-03T11:32:39.368 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.367+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~U4BGUAXH9MA6.1 size=728207 2023-12-03T11:32:39.368 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.367+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=U4BGUAXH9MA6 tag=XPBXLOQAEF7H type=write size=2825359 2023-12-03T11:32:39.369 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.368+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=9XWIETI538GJ type=del 2023-12-03T11:32:39.371 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.370+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~2SYA00AUZ2R1.0 size=1048576 2023-12-03T11:32:39.372 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.371+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~2SYA00AUZ2R1.1 size=1048576 2023-12-03T11:32:39.373 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.372+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~2SYA00AUZ2R1.2 size=108608 2023-12-03T11:32:39.373 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.372+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=2SYA00AUZ2R1 tag=KKJSNK4N4UIQ type=write size=3254336 2023-12-03T11:32:39.375 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.374+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=VRGJFRGF3OXG type=del 2023-12-03T11:32:39.376 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.375+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=ZNP0W0PYMKK3 type=del size=1152623 2023-12-03T11:32:39.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.376+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~UI1X7QKNGYEZ.0 size=1048576 2023-12-03T11:32:39.378 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.377+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~UI1X7QKNGYEZ.1 size=1048576 2023-12-03T11:32:39.379 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.378+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~UI1X7QKNGYEZ.2 size=638236 2023-12-03T11:32:39.381 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.380+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=UI1X7QKNGYEZ tag=VNMY1G6NZ7JH type=write size=3783964 2023-12-03T11:32:39.382 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.382+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=PQLNYF1NXIFA type=del size=1629436 2023-12-03T11:32:39.384 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.383+0000 7f4d50c67780 1 < completed delete operation key=7C7UX0231SHV tag=N6D3HCY9KU36 type=del 2023-12-03T11:32:39.386 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.385+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~VMJTDELB9SHM.0 size=1048576 2023-12-03T11:32:39.387 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.386+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~VMJTDELB9SHM.1 size=152143 2023-12-03T11:32:39.387 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.386+0000 7f4d50c67780 1 > prepared multipart upload key=ENMJS0KEVS2S upload=VMJTDELB9SHM tag=5UYIKDC8B9E3 type=write size=2249295 2023-12-03T11:32:39.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.387+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=AW11KH4BSLZ2 type=del 2023-12-03T11:32:39.390 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.389+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~X2KFPXOHOVCN.0 size=1048576 2023-12-03T11:32:39.391 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.390+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~X2KFPXOHOVCN.1 size=536801 2023-12-03T11:32:39.391 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.390+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=X2KFPXOHOVCN tag=2P05PM7WGZD1 type=write size=2633953 2023-12-03T11:32:39.392 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.392+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~UNBH7D5Q2RT0.0 size=1048576 2023-12-03T11:32:39.393 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.393+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~UNBH7D5Q2RT0.1 size=1048576 2023-12-03T11:32:39.395 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.394+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~UNBH7D5Q2RT0.2 size=528504 2023-12-03T11:32:39.397 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.397+0000 7f4d50c67780 1 < completed multipart upload key=U6R5Y9JXKT32 upload=UNBH7D5Q2RT0 tag=ACE3X9HQ6ECU type=write size=3674232 2023-12-03T11:32:39.400 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.399+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~PY7L15IP3NQC.0 size=1048576 2023-12-03T11:32:39.400 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.400+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~PY7L15IP3NQC.1 size=1048576 2023-12-03T11:32:39.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.401+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~PY7L15IP3NQC.2 size=303706 2023-12-03T11:32:39.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.401+0000 7f4d50c67780 1 > prepared multipart upload key=ULLPV2G10BME upload=PY7L15IP3NQC tag=W6QWPPQJ3JZS type=write size=3449434 2023-12-03T11:32:39.404 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.403+0000 7f4d50c67780 1 < suggested remove operation key=WUM939BATDG9 tag=VMM3059HQ1X2 type=del 2023-12-03T11:32:39.406 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.405+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~GQGG7NI57C8Q.0 size=1048576 2023-12-03T11:32:39.407 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.406+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~GQGG7NI57C8Q.1 size=38196 2023-12-03T11:32:39.407 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.406+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=GQGG7NI57C8Q tag=DO68B3BKPGNE type=write size=2135348 2023-12-03T11:32:39.408 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.407+0000 7f4d50c67780 1 < completed delete operation key=MLKGLDFFDC3W tag=VJ11C9OI7KN1 type=del 2023-12-03T11:32:39.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.409+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=87JMK4JNJYBI type=del size=458642 2023-12-03T11:32:39.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.411+0000 7f4d50c67780 1 < suggested remove operation key=52E31L45TN7V tag=GRKWP7ZGJ7JM type=del 2023-12-03T11:32:39.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.413+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~O0VJLFJSSC0I.0 size=1048576 2023-12-03T11:32:39.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.414+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~O0VJLFJSSC0I.1 size=1048576 2023-12-03T11:32:39.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.415+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~O0VJLFJSSC0I.2 size=792936 2023-12-03T11:32:39.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.415+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=O0VJLFJSSC0I tag=HJFL7H2JOXNS type=write size=3938664 2023-12-03T11:32:39.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.416+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~BRYORK2S0CG8.0 size=606008 2023-12-03T11:32:39.419 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.418+0000 7f4d50c67780 1 < completed multipart upload key=CQPZ0X62207Z upload=BRYORK2S0CG8 tag=V4KY1LS4KMEP type=write size=1654584 2023-12-03T11:32:39.420 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.419+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=MLZVAQWOB9WX type=write size=771446 2023-12-03T11:32:39.422 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.422+0000 7f4d50c67780 1 < suggested remove operation key=JR8CIONID4QC tag=SICG91QL5PHU type=del 2023-12-03T11:32:39.425 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.424+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~UCTGZEFOH263.0 size=706815 2023-12-03T11:32:39.425 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.424+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=UCTGZEFOH263 tag=41RQ3RD08GX8 type=write size=1755391 2023-12-03T11:32:39.427 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.426+0000 7f4d50c67780 1 < suggested remove operation key=ZE19S5UCCZ3C tag=JTZ9UGU7V5GG type=del 2023-12-03T11:32:39.428 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.427+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=S4LKZYDR3A07 type=write size=904838 2023-12-03T11:32:39.430 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.429+0000 7f4d50c67780 1 < completed write operation key=8J1EO2JDQUQH tag=U5MF9MW3IJLX type=write size=347179 2023-12-03T11:32:39.431 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.430+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=14Z4PA9YAOTM type=del size=695889 2023-12-03T11:32:39.431 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.431+0000 7f4d50c67780 1 < canceled part key=_multipart_CQPZ0X62207Z.2~4UH2A689SMXL.0 size=74654 2023-12-03T11:32:39.434 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.433+0000 7f4d50c67780 1 < canceled multipart upload key=CQPZ0X62207Z upload=4UH2A689SMXL tag=U9I1X97NP735 type=write size=1123230 2023-12-03T11:32:39.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.435+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~M41TL2IL7B9Z.0 size=307457 2023-12-03T11:32:39.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.435+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=M41TL2IL7B9Z tag=HBIVQKW9NT4R type=write size=1356033 2023-12-03T11:32:39.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.436+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~7EM55GI76XJP.0 size=1048576 2023-12-03T11:32:39.438 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.437+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~7EM55GI76XJP.1 size=825113 2023-12-03T11:32:39.441 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.439+0000 7f4d50c67780 1 < completed multipart upload key=ULLPV2G10BME upload=7EM55GI76XJP tag=YBIWZU5I7QM7 type=write size=2922265 2023-12-03T11:32:39.441 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.440+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=THY5AF0H6X9V type=del size=184925 2023-12-03T11:32:39.443 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.442+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~U4BGUAXH9MA6.0 size=1048576 2023-12-03T11:32:39.443 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.443+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~U4BGUAXH9MA6.1 size=728207 2023-12-03T11:32:39.445 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.445+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=U4BGUAXH9MA6 tag=XPBXLOQAEF7H type=write size=2825359 2023-12-03T11:32:39.446 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.446+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=JP1Y5G9AR07Q type=del size=2392491 2023-12-03T11:32:39.448 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.447+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~2SYA00AUZ2R1.0 size=1048576 2023-12-03T11:32:39.449 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.448+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~2SYA00AUZ2R1.1 size=1048576 2023-12-03T11:32:39.450 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.449+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~2SYA00AUZ2R1.2 size=108608 2023-12-03T11:32:39.452 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.451+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=2SYA00AUZ2R1 tag=KKJSNK4N4UIQ type=write size=3254336 2023-12-03T11:32:39.453 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.452+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=VC291WGEPHNJ type=del size=2744545 2023-12-03T11:32:39.455 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.455+0000 7f4d50c67780 1 < suggested update operation key=RF2Q24GI24HJ tag=ZNP0W0PYMKK3 type=del size=1152623 2023-12-03T11:32:39.458 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.457+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~XT1EM9VIHFAQ.0 size=1048576 2023-12-03T11:32:39.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.458+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~XT1EM9VIHFAQ.1 size=981297 2023-12-03T11:32:39.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.458+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=XT1EM9VIHFAQ tag=PF7GWRQDWECN type=write size=3078449 2023-12-03T11:32:39.460 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.459+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=PQLNYF1NXIFA type=del 2023-12-03T11:32:39.461 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.460+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=VOXFXP6CUDTX type=del size=2634770 2023-12-03T11:32:39.462 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.461+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~VMJTDELB9SHM.0 size=1048576 2023-12-03T11:32:39.463 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.462+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~VMJTDELB9SHM.1 size=152143 2023-12-03T11:32:39.465 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.464+0000 7f4d50c67780 1 < completed multipart upload key=ENMJS0KEVS2S upload=VMJTDELB9SHM tag=5UYIKDC8B9E3 type=write size=2249295 2023-12-03T11:32:39.467 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.467+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~5WSL2VVMRCJP.0 size=989475 2023-12-03T11:32:39.468 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.467+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=5WSL2VVMRCJP tag=AORUXP0ZOINX type=write size=2038051 2023-12-03T11:32:39.469 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.468+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~X2KFPXOHOVCN.0 size=1048576 2023-12-03T11:32:39.470 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.469+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~X2KFPXOHOVCN.1 size=536801 2023-12-03T11:32:39.472 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.471+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=X2KFPXOHOVCN tag=2P05PM7WGZD1 type=write size=2633953 2023-12-03T11:32:39.474 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.473+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=XU4XYFYRD0M4 type=del size=2625111 2023-12-03T11:32:39.475 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.474+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~PY7L15IP3NQC.0 size=1048576 2023-12-03T11:32:39.476 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.475+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~PY7L15IP3NQC.1 size=1048576 2023-12-03T11:32:39.477 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.476+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~PY7L15IP3NQC.2 size=303706 2023-12-03T11:32:39.479 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.478+0000 7f4d50c67780 1 < completed multipart upload key=ULLPV2G10BME upload=PY7L15IP3NQC tag=W6QWPPQJ3JZS type=write size=3449434 2023-12-03T11:32:39.480 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.479+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=7K30F0Q1GC4F type=del size=877348 2023-12-03T11:32:39.481 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.480+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~GQGG7NI57C8Q.0 size=1048576 2023-12-03T11:32:39.482 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.481+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~GQGG7NI57C8Q.1 size=38196 2023-12-03T11:32:39.484 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.484+0000 7f4d50c67780 1 < completed multipart upload key=7C7UX0231SHV upload=GQGG7NI57C8Q tag=DO68B3BKPGNE type=write size=2135348 2023-12-03T11:32:39.487 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.486+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~0O5W9ENBPHTQ.0 size=1048576 2023-12-03T11:32:39.488 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.487+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~0O5W9ENBPHTQ.1 size=1048576 2023-12-03T11:32:39.489 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.488+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~0O5W9ENBPHTQ.2 size=349464 2023-12-03T11:32:39.489 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.488+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=0O5W9ENBPHTQ tag=PM23MOYM449O type=write size=3495192 2023-12-03T11:32:39.491 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.491+0000 7f4d50c67780 1 < suggested remove operation key=JR8CIONID4QC tag=87JMK4JNJYBI type=del 2023-12-03T11:32:39.492 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.492+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=08SGGAZQ06C6 type=del size=2077949 2023-12-03T11:32:39.494 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.493+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~O0VJLFJSSC0I.0 size=1048576 2023-12-03T11:32:39.495 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.494+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~O0VJLFJSSC0I.1 size=1048576 2023-12-03T11:32:39.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.495+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~O0VJLFJSSC0I.2 size=792936 2023-12-03T11:32:39.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.497+0000 7f4d50c67780 1 < completed multipart upload key=MLKGLDFFDC3W upload=O0VJLFJSSC0I tag=HJFL7H2JOXNS type=write size=3938664 2023-12-03T11:32:39.501 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.500+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~TMT0W2A2PRSV.0 size=230641 2023-12-03T11:32:39.501 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.500+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=TMT0W2A2PRSV tag=FSJJ82Z736F3 type=write size=1279217 2023-12-03T11:32:39.502 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.501+0000 7f4d50c67780 1 < completed write operation key=JBL6IOJC4TT0 tag=MLZVAQWOB9WX type=write size=771446 2023-12-03T11:32:39.503 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.503+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=BPCG247YUUCL type=del size=451357 2023-12-03T11:32:39.504 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.503+0000 7f4d50c67780 1 < canceled part key=_multipart_CQPZ0X62207Z.2~UCTGZEFOH263.0 size=706815 2023-12-03T11:32:39.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.505+0000 7f4d50c67780 1 < canceled multipart upload key=CQPZ0X62207Z upload=UCTGZEFOH263 tag=41RQ3RD08GX8 type=write size=1755391 2023-12-03T11:32:39.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.507+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~P3O8EID2L92M.0 size=1048576 2023-12-03T11:32:39.509 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.508+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~P3O8EID2L92M.1 size=944177 2023-12-03T11:32:39.509 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.508+0000 7f4d50c67780 1 > prepared multipart upload key=TOGV2BZ99FRF upload=P3O8EID2L92M tag=GA2ADU2OJANY type=write size=3041329 2023-12-03T11:32:39.510 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.509+0000 7f4d50c67780 -1 < no bi entry to suggest for operation key=JR8CIONID4QC tag=S4LKZYDR3A07 type=write size=904838: (2) No such file or directory 2023-12-03T11:32:39.512 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.511+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=RN0PTKIV0EH2 type=del size=1413119 2023-12-03T11:32:39.514 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.513+0000 7f4d50c67780 1 < completed delete operation key=02W4TX7ZCDI6 tag=14Z4PA9YAOTM type=del 2023-12-03T11:32:39.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.514+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=SX2EUIFTV1YE type=write size=680394 2023-12-03T11:32:39.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.514+0000 7f4d50c67780 1 < canceled part key=_multipart_EX93BYX10WJB.2~M41TL2IL7B9Z.0 size=307457 2023-12-03T11:32:39.517 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.516+0000 7f4d50c67780 1 < canceled multipart upload key=EX93BYX10WJB upload=M41TL2IL7B9Z tag=HBIVQKW9NT4R type=write size=1356033 2023-12-03T11:32:39.520 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.519+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~57WJWE119KJY.0 size=336301 2023-12-03T11:32:39.520 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.519+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=57WJWE119KJY tag=5KP6VHI4TC36 type=write size=1384877 2023-12-03T11:32:39.521 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.520+0000 7f4d50c67780 1 < completed delete operation key=ZE19S5UCCZ3C tag=THY5AF0H6X9V type=del 2023-12-03T11:32:39.523 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.522+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~4DUC8VUADMCL.0 size=1048576 2023-12-03T11:32:39.524 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.523+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~4DUC8VUADMCL.1 size=1048576 2023-12-03T11:32:39.525 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.524+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~4DUC8VUADMCL.2 size=13303 2023-12-03T11:32:39.525 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.524+0000 7f4d50c67780 1 > prepared multipart upload key=G0O8EC405LYM upload=4DUC8VUADMCL tag=XQD5ACKF0RC1 type=write size=3159031 2023-12-03T11:32:39.526 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.526+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=JP1Y5G9AR07Q type=del 2023-12-03T11:32:39.528 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.527+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=62FQT9NFPD3T type=del size=1760948 2023-12-03T11:32:39.529 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.528+0000 7f4d50c67780 1 < completed delete operation key=MLKGLDFFDC3W tag=VC291WGEPHNJ type=del 2023-12-03T11:32:39.531 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.531+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~AJJOIY6Q457U.0 size=420098 2023-12-03T11:32:39.531 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.531+0000 7f4d50c67780 1 > prepared multipart upload key=ULLPV2G10BME upload=AJJOIY6Q457U tag=JQQQFCEA4JI7 type=write size=1468674 2023-12-03T11:32:39.533 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.532+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~XT1EM9VIHFAQ.0 size=1048576 2023-12-03T11:32:39.534 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.533+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~XT1EM9VIHFAQ.1 size=981297 2023-12-03T11:32:39.538 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.535+0000 7f4d50c67780 1 < completed multipart upload key=K7YVVH7SAKMC upload=XT1EM9VIHFAQ tag=PF7GWRQDWECN type=write size=3078449 2023-12-03T11:32:39.538 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.536+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=H1WH0YY4BZAP type=write size=933181 2023-12-03T11:32:39.539 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.538+0000 7f4d50c67780 1 < canceled operation key=52E31L45TN7V tag=VOXFXP6CUDTX type=del size=2634770 2023-12-03T11:32:39.541 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.540+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~E4XUF82I1DJ7.0 size=1048576 2023-12-03T11:32:39.541 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.541+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~E4XUF82I1DJ7.1 size=675494 2023-12-03T11:32:39.542 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.541+0000 7f4d50c67780 1 > prepared multipart upload key=YDRAH5EE39R4 upload=E4XUF82I1DJ7 tag=W2P347120RJV type=write size=2772646 2023-12-03T11:32:39.543 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.542+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~5WSL2VVMRCJP.0 size=989475 2023-12-03T11:32:39.545 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.544+0000 7f4d50c67780 1 < completed multipart upload key=MLKGLDFFDC3W upload=5WSL2VVMRCJP tag=AORUXP0ZOINX type=write size=2038051 2023-12-03T11:32:39.547 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.547+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~ACM0T6O2FZ72.0 size=755413 2023-12-03T11:32:39.548 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.547+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=ACM0T6O2FZ72 tag=5P6KW3NQ7GLP type=write size=1803989 2023-12-03T11:32:39.549 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.548+0000 7f4d50c67780 1 < completed delete operation key=K7YVVH7SAKMC tag=XU4XYFYRD0M4 type=del 2023-12-03T11:32:39.551 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.550+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~RNY58XGFBVUE.0 size=420610 2023-12-03T11:32:39.551 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.550+0000 7f4d50c67780 1 > prepared multipart upload key=TOGV2BZ99FRF upload=RNY58XGFBVUE tag=6KQN5VM2CGCW type=write size=1469186 2023-12-03T11:32:39.552 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.552+0000 7f4d50c67780 1 < completed delete operation key=WUM939BATDG9 tag=7K30F0Q1GC4F type=del 2023-12-03T11:32:39.554 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.553+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=AXE9ZS2375ST type=write size=181617 2023-12-03T11:32:39.555 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.554+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~0O5W9ENBPHTQ.0 size=1048576 2023-12-03T11:32:39.556 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.555+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~0O5W9ENBPHTQ.1 size=1048576 2023-12-03T11:32:39.557 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.556+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~0O5W9ENBPHTQ.2 size=349464 2023-12-03T11:32:39.559 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.558+0000 7f4d50c67780 1 < completed multipart upload key=V0ND3OBFJJUB upload=0O5W9ENBPHTQ tag=PM23MOYM449O type=write size=3495192 2023-12-03T11:32:39.560 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.560+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=V24FO8I9U3P9 type=del size=3256849 2023-12-03T11:32:39.562 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.561+0000 7f4d50c67780 1 < canceled operation key=XM5E3D99MXVA tag=08SGGAZQ06C6 type=del size=2077949 2023-12-03T11:32:39.564 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.563+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~B5U95RG0OSQ2.0 size=970460 2023-12-03T11:32:39.564 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.563+0000 7f4d50c67780 1 > prepared multipart upload key=JR8CIONID4QC upload=B5U95RG0OSQ2 tag=TVU7IRUV6GIK type=write size=2019036 2023-12-03T11:32:39.565 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.564+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~TMT0W2A2PRSV.0 size=230641 2023-12-03T11:32:39.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.566+0000 7f4d50c67780 1 < completed multipart upload key=CQPZ0X62207Z upload=TMT0W2A2PRSV tag=FSJJ82Z736F3 type=write size=1279217 2023-12-03T11:32:39.569 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.568+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~58AX7H235ATP.0 size=1048576 2023-12-03T11:32:39.570 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.569+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~58AX7H235ATP.1 size=798084 2023-12-03T11:32:39.570 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.569+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=58AX7H235ATP tag=0AVN0M33WFPM type=write size=2895236 2023-12-03T11:32:39.571 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.570+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=BPCG247YUUCL type=del 2023-12-03T11:32:39.573 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.572+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~PCFK7BZQD4H5.0 size=1048576 2023-12-03T11:32:39.574 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.573+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~PCFK7BZQD4H5.1 size=518515 2023-12-03T11:32:39.574 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.573+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=PCFK7BZQD4H5 tag=UYY1Q5356KZQ type=write size=2615667 2023-12-03T11:32:39.575 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.574+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~P3O8EID2L92M.0 size=1048576 2023-12-03T11:32:39.576 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.575+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~P3O8EID2L92M.1 size=944177 2023-12-03T11:32:39.578 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.577+0000 7f4d50c67780 1 < completed multipart upload key=TOGV2BZ99FRF upload=P3O8EID2L92M tag=GA2ADU2OJANY type=write size=3041329 2023-12-03T11:32:39.580 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.579+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~RJXPFWW2AB57.0 size=1048576 2023-12-03T11:32:39.581 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.580+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~RJXPFWW2AB57.1 size=1048576 2023-12-03T11:32:39.582 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.581+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~RJXPFWW2AB57.2 size=648110 2023-12-03T11:32:39.582 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.581+0000 7f4d50c67780 1 > prepared multipart upload key=ENMJS0KEVS2S upload=RJXPFWW2AB57 tag=O6FMP1VN34HT type=write size=3793838 2023-12-03T11:32:39.584 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.583+0000 7f4d50c67780 1 < completed delete operation key=7C7UX0231SHV tag=RN0PTKIV0EH2 type=del 2023-12-03T11:32:39.585 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.584+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=3B7WWZ3WWXJF type=del size=3165895 2023-12-03T11:32:39.588 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.587+0000 7f4d50c67780 1 < suggested remove operation key=CQPZ0X62207Z tag=SX2EUIFTV1YE type=write 2023-12-03T11:32:39.589 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.588+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=D54HEBCFGMDA type=del size=2195597 2023-12-03T11:32:39.591 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.590+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~57WJWE119KJY.0 size=336301 2023-12-03T11:32:39.593 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.592+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=57WJWE119KJY tag=5KP6VHI4TC36 type=write size=1384877 2023-12-03T11:32:39.594 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.593+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=7QV91OLYXODI type=del size=569708 2023-12-03T11:32:39.595 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.594+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~4DUC8VUADMCL.0 size=1048576 2023-12-03T11:32:39.596 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.596+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~4DUC8VUADMCL.1 size=1048576 2023-12-03T11:32:39.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.596+0000 7f4d50c67780 1 < canceled part key=_multipart_G0O8EC405LYM.2~4DUC8VUADMCL.2 size=13303 2023-12-03T11:32:39.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.598+0000 7f4d50c67780 1 < canceled multipart upload key=G0O8EC405LYM upload=4DUC8VUADMCL tag=XQD5ACKF0RC1 type=write size=3159031 2023-12-03T11:32:39.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.600+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~FL4JOZI1US7X.0 size=1048576 2023-12-03T11:32:39.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.601+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~FL4JOZI1US7X.1 size=1048576 2023-12-03T11:32:39.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.602+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~FL4JOZI1US7X.2 size=202552 2023-12-03T11:32:39.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.602+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=FL4JOZI1US7X tag=OGT0WNDT8GXA type=write size=3348280 2023-12-03T11:32:39.604 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.603+0000 7f4d50c67780 1 < completed delete operation key=ZE19S5UCCZ3C tag=62FQT9NFPD3T type=del 2023-12-03T11:32:39.605 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.605+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=02KA0RNU4QFK type=del size=1271551 2023-12-03T11:32:39.607 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.606+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~AJJOIY6Q457U.0 size=420098 2023-12-03T11:32:39.609 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.608+0000 7f4d50c67780 1 < completed multipart upload key=ULLPV2G10BME upload=AJJOIY6Q457U tag=JQQQFCEA4JI7 type=write size=1468674 2023-12-03T11:32:39.611 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.611+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~CFYESQSH0N28.0 size=1048576 2023-12-03T11:32:39.612 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.612+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~CFYESQSH0N28.1 size=1048576 2023-12-03T11:32:39.613 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.613+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~CFYESQSH0N28.2 size=1042085 2023-12-03T11:32:39.613 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.613+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=CFYESQSH0N28 tag=JOHBREOP0ZSR type=write size=4187813 2023-12-03T11:32:39.616 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.615+0000 7f4d50c67780 1 < suggested remove operation key=MLKGLDFFDC3W tag=H1WH0YY4BZAP type=write 2023-12-03T11:32:39.617 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.616+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=2S7NSAIVWV6L type=del size=2406108 2023-12-03T11:32:39.618 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.618+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~E4XUF82I1DJ7.0 size=1048576 2023-12-03T11:32:39.619 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.619+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~E4XUF82I1DJ7.1 size=675494 2023-12-03T11:32:39.622 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.621+0000 7f4d50c67780 1 < completed multipart upload key=YDRAH5EE39R4 upload=E4XUF82I1DJ7 tag=W2P347120RJV type=write size=2772646 2023-12-03T11:32:39.624 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.623+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~D1YMGZLH3TKD.0 size=1048576 2023-12-03T11:32:39.625 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.624+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~D1YMGZLH3TKD.1 size=1048576 2023-12-03T11:32:39.626 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.625+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~D1YMGZLH3TKD.2 size=676663 2023-12-03T11:32:39.626 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.625+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=D1YMGZLH3TKD tag=0ITHB6YAAKI7 type=write size=3822391 2023-12-03T11:32:39.628 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.627+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~ACM0T6O2FZ72.0 size=755413 2023-12-03T11:32:39.630 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.629+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=ACM0T6O2FZ72 tag=5P6KW3NQ7GLP type=write size=1803989 2023-12-03T11:32:39.631 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.630+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=D79E1AMBD3TL type=write size=155113 2023-12-03T11:32:39.632 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.631+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~RNY58XGFBVUE.0 size=420610 2023-12-03T11:32:39.634 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.633+0000 7f4d50c67780 1 < completed multipart upload key=TOGV2BZ99FRF upload=RNY58XGFBVUE tag=6KQN5VM2CGCW type=write size=1469186 2023-12-03T11:32:39.635 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.634+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=XLO60VG48X92 type=write size=850160 2023-12-03T11:32:39.636 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.636+0000 7f4d50c67780 1 < canceled operation key=52E31L45TN7V tag=AXE9ZS2375ST type=write size=181617 2023-12-03T11:32:39.639 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.638+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~2SMU2C85JN9G.0 size=1048576 2023-12-03T11:32:39.639 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.639+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~2SMU2C85JN9G.1 size=957284 2023-12-03T11:32:39.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.639+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=2SMU2C85JN9G tag=QW8BPTAEBX6Q type=write size=3054436 2023-12-03T11:32:39.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.640+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=V24FO8I9U3P9 type=del 2023-12-03T11:32:39.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.641+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=PWVBNOC40UA3 type=del size=2026318 2023-12-03T11:32:39.643 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.642+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~B5U95RG0OSQ2.0 size=970460 2023-12-03T11:32:39.645 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.645+0000 7f4d50c67780 1 < completed multipart upload key=JR8CIONID4QC upload=B5U95RG0OSQ2 tag=TVU7IRUV6GIK type=write size=2019036 2023-12-03T11:32:39.647 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.646+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=HNXV3QL5CZST type=write size=331373 2023-12-03T11:32:39.648 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.647+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~58AX7H235ATP.0 size=1048576 2023-12-03T11:32:39.649 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.648+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~58AX7H235ATP.1 size=798084 2023-12-03T11:32:39.651 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.650+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=58AX7H235ATP tag=0AVN0M33WFPM type=write size=2895236 2023-12-03T11:32:39.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.652+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=05T4Z2J2G75Z type=del size=1318778 2023-12-03T11:32:39.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.653+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~PCFK7BZQD4H5.0 size=1048576 2023-12-03T11:32:39.655 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.654+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~PCFK7BZQD4H5.1 size=518515 2023-12-03T11:32:39.657 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.656+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=PCFK7BZQD4H5 tag=UYY1Q5356KZQ type=write size=2615667 2023-12-03T11:32:39.659 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.658+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~XGLM6NIAYXGB.0 size=678739 2023-12-03T11:32:39.659 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.658+0000 7f4d50c67780 1 > prepared multipart upload key=YDRAH5EE39R4 upload=XGLM6NIAYXGB tag=JO31X8LRF7W7 type=write size=1727315 2023-12-03T11:32:39.659 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.658+0000 7f4d50c67780 1 < canceled part key=_multipart_ENMJS0KEVS2S.2~RJXPFWW2AB57.0 size=1048576 2023-12-03T11:32:39.660 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.660+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~RJXPFWW2AB57.1 size=1048576 2023-12-03T11:32:39.661 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.661+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~RJXPFWW2AB57.2 size=648110 2023-12-03T11:32:39.663 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.663+0000 7f4d50c67780 1 < canceled multipart upload key=ENMJS0KEVS2S upload=RJXPFWW2AB57 tag=O6FMP1VN34HT type=write size=3793838 2023-12-03T11:32:39.665 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.664+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=R1R2NATZNGO3 type=write size=251891 2023-12-03T11:32:39.666 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.665+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=3B7WWZ3WWXJF type=del 2023-12-03T11:32:39.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.666+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=YFVST2MI4B2W type=write size=337346 2023-12-03T11:32:39.670 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.669+0000 7f4d50c67780 1 < suggested update operation key=02W4TX7ZCDI6 tag=D54HEBCFGMDA type=del size=2195597 2023-12-03T11:32:39.671 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.670+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=OMIG0JSTPSPZ type=del size=2094335 2023-12-03T11:32:39.672 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.671+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=7QV91OLYXODI type=del 2023-12-03T11:32:39.674 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.674+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~GAQ72WBCR8LZ.0 size=1048576 2023-12-03T11:32:39.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.674+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~GAQ72WBCR8LZ.1 size=1048576 2023-12-03T11:32:39.676 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.676+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~GAQ72WBCR8LZ.2 size=75084 2023-12-03T11:32:39.676 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.676+0000 7f4d50c67780 1 > prepared multipart upload key=JBL6IOJC4TT0 upload=GAQ72WBCR8LZ tag=2PRWUVG5VFVF type=write size=3220812 2023-12-03T11:32:39.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.677+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~FL4JOZI1US7X.0 size=1048576 2023-12-03T11:32:39.679 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.678+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~FL4JOZI1US7X.1 size=1048576 2023-12-03T11:32:39.680 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.679+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~FL4JOZI1US7X.2 size=202552 2023-12-03T11:32:39.681 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.681+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=FL4JOZI1US7X tag=OGT0WNDT8GXA type=write size=3348280 2023-12-03T11:32:39.683 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.682+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=FZQKFXFO6RJE type=del size=2256604 2023-12-03T11:32:39.684 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.683+0000 7f4d50c67780 1 < completed delete operation key=TEIYINZFFG76 tag=02KA0RNU4QFK type=del 2023-12-03T11:32:39.686 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.685+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~GND2NQ3O9DZ8.0 size=1048576 2023-12-03T11:32:39.687 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.686+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~GND2NQ3O9DZ8.1 size=1048576 2023-12-03T11:32:39.688 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.687+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~GND2NQ3O9DZ8.2 size=504388 2023-12-03T11:32:39.688 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.687+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=GND2NQ3O9DZ8 tag=P2DI99MPG0A8 type=write size=3650116 2023-12-03T11:32:39.689 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.688+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~CFYESQSH0N28.0 size=1048576 2023-12-03T11:32:39.690 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.689+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~CFYESQSH0N28.1 size=1048576 2023-12-03T11:32:39.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.690+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~CFYESQSH0N28.2 size=1042085 2023-12-03T11:32:39.692 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.692+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=CFYESQSH0N28 tag=JOHBREOP0ZSR type=write size=4187813 2023-12-03T11:32:39.694 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.693+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=DV64C1UXT6WZ type=write size=667492 2023-12-03T11:32:39.695 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.694+0000 7f4d50c67780 1 < completed delete operation key=EX93BYX10WJB tag=2S7NSAIVWV6L type=del 2023-12-03T11:32:39.696 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.695+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=1GV6UO3URCBP type=del size=608318 2023-12-03T11:32:39.698 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.697+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~D1YMGZLH3TKD.0 size=1048576 2023-12-03T11:32:39.699 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.698+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~D1YMGZLH3TKD.1 size=1048576 2023-12-03T11:32:39.700 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.699+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~D1YMGZLH3TKD.2 size=676663 2023-12-03T11:32:39.702 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.701+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=D1YMGZLH3TKD tag=0ITHB6YAAKI7 type=write size=3822391 2023-12-03T11:32:39.703 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.702+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=CR1GA8D9Q1XS type=del size=3262888 2023-12-03T11:32:39.706 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.705+0000 7f4d50c67780 1 < suggested update operation key=EX93BYX10WJB tag=D79E1AMBD3TL type=write size=155113 2023-12-03T11:32:39.707 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.706+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=PQKEHK9VF6X9 type=del size=3469455 2023-12-03T11:32:39.708 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.708+0000 7f4d50c67780 1 < completed write operation key=YDRAH5EE39R4 tag=XLO60VG48X92 type=write size=850160 2023-12-03T11:32:39.710 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.709+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=2HPN9TAYHL8U type=del size=2811277 2023-12-03T11:32:39.710 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.709+0000 7f4d50c67780 1 < canceled part key=_multipart_8J1EO2JDQUQH.2~2SMU2C85JN9G.0 size=1048576 2023-12-03T11:32:39.711 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.710+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~2SMU2C85JN9G.1 size=957284 2023-12-03T11:32:39.713 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.712+0000 7f4d50c67780 1 < canceled multipart upload key=8J1EO2JDQUQH upload=2SMU2C85JN9G tag=QW8BPTAEBX6Q type=write size=3054436 2023-12-03T11:32:39.714 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.713+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=WS8NXFVCHUD8 type=del size=2288553 2023-12-03T11:32:39.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.715+0000 7f4d50c67780 1 < completed delete operation key=JR8CIONID4QC tag=PWVBNOC40UA3 type=del 2023-12-03T11:32:39.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.717+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~QL21TREUHWWA.0 size=800291 2023-12-03T11:32:39.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.717+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=QL21TREUHWWA tag=9GRX0Q444Y4N type=write size=1848867 2023-12-03T11:32:39.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.720+0000 7f4d50c67780 1 < suggested update operation key=83I1M5WIVKAA tag=HNXV3QL5CZST type=write size=331373 2023-12-03T11:32:39.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.721+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=LRNNIMVTQD32 type=del size=2390505 2023-12-03T11:32:39.725 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.724+0000 7f4d50c67780 1 < suggested remove operation key=0M6ZAD39I852 tag=05T4Z2J2G75Z type=del 2023-12-03T11:32:39.726 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.725+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=6M1X2JYU8OOI type=write size=363875 2023-12-03T11:32:39.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.726+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~XGLM6NIAYXGB.0 size=678739 2023-12-03T11:32:39.729 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.728+0000 7f4d50c67780 1 < completed multipart upload key=YDRAH5EE39R4 upload=XGLM6NIAYXGB tag=JO31X8LRF7W7 type=write size=1727315 2023-12-03T11:32:39.730 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.729+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=UO03KFWYI2KD type=write size=297238 2023-12-03T11:32:39.731 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.730+0000 7f4d50c67780 1 < completed write operation key=BX5POXMMYLB7 tag=R1R2NATZNGO3 type=write size=251891 2023-12-03T11:32:39.732 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.732+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=HUS6DTG4FSIC type=del size=2045040 2023-12-03T11:32:39.734 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.733+0000 7f4d50c67780 1 < completed write operation key=K7YVVH7SAKMC tag=YFVST2MI4B2W type=write size=337346 2023-12-03T11:32:39.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.734+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=BI7SBHTQZLT9 type=del size=2607750 2023-12-03T11:32:39.737 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.737+0000 7f4d50c67780 1 < suggested update operation key=V0ND3OBFJJUB tag=OMIG0JSTPSPZ type=del size=2094335 2023-12-03T11:32:39.740 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.739+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~JCX8N62PBZ3L.0 size=1048576 2023-12-03T11:32:39.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.740+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~JCX8N62PBZ3L.1 size=1048576 2023-12-03T11:32:39.743 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.742+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~JCX8N62PBZ3L.2 size=926146 2023-12-03T11:32:39.743 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.742+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=JCX8N62PBZ3L tag=0443KMET3YPY type=write size=4071874 2023-12-03T11:32:39.744 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.743+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~GAQ72WBCR8LZ.0 size=1048576 2023-12-03T11:32:39.746 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.745+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~GAQ72WBCR8LZ.1 size=1048576 2023-12-03T11:32:39.747 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.746+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~GAQ72WBCR8LZ.2 size=75084 2023-12-03T11:32:39.749 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.748+0000 7f4d50c67780 1 < completed multipart upload key=JBL6IOJC4TT0 upload=GAQ72WBCR8LZ tag=2PRWUVG5VFVF type=write size=3220812 2023-12-03T11:32:39.750 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.749+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=16P8612OE1DY type=write size=457096 2023-12-03T11:32:39.752 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.751+0000 7f4d50c67780 -1 < failed to complete operation key=EX93BYX10WJB tag=FZQKFXFO6RJE type=del size=2256604: (22) Invalid argument 2023-12-03T11:32:39.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.753+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~3S9DZKUXHRS9.0 size=195016 2023-12-03T11:32:39.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.753+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=3S9DZKUXHRS9 tag=F7B9WRVZSHI2 type=write size=1243592 2023-12-03T11:32:39.755 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.754+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~GND2NQ3O9DZ8.0 size=1048576 2023-12-03T11:32:39.756 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.755+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~GND2NQ3O9DZ8.1 size=1048576 2023-12-03T11:32:39.757 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.756+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~GND2NQ3O9DZ8.2 size=504388 2023-12-03T11:32:39.759 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.758+0000 7f4d50c67780 1 < completed multipart upload key=V0ND3OBFJJUB upload=GND2NQ3O9DZ8 tag=P2DI99MPG0A8 type=write size=3650116 2023-12-03T11:32:39.761 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.760+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~TUV58UWXZBGW.0 size=483571 2023-12-03T11:32:39.761 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.760+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=TUV58UWXZBGW tag=O9XILJBWZ5SP type=write size=1532147 2023-12-03T11:32:39.762 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.761+0000 7f4d50c67780 1 < completed write operation key=8J1EO2JDQUQH tag=DV64C1UXT6WZ type=write size=667492 2023-12-03T11:32:39.763 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.762+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=PS25N6QLJWXZ type=del size=97653 2023-12-03T11:32:39.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.763+0000 7f4d50c67780 1 < completed delete operation key=7C7UX0231SHV tag=1GV6UO3URCBP type=del 2023-12-03T11:32:39.765 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.765+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=1ALI3F1ED6OW type=del size=2014437 2023-12-03T11:32:39.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.767+0000 7f4d50c67780 1 < suggested remove operation key=MLKGLDFFDC3W tag=CR1GA8D9Q1XS type=del 2023-12-03T11:32:39.769 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.768+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=5ERW8QQK2XL0 type=write size=30378 2023-12-03T11:32:39.770 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.769+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=PQKEHK9VF6X9 type=del 2023-12-03T11:32:39.771 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.771+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=7P6VMLS6QMR6 type=del size=3935883 2023-12-03T11:32:39.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.772+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=2HPN9TAYHL8U type=del 2023-12-03T11:32:39.775 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.774+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~WTVBJNT2RG6X.0 size=501790 2023-12-03T11:32:39.775 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.774+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=WTVBJNT2RG6X tag=1YUGFSTP1M6G type=write size=1550366 2023-12-03T11:32:39.776 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.775+0000 7f4d50c67780 1 < completed delete operation key=YDRAH5EE39R4 tag=WS8NXFVCHUD8 type=del 2023-12-03T11:32:39.778 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.777+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~2V318QO57DJK.0 size=1048576 2023-12-03T11:32:39.779 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.779+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~2V318QO57DJK.1 size=144006 2023-12-03T11:32:39.779 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.779+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=2V318QO57DJK tag=RA4LHAIU0JQK type=write size=2241158 2023-12-03T11:32:39.780 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.779+0000 7f4d50c67780 1 < canceled part key=_multipart_GTLP2WZUX7U8.2~QL21TREUHWWA.0 size=800291 2023-12-03T11:32:39.782 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.781+0000 7f4d50c67780 1 < canceled multipart upload key=GTLP2WZUX7U8 upload=QL21TREUHWWA tag=9GRX0Q444Y4N type=write size=1848867 2023-12-03T11:32:39.783 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.782+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=00P1DP1UCYKE type=del size=3986415 2023-12-03T11:32:39.784 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.783+0000 7f4d50c67780 1 < completed delete operation key=TEIYINZFFG76 tag=LRNNIMVTQD32 type=del 2023-12-03T11:32:39.785 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.784+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=1VEC9U40ONU7 type=del size=1383776 2023-12-03T11:32:39.787 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.786+0000 7f4d50c67780 1 < canceled operation key=ZE19S5UCCZ3C tag=6M1X2JYU8OOI type=write size=363875 2023-12-03T11:32:39.789 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.788+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~AHDSEZEJZHTW.0 size=278574 2023-12-03T11:32:39.789 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.788+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=AHDSEZEJZHTW tag=IQG3WRTVVXHI type=write size=1327150 2023-12-03T11:32:39.790 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.789+0000 7f4d50c67780 1 < completed write operation key=ENMJS0KEVS2S tag=UO03KFWYI2KD type=write size=297238 2023-12-03T11:32:39.792 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.792+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~80WOMHHAC0LO.0 size=1048576 2023-12-03T11:32:39.794 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.793+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~80WOMHHAC0LO.1 size=122205 2023-12-03T11:32:39.794 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.793+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=80WOMHHAC0LO tag=AF2RPGK41KQX type=write size=2219357 2023-12-03T11:32:39.795 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.794+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=HUS6DTG4FSIC type=del 2023-12-03T11:32:39.797 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.796+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~L9HS043E8GAO.0 size=866403 2023-12-03T11:32:39.797 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.796+0000 7f4d50c67780 1 > prepared multipart upload key=ENMJS0KEVS2S upload=L9HS043E8GAO tag=P0TBVBFEPR5F type=write size=1914979 2023-12-03T11:32:39.799 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.798+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=BI7SBHTQZLT9 type=del 2023-12-03T11:32:39.800 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.799+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=2D3WOJ95M182 type=del size=908136 2023-12-03T11:32:39.801 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.800+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~JCX8N62PBZ3L.0 size=1048576 2023-12-03T11:32:39.802 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.801+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~JCX8N62PBZ3L.1 size=1048576 2023-12-03T11:32:39.803 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.802+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~JCX8N62PBZ3L.2 size=926146 2023-12-03T11:32:39.805 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.804+0000 7f4d50c67780 1 < completed multipart upload key=K7YVVH7SAKMC upload=JCX8N62PBZ3L tag=0443KMET3YPY type=write size=4071874 2023-12-03T11:32:39.807 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.806+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~1JQ932MF50JM.0 size=1048576 2023-12-03T11:32:39.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.807+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~1JQ932MF50JM.1 size=1048576 2023-12-03T11:32:39.809 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.808+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~1JQ932MF50JM.2 size=65239 2023-12-03T11:32:39.809 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.808+0000 7f4d50c67780 1 > prepared multipart upload key=YDRAH5EE39R4 upload=1JQ932MF50JM tag=1XH9VAORILZQ type=write size=3210967 2023-12-03T11:32:39.811 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.810+0000 7f4d50c67780 1 < completed write operation key=XM5E3D99MXVA tag=16P8612OE1DY type=write size=457096 2023-12-03T11:32:39.813 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.812+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~D96QH32JA26D.0 size=372294 2023-12-03T11:32:39.813 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.812+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=D96QH32JA26D tag=HQA8RW4H5EUO type=write size=1420870 2023-12-03T11:32:39.814 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.813+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~3S9DZKUXHRS9.0 size=195016 2023-12-03T11:32:39.816 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.815+0000 7f4d50c67780 1 < completed multipart upload key=EAP0BYZTTT2E upload=3S9DZKUXHRS9 tag=F7B9WRVZSHI2 type=write size=1243592 2023-12-03T11:32:39.818 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.817+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~X2IVPK4Y4NRY.0 size=700573 2023-12-03T11:32:39.818 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.817+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=X2IVPK4Y4NRY tag=1D2692DHWFWS type=write size=1749149 2023-12-03T11:32:39.819 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.818+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~TUV58UWXZBGW.0 size=483571 2023-12-03T11:32:39.821 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.821+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=TUV58UWXZBGW tag=O9XILJBWZ5SP type=write size=1532147 2023-12-03T11:32:39.823 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.823+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~YJOTLEO7905T.0 size=1048576 2023-12-03T11:32:39.825 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.824+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~YJOTLEO7905T.1 size=160886 2023-12-03T11:32:39.825 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.824+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=YJOTLEO7905T tag=ULFFHHMPV4QG type=write size=2258038 2023-12-03T11:32:39.826 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.825+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=PS25N6QLJWXZ type=del 2023-12-03T11:32:39.828 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.827+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~8ZXGL4QCYCYT.0 size=1048576 2023-12-03T11:32:39.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.828+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~8ZXGL4QCYCYT.1 size=1048576 2023-12-03T11:32:39.830 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.829+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~8ZXGL4QCYCYT.2 size=207348 2023-12-03T11:32:39.830 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.829+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=8ZXGL4QCYCYT tag=N1LNJOYTZ0F6 type=write size=3353076 2023-12-03T11:32:39.831 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.830+0000 7f4d50c67780 1 < completed delete operation key=V0ND3OBFJJUB tag=1ALI3F1ED6OW type=del 2023-12-03T11:32:39.832 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.831+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=FK38ETBBWSND type=del size=3888045 2023-12-03T11:32:39.834 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.833+0000 7f4d50c67780 1 < completed write operation key=52E31L45TN7V tag=5ERW8QQK2XL0 type=write size=30378 2023-12-03T11:32:39.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.834+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=SOTIPWP2UOT6 type=del size=2263333 2023-12-03T11:32:39.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.835+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=7P6VMLS6QMR6 type=del 2023-12-03T11:32:39.838 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.838+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~CA84WRMDWQZY.0 size=1048576 2023-12-03T11:32:39.839 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.839+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~CA84WRMDWQZY.1 size=1048576 2023-12-03T11:32:39.841 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.840+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~CA84WRMDWQZY.2 size=746104 2023-12-03T11:32:39.841 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.840+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=CA84WRMDWQZY tag=CQSB7ZXJK0HR type=write size=3891832 2023-12-03T11:32:39.842 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.841+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~WTVBJNT2RG6X.0 size=501790 2023-12-03T11:32:39.844 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.843+0000 7f4d50c67780 1 < completed multipart upload key=CQPZ0X62207Z upload=WTVBJNT2RG6X tag=1YUGFSTP1M6G type=write size=1550366 2023-12-03T11:32:39.845 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.844+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=AM5FVQ8F33NK type=del size=677529 2023-12-03T11:32:39.846 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.845+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~2V318QO57DJK.0 size=1048576 2023-12-03T11:32:39.847 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.847+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~2V318QO57DJK.1 size=144006 2023-12-03T11:32:39.849 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.849+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=2V318QO57DJK tag=RA4LHAIU0JQK type=write size=2241158 2023-12-03T11:32:39.852 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.851+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~2OV1TMHD7968.0 size=631445 2023-12-03T11:32:39.852 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.851+0000 7f4d50c67780 1 > prepared multipart upload key=JBL6IOJC4TT0 upload=2OV1TMHD7968 tag=J6QKJIXXRD3H type=write size=1680021 2023-12-03T11:32:39.853 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.852+0000 7f4d50c67780 1 < completed delete operation key=73SL3ZBBDA6Q tag=00P1DP1UCYKE type=del 2023-12-03T11:32:39.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.853+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=D2777VNK98G9 type=del size=713853 2023-12-03T11:32:39.855 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.855+0000 7f4d50c67780 1 < completed delete operation key=YDRAH5EE39R4 tag=1VEC9U40ONU7 type=del 2023-12-03T11:32:39.857 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.857+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=ICVF1HUO9CIV type=del size=3625331 2023-12-03T11:32:39.859 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.858+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~AHDSEZEJZHTW.0 size=278574 2023-12-03T11:32:39.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.860+0000 7f4d50c67780 1 < completed multipart upload key=K7YVVH7SAKMC upload=AHDSEZEJZHTW tag=IQG3WRTVVXHI type=write size=1327150 2023-12-03T11:32:39.862 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.861+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=0PHYJNVVTZO1 type=del size=1301044 2023-12-03T11:32:39.863 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.862+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~80WOMHHAC0LO.0 size=1048576 2023-12-03T11:32:39.864 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.863+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~80WOMHHAC0LO.1 size=122205 2023-12-03T11:32:39.866 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.866+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=80WOMHHAC0LO tag=AF2RPGK41KQX type=write size=2219357 2023-12-03T11:32:39.869 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.868+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~05FMCXBBDGJF.0 size=1048576 2023-12-03T11:32:39.870 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.869+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~05FMCXBBDGJF.1 size=1048576 2023-12-03T11:32:39.871 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.870+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~05FMCXBBDGJF.2 size=273361 2023-12-03T11:32:39.871 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.870+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=05FMCXBBDGJF tag=WGSXTMYQW7Y5 type=write size=3419089 2023-12-03T11:32:39.872 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.871+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~L9HS043E8GAO.0 size=866403 2023-12-03T11:32:39.874 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.873+0000 7f4d50c67780 1 < completed multipart upload key=ENMJS0KEVS2S upload=L9HS043E8GAO tag=P0TBVBFEPR5F type=write size=1914979 2023-12-03T11:32:39.876 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.875+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~CJ0FV8QK0VWB.0 size=1048576 2023-12-03T11:32:39.877 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.876+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~CJ0FV8QK0VWB.1 size=484564 2023-12-03T11:32:39.877 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.876+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=CJ0FV8QK0VWB tag=4CIZ85K1TYBJ type=write size=2581716 2023-12-03T11:32:39.878 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.878+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=2D3WOJ95M182 type=del 2023-12-03T11:32:39.881 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.880+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~N4ML9GOQ0KBX.0 size=1048576 2023-12-03T11:32:39.882 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.881+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~N4ML9GOQ0KBX.1 size=1048576 2023-12-03T11:32:39.882 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.882+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~N4ML9GOQ0KBX.2 size=1021589 2023-12-03T11:32:39.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.882+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=N4ML9GOQ0KBX tag=3MDN65IGNW92 type=write size=4167317 2023-12-03T11:32:39.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.883+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~1JQ932MF50JM.0 size=1048576 2023-12-03T11:32:39.885 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.884+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~1JQ932MF50JM.1 size=1048576 2023-12-03T11:32:39.885 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.885+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~1JQ932MF50JM.2 size=65239 2023-12-03T11:32:39.887 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.887+0000 7f4d50c67780 1 < completed multipart upload key=YDRAH5EE39R4 upload=1JQ932MF50JM tag=1XH9VAORILZQ type=write size=3210967 2023-12-03T11:32:39.890 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.889+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~E0XDQP8LR9D2.0 size=1048576 2023-12-03T11:32:39.891 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.890+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~E0XDQP8LR9D2.1 size=1048576 2023-12-03T11:32:39.892 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.891+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~E0XDQP8LR9D2.2 size=560341 2023-12-03T11:32:39.892 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.891+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=E0XDQP8LR9D2 tag=6966XRLARKR6 type=write size=3706069 2023-12-03T11:32:39.893 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.892+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~D96QH32JA26D.0 size=372294 2023-12-03T11:32:39.895 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.894+0000 7f4d50c67780 1 < completed multipart upload key=MLKGLDFFDC3W upload=D96QH32JA26D tag=HQA8RW4H5EUO type=write size=1420870 2023-12-03T11:32:39.896 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.895+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=P4FSPLHYX5Y5 type=del size=1821949 2023-12-03T11:32:39.897 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.896+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~X2IVPK4Y4NRY.0 size=700573 2023-12-03T11:32:39.899 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.898+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=X2IVPK4Y4NRY tag=1D2692DHWFWS type=write size=1749149 2023-12-03T11:32:39.901 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.900+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~OS6QR9ZNY373.0 size=1048576 2023-12-03T11:32:39.902 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.901+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~OS6QR9ZNY373.1 size=511208 2023-12-03T11:32:39.902 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.901+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=OS6QR9ZNY373 tag=HADF3CR79XML type=write size=2608360 2023-12-03T11:32:39.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.902+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~YJOTLEO7905T.0 size=1048576 2023-12-03T11:32:39.904 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.903+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~YJOTLEO7905T.1 size=160886 2023-12-03T11:32:39.906 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.905+0000 7f4d50c67780 1 < completed multipart upload key=02W4TX7ZCDI6 upload=YJOTLEO7905T tag=ULFFHHMPV4QG type=write size=2258038 2023-12-03T11:32:39.907 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.906+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=1P1TYKEY7EYJ type=del size=3491304 2023-12-03T11:32:39.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.908+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~8ZXGL4QCYCYT.0 size=1048576 2023-12-03T11:32:39.909 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.909+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~8ZXGL4QCYCYT.1 size=1048576 2023-12-03T11:32:39.910 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.910+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~8ZXGL4QCYCYT.2 size=207348 2023-12-03T11:32:39.912 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.912+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=8ZXGL4QCYCYT tag=N1LNJOYTZ0F6 type=write size=3353076 2023-12-03T11:32:39.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.914+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~EMZTQ3KXX9NY.0 size=638487 2023-12-03T11:32:39.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.914+0000 7f4d50c67780 1 > prepared multipart upload key=JR8CIONID4QC upload=EMZTQ3KXX9NY tag=GC3H8Q4VEMPS type=write size=1687063 2023-12-03T11:32:39.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.915+0000 7f4d50c67780 1 < canceled operation key=U6R5Y9JXKT32 tag=FK38ETBBWSND type=del size=3888045 2023-12-03T11:32:39.918 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.917+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~OA1M683OQB83.0 size=89591 2023-12-03T11:32:39.918 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.917+0000 7f4d50c67780 1 > prepared multipart upload key=RF2Q24GI24HJ upload=OA1M683OQB83 tag=THW726TYYY6B type=write size=1138167 2023-12-03T11:32:39.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.918+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=SOTIPWP2UOT6 type=del 2023-12-03T11:32:39.921 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.921+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~U9I67PDMWRMW.0 size=1048576 2023-12-03T11:32:39.922 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.922+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~U9I67PDMWRMW.1 size=556545 2023-12-03T11:32:39.922 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.922+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=U9I67PDMWRMW tag=G48QPE1UCR38 type=write size=2653697 2023-12-03T11:32:39.924 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.923+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~CA84WRMDWQZY.0 size=1048576 2023-12-03T11:32:39.925 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.924+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~CA84WRMDWQZY.1 size=1048576 2023-12-03T11:32:39.925 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.925+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~CA84WRMDWQZY.2 size=746104 2023-12-03T11:32:39.928 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.927+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=CA84WRMDWQZY tag=CQSB7ZXJK0HR type=write size=3891832 2023-12-03T11:32:39.929 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.928+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=IFGFLCW0KMJ1 type=del size=3202719 2023-12-03T11:32:39.930 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.929+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=AM5FVQ8F33NK type=del 2023-12-03T11:32:39.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.930+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=GBO1VA3UO3AV type=del size=927576 2023-12-03T11:32:39.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.932+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~2OV1TMHD7968.0 size=631445 2023-12-03T11:32:39.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.934+0000 7f4d50c67780 1 < completed multipart upload key=JBL6IOJC4TT0 upload=2OV1TMHD7968 tag=J6QKJIXXRD3H type=write size=1680021 2023-12-03T11:32:39.936 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.935+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=220LHRM4KIUM type=del size=363195 2023-12-03T11:32:39.937 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.936+0000 7f4d50c67780 1 < completed delete operation key=02W4TX7ZCDI6 tag=D2777VNK98G9 type=del 2023-12-03T11:32:39.939 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.938+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~7MOJAO63VL04.0 size=1048576 2023-12-03T11:32:39.940 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.939+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~7MOJAO63VL04.1 size=1048576 2023-12-03T11:32:39.941 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.941+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~7MOJAO63VL04.2 size=769883 2023-12-03T11:32:39.942 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.941+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=7MOJAO63VL04 tag=3UAAR8B53NH0 type=write size=3915611 2023-12-03T11:32:39.943 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.942+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=ICVF1HUO9CIV type=del 2023-12-03T11:32:39.945 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.944+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~1PCC1LF664GE.0 size=1048576 2023-12-03T11:32:39.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.945+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~1PCC1LF664GE.1 size=1048576 2023-12-03T11:32:39.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.946+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~1PCC1LF664GE.2 size=858028 2023-12-03T11:32:39.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.946+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=1PCC1LF664GE tag=QJ8IALG9KOF5 type=write size=4003756 2023-12-03T11:32:39.950 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.949+0000 7f4d50c67780 1 < suggested update operation key=TOGV2BZ99FRF tag=0PHYJNVVTZO1 type=del size=1301044 2023-12-03T11:32:39.952 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.951+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~DT0OTJYVWZ0B.0 size=335398 2023-12-03T11:32:39.952 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.951+0000 7f4d50c67780 1 > prepared multipart upload key=TEIYINZFFG76 upload=DT0OTJYVWZ0B tag=GW500NND555A type=write size=1383974 2023-12-03T11:32:39.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.953+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~05FMCXBBDGJF.0 size=1048576 2023-12-03T11:32:39.955 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.954+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~05FMCXBBDGJF.1 size=1048576 2023-12-03T11:32:39.956 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.955+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~05FMCXBBDGJF.2 size=273361 2023-12-03T11:32:39.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.957+0000 7f4d50c67780 1 < completed multipart upload key=EH4B2QP1C42H upload=05FMCXBBDGJF tag=WGSXTMYQW7Y5 type=write size=3419089 2023-12-03T11:32:39.961 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.960+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~8A15AZF4WGPI.0 size=439919 2023-12-03T11:32:39.961 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.960+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=8A15AZF4WGPI tag=TZR135QBB09W type=write size=1488495 2023-12-03T11:32:39.962 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.962+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~CJ0FV8QK0VWB.0 size=1048576 2023-12-03T11:32:39.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.963+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~CJ0FV8QK0VWB.1 size=484564 2023-12-03T11:32:39.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.965+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=CJ0FV8QK0VWB tag=4CIZ85K1TYBJ type=write size=2581716 2023-12-03T11:32:39.969 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.968+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~37H82NX3G9TA.0 size=667142 2023-12-03T11:32:39.969 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.968+0000 7f4d50c67780 1 > prepared multipart upload key=TOGV2BZ99FRF upload=37H82NX3G9TA tag=E2HTNFDEL377 type=write size=1715718 2023-12-03T11:32:39.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.969+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~N4ML9GOQ0KBX.0 size=1048576 2023-12-03T11:32:39.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.969+0000 7f4d50c67780 1 < canceled part key=_multipart_BX5POXMMYLB7.2~N4ML9GOQ0KBX.1 size=1048576 2023-12-03T11:32:39.971 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.970+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~N4ML9GOQ0KBX.2 size=1021589 2023-12-03T11:32:39.973 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.972+0000 7f4d50c67780 1 < canceled multipart upload key=BX5POXMMYLB7 upload=N4ML9GOQ0KBX tag=3MDN65IGNW92 type=write size=4167317 2023-12-03T11:32:39.975 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.974+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~035CLBUPGZSM.0 size=1048576 2023-12-03T11:32:39.976 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.975+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~035CLBUPGZSM.1 size=1048576 2023-12-03T11:32:39.976 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.976+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~035CLBUPGZSM.2 size=1041958 2023-12-03T11:32:39.977 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.976+0000 7f4d50c67780 1 > prepared multipart upload key=TOGV2BZ99FRF upload=035CLBUPGZSM tag=9DDFMVI72FCW type=write size=4187686 2023-12-03T11:32:39.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.977+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~E0XDQP8LR9D2.0 size=1048576 2023-12-03T11:32:39.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.978+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~E0XDQP8LR9D2.1 size=1048576 2023-12-03T11:32:39.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.979+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~E0XDQP8LR9D2.2 size=560341 2023-12-03T11:32:39.981 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.981+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=E0XDQP8LR9D2 tag=6966XRLARKR6 type=write size=3706069 2023-12-03T11:32:39.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.982+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=7MLTCA2WME7C type=del size=2989656 2023-12-03T11:32:39.984 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.983+0000 7f4d50c67780 1 < completed delete operation key=K7YVVH7SAKMC tag=P4FSPLHYX5Y5 type=del 2023-12-03T11:32:39.986 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.985+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~P4G14AUEBPNL.0 size=857512 2023-12-03T11:32:39.986 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.985+0000 7f4d50c67780 1 > prepared multipart upload key=JBL6IOJC4TT0 upload=P4G14AUEBPNL tag=0SGTUP46OKO9 type=write size=1906088 2023-12-03T11:32:39.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.986+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~OS6QR9ZNY373.0 size=1048576 2023-12-03T11:32:39.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.987+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~OS6QR9ZNY373.1 size=511208 2023-12-03T11:32:39.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.989+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=OS6QR9ZNY373 tag=HADF3CR79XML type=write size=2608360 2023-12-03T11:32:39.992 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.991+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~M4THIW471U8M.0 size=1048576 2023-12-03T11:32:39.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.992+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~M4THIW471U8M.1 size=6376 2023-12-03T11:32:39.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.992+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=M4THIW471U8M tag=ODDS0JWXPLFA type=write size=2103528 2023-12-03T11:32:39.994 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.993+0000 7f4d50c67780 1 < completed delete operation key=EY1RBO15PCRR tag=1P1TYKEY7EYJ type=del 2023-12-03T11:32:39.996 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.995+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~YJP1SBUDI755.0 size=1048576 2023-12-03T11:32:39.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.996+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~YJP1SBUDI755.1 size=1048576 2023-12-03T11:32:39.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.997+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~YJP1SBUDI755.2 size=146747 2023-12-03T11:32:39.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.997+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=YJP1SBUDI755 tag=GQKOE97B27OE type=write size=3292475 2023-12-03T11:32:39.999 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:39.998+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~EMZTQ3KXX9NY.0 size=638487 2023-12-03T11:32:40.001 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.000+0000 7f4d50c67780 1 < completed multipart upload key=JR8CIONID4QC upload=EMZTQ3KXX9NY tag=GC3H8Q4VEMPS type=write size=1687063 2023-12-03T11:32:40.002 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.001+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=X2CE9AMA03N8 type=del size=3239675 2023-12-03T11:32:40.003 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.002+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~OA1M683OQB83.0 size=89591 2023-12-03T11:32:40.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.004+0000 7f4d50c67780 1 < completed multipart upload key=RF2Q24GI24HJ upload=OA1M683OQB83 tag=THW726TYYY6B type=write size=1138167 2023-12-03T11:32:40.006 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.005+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=Q2TMUFIQKASQ type=write size=501874 2023-12-03T11:32:40.007 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.006+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~U9I67PDMWRMW.0 size=1048576 2023-12-03T11:32:40.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.007+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~U9I67PDMWRMW.1 size=556545 2023-12-03T11:32:40.016 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.015+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=U9I67PDMWRMW tag=G48QPE1UCR38 type=write size=2653697 2023-12-03T11:32:40.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.016+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=M7EXKRWHKOTH type=del size=3242863 2023-12-03T11:32:40.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.017+0000 7f4d50c67780 1 < canceled operation key=EX93BYX10WJB tag=IFGFLCW0KMJ1 type=del size=3202719 2023-12-03T11:32:40.020 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.019+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~FB82AYTYCOKN.0 size=543063 2023-12-03T11:32:40.020 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.019+0000 7f4d50c67780 1 > prepared multipart upload key=TEIYINZFFG76 upload=FB82AYTYCOKN tag=7NE5N526QCHA type=write size=1591639 2023-12-03T11:32:40.021 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.021+0000 7f4d50c67780 1 < completed delete operation key=YDRAH5EE39R4 tag=GBO1VA3UO3AV type=del 2023-12-03T11:32:40.023 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.022+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=TPYZZNP4VRJL type=del size=754656 2023-12-03T11:32:40.024 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.023+0000 7f4d50c67780 1 < canceled operation key=0M6ZAD39I852 tag=220LHRM4KIUM type=del size=363195 2023-12-03T11:32:40.026 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.025+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~SFMWZI19IWXN.0 size=218360 2023-12-03T11:32:40.026 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.025+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=SFMWZI19IWXN tag=7IMV4L5U0O1N type=write size=1266936 2023-12-03T11:32:40.028 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.027+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~7MOJAO63VL04.0 size=1048576 2023-12-03T11:32:40.029 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.028+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~7MOJAO63VL04.1 size=1048576 2023-12-03T11:32:40.030 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.029+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~7MOJAO63VL04.2 size=769883 2023-12-03T11:32:40.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.031+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=7MOJAO63VL04 tag=3UAAR8B53NH0 type=write size=3915611 2023-12-03T11:32:40.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.033+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=HEFO09FK21MS type=write size=230107 2023-12-03T11:32:40.035 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.034+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~1PCC1LF664GE.0 size=1048576 2023-12-03T11:32:40.036 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.035+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~1PCC1LF664GE.1 size=1048576 2023-12-03T11:32:40.037 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.036+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~1PCC1LF664GE.2 size=858028 2023-12-03T11:32:40.039 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.038+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=1PCC1LF664GE tag=QJ8IALG9KOF5 type=write size=4003756 2023-12-03T11:32:40.041 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.040+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=BRVB7NSH919P type=del size=2267639 2023-12-03T11:32:40.042 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.041+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~DT0OTJYVWZ0B.0 size=335398 2023-12-03T11:32:40.044 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.043+0000 7f4d50c67780 1 < completed multipart upload key=TEIYINZFFG76 upload=DT0OTJYVWZ0B tag=GW500NND555A type=write size=1383974 2023-12-03T11:32:40.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.044+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=9EK1FC9NR3QC type=del size=2085366 2023-12-03T11:32:40.047 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.046+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~8A15AZF4WGPI.0 size=439919 2023-12-03T11:32:40.049 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.048+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=8A15AZF4WGPI tag=TZR135QBB09W type=write size=1488495 2023-12-03T11:32:40.050 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.049+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=YXYYPOBO9N6T type=del size=2114607 2023-12-03T11:32:40.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.050+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~37H82NX3G9TA.0 size=667142 2023-12-03T11:32:40.053 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.053+0000 7f4d50c67780 1 < completed multipart upload key=TOGV2BZ99FRF upload=37H82NX3G9TA tag=E2HTNFDEL377 type=write size=1715718 2023-12-03T11:32:40.056 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.055+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~B841ZOQQ2E2Y.0 size=695617 2023-12-03T11:32:40.056 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.055+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=B841ZOQQ2E2Y tag=UAMYS6EHGHHL type=write size=1744193 2023-12-03T11:32:40.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.057+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~035CLBUPGZSM.0 size=1048576 2023-12-03T11:32:40.059 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.058+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~035CLBUPGZSM.1 size=1048576 2023-12-03T11:32:40.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.059+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~035CLBUPGZSM.2 size=1041958 2023-12-03T11:32:40.062 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.061+0000 7f4d50c67780 1 < completed multipart upload key=TOGV2BZ99FRF upload=035CLBUPGZSM tag=9DDFMVI72FCW type=write size=4187686 2023-12-03T11:32:40.065 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.064+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~QRQKTUTABJCB.0 size=1048576 2023-12-03T11:32:40.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.065+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~QRQKTUTABJCB.1 size=703848 2023-12-03T11:32:40.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.065+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=QRQKTUTABJCB tag=J028FXCFE7YT type=write size=2801000 2023-12-03T11:32:40.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.066+0000 7f4d50c67780 1 < completed delete operation key=02W4TX7ZCDI6 tag=7MLTCA2WME7C type=del 2023-12-03T11:32:40.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.068+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~1ZD1GVV7EM51.0 size=1019163 2023-12-03T11:32:40.070 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.068+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=1ZD1GVV7EM51 tag=4ELIGEPUT2ME type=write size=2067739 2023-12-03T11:32:40.071 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.070+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~P4G14AUEBPNL.0 size=857512 2023-12-03T11:32:40.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.072+0000 7f4d50c67780 1 < completed multipart upload key=JBL6IOJC4TT0 upload=P4G14AUEBPNL tag=0SGTUP46OKO9 type=write size=1906088 2023-12-03T11:32:40.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.073+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=L6JBBOFTW530 type=write size=875746 2023-12-03T11:32:40.075 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.074+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~M4THIW471U8M.0 size=1048576 2023-12-03T11:32:40.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.075+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~M4THIW471U8M.1 size=6376 2023-12-03T11:32:40.078 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.077+0000 7f4d50c67780 1 < completed multipart upload key=EH4B2QP1C42H upload=M4THIW471U8M tag=ODDS0JWXPLFA type=write size=2103528 2023-12-03T11:32:40.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.079+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~YA3P8ZC6I014.0 size=1048576 2023-12-03T11:32:40.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.080+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~YA3P8ZC6I014.1 size=1048576 2023-12-03T11:32:40.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.082+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~YA3P8ZC6I014.2 size=422061 2023-12-03T11:32:40.083 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.082+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=YA3P8ZC6I014 tag=FIVAZ7PHYZ4T type=write size=3567789 2023-12-03T11:32:40.084 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.083+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~YJP1SBUDI755.0 size=1048576 2023-12-03T11:32:40.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.085+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~YJP1SBUDI755.1 size=1048576 2023-12-03T11:32:40.087 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.086+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~YJP1SBUDI755.2 size=146747 2023-12-03T11:32:40.089 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.088+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=YJP1SBUDI755 tag=GQKOE97B27OE type=write size=3292475 2023-12-03T11:32:40.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.090+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~CDSVG0QV3SZQ.0 size=1048576 2023-12-03T11:32:40.092 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.091+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~CDSVG0QV3SZQ.1 size=38972 2023-12-03T11:32:40.092 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.091+0000 7f4d50c67780 1 > prepared multipart upload key=TEIYINZFFG76 upload=CDSVG0QV3SZQ tag=UG1A2L4C7MME type=write size=2136124 2023-12-03T11:32:40.093 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.093+0000 7f4d50c67780 1 < completed delete operation key=MLKGLDFFDC3W tag=X2CE9AMA03N8 type=del 2023-12-03T11:32:40.095 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.094+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=2TOORZZ8PW9J type=del size=2810456 2023-12-03T11:32:40.096 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.095+0000 7f4d50c67780 1 < completed write operation key=V0ND3OBFJJUB tag=Q2TMUFIQKASQ type=write size=501874 2023-12-03T11:32:40.097 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.096+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=BV1Y1L0WG3CJ type=write size=175060 2023-12-03T11:32:40.099 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.098+0000 7f4d50c67780 1 < suggested update operation key=QQDBWLVSXIHP tag=M7EXKRWHKOTH type=del size=3242863 2023-12-03T11:32:40.100 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.100+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=URAHP4KXOI5W type=del size=3175261 2023-12-03T11:32:40.102 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.101+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~FB82AYTYCOKN.0 size=543063 2023-12-03T11:32:40.104 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.103+0000 7f4d50c67780 1 < completed multipart upload key=TEIYINZFFG76 upload=FB82AYTYCOKN tag=7NE5N526QCHA type=write size=1591639 2023-12-03T11:32:40.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.105+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~SPGMD4RDA5S8.0 size=1048576 2023-12-03T11:32:40.107 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.106+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~SPGMD4RDA5S8.1 size=314155 2023-12-03T11:32:40.107 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.106+0000 7f4d50c67780 1 > prepared multipart upload key=73SL3ZBBDA6Q upload=SPGMD4RDA5S8 tag=663JNNWGKO93 type=write size=2411307 2023-12-03T11:32:40.108 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.107+0000 7f4d50c67780 1 < completed delete operation key=52E31L45TN7V tag=TPYZZNP4VRJL type=del 2023-12-03T11:32:40.109 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.108+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=6PEFAM1J2TGV type=del size=4120114 2023-12-03T11:32:40.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.110+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~SFMWZI19IWXN.0 size=218360 2023-12-03T11:32:40.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.112+0000 7f4d50c67780 1 < completed multipart upload key=EH4B2QP1C42H upload=SFMWZI19IWXN tag=7IMV4L5U0O1N type=write size=1266936 2023-12-03T11:32:40.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.113+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=XS9X2KW71QX5 type=del size=589490 2023-12-03T11:32:40.115 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.114+0000 7f4d50c67780 1 < completed write operation key=TOGV2BZ99FRF tag=HEFO09FK21MS type=write size=230107 2023-12-03T11:32:40.116 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.115+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=QYBZEYCV9L9O type=del size=3744261 2023-12-03T11:32:40.117 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.116+0000 7f4d50c67780 1 < completed delete operation key=GTLP2WZUX7U8 tag=BRVB7NSH919P type=del 2023-12-03T11:32:40.118 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.118+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=RMWBAW5R4JNU type=del size=263155 2023-12-03T11:32:40.120 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.119+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=9EK1FC9NR3QC type=del 2023-12-03T11:32:40.122 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.121+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~41TBD3ULT30F.0 size=1048576 2023-12-03T11:32:40.123 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.122+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~41TBD3ULT30F.1 size=296127 2023-12-03T11:32:40.123 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.122+0000 7f4d50c67780 1 > prepared multipart upload key=TEIYINZFFG76 upload=41TBD3ULT30F tag=39JR4VUL6KDS type=write size=2393279 2023-12-03T11:32:40.124 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.123+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=YXYYPOBO9N6T type=del 2023-12-03T11:32:40.125 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.124+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=B5HJ37NN3KCT type=del size=3360811 2023-12-03T11:32:40.126 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.125+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~B841ZOQQ2E2Y.0 size=695617 2023-12-03T11:32:40.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.127+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=B841ZOQQ2E2Y tag=UAMYS6EHGHHL type=write size=1744193 2023-12-03T11:32:40.129 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.128+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=1427YLO0J9HW type=write size=352754 2023-12-03T11:32:40.130 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.130+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~QRQKTUTABJCB.0 size=1048576 2023-12-03T11:32:40.131 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.130+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~QRQKTUTABJCB.1 size=703848 2023-12-03T11:32:40.133 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.133+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=QRQKTUTABJCB tag=J028FXCFE7YT type=write size=2801000 2023-12-03T11:32:40.136 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.135+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~0TTA9UZ1EJCO.0 size=1048576 2023-12-03T11:32:40.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.136+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~0TTA9UZ1EJCO.1 size=1048576 2023-12-03T11:32:40.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.137+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~0TTA9UZ1EJCO.2 size=553490 2023-12-03T11:32:40.138 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.137+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=0TTA9UZ1EJCO tag=4E0PA4A6LX7X type=write size=3699218 2023-12-03T11:32:40.139 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.138+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~1ZD1GVV7EM51.0 size=1019163 2023-12-03T11:32:40.141 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.140+0000 7f4d50c67780 1 < completed multipart upload key=7C7UX0231SHV upload=1ZD1GVV7EM51 tag=4ELIGEPUT2ME type=write size=2067739 2023-12-03T11:32:40.143 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.142+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~JRWMFHESO919.0 size=1048576 2023-12-03T11:32:40.144 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.143+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~JRWMFHESO919.1 size=1048576 2023-12-03T11:32:40.145 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.144+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~JRWMFHESO919.2 size=992379 2023-12-03T11:32:40.145 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.144+0000 7f4d50c67780 1 > prepared multipart upload key=ULLPV2G10BME upload=JRWMFHESO919 tag=HML0GXZ59NLE type=write size=4138107 2023-12-03T11:32:40.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.145+0000 7f4d50c67780 1 < completed write operation key=JR8CIONID4QC tag=L6JBBOFTW530 type=write size=875746 2023-12-03T11:32:40.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.147+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~BLEQKKG29CNM.0 size=10867 2023-12-03T11:32:40.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.147+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=BLEQKKG29CNM tag=17Z4A1XZK02M type=write size=1059443 2023-12-03T11:32:40.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.147+0000 7f4d50c67780 1 < canceled part key=_multipart_2H6AFQ362OGP.2~YA3P8ZC6I014.0 size=1048576 2023-12-03T11:32:40.149 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.148+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~YA3P8ZC6I014.1 size=1048576 2023-12-03T11:32:40.150 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.149+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~YA3P8ZC6I014.2 size=422061 2023-12-03T11:32:40.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.151+0000 7f4d50c67780 1 < canceled multipart upload key=2H6AFQ362OGP upload=YA3P8ZC6I014 tag=FIVAZ7PHYZ4T type=write size=3567789 2023-12-03T11:32:40.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.153+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~L4XNH56AH27M.0 size=1048576 2023-12-03T11:32:40.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.154+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~L4XNH56AH27M.1 size=1048576 2023-12-03T11:32:40.156 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.155+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~L4XNH56AH27M.2 size=901561 2023-12-03T11:32:40.156 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.155+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=L4XNH56AH27M tag=RS79MK0EPHON type=write size=4047289 2023-12-03T11:32:40.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.156+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~CDSVG0QV3SZQ.0 size=1048576 2023-12-03T11:32:40.158 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.157+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~CDSVG0QV3SZQ.1 size=38972 2023-12-03T11:32:40.160 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.160+0000 7f4d50c67780 1 < completed multipart upload key=TEIYINZFFG76 upload=CDSVG0QV3SZQ tag=UG1A2L4C7MME type=write size=2136124 2023-12-03T11:32:40.162 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.161+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=IJEAHPAL077T type=write size=236782 2023-12-03T11:32:40.163 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.162+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=2TOORZZ8PW9J type=del 2023-12-03T11:32:40.164 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.164+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=X05QVWPJ0RUJ type=del size=2614982 2023-12-03T11:32:40.166 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.165+0000 7f4d50c67780 1 < canceled operation key=YDRAH5EE39R4 tag=BV1Y1L0WG3CJ type=write size=175060 2023-12-03T11:32:40.167 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.167+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=RQ1Q7NSQ8X3Z type=del size=3242095 2023-12-03T11:32:40.169 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.168+0000 7f4d50c67780 1 < canceled operation key=TEIYINZFFG76 tag=URAHP4KXOI5W type=del size=3175261 2023-12-03T11:32:40.171 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.170+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~HVU1FPDKGI12.0 size=1048576 2023-12-03T11:32:40.172 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.171+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~HVU1FPDKGI12.1 size=397373 2023-12-03T11:32:40.172 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.171+0000 7f4d50c67780 1 > prepared multipart upload key=ENMJS0KEVS2S upload=HVU1FPDKGI12 tag=T37L1USR3W8O type=write size=2494525 2023-12-03T11:32:40.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.173+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~SPGMD4RDA5S8.0 size=1048576 2023-12-03T11:32:40.175 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.174+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~SPGMD4RDA5S8.1 size=314155 2023-12-03T11:32:40.177 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.176+0000 7f4d50c67780 1 < completed multipart upload key=73SL3ZBBDA6Q upload=SPGMD4RDA5S8 tag=663JNNWGKO93 type=write size=2411307 2023-12-03T11:32:40.178 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.177+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=CJDA0APC83J2 type=del size=941395 2023-12-03T11:32:40.179 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.178+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=6PEFAM1J2TGV type=del 2023-12-03T11:32:40.181 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.180+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=6PX7E03CBW26 type=del size=3448017 2023-12-03T11:32:40.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.181+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=XS9X2KW71QX5 type=del 2023-12-03T11:32:40.183 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.182+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=WH8S5XCKI0HD type=del size=3536875 2023-12-03T11:32:40.184 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.184+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=QYBZEYCV9L9O type=del 2023-12-03T11:32:40.187 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.186+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~LJYBUOBPO7N6.0 size=456399 2023-12-03T11:32:40.187 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.186+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=LJYBUOBPO7N6 tag=U4UBOXSVCJWM type=write size=1504975 2023-12-03T11:32:40.188 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.187+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=RMWBAW5R4JNU type=del 2023-12-03T11:32:40.189 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.188+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=R0XRT1RZZLVN type=write size=423103 2023-12-03T11:32:40.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.190+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~41TBD3ULT30F.0 size=1048576 2023-12-03T11:32:40.192 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.191+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~41TBD3ULT30F.1 size=296127 2023-12-03T11:32:40.194 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.193+0000 7f4d50c67780 1 < completed multipart upload key=TEIYINZFFG76 upload=41TBD3ULT30F tag=39JR4VUL6KDS type=write size=2393279 2023-12-03T11:32:40.195 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.194+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=FSZX9S1X5QRL type=del size=2980658 2023-12-03T11:32:40.196 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.195+0000 7f4d50c67780 1 < completed delete operation key=7C7UX0231SHV tag=B5HJ37NN3KCT type=del 2023-12-03T11:32:40.199 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.198+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~6FPE9E3GOI2K.0 size=1048576 2023-12-03T11:32:40.200 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.199+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~6FPE9E3GOI2K.1 size=1048576 2023-12-03T11:32:40.201 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.200+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~6FPE9E3GOI2K.2 size=819593 2023-12-03T11:32:40.201 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.200+0000 7f4d50c67780 1 > prepared multipart upload key=JBL6IOJC4TT0 upload=6FPE9E3GOI2K tag=4CY5A95X23BB type=write size=3965321 2023-12-03T11:32:40.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.201+0000 7f4d50c67780 1 < completed write operation key=ULLPV2G10BME tag=1427YLO0J9HW type=write size=352754 2023-12-03T11:32:40.204 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.204+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~NCERVYEJI68A.0 size=949744 2023-12-03T11:32:40.204 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.204+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=NCERVYEJI68A tag=TP6CHGUKVMT8 type=write size=1998320 2023-12-03T11:32:40.205 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.205+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~0TTA9UZ1EJCO.0 size=1048576 2023-12-03T11:32:40.206 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.206+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~0TTA9UZ1EJCO.1 size=1048576 2023-12-03T11:32:40.208 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.207+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~0TTA9UZ1EJCO.2 size=553490 2023-12-03T11:32:40.210 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.209+0000 7f4d50c67780 1 < completed multipart upload key=WUM939BATDG9 upload=0TTA9UZ1EJCO tag=4E0PA4A6LX7X type=write size=3699218 2023-12-03T11:32:40.211 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.210+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=0BDDT7VV6S4H type=del size=3929212 2023-12-03T11:32:40.212 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.211+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~JRWMFHESO919.0 size=1048576 2023-12-03T11:32:40.213 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.212+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~JRWMFHESO919.1 size=1048576 2023-12-03T11:32:40.213 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.212+0000 7f4d50c67780 1 < canceled part key=_multipart_ULLPV2G10BME.2~JRWMFHESO919.2 size=992379 2023-12-03T11:32:40.216 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.215+0000 7f4d50c67780 1 < canceled multipart upload key=ULLPV2G10BME upload=JRWMFHESO919 tag=HML0GXZ59NLE type=write size=4138107 2023-12-03T11:32:40.217 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.216+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=XZUERPORK5UA type=del size=131820 2023-12-03T11:32:40.218 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.217+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~BLEQKKG29CNM.0 size=10867 2023-12-03T11:32:40.220 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.219+0000 7f4d50c67780 1 < completed multipart upload key=83I1M5WIVKAA upload=BLEQKKG29CNM tag=17Z4A1XZK02M type=write size=1059443 2023-12-03T11:32:40.222 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.221+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~6WK7Y1GYKDA6.0 size=1048576 2023-12-03T11:32:40.223 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.222+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~6WK7Y1GYKDA6.1 size=641207 2023-12-03T11:32:40.223 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.222+0000 7f4d50c67780 1 > prepared multipart upload key=52E31L45TN7V upload=6WK7Y1GYKDA6 tag=IT08YE7YNQY6 type=write size=2738359 2023-12-03T11:32:40.224 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.223+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~L4XNH56AH27M.0 size=1048576 2023-12-03T11:32:40.225 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.224+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~L4XNH56AH27M.1 size=1048576 2023-12-03T11:32:40.225 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.225+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~L4XNH56AH27M.2 size=901561 2023-12-03T11:32:40.227 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.227+0000 7f4d50c67780 1 < completed multipart upload key=MLKGLDFFDC3W upload=L4XNH56AH27M tag=RS79MK0EPHON type=write size=4047289 2023-12-03T11:32:40.229 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.228+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~NJ1PDMRMJXUI.0 size=1048576 2023-12-03T11:32:40.230 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.229+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~NJ1PDMRMJXUI.1 size=791529 2023-12-03T11:32:40.230 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.229+0000 7f4d50c67780 1 > prepared multipart upload key=TOGV2BZ99FRF upload=NJ1PDMRMJXUI tag=NJG8000S5CB9 type=write size=2888681 2023-12-03T11:32:40.232 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.231+0000 7f4d50c67780 1 < completed write operation key=JBL6IOJC4TT0 tag=IJEAHPAL077T type=write size=236782 2023-12-03T11:32:40.233 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.232+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=TGVSL2YK8FPX type=del size=3528686 2023-12-03T11:32:40.235 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.234+0000 7f4d50c67780 1 < suggested update operation key=0M6ZAD39I852 tag=X05QVWPJ0RUJ type=del size=2614982 2023-12-03T11:32:40.236 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.236+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=7J2AM5BKC0FO type=del size=602850 2023-12-03T11:32:40.238 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.237+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=RQ1Q7NSQ8X3Z type=del 2023-12-03T11:32:40.239 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.238+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=PUI1IPSI7HZG type=del size=2636011 2023-12-03T11:32:40.240 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.239+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~HVU1FPDKGI12.0 size=1048576 2023-12-03T11:32:40.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.240+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~HVU1FPDKGI12.1 size=397373 2023-12-03T11:32:40.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.242+0000 7f4d50c67780 1 < completed multipart upload key=ENMJS0KEVS2S upload=HVU1FPDKGI12 tag=T37L1USR3W8O type=write size=2494525 2023-12-03T11:32:40.244 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.243+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=PLW4YTWTBWRB type=del size=345495 2023-12-03T11:32:40.245 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.244+0000 7f4d50c67780 1 < completed delete operation key=YDRAH5EE39R4 tag=CJDA0APC83J2 type=del 2023-12-03T11:32:40.246 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.245+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=8DYZS5H3OFR8 type=write size=35413 2023-12-03T11:32:40.247 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.247+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=6PX7E03CBW26 type=del 2023-12-03T11:32:40.249 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.248+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=SCF5T427BBY4 type=del size=3776079 2023-12-03T11:32:40.250 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.249+0000 7f4d50c67780 -1 < failed to complete operation key=0M6ZAD39I852 tag=WH8S5XCKI0HD type=del size=3536875: (22) Invalid argument 2023-12-03T11:32:40.251 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.250+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=6J8EY0RKKGKS type=del size=2410995 2023-12-03T11:32:40.252 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.251+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~LJYBUOBPO7N6.0 size=456399 2023-12-03T11:32:40.254 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.253+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=LJYBUOBPO7N6 tag=U4UBOXSVCJWM type=write size=1504975 2023-12-03T11:32:40.255 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.254+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=Y3RS3R7WTG61 type=del size=691611 2023-12-03T11:32:40.257 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.256+0000 7f4d50c67780 1 < completed write operation key=02W4TX7ZCDI6 tag=R0XRT1RZZLVN type=write size=423103 2023-12-03T11:32:40.259 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.258+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~HXGP61NTKLCJ.0 size=1048576 2023-12-03T11:32:40.260 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.259+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~HXGP61NTKLCJ.1 size=802197 2023-12-03T11:32:40.260 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.259+0000 7f4d50c67780 1 > prepared multipart upload key=RF2Q24GI24HJ upload=HXGP61NTKLCJ tag=5QNSW84RBKCK type=write size=2899349 2023-12-03T11:32:40.262 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.261+0000 7f4d50c67780 1 < suggested remove operation key=K7YVVH7SAKMC tag=FSZX9S1X5QRL type=del 2023-12-03T11:32:40.263 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.263+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=FGSFABPWNY1F type=del size=3585734 2023-12-03T11:32:40.265 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.264+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~6FPE9E3GOI2K.0 size=1048576 2023-12-03T11:32:40.266 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.265+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~6FPE9E3GOI2K.1 size=1048576 2023-12-03T11:32:40.267 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.266+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~6FPE9E3GOI2K.2 size=819593 2023-12-03T11:32:40.269 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.268+0000 7f4d50c67780 1 < completed multipart upload key=JBL6IOJC4TT0 upload=6FPE9E3GOI2K tag=4CY5A95X23BB type=write size=3965321 2023-12-03T11:32:40.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.270+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~SRFQ5C4O2QZ0.0 size=482798 2023-12-03T11:32:40.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.270+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=SRFQ5C4O2QZ0 tag=D2L0N26OA4YM type=write size=1531374 2023-12-03T11:32:40.272 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.271+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~NCERVYEJI68A.0 size=949744 2023-12-03T11:32:40.274 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.273+0000 7f4d50c67780 1 < completed multipart upload key=WUM939BATDG9 upload=NCERVYEJI68A tag=TP6CHGUKVMT8 type=write size=1998320 2023-12-03T11:32:40.276 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.276+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~07Q4YFMAAZUS.0 size=1048576 2023-12-03T11:32:40.277 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.276+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~07Q4YFMAAZUS.1 size=1048576 2023-12-03T11:32:40.278 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.277+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~07Q4YFMAAZUS.2 size=533947 2023-12-03T11:32:40.278 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.277+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=07Q4YFMAAZUS tag=094T2NLURIQW type=write size=3679675 2023-12-03T11:32:40.279 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.279+0000 7f4d50c67780 1 < canceled operation key=YDRAH5EE39R4 tag=0BDDT7VV6S4H type=del size=3929212 2023-12-03T11:32:40.281 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.280+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=80IAGF4XETDJ type=write size=212634 2023-12-03T11:32:40.282 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.281+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=XZUERPORK5UA type=del 2023-12-03T11:32:40.284 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.283+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~NLVSIBPGTYRO.0 size=1048576 2023-12-03T11:32:40.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.284+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~NLVSIBPGTYRO.1 size=1048576 2023-12-03T11:32:40.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.285+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~NLVSIBPGTYRO.2 size=409531 2023-12-03T11:32:40.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.285+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=NLVSIBPGTYRO tag=XRSCT414UFGY type=write size=3555259 2023-12-03T11:32:40.287 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.286+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~6WK7Y1GYKDA6.0 size=1048576 2023-12-03T11:32:40.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.287+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~6WK7Y1GYKDA6.1 size=641207 2023-12-03T11:32:40.290 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.289+0000 7f4d50c67780 1 < completed multipart upload key=52E31L45TN7V upload=6WK7Y1GYKDA6 tag=IT08YE7YNQY6 type=write size=2738359 2023-12-03T11:32:40.291 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.290+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=LD8F1NWZGJPC type=del size=366372 2023-12-03T11:32:40.292 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.291+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~NJ1PDMRMJXUI.0 size=1048576 2023-12-03T11:32:40.293 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.292+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~NJ1PDMRMJXUI.1 size=791529 2023-12-03T11:32:40.295 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.294+0000 7f4d50c67780 1 < completed multipart upload key=TOGV2BZ99FRF upload=NJ1PDMRMJXUI tag=NJG8000S5CB9 type=write size=2888681 2023-12-03T11:32:40.297 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.296+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~QTRFPS8UBIBD.0 size=1048576 2023-12-03T11:32:40.298 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.297+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~QTRFPS8UBIBD.1 size=831908 2023-12-03T11:32:40.298 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.297+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=QTRFPS8UBIBD tag=E1EX96QKN0V1 type=write size=2929060 2023-12-03T11:32:40.301 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.300+0000 7f4d50c67780 1 < suggested update operation key=52E31L45TN7V tag=TGVSL2YK8FPX type=del size=3528686 2023-12-03T11:32:40.302 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.301+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=5ZVLELDRFL3K type=del size=3248591 2023-12-03T11:32:40.303 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.302+0000 7f4d50c67780 1 < canceled operation key=TOGV2BZ99FRF tag=7J2AM5BKC0FO type=del size=602850 2023-12-03T11:32:40.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.303+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=M3PCX73NJ4BN type=del size=1548898 2023-12-03T11:32:40.305 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.304+0000 7f4d50c67780 1 < completed delete operation key=EX93BYX10WJB tag=PUI1IPSI7HZG type=del 2023-12-03T11:32:40.306 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.306+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=TTS12GPO6V6N type=del size=2286695 2023-12-03T11:32:40.310 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.309+0000 7f4d50c67780 1 < suggested update operation key=0M6ZAD39I852 tag=PLW4YTWTBWRB type=del size=345495 2023-12-03T11:32:40.312 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.311+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~IMW6FUOV02IU.0 size=493082 2023-12-03T11:32:40.312 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.311+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=IMW6FUOV02IU tag=00TIWAGXH2KM type=write size=1541658 2023-12-03T11:32:40.313 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.312+0000 7f4d50c67780 1 < completed write operation key=TOGV2BZ99FRF tag=8DYZS5H3OFR8 type=write size=35413 2023-12-03T11:32:40.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.314+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~C7G5EG031WGM.0 size=1048576 2023-12-03T11:32:40.322 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.321+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~C7G5EG031WGM.1 size=948587 2023-12-03T11:32:40.322 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.321+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=C7G5EG031WGM tag=5SIQE8AK7ATY type=write size=3045739 2023-12-03T11:32:40.323 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.323+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=SCF5T427BBY4 type=del 2023-12-03T11:32:40.325 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.324+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=MPE4MIOA82AJ type=write size=236767 2023-12-03T11:32:40.326 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.325+0000 7f4d50c67780 -1 < failed to complete operation key=52E31L45TN7V tag=6J8EY0RKKGKS type=del size=2410995: (22) Invalid argument 2023-12-03T11:32:40.327 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.326+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=CUD82Z42K7YT type=del size=928943 2023-12-03T11:32:40.328 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.327+0000 7f4d50c67780 1 < canceled operation key=BX5POXMMYLB7 tag=Y3RS3R7WTG61 type=del size=691611 2023-12-03T11:32:40.329 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.328+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=A3D2ODRO2BOE type=del size=539919 2023-12-03T11:32:40.330 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.330+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~HXGP61NTKLCJ.0 size=1048576 2023-12-03T11:32:40.331 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.331+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~HXGP61NTKLCJ.1 size=802197 2023-12-03T11:32:40.333 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.332+0000 7f4d50c67780 1 < completed multipart upload key=RF2Q24GI24HJ upload=HXGP61NTKLCJ tag=5QNSW84RBKCK type=write size=2899349 2023-12-03T11:32:40.334 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.334+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=PTR51DWFVNKC type=del size=3378851 2023-12-03T11:32:40.336 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.335+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=FGSFABPWNY1F type=del 2023-12-03T11:32:40.337 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.336+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=BG2N3YU6MO1D type=del size=65908 2023-12-03T11:32:40.338 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.337+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~SRFQ5C4O2QZ0.0 size=482798 2023-12-03T11:32:40.340 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.339+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=SRFQ5C4O2QZ0 tag=D2L0N26OA4YM type=write size=1531374 2023-12-03T11:32:40.341 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.340+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=LM56HI4LWXFY type=del size=772166 2023-12-03T11:32:40.342 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.342+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~07Q4YFMAAZUS.0 size=1048576 2023-12-03T11:32:40.343 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.343+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~07Q4YFMAAZUS.1 size=1048576 2023-12-03T11:32:40.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.344+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~07Q4YFMAAZUS.2 size=533947 2023-12-03T11:32:40.346 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.345+0000 7f4d50c67780 1 < completed multipart upload key=EAP0BYZTTT2E upload=07Q4YFMAAZUS tag=094T2NLURIQW type=write size=3679675 2023-12-03T11:32:40.347 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.347+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=V20D4XSKLY92 type=del size=1670809 2023-12-03T11:32:40.348 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.348+0000 7f4d50c67780 1 < canceled operation key=WUM939BATDG9 tag=80IAGF4XETDJ type=write size=212634 2023-12-03T11:32:40.350 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.349+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=BGB5PFEXDFNH type=del size=1157966 2023-12-03T11:32:40.350 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.349+0000 7f4d50c67780 1 < canceled part key=_multipart_MLKGLDFFDC3W.2~NLVSIBPGTYRO.0 size=1048576 2023-12-03T11:32:40.351 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.350+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~NLVSIBPGTYRO.1 size=1048576 2023-12-03T11:32:40.351 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.350+0000 7f4d50c67780 1 < canceled part key=_multipart_MLKGLDFFDC3W.2~NLVSIBPGTYRO.2 size=409531 2023-12-03T11:32:40.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.352+0000 7f4d50c67780 1 < canceled multipart upload key=MLKGLDFFDC3W upload=NLVSIBPGTYRO tag=XRSCT414UFGY type=write size=3555259 2023-12-03T11:32:40.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.353+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=4QA6A3HQW0HD type=write size=993156 2023-12-03T11:32:40.355 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.354+0000 7f4d50c67780 1 < completed delete operation key=7C7UX0231SHV tag=LD8F1NWZGJPC type=del 2023-12-03T11:32:40.357 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.356+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~76Y1SVU1J7ZA.0 size=675067 2023-12-03T11:32:40.357 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.356+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=76Y1SVU1J7ZA tag=X95RK972S9XA type=write size=1723643 2023-12-03T11:32:40.358 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.357+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~QTRFPS8UBIBD.0 size=1048576 2023-12-03T11:32:40.359 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.357+0000 7f4d50c67780 1 < canceled part key=_multipart_WUM939BATDG9.2~QTRFPS8UBIBD.1 size=831908 2023-12-03T11:32:40.360 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.359+0000 7f4d50c67780 1 < canceled multipart upload key=WUM939BATDG9 upload=QTRFPS8UBIBD tag=E1EX96QKN0V1 type=write size=2929060 2023-12-03T11:32:40.361 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.361+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=HMWCKU1633EP type=write size=955807 2023-12-03T11:32:40.363 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.362+0000 7f4d50c67780 1 < completed delete operation key=73SL3ZBBDA6Q tag=5ZVLELDRFL3K type=del 2023-12-03T11:32:40.365 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.364+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~OYOFX99EK3RW.0 size=1048576 2023-12-03T11:32:40.366 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.365+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~OYOFX99EK3RW.1 size=1048576 2023-12-03T11:32:40.367 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.366+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~OYOFX99EK3RW.2 size=436788 2023-12-03T11:32:40.367 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.366+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=OYOFX99EK3RW tag=KFGDOIA2M5G7 type=write size=3582516 2023-12-03T11:32:40.368 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.367+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=M3PCX73NJ4BN type=del 2023-12-03T11:32:40.369 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.368+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=ZV376U1AL47B type=del size=1897527 2023-12-03T11:32:40.370 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.370+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=TTS12GPO6V6N type=del 2023-12-03T11:32:40.372 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.372+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~OMI8KF776FHU.0 size=510337 2023-12-03T11:32:40.372 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.372+0000 7f4d50c67780 1 > prepared multipart upload key=TOGV2BZ99FRF upload=OMI8KF776FHU tag=JNYR2DDVOVRK type=write size=1558913 2023-12-03T11:32:40.374 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.373+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~IMW6FUOV02IU.0 size=493082 2023-12-03T11:32:40.376 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.375+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=IMW6FUOV02IU tag=00TIWAGXH2KM type=write size=1541658 2023-12-03T11:32:40.378 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.377+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~PSGNNG0CH4C6.0 size=1048576 2023-12-03T11:32:40.379 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.378+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~PSGNNG0CH4C6.1 size=653820 2023-12-03T11:32:40.379 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.378+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=PSGNNG0CH4C6 tag=VEMMT0AQ9NOM type=write size=2750972 2023-12-03T11:32:40.380 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.379+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~C7G5EG031WGM.0 size=1048576 2023-12-03T11:32:40.381 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.380+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~C7G5EG031WGM.1 size=948587 2023-12-03T11:32:40.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.382+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=C7G5EG031WGM tag=5SIQE8AK7ATY type=write size=3045739 2023-12-03T11:32:40.384 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.384+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=D3YD5CU3LSDB type=del size=3972164 2023-12-03T11:32:40.386 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.385+0000 7f4d50c67780 1 < completed write operation key=JR8CIONID4QC tag=MPE4MIOA82AJ type=write size=236767 2023-12-03T11:32:40.387 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.386+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=OXMN57TP9SVO type=del size=3917655 2023-12-03T11:32:40.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.387+0000 7f4d50c67780 1 < completed delete operation key=EX93BYX10WJB tag=CUD82Z42K7YT type=del 2023-12-03T11:32:40.390 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.390+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~X4P6WP616BZL.0 size=914055 2023-12-03T11:32:40.390 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.390+0000 7f4d50c67780 1 > prepared multipart upload key=U6R5Y9JXKT32 upload=X4P6WP616BZL tag=XSZ16OURPTQ6 type=write size=1962631 2023-12-03T11:32:40.393 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.392+0000 7f4d50c67780 1 < suggested update operation key=TOGV2BZ99FRF tag=A3D2ODRO2BOE type=del size=539919 2023-12-03T11:32:40.394 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.393+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=XG475PKYAQ0K type=write size=845581 2023-12-03T11:32:40.395 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.395+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=PTR51DWFVNKC type=del 2023-12-03T11:32:40.397 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.396+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=S1GOYHW1VP2Y type=del size=1123963 2023-12-03T11:32:40.398 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.397+0000 7f4d50c67780 1 < canceled operation key=U6R5Y9JXKT32 tag=BG2N3YU6MO1D type=del size=65908 2023-12-03T11:32:40.399 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.399+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=D8DDGFJKTHKN type=write size=238091 2023-12-03T11:32:40.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.401+0000 7f4d50c67780 1 < suggested update operation key=V0ND3OBFJJUB tag=LM56HI4LWXFY type=del size=772166 2023-12-03T11:32:40.404 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.403+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~JKM3IXR4SB2F.0 size=1048576 2023-12-03T11:32:40.405 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.404+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~JKM3IXR4SB2F.1 size=825637 2023-12-03T11:32:40.405 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.404+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=JKM3IXR4SB2F tag=2H5KCWE2D7NJ type=write size=2922789 2023-12-03T11:32:40.406 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.405+0000 7f4d50c67780 1 < canceled operation key=EAP0BYZTTT2E tag=V20D4XSKLY92 type=del size=1670809 2023-12-03T11:32:40.407 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.407+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=DI1736HK1H7R type=del size=1599389 2023-12-03T11:32:40.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.408+0000 7f4d50c67780 -1 < failed to complete operation key=V0ND3OBFJJUB tag=BGB5PFEXDFNH type=del size=1157966: (22) Invalid argument 2023-12-03T11:32:40.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.409+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=UK8GVNQBL508 type=del size=860909 2023-12-03T11:32:40.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.410+0000 7f4d50c67780 1 < canceled operation key=QQDBWLVSXIHP tag=4QA6A3HQW0HD type=write size=993156 2023-12-03T11:32:40.413 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.412+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=R6F7HIMOIND8 type=del size=624626 2023-12-03T11:32:40.413 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.413+0000 7f4d50c67780 1 < canceled part key=_multipart_EH4B2QP1C42H.2~76Y1SVU1J7ZA.0 size=675067 2023-12-03T11:32:40.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.415+0000 7f4d50c67780 1 < canceled multipart upload key=EH4B2QP1C42H upload=76Y1SVU1J7ZA tag=X95RK972S9XA type=write size=1723643 2023-12-03T11:32:40.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.416+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=NEPT42LL74NJ type=del size=3028847 2023-12-03T11:32:40.419 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.418+0000 7f4d50c67780 1 < suggested update operation key=JBL6IOJC4TT0 tag=HMWCKU1633EP type=write size=955807 2023-12-03T11:32:40.420 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.420+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=HA7M6B5546JO type=del size=3905677 2023-12-03T11:32:40.422 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.421+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~OYOFX99EK3RW.0 size=1048576 2023-12-03T11:32:40.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.422+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~OYOFX99EK3RW.1 size=1048576 2023-12-03T11:32:40.424 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.423+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~OYOFX99EK3RW.2 size=436788 2023-12-03T11:32:40.426 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.425+0000 7f4d50c67780 1 < completed multipart upload key=K7YVVH7SAKMC upload=OYOFX99EK3RW tag=KFGDOIA2M5G7 type=write size=3582516 2023-12-03T11:32:40.427 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.426+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=TGK2P3JME08B type=write size=822033 2023-12-03T11:32:40.429 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.429+0000 7f4d50c67780 1 < completed delete operation key=EY1RBO15PCRR tag=ZV376U1AL47B type=del 2023-12-03T11:32:40.431 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.430+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=I8KEGNCLGN02 type=del size=495216 2023-12-03T11:32:40.432 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.431+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~OMI8KF776FHU.0 size=510337 2023-12-03T11:32:40.434 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.433+0000 7f4d50c67780 1 < completed multipart upload key=TOGV2BZ99FRF upload=OMI8KF776FHU tag=JNYR2DDVOVRK type=write size=1558913 2023-12-03T11:32:40.435 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.434+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=7TNVULWQZWJE type=del size=2871615 2023-12-03T11:32:40.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.436+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~PSGNNG0CH4C6.0 size=1048576 2023-12-03T11:32:40.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.436+0000 7f4d50c67780 1 < canceled part key=_multipart_V0ND3OBFJJUB.2~PSGNNG0CH4C6.1 size=653820 2023-12-03T11:32:40.439 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.438+0000 7f4d50c67780 1 < canceled multipart upload key=V0ND3OBFJJUB upload=PSGNNG0CH4C6 tag=VEMMT0AQ9NOM type=write size=2750972 2023-12-03T11:32:40.440 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.439+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=G5D77PA116NS type=del size=3989122 2023-12-03T11:32:40.441 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.440+0000 7f4d50c67780 -1 < failed to complete operation key=TOGV2BZ99FRF tag=D3YD5CU3LSDB type=del size=3972164: (22) Invalid argument 2023-12-03T11:32:40.444 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.443+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~9TM713AU3H8W.0 size=174602 2023-12-03T11:32:40.444 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.443+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=9TM713AU3H8W tag=DYM2G26F1C1O type=write size=1223178 2023-12-03T11:32:40.445 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.444+0000 7f4d50c67780 1 < completed delete operation key=JR8CIONID4QC tag=OXMN57TP9SVO type=del 2023-12-03T11:32:40.446 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.445+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=OB5T09NCSMO0 type=write size=365495 2023-12-03T11:32:40.448 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.447+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~X4P6WP616BZL.0 size=914055 2023-12-03T11:32:40.449 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.448+0000 7f4d50c67780 1 < completed multipart upload key=U6R5Y9JXKT32 upload=X4P6WP616BZL tag=XSZ16OURPTQ6 type=write size=1962631 2023-12-03T11:32:40.450 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.450+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=AXZKNGRM39VA type=del size=1656767 2023-12-03T11:32:40.452 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.451+0000 7f4d50c67780 -1 < failed to complete operation key=JBL6IOJC4TT0 tag=XG475PKYAQ0K type=write size=845581: (22) Invalid argument 2023-12-03T11:32:40.454 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.453+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~UE2SUREJTJ1E.0 size=967293 2023-12-03T11:32:40.454 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.453+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=UE2SUREJTJ1E tag=GU4J23H9E2E1 type=write size=2015869 2023-12-03T11:32:40.455 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.454+0000 7f4d50c67780 1 < canceled operation key=0M6ZAD39I852 tag=S1GOYHW1VP2Y type=del size=1123963 2023-12-03T11:32:40.456 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.455+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=RBEG5D95BSWT type=write size=604426 2023-12-03T11:32:40.458 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.457+0000 7f4d50c67780 1 < suggested remove operation key=GTLP2WZUX7U8 tag=D8DDGFJKTHKN type=write 2023-12-03T11:32:40.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.459+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=EE0SH7GINZH3 type=del size=1068925 2023-12-03T11:32:40.461 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.460+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~JKM3IXR4SB2F.0 size=1048576 2023-12-03T11:32:40.462 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.461+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~JKM3IXR4SB2F.1 size=825637 2023-12-03T11:32:40.464 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.463+0000 7f4d50c67780 1 < completed multipart upload key=WUM939BATDG9 upload=JKM3IXR4SB2F tag=2H5KCWE2D7NJ type=write size=2922789 2023-12-03T11:32:40.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.465+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~LWC7UZLTFFFX.0 size=1048576 2023-12-03T11:32:40.467 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.466+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~LWC7UZLTFFFX.1 size=98546 2023-12-03T11:32:40.467 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.466+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=LWC7UZLTFFFX tag=C8Z800X2URCQ type=write size=2195698 2023-12-03T11:32:40.469 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.468+0000 7f4d50c67780 1 < suggested update operation key=EH4B2QP1C42H tag=DI1736HK1H7R type=del size=1599389 2023-12-03T11:32:40.470 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.469+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=ODVBK4SQVUYL type=del size=4016592 2023-12-03T11:32:40.471 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.471+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=UK8GVNQBL508 type=del 2023-12-03T11:32:40.473 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.472+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=AUNG9PVV216Z type=del size=1885123 2023-12-03T11:32:40.475 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.474+0000 7f4d50c67780 1 < suggested update operation key=73SL3ZBBDA6Q tag=R6F7HIMOIND8 type=del size=624626 2023-12-03T11:32:40.477 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.476+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~P1DPADODI1IF.0 size=368579 2023-12-03T11:32:40.477 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.476+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=P1DPADODI1IF tag=N39ELZKPTUWE type=write size=1417155 2023-12-03T11:32:40.478 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.478+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=NEPT42LL74NJ type=del 2023-12-03T11:32:40.481 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.480+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~1VT1LIYJPQOC.0 size=457794 2023-12-03T11:32:40.481 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.480+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=1VT1LIYJPQOC tag=ARICN492CAKN type=write size=1506370 2023-12-03T11:32:40.482 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.481+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=HA7M6B5546JO type=del 2023-12-03T11:32:40.484 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.483+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~4REJPBPNBS8O.0 size=1048576 2023-12-03T11:32:40.485 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.484+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~4REJPBPNBS8O.1 size=542577 2023-12-03T11:32:40.485 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.484+0000 7f4d50c67780 1 > prepared multipart upload key=QQDBWLVSXIHP upload=4REJPBPNBS8O tag=S35HWM79OIL6 type=write size=2639729 2023-12-03T11:32:40.486 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.485+0000 7f4d50c67780 1 < completed write operation key=TOGV2BZ99FRF tag=TGK2P3JME08B type=write size=822033 2023-12-03T11:32:40.489 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.488+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~2W496HTFO9FO.0 size=1048576 2023-12-03T11:32:40.489 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.489+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~2W496HTFO9FO.1 size=1048576 2023-12-03T11:32:40.491 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.490+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~2W496HTFO9FO.2 size=363509 2023-12-03T11:32:40.491 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.490+0000 7f4d50c67780 1 > prepared multipart upload key=U6R5Y9JXKT32 upload=2W496HTFO9FO tag=N55RJZZA0NIM type=write size=3509237 2023-12-03T11:32:40.492 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.491+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=I8KEGNCLGN02 type=del 2023-12-03T11:32:40.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.492+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=JA0WZU9YWTNG type=del size=330759 2023-12-03T11:32:40.494 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.493+0000 7f4d50c67780 1 < completed delete operation key=7C7UX0231SHV tag=7TNVULWQZWJE type=del 2023-12-03T11:32:40.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.495+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~GE3IQ49XYHM9.0 size=1048576 2023-12-03T11:32:40.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.496+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~GE3IQ49XYHM9.1 size=982153 2023-12-03T11:32:40.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.496+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=GE3IQ49XYHM9 tag=MXENUVNQHXYD type=write size=3079305 2023-12-03T11:32:40.499 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.498+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=G5D77PA116NS type=del 2023-12-03T11:32:40.501 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.500+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~KD2CRD9M3L5L.0 size=364769 2023-12-03T11:32:40.501 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.500+0000 7f4d50c67780 1 > prepared multipart upload key=ULLPV2G10BME upload=KD2CRD9M3L5L tag=Q6O3LCP8BUYT type=write size=1413345 2023-12-03T11:32:40.502 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.501+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~9TM713AU3H8W.0 size=174602 2023-12-03T11:32:40.504 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.503+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=9TM713AU3H8W tag=DYM2G26F1C1O type=write size=1223178 2023-12-03T11:32:40.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.506+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~SHPT1Q993NQU.0 size=260765 2023-12-03T11:32:40.507 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.506+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=SHPT1Q993NQU tag=QZ71PQKCZ3SQ type=write size=1309341 2023-12-03T11:32:40.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.507+0000 7f4d50c67780 1 < completed write operation key=V0ND3OBFJJUB tag=OB5T09NCSMO0 type=write size=365495 2023-12-03T11:32:40.510 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.509+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~M6Q2W724OZYN.0 size=1048576 2023-12-03T11:32:40.511 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.510+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~M6Q2W724OZYN.1 size=757771 2023-12-03T11:32:40.511 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.510+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=M6Q2W724OZYN tag=FFSJYXY4NN9J type=write size=2854923 2023-12-03T11:32:40.512 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.512+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=AXZKNGRM39VA type=del 2023-12-03T11:32:40.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.514+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~YRIM3UPTPEE4.0 size=1048576 2023-12-03T11:32:40.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.515+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~YRIM3UPTPEE4.1 size=1048576 2023-12-03T11:32:40.516 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.516+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~YRIM3UPTPEE4.2 size=314980 2023-12-03T11:32:40.517 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.516+0000 7f4d50c67780 1 > prepared multipart upload key=73SL3ZBBDA6Q upload=YRIM3UPTPEE4 tag=C685ZPRYR1KR type=write size=3460708 2023-12-03T11:32:40.518 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.517+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~UE2SUREJTJ1E.0 size=967293 2023-12-03T11:32:40.520 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.519+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=UE2SUREJTJ1E tag=GU4J23H9E2E1 type=write size=2015869 2023-12-03T11:32:40.521 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.520+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=B4AAMALBRIZQ type=write size=602695 2023-12-03T11:32:40.522 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.521+0000 7f4d50c67780 1 < completed write operation key=RF2Q24GI24HJ tag=RBEG5D95BSWT type=write size=604426 2023-12-03T11:32:40.524 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.524+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~OFAH857U6CD0.0 size=1048576 2023-12-03T11:32:40.525 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.525+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~OFAH857U6CD0.1 size=1048576 2023-12-03T11:32:40.526 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.525+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~OFAH857U6CD0.2 size=180836 2023-12-03T11:32:40.526 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.525+0000 7f4d50c67780 1 > prepared multipart upload key=RF2Q24GI24HJ upload=OFAH857U6CD0 tag=TPMIR2H28D7A type=write size=3326564 2023-12-03T11:32:40.528 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.527+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=EE0SH7GINZH3 type=del 2023-12-03T11:32:40.529 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.528+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=LG0KUZKSG19P type=del size=597694 2023-12-03T11:32:40.530 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.529+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~LWC7UZLTFFFX.0 size=1048576 2023-12-03T11:32:40.531 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.530+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~LWC7UZLTFFFX.1 size=98546 2023-12-03T11:32:40.533 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.532+0000 7f4d50c67780 1 < completed multipart upload key=CQPZ0X62207Z upload=LWC7UZLTFFFX tag=C8Z800X2URCQ type=write size=2195698 2023-12-03T11:32:40.534 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.533+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=LP7VXFBU4HSP type=del size=1990346 2023-12-03T11:32:40.536 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.535+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=ODVBK4SQVUYL type=del 2023-12-03T11:32:40.538 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.537+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~I3RGKKWKXHQT.0 size=725989 2023-12-03T11:32:40.538 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.537+0000 7f4d50c67780 1 > prepared multipart upload key=RF2Q24GI24HJ upload=I3RGKKWKXHQT tag=R09K846JYT3J type=write size=1774565 2023-12-03T11:32:40.539 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.538+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=AUNG9PVV216Z type=del 2023-12-03T11:32:40.540 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.539+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=BA47YFF11M03 type=write size=621991 2023-12-03T11:32:40.542 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.541+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~P1DPADODI1IF.0 size=368579 2023-12-03T11:32:40.545 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.544+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=P1DPADODI1IF tag=N39ELZKPTUWE type=write size=1417155 2023-12-03T11:32:40.547 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.546+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~TR78RGPZIHJX.0 size=1048576 2023-12-03T11:32:40.548 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.547+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~TR78RGPZIHJX.1 size=1048576 2023-12-03T11:32:40.549 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.548+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~TR78RGPZIHJX.2 size=625832 2023-12-03T11:32:40.549 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.548+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=TR78RGPZIHJX tag=HVE4GOEHRMFM type=write size=3771560 2023-12-03T11:32:40.550 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.549+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~1VT1LIYJPQOC.0 size=457794 2023-12-03T11:32:40.552 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.551+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=1VT1LIYJPQOC tag=ARICN492CAKN type=write size=1506370 2023-12-03T11:32:40.553 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.552+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=6EFL1MBJY5N6 type=del size=1567560 2023-12-03T11:32:40.554 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.553+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~4REJPBPNBS8O.0 size=1048576 2023-12-03T11:32:40.555 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.555+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~4REJPBPNBS8O.1 size=542577 2023-12-03T11:32:40.558 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.557+0000 7f4d50c67780 1 < completed multipart upload key=QQDBWLVSXIHP upload=4REJPBPNBS8O tag=S35HWM79OIL6 type=write size=2639729 2023-12-03T11:32:40.560 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.560+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~2MEQGTBSLIQY.0 size=524200 2023-12-03T11:32:40.561 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.560+0000 7f4d50c67780 1 > prepared multipart upload key=QQDBWLVSXIHP upload=2MEQGTBSLIQY tag=2OHIPUQOOHN0 type=write size=1572776 2023-12-03T11:32:40.562 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.561+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~2W496HTFO9FO.0 size=1048576 2023-12-03T11:32:40.563 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.562+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~2W496HTFO9FO.1 size=1048576 2023-12-03T11:32:40.564 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.563+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~2W496HTFO9FO.2 size=363509 2023-12-03T11:32:40.566 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.565+0000 7f4d50c67780 1 < completed multipart upload key=U6R5Y9JXKT32 upload=2W496HTFO9FO tag=N55RJZZA0NIM type=write size=3509237 2023-12-03T11:32:40.568 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.567+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~S44SEKKP5HY7.0 size=1048576 2023-12-03T11:32:40.569 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.568+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~S44SEKKP5HY7.1 size=1048576 2023-12-03T11:32:40.570 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.569+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~S44SEKKP5HY7.2 size=871096 2023-12-03T11:32:40.570 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.569+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=S44SEKKP5HY7 tag=V3OI7SV8FA0S type=write size=4016824 2023-12-03T11:32:40.571 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.571+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=JA0WZU9YWTNG type=del 2023-12-03T11:32:40.573 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.572+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=A03NAXG71PC3 type=del size=1738325 2023-12-03T11:32:40.573 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.572+0000 7f4d50c67780 1 < canceled part key=_multipart_EH4B2QP1C42H.2~GE3IQ49XYHM9.0 size=1048576 2023-12-03T11:32:40.574 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.573+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~GE3IQ49XYHM9.1 size=982153 2023-12-03T11:32:40.576 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.575+0000 7f4d50c67780 1 < canceled multipart upload key=EH4B2QP1C42H upload=GE3IQ49XYHM9 tag=MXENUVNQHXYD type=write size=3079305 2023-12-03T11:32:40.578 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.577+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~AAXLEDTNDJNW.0 size=1048576 2023-12-03T11:32:40.579 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.578+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~AAXLEDTNDJNW.1 size=121855 2023-12-03T11:32:40.579 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.579+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=AAXLEDTNDJNW tag=017GUITNHQGM type=write size=2219007 2023-12-03T11:32:40.581 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.580+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~KD2CRD9M3L5L.0 size=364769 2023-12-03T11:32:40.583 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.582+0000 7f4d50c67780 1 < completed multipart upload key=ULLPV2G10BME upload=KD2CRD9M3L5L tag=Q6O3LCP8BUYT type=write size=1413345 2023-12-03T11:32:40.584 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.583+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=YL9W5IE2A0Q2 type=del size=3630577 2023-12-03T11:32:40.585 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.585+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~SHPT1Q993NQU.0 size=260765 2023-12-03T11:32:40.588 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.587+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=SHPT1Q993NQU tag=QZ71PQKCZ3SQ type=write size=1309341 2023-12-03T11:32:40.590 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.589+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~TCKZ9K7H11BR.0 size=577661 2023-12-03T11:32:40.590 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.589+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=TCKZ9K7H11BR tag=R90MSG041XYT type=write size=1626237 2023-12-03T11:32:40.591 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.590+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~M6Q2W724OZYN.0 size=1048576 2023-12-03T11:32:40.592 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.591+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~M6Q2W724OZYN.1 size=757771 2023-12-03T11:32:40.594 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.593+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=M6Q2W724OZYN tag=FFSJYXY4NN9J type=write size=2854923 2023-12-03T11:32:40.595 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.594+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=AKAVJFXKVFM8 type=del size=3263913 2023-12-03T11:32:40.596 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.595+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~YRIM3UPTPEE4.0 size=1048576 2023-12-03T11:32:40.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.596+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~YRIM3UPTPEE4.1 size=1048576 2023-12-03T11:32:40.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.596+0000 7f4d50c67780 1 < canceled part key=_multipart_73SL3ZBBDA6Q.2~YRIM3UPTPEE4.2 size=314980 2023-12-03T11:32:40.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.598+0000 7f4d50c67780 1 < canceled multipart upload key=73SL3ZBBDA6Q upload=YRIM3UPTPEE4 tag=C685ZPRYR1KR type=write size=3460708 2023-12-03T11:32:40.600 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.599+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=BFDN140N1SID type=write size=674221 2023-12-03T11:32:40.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.601+0000 7f4d50c67780 1 < completed write operation key=EY1RBO15PCRR tag=B4AAMALBRIZQ type=write size=602695 2023-12-03T11:32:40.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.602+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=XSDYDFVK9OGE type=del size=1045677 2023-12-03T11:32:40.604 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.603+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~OFAH857U6CD0.0 size=1048576 2023-12-03T11:32:40.605 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.604+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~OFAH857U6CD0.1 size=1048576 2023-12-03T11:32:40.606 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.605+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~OFAH857U6CD0.2 size=180836 2023-12-03T11:32:40.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.607+0000 7f4d50c67780 1 < completed multipart upload key=RF2Q24GI24HJ upload=OFAH857U6CD0 tag=TPMIR2H28D7A type=write size=3326564 2023-12-03T11:32:40.610 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.609+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~697PV6YCJ3X6.0 size=789994 2023-12-03T11:32:40.610 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.609+0000 7f4d50c67780 1 > prepared multipart upload key=JR8CIONID4QC upload=697PV6YCJ3X6 tag=M1OJLMRWLPB9 type=write size=1838570 2023-12-03T11:32:40.611 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.611+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=LG0KUZKSG19P type=del 2023-12-03T11:32:40.614 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.613+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~K8JHGLOXWFIV.0 size=1048576 2023-12-03T11:32:40.615 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.614+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~K8JHGLOXWFIV.1 size=920972 2023-12-03T11:32:40.615 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.614+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=K8JHGLOXWFIV tag=8Q7Z3YUPJBRC type=write size=3018124 2023-12-03T11:32:40.616 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.615+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=LP7VXFBU4HSP type=del 2023-12-03T11:32:40.618 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.617+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=KYT6CWMEROFR type=del size=3911363 2023-12-03T11:32:40.619 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.618+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~I3RGKKWKXHQT.0 size=725989 2023-12-03T11:32:40.621 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.620+0000 7f4d50c67780 1 < completed multipart upload key=RF2Q24GI24HJ upload=I3RGKKWKXHQT tag=R09K846JYT3J type=write size=1774565 2023-12-03T11:32:40.623 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.622+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~B4ADC9Z095N5.0 size=1048576 2023-12-03T11:32:40.624 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.623+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~B4ADC9Z095N5.1 size=1048576 2023-12-03T11:32:40.625 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.624+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~B4ADC9Z095N5.2 size=258381 2023-12-03T11:32:40.625 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.624+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=B4ADC9Z095N5 tag=W28RJ30NV4A6 type=write size=3404109 2023-12-03T11:32:40.626 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.625+0000 7f4d50c67780 1 < completed write operation key=02W4TX7ZCDI6 tag=BA47YFF11M03 type=write size=621991 2023-12-03T11:32:40.628 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.626+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=3QWE70V6ZX2G type=del size=2993577 2023-12-03T11:32:40.629 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.628+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~TR78RGPZIHJX.0 size=1048576 2023-12-03T11:32:40.630 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.629+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~TR78RGPZIHJX.1 size=1048576 2023-12-03T11:32:40.631 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.630+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~TR78RGPZIHJX.2 size=625832 2023-12-03T11:32:40.633 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.632+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=TR78RGPZIHJX tag=HVE4GOEHRMFM type=write size=3771560 2023-12-03T11:32:40.634 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.633+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=RLU2S5B11L6I type=write size=307573 2023-12-03T11:32:40.635 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.635+0000 7f4d50c67780 1 < canceled operation key=8J1EO2JDQUQH tag=6EFL1MBJY5N6 type=del size=1567560 2023-12-03T11:32:40.638 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.637+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~EN96USYBJRS8.0 size=1048576 2023-12-03T11:32:40.639 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.638+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~EN96USYBJRS8.1 size=430042 2023-12-03T11:32:40.639 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.638+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=EN96USYBJRS8 tag=VT7TR463I3YY type=write size=2527194 2023-12-03T11:32:40.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.639+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~2MEQGTBSLIQY.0 size=524200 2023-12-03T11:32:40.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.641+0000 7f4d50c67780 1 < completed multipart upload key=QQDBWLVSXIHP upload=2MEQGTBSLIQY tag=2OHIPUQOOHN0 type=write size=1572776 2023-12-03T11:32:40.643 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.643+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=1E4ZJMEZF6BO type=del size=1794526 2023-12-03T11:32:40.645 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.644+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~S44SEKKP5HY7.0 size=1048576 2023-12-03T11:32:40.646 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.645+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~S44SEKKP5HY7.1 size=1048576 2023-12-03T11:32:40.647 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.646+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~S44SEKKP5HY7.2 size=871096 2023-12-03T11:32:40.649 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.648+0000 7f4d50c67780 1 < completed multipart upload key=EAP0BYZTTT2E upload=S44SEKKP5HY7 tag=V3OI7SV8FA0S type=write size=4016824 2023-12-03T11:32:40.650 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.649+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=4RP7J65EWCT2 type=write size=383752 2023-12-03T11:32:40.652 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.651+0000 7f4d50c67780 1 < completed delete operation key=7C7UX0231SHV tag=A03NAXG71PC3 type=del 2023-12-03T11:32:40.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.652+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=XP3S3BQZYJY1 type=del size=2914728 2023-12-03T11:32:40.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.653+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~AAXLEDTNDJNW.0 size=1048576 2023-12-03T11:32:40.655 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.654+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~AAXLEDTNDJNW.1 size=121855 2023-12-03T11:32:40.658 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.658+0000 7f4d50c67780 1 < completed multipart upload key=02W4TX7ZCDI6 upload=AAXLEDTNDJNW tag=017GUITNHQGM type=write size=2219007 2023-12-03T11:32:40.660 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.659+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=VRSUEYDVWTJ2 type=del size=2469472 2023-12-03T11:32:40.661 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.660+0000 7f4d50c67780 1 < canceled operation key=U6R5Y9JXKT32 tag=YL9W5IE2A0Q2 type=del size=3630577 2023-12-03T11:32:40.662 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.661+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=TU8N77FGB2BJ type=del size=1072110 2023-12-03T11:32:40.663 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.662+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~TCKZ9K7H11BR.0 size=577661 2023-12-03T11:32:40.665 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.664+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=TCKZ9K7H11BR tag=R90MSG041XYT type=write size=1626237 2023-12-03T11:32:40.668 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.667+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~TVAHQX45BL0P.0 size=1048576 2023-12-03T11:32:40.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.668+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~TVAHQX45BL0P.1 size=396244 2023-12-03T11:32:40.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.668+0000 7f4d50c67780 1 > prepared multipart upload key=ULLPV2G10BME upload=TVAHQX45BL0P tag=F21REFHKDHQV type=write size=2493396 2023-12-03T11:32:40.670 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.669+0000 7f4d50c67780 1 < completed delete operation key=7C7UX0231SHV tag=AKAVJFXKVFM8 type=del 2023-12-03T11:32:40.671 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.670+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=GGV8J6MR53XT type=del size=2714358 2023-12-03T11:32:40.672 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.672+0000 7f4d50c67780 1 < completed write operation key=52E31L45TN7V tag=BFDN140N1SID type=write size=674221 2023-12-03T11:32:40.674 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.674+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~DE6RMAOGTE0W.0 size=1048576 2023-12-03T11:32:40.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.675+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~DE6RMAOGTE0W.1 size=628952 2023-12-03T11:32:40.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.675+0000 7f4d50c67780 1 > prepared multipart upload key=JBL6IOJC4TT0 upload=DE6RMAOGTE0W tag=4AP7DVJZTN3Z type=write size=2726104 2023-12-03T11:32:40.676 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.676+0000 7f4d50c67780 1 < completed delete operation key=0M6ZAD39I852 tag=XSDYDFVK9OGE type=del 2023-12-03T11:32:40.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.677+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=0AP7LJAX02GH type=del size=2826307 2023-12-03T11:32:40.679 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.678+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~697PV6YCJ3X6.0 size=789994 2023-12-03T11:32:40.681 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.680+0000 7f4d50c67780 1 < completed multipart upload key=JR8CIONID4QC upload=697PV6YCJ3X6 tag=M1OJLMRWLPB9 type=write size=1838570 2023-12-03T11:32:40.682 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.681+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=8JGAMG0DWC04 type=del size=1501978 2023-12-03T11:32:40.683 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.683+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~K8JHGLOXWFIV.0 size=1048576 2023-12-03T11:32:40.685 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.684+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~K8JHGLOXWFIV.1 size=920972 2023-12-03T11:32:40.687 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.686+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=K8JHGLOXWFIV tag=8Q7Z3YUPJBRC type=write size=3018124 2023-12-03T11:32:40.689 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.688+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~P9INNSII3IC7.0 size=1048576 2023-12-03T11:32:40.690 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.689+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~P9INNSII3IC7.1 size=1048576 2023-12-03T11:32:40.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.690+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~P9INNSII3IC7.2 size=461896 2023-12-03T11:32:40.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.690+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=P9INNSII3IC7 tag=M9LL4F2R7CF3 type=write size=3607624 2023-12-03T11:32:40.692 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.691+0000 7f4d50c67780 1 < completed delete operation key=WUM939BATDG9 tag=KYT6CWMEROFR type=del 2023-12-03T11:32:40.693 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.693+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=6F2WVP9JS2IS type=del size=3178264 2023-12-03T11:32:40.695 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.694+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~B4ADC9Z095N5.0 size=1048576 2023-12-03T11:32:40.696 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.695+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~B4ADC9Z095N5.1 size=1048576 2023-12-03T11:32:40.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.696+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~B4ADC9Z095N5.2 size=258381 2023-12-03T11:32:40.700 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.699+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=B4ADC9Z095N5 tag=W28RJ30NV4A6 type=write size=3404109 2023-12-03T11:32:40.701 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.700+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=5NSNPSLPA62Q type=del size=1963877 2023-12-03T11:32:40.702 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.702+0000 7f4d50c67780 1 < canceled operation key=WUM939BATDG9 tag=3QWE70V6ZX2G type=del size=2993577 2023-12-03T11:32:40.704 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.703+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=7ZUYWTL1WO3H type=write size=456188 2023-12-03T11:32:40.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.704+0000 7f4d50c67780 1 < completed write operation key=YDRAH5EE39R4 tag=RLU2S5B11L6I type=write size=307573 2023-12-03T11:32:40.706 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.705+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=OQ95NJ39ETI7 type=write size=741833 2023-12-03T11:32:40.707 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.706+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~EN96USYBJRS8.0 size=1048576 2023-12-03T11:32:40.707 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.706+0000 7f4d50c67780 1 < canceled part key=_multipart_02W4TX7ZCDI6.2~EN96USYBJRS8.1 size=430042 2023-12-03T11:32:40.709 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.708+0000 7f4d50c67780 1 < canceled multipart upload key=02W4TX7ZCDI6 upload=EN96USYBJRS8 tag=VT7TR463I3YY type=write size=2527194 2023-12-03T11:32:40.711 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.710+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=46S4KMDSAFP1 type=del size=1567845 2023-12-03T11:32:40.713 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.712+0000 7f4d50c67780 1 < suggested remove operation key=U6R5Y9JXKT32 tag=1E4ZJMEZF6BO type=del 2023-12-03T11:32:40.714 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.713+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=2ZXWV4KDLL43 type=del size=3158855 2023-12-03T11:32:40.717 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.716+0000 7f4d50c67780 1 < suggested update operation key=2H6AFQ362OGP tag=4RP7J65EWCT2 type=write size=383752 2023-12-03T11:32:40.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.718+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~YSG1WPGQRYC0.0 size=1048576 2023-12-03T11:32:40.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.719+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~YSG1WPGQRYC0.1 size=1048576 2023-12-03T11:32:40.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.720+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~YSG1WPGQRYC0.2 size=824377 2023-12-03T11:32:40.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.720+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=YSG1WPGQRYC0 tag=YL04X0540JQI type=write size=3970105 2023-12-03T11:32:40.723 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.722+0000 7f4d50c67780 1 < completed delete operation key=02W4TX7ZCDI6 tag=XP3S3BQZYJY1 type=del 2023-12-03T11:32:40.724 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.723+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=GV28TZ8HC1M0 type=del size=2940564 2023-12-03T11:32:40.726 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.725+0000 7f4d50c67780 1 < suggested update operation key=0M6ZAD39I852 tag=VRSUEYDVWTJ2 type=del size=2469472 2023-12-03T11:32:40.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.727+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=NZF73BLFB3LC type=del size=426712 2023-12-03T11:32:40.729 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.728+0000 7f4d50c67780 1 < completed delete operation key=MLKGLDFFDC3W tag=TU8N77FGB2BJ type=del 2023-12-03T11:32:40.731 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.731+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~R5BW5VYD1N0H.0 size=1045677 2023-12-03T11:32:40.732 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.731+0000 7f4d50c67780 1 > prepared multipart upload key=G0O8EC405LYM upload=R5BW5VYD1N0H tag=MY006ARPI9D7 type=write size=2094253 2023-12-03T11:32:40.733 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.732+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~TVAHQX45BL0P.0 size=1048576 2023-12-03T11:32:40.734 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.733+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~TVAHQX45BL0P.1 size=396244 2023-12-03T11:32:40.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.735+0000 7f4d50c67780 1 < completed multipart upload key=ULLPV2G10BME upload=TVAHQX45BL0P tag=F21REFHKDHQV type=write size=2493396 2023-12-03T11:32:40.738 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.737+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=8UGYYMCVRRPB type=del size=1110495 2023-12-03T11:32:40.740 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.739+0000 7f4d50c67780 1 < suggested update operation key=MLKGLDFFDC3W tag=GGV8J6MR53XT type=del size=2714358 2023-12-03T11:32:40.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.741+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=HOL19XGI9WE8 type=del size=1383810 2023-12-03T11:32:40.743 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.742+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~DE6RMAOGTE0W.0 size=1048576 2023-12-03T11:32:40.744 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.743+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~DE6RMAOGTE0W.1 size=628952 2023-12-03T11:32:40.746 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.746+0000 7f4d50c67780 1 < completed multipart upload key=JBL6IOJC4TT0 upload=DE6RMAOGTE0W tag=4AP7DVJZTN3Z type=write size=2726104 2023-12-03T11:32:40.748 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.747+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=HX5NSSMJP6R5 type=del size=268036 2023-12-03T11:32:40.749 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.748+0000 7f4d50c67780 1 < completed delete operation key=WUM939BATDG9 tag=0AP7LJAX02GH type=del 2023-12-03T11:32:40.750 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.750+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=1UW01K0H8X9E type=del size=2116843 2023-12-03T11:32:40.752 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.751+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=8JGAMG0DWC04 type=del 2023-12-03T11:32:40.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.753+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~9QMKIE90D78P.0 size=703800 2023-12-03T11:32:40.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.753+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=9QMKIE90D78P tag=8D63LA5ZC9D2 type=write size=1752376 2023-12-03T11:32:40.755 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.754+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~P9INNSII3IC7.0 size=1048576 2023-12-03T11:32:40.756 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.755+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~P9INNSII3IC7.1 size=1048576 2023-12-03T11:32:40.757 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.756+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~P9INNSII3IC7.2 size=461896 2023-12-03T11:32:40.759 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.759+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=P9INNSII3IC7 tag=M9LL4F2R7CF3 type=write size=3607624 2023-12-03T11:32:40.761 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.760+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=FH3T8RY5VIDB type=del size=94065 2023-12-03T11:32:40.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.763+0000 7f4d50c67780 1 < suggested update operation key=73SL3ZBBDA6Q tag=6F2WVP9JS2IS type=del size=3178264 2023-12-03T11:32:40.766 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.765+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~G1L9863KMAO9.0 size=1048576 2023-12-03T11:32:40.767 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.766+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~G1L9863KMAO9.1 size=541433 2023-12-03T11:32:40.767 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.766+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=G1L9863KMAO9 tag=3V60G7S765IX type=write size=2638585 2023-12-03T11:32:40.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.768+0000 7f4d50c67780 1 < completed delete operation key=02W4TX7ZCDI6 tag=5NSNPSLPA62Q type=del 2023-12-03T11:32:40.770 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.769+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=8ZBSQ38W22GI type=del size=3502338 2023-12-03T11:32:40.771 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.770+0000 7f4d50c67780 -1 < failed to complete operation key=U6R5Y9JXKT32 tag=7ZUYWTL1WO3H type=write size=456188: (22) Invalid argument 2023-12-03T11:32:40.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.772+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~B0AIUARAADHL.0 size=1048576 2023-12-03T11:32:40.774 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.774+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~B0AIUARAADHL.1 size=1048576 2023-12-03T11:32:40.777 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.775+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~B0AIUARAADHL.2 size=807587 2023-12-03T11:32:40.777 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.775+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=B0AIUARAADHL tag=BHA2YAGN53WP type=write size=3953315 2023-12-03T11:32:40.778 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.777+0000 7f4d50c67780 1 < completed write operation key=83I1M5WIVKAA tag=OQ95NJ39ETI7 type=write size=741833 2023-12-03T11:32:40.780 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.779+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~XEY6PDGATDI7.0 size=1048576 2023-12-03T11:32:40.781 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.780+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~XEY6PDGATDI7.1 size=1048576 2023-12-03T11:32:40.782 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.781+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~XEY6PDGATDI7.2 size=828307 2023-12-03T11:32:40.782 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.781+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=XEY6PDGATDI7 tag=O5F2M9BK7FAW type=write size=3974035 2023-12-03T11:32:40.784 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.783+0000 7f4d50c67780 1 < suggested remove operation key=EX93BYX10WJB tag=46S4KMDSAFP1 type=del 2023-12-03T11:32:40.785 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.785+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=LIKKZAXCT58S type=del size=98468 2023-12-03T11:32:40.786 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.786+0000 7f4d50c67780 1 < completed delete operation key=EAP0BYZTTT2E tag=2ZXWV4KDLL43 type=del 2023-12-03T11:32:40.788 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.787+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=ECJ023QCZSSL type=del size=3840044 2023-12-03T11:32:40.789 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.788+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~YSG1WPGQRYC0.0 size=1048576 2023-12-03T11:32:40.790 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.789+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~YSG1WPGQRYC0.1 size=1048576 2023-12-03T11:32:40.791 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.790+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~YSG1WPGQRYC0.2 size=824377 2023-12-03T11:32:40.793 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.792+0000 7f4d50c67780 1 < completed multipart upload key=V0ND3OBFJJUB upload=YSG1WPGQRYC0 tag=YL04X0540JQI type=write size=3970105 2023-12-03T11:32:40.794 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.793+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=T27G52P5W6UL type=del size=3585432 2023-12-03T11:32:40.797 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.796+0000 7f4d50c67780 1 < suggested update operation key=2H6AFQ362OGP tag=GV28TZ8HC1M0 type=del size=2940564 2023-12-03T11:32:40.799 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.798+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~RDJH2TSJWBJV.0 size=1048576 2023-12-03T11:32:40.800 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.799+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~RDJH2TSJWBJV.1 size=1048576 2023-12-03T11:32:40.801 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.800+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~RDJH2TSJWBJV.2 size=161130 2023-12-03T11:32:40.801 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.800+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=RDJH2TSJWBJV tag=PQ2HCVQO333F type=write size=3306858 2023-12-03T11:32:40.802 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.801+0000 7f4d50c67780 1 < canceled operation key=TEIYINZFFG76 tag=NZF73BLFB3LC type=del size=426712 2023-12-03T11:32:40.803 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.802+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=RH84YSHJNTV3 type=write size=247892 2023-12-03T11:32:40.804 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.804+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~R5BW5VYD1N0H.0 size=1045677 2023-12-03T11:32:40.807 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.806+0000 7f4d50c67780 1 < completed multipart upload key=G0O8EC405LYM upload=R5BW5VYD1N0H tag=MY006ARPI9D7 type=write size=2094253 2023-12-03T11:32:40.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.807+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=O1OAWF7FVCLF type=del size=1430293 2023-12-03T11:32:40.810 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.809+0000 7f4d50c67780 1 < suggested update operation key=RF2Q24GI24HJ tag=8UGYYMCVRRPB type=del size=1110495 2023-12-03T11:32:40.811 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.811+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=EQ6EZNLWCZMW type=del size=1188833 2023-12-03T11:32:40.813 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.812+0000 7f4d50c67780 1 < completed delete operation key=CQPZ0X62207Z tag=HOL19XGI9WE8 type=del 2023-12-03T11:32:40.814 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.813+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=618DLC50B1VU type=del size=2967612 2023-12-03T11:32:40.816 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.816+0000 7f4d50c67780 1 < suggested remove operation key=G0O8EC405LYM tag=HX5NSSMJP6R5 type=del 2023-12-03T11:32:40.818 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.817+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=JW5BSMRS3JIR type=del size=2297835 2023-12-03T11:32:40.819 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.818+0000 7f4d50c67780 1 < completed delete operation key=V0ND3OBFJJUB tag=1UW01K0H8X9E type=del 2023-12-03T11:32:40.820 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.819+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=RVKFKE978TN3 type=del size=101678 2023-12-03T11:32:40.822 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.821+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~9QMKIE90D78P.0 size=703800 2023-12-03T11:32:40.824 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.823+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=9QMKIE90D78P tag=8D63LA5ZC9D2 type=write size=1752376 2023-12-03T11:32:40.826 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.825+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~UG11PHL4PQ0Q.0 size=1048576 2023-12-03T11:32:40.827 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.826+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~UG11PHL4PQ0Q.1 size=1048576 2023-12-03T11:32:40.828 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.827+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~UG11PHL4PQ0Q.2 size=181409 2023-12-03T11:32:40.828 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.827+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=UG11PHL4PQ0Q tag=3KXAWKDB0LZO type=write size=3327137 2023-12-03T11:32:40.830 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.830+0000 7f4d50c67780 1 < suggested update operation key=83I1M5WIVKAA tag=FH3T8RY5VIDB type=del size=94065 2023-12-03T11:32:40.832 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.831+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=KSOMKCQKKATI type=del size=2395648 2023-12-03T11:32:40.833 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.832+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~G1L9863KMAO9.0 size=1048576 2023-12-03T11:32:40.834 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.833+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~G1L9863KMAO9.1 size=541433 2023-12-03T11:32:40.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.835+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=G1L9863KMAO9 tag=3V60G7S765IX type=write size=2638585 2023-12-03T11:32:40.837 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.837+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=R6X5CCQKC4YH type=del size=3763807 2023-12-03T11:32:40.839 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.838+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=8ZBSQ38W22GI type=del 2023-12-03T11:32:40.840 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.839+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=BP8AHKZWYK66 type=del size=3039792 2023-12-03T11:32:40.841 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.841+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~B0AIUARAADHL.0 size=1048576 2023-12-03T11:32:40.843 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.842+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~B0AIUARAADHL.1 size=1048576 2023-12-03T11:32:40.843 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.843+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~B0AIUARAADHL.2 size=807587 2023-12-03T11:32:40.845 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.845+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=B0AIUARAADHL tag=BHA2YAGN53WP type=write size=3953315 2023-12-03T11:32:40.847 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.846+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=NOSXIDU4BUSG type=del size=1693618 2023-12-03T11:32:40.848 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.847+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~XEY6PDGATDI7.0 size=1048576 2023-12-03T11:32:40.849 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.848+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~XEY6PDGATDI7.1 size=1048576 2023-12-03T11:32:40.849 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.848+0000 7f4d50c67780 1 < canceled part key=_multipart_EX93BYX10WJB.2~XEY6PDGATDI7.2 size=828307 2023-12-03T11:32:40.851 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.850+0000 7f4d50c67780 1 < canceled multipart upload key=EX93BYX10WJB upload=XEY6PDGATDI7 tag=O5F2M9BK7FAW type=write size=3974035 2023-12-03T11:32:40.853 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.852+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~ELEJZGIYDDTS.0 size=1048576 2023-12-03T11:32:40.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.853+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~ELEJZGIYDDTS.1 size=1048576 2023-12-03T11:32:40.855 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.854+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~ELEJZGIYDDTS.2 size=249404 2023-12-03T11:32:40.855 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.854+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=ELEJZGIYDDTS tag=KFWI1V46UAQ2 type=write size=3395132 2023-12-03T11:32:40.856 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.855+0000 7f4d50c67780 1 < canceled operation key=V0ND3OBFJJUB tag=LIKKZAXCT58S type=del size=98468 2023-12-03T11:32:40.858 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.857+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~2Y8Q4EFGD6VK.0 size=747898 2023-12-03T11:32:40.858 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.857+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=2Y8Q4EFGD6VK tag=OYN9CGZT278V type=write size=1796474 2023-12-03T11:32:40.859 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.859+0000 7f4d50c67780 -1 < failed to complete operation key=G0O8EC405LYM tag=ECJ023QCZSSL type=del size=3840044: (22) Invalid argument 2023-12-03T11:32:40.862 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.861+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~N90ZE4BF8NAZ.0 size=1048576 2023-12-03T11:32:40.863 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.862+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~N90ZE4BF8NAZ.1 size=1032196 2023-12-03T11:32:40.863 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.862+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=N90ZE4BF8NAZ tag=5SYL6ES3S94Z type=write size=3129348 2023-12-03T11:32:40.865 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.864+0000 7f4d50c67780 1 < suggested update operation key=CQPZ0X62207Z tag=T27G52P5W6UL type=del size=3585432 2023-12-03T11:32:40.866 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.865+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=VXJ31U3VT54B type=del size=57396 2023-12-03T11:32:40.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.867+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~RDJH2TSJWBJV.0 size=1048576 2023-12-03T11:32:40.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.868+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~RDJH2TSJWBJV.1 size=1048576 2023-12-03T11:32:40.870 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.869+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~RDJH2TSJWBJV.2 size=161130 2023-12-03T11:32:40.872 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.871+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=RDJH2TSJWBJV tag=PQ2HCVQO333F type=write size=3306858 2023-12-03T11:32:40.874 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.873+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~9R74WFNETEQY.0 size=1048576 2023-12-03T11:32:40.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.874+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~9R74WFNETEQY.1 size=769564 2023-12-03T11:32:40.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.874+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=9R74WFNETEQY tag=QN4AUMXN1ZLJ type=write size=2866716 2023-12-03T11:32:40.876 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.875+0000 7f4d50c67780 -1 < failed to complete operation key=RF2Q24GI24HJ tag=RH84YSHJNTV3 type=write size=247892: (22) Invalid argument 2023-12-03T11:32:40.877 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.876+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=16E3YW44G4LZ type=write size=283288 2023-12-03T11:32:40.881 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.878+0000 7f4d50c67780 1 < completed delete operation key=52E31L45TN7V tag=O1OAWF7FVCLF type=del 2023-12-03T11:32:40.881 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.881+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~YJ6I7RLDLMM0.0 size=1048576 2023-12-03T11:32:40.882 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.882+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~YJ6I7RLDLMM0.1 size=177037 2023-12-03T11:32:40.882 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.882+0000 7f4d50c67780 1 > prepared multipart upload key=ZE19S5UCCZ3C upload=YJ6I7RLDLMM0 tag=CKLIGBXPX4ED type=write size=2274189 2023-12-03T11:32:40.885 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.884+0000 7f4d50c67780 1 < suggested update operation key=0M6ZAD39I852 tag=EQ6EZNLWCZMW type=del size=1188833 2023-12-03T11:32:40.886 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.885+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=E67W0A44FUS8 type=del size=3346139 2023-12-03T11:32:40.889 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.888+0000 7f4d50c67780 1 < suggested update operation key=V0ND3OBFJJUB tag=618DLC50B1VU type=del size=2967612 2023-12-03T11:32:40.890 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.889+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=21YG5EPXGPFZ type=del size=2901268 2023-12-03T11:32:40.891 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.890+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=JW5BSMRS3JIR type=del 2023-12-03T11:32:40.894 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.893+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=GDBB2RKMIS4O type=del size=2275303 2023-12-03T11:32:40.895 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.894+0000 7f4d50c67780 1 < completed delete operation key=K7YVVH7SAKMC tag=RVKFKE978TN3 type=del 2023-12-03T11:32:40.897 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.896+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=G3CJRQKLVFZZ type=del size=216931 2023-12-03T11:32:40.898 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.897+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~UG11PHL4PQ0Q.0 size=1048576 2023-12-03T11:32:40.899 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.898+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~UG11PHL4PQ0Q.1 size=1048576 2023-12-03T11:32:40.900 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.899+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~UG11PHL4PQ0Q.2 size=181409 2023-12-03T11:32:40.902 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.901+0000 7f4d50c67780 1 < completed multipart upload key=83I1M5WIVKAA upload=UG11PHL4PQ0Q tag=3KXAWKDB0LZO type=write size=3327137 2023-12-03T11:32:40.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.903+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=1BJLZRJWZ6ZH type=del size=669246 2023-12-03T11:32:40.905 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.904+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=KSOMKCQKKATI type=del 2023-12-03T11:32:40.906 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.905+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=RAPNYNXO3Z52 type=del size=3169503 2023-12-03T11:32:40.907 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.906+0000 7f4d50c67780 -1 < failed to complete operation key=V0ND3OBFJJUB tag=R6X5CCQKC4YH type=del size=3763807: (22) Invalid argument 2023-12-03T11:32:40.909 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.908+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=8B26R07TJQ8A type=del size=362545 2023-12-03T11:32:40.910 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.909+0000 7f4d50c67780 -1 < failed to complete operation key=0M6ZAD39I852 tag=BP8AHKZWYK66 type=del size=3039792: (22) Invalid argument 2023-12-03T11:32:40.912 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.911+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~B6LYTS14LD7M.0 size=1048576 2023-12-03T11:32:40.913 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.912+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~B6LYTS14LD7M.1 size=1048576 2023-12-03T11:32:40.914 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.913+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~B6LYTS14LD7M.2 size=1046823 2023-12-03T11:32:40.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.913+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=B6LYTS14LD7M tag=EH242FDZJ4OI type=write size=4192551 2023-12-03T11:32:40.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.916+0000 7f4d50c67780 1 < suggested update operation key=2H6AFQ362OGP tag=NOSXIDU4BUSG type=del size=1693618 2023-12-03T11:32:40.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.918+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~2S9KP52S6J0F.0 size=1048576 2023-12-03T11:32:40.920 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.919+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~2S9KP52S6J0F.1 size=1048576 2023-12-03T11:32:40.921 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.920+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~2S9KP52S6J0F.2 size=769674 2023-12-03T11:32:40.921 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.920+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=2S9KP52S6J0F tag=98F27TG7FG7F type=write size=3915402 2023-12-03T11:32:40.922 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.921+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~ELEJZGIYDDTS.0 size=1048576 2023-12-03T11:32:40.923 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.922+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~ELEJZGIYDDTS.1 size=1048576 2023-12-03T11:32:40.924 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.923+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~ELEJZGIYDDTS.2 size=249404 2023-12-03T11:32:40.926 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.925+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=ELEJZGIYDDTS tag=KFWI1V46UAQ2 type=write size=3395132 2023-12-03T11:32:40.927 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.926+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=HLTPFC95ZLHM type=write size=73074 2023-12-03T11:32:40.929 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.928+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~2Y8Q4EFGD6VK.0 size=747898 2023-12-03T11:32:40.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.930+0000 7f4d50c67780 1 < completed multipart upload key=WUM939BATDG9 upload=2Y8Q4EFGD6VK tag=OYN9CGZT278V type=write size=1796474 2023-12-03T11:32:40.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.931+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=7F61CFFWZCX4 type=del size=1626412 2023-12-03T11:32:40.933 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.932+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~N90ZE4BF8NAZ.0 size=1048576 2023-12-03T11:32:40.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.934+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~N90ZE4BF8NAZ.1 size=1032196 2023-12-03T11:32:40.937 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.936+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=N90ZE4BF8NAZ tag=5SYL6ES3S94Z type=write size=3129348 2023-12-03T11:32:40.938 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.937+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=5V4TDTQ68C42 type=del size=862967 2023-12-03T11:32:40.941 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.940+0000 7f4d50c67780 1 < suggested remove operation key=TEIYINZFFG76 tag=VXJ31U3VT54B type=del 2023-12-03T11:32:40.943 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.942+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~B6HVY429MD9B.0 size=828923 2023-12-03T11:32:40.943 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.942+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=B6HVY429MD9B tag=UUR2EJYT81C9 type=write size=1877499 2023-12-03T11:32:40.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.945+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~9R74WFNETEQY.0 size=1048576 2023-12-03T11:32:40.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.945+0000 7f4d50c67780 1 < canceled part key=_multipart_83I1M5WIVKAA.2~9R74WFNETEQY.1 size=769564 2023-12-03T11:32:40.951 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.950+0000 7f4d50c67780 1 < canceled multipart upload key=83I1M5WIVKAA upload=9R74WFNETEQY tag=QN4AUMXN1ZLJ type=write size=2866716 2023-12-03T11:32:40.953 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.952+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=28ECADWVOC8T type=del size=1681494 2023-12-03T11:32:40.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.953+0000 7f4d50c67780 -1 < failed to complete operation key=V0ND3OBFJJUB tag=16E3YW44G4LZ type=write size=283288: (22) Invalid argument 2023-12-03T11:32:40.956 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.955+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~JALCCCK9HFPC.0 size=927308 2023-12-03T11:32:40.956 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.955+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=JALCCCK9HFPC tag=26JBSCCA4TGD type=write size=1975884 2023-12-03T11:32:40.957 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.956+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~YJ6I7RLDLMM0.0 size=1048576 2023-12-03T11:32:40.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.957+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~YJ6I7RLDLMM0.1 size=177037 2023-12-03T11:32:40.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.959+0000 7f4d50c67780 1 < completed multipart upload key=ZE19S5UCCZ3C upload=YJ6I7RLDLMM0 tag=CKLIGBXPX4ED type=write size=2274189 2023-12-03T11:32:40.962 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.961+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~LGFYK0VKQJBK.0 size=84020 2023-12-03T11:32:40.962 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.961+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=LGFYK0VKQJBK tag=WWZMR6A58YBM type=write size=1132596 2023-12-03T11:32:40.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.962+0000 7f4d50c67780 1 < completed delete operation key=73SL3ZBBDA6Q tag=E67W0A44FUS8 type=del 2023-12-03T11:32:40.964 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.964+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=3Q94QQVTGOND type=del size=353671 2023-12-03T11:32:40.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.965+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=21YG5EPXGPFZ type=del 2023-12-03T11:32:40.967 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.966+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=QHADD949RRPA type=del size=3366013 2023-12-03T11:32:40.968 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.967+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=GDBB2RKMIS4O type=del 2023-12-03T11:32:40.969 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.968+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=P3NWNT328HVS type=write size=28326 2023-12-03T11:32:40.971 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.971+0000 7f4d50c67780 1 < suggested remove operation key=G0O8EC405LYM tag=G3CJRQKLVFZZ type=del 2023-12-03T11:32:40.974 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.973+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~ER8BCH7E572L.0 size=1048576 2023-12-03T11:32:40.975 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.974+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~ER8BCH7E572L.1 size=663002 2023-12-03T11:32:40.975 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.974+0000 7f4d50c67780 1 > prepared multipart upload key=ZE19S5UCCZ3C upload=ER8BCH7E572L tag=JI0TW06ZOYP6 type=write size=2760154 2023-12-03T11:32:40.976 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.975+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=1BJLZRJWZ6ZH type=del 2023-12-03T11:32:40.977 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.976+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=J40TL35QEC4K type=write size=179132 2023-12-03T11:32:40.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.977+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=RAPNYNXO3Z52 type=del 2023-12-03T11:32:40.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.978+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=LY2XNLUZLQZK type=del size=2065194 2023-12-03T11:32:40.981 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.981+0000 7f4d50c67780 1 < suggested remove operation key=RF2Q24GI24HJ tag=8B26R07TJQ8A type=del 2023-12-03T11:32:40.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.982+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=F53KUPC9IP14 type=del size=2512145 2023-12-03T11:32:40.984 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.983+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~B6LYTS14LD7M.0 size=1048576 2023-12-03T11:32:40.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.984+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~B6LYTS14LD7M.1 size=1048576 2023-12-03T11:32:40.986 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.985+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~B6LYTS14LD7M.2 size=1046823 2023-12-03T11:32:40.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.987+0000 7f4d50c67780 1 < completed multipart upload key=MLKGLDFFDC3W upload=B6LYTS14LD7M tag=EH242FDZJ4OI type=write size=4192551 2023-12-03T11:32:40.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.989+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~IC7OZ4LSBVQM.0 size=1048576 2023-12-03T11:32:40.991 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.990+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~IC7OZ4LSBVQM.1 size=1048576 2023-12-03T11:32:40.992 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.991+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~IC7OZ4LSBVQM.2 size=917235 2023-12-03T11:32:40.992 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.991+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=IC7OZ4LSBVQM tag=WA9RHTXRH1CF type=write size=4062963 2023-12-03T11:32:40.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.992+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~2S9KP52S6J0F.0 size=1048576 2023-12-03T11:32:40.994 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.993+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~2S9KP52S6J0F.1 size=1048576 2023-12-03T11:32:40.995 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.994+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~2S9KP52S6J0F.2 size=769674 2023-12-03T11:32:40.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.997+0000 7f4d50c67780 1 < completed multipart upload key=V0ND3OBFJJUB upload=2S9KP52S6J0F tag=98F27TG7FG7F type=write size=3915402 2023-12-03T11:32:40.999 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:40.999+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=3LSQ28BNDCHN type=write size=638547 2023-12-03T11:32:41.001 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.000+0000 7f4d50c67780 1 < completed write operation key=XM5E3D99MXVA tag=HLTPFC95ZLHM type=write size=73074 2023-12-03T11:32:41.002 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.001+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=TUL3UR0DJTBO type=del size=1640709 2023-12-03T11:32:41.003 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.002+0000 7f4d50c67780 1 < completed delete operation key=K7YVVH7SAKMC tag=7F61CFFWZCX4 type=del 2023-12-03T11:32:41.004 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.004+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=69UQ9OYI1KPI type=del size=2068982 2023-12-03T11:32:41.006 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.005+0000 7f4d50c67780 1 < completed delete operation key=CQPZ0X62207Z tag=5V4TDTQ68C42 type=del 2023-12-03T11:32:41.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.007+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~2YXZBSNRAJ59.0 size=1048576 2023-12-03T11:32:41.009 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.008+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~2YXZBSNRAJ59.1 size=922329 2023-12-03T11:32:41.009 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.008+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=2YXZBSNRAJ59 tag=3QSMHQNEIKGD type=write size=3019481 2023-12-03T11:32:41.010 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.009+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~B6HVY429MD9B.0 size=828923 2023-12-03T11:32:41.012 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.011+0000 7f4d50c67780 1 < completed multipart upload key=83I1M5WIVKAA upload=B6HVY429MD9B tag=UUR2EJYT81C9 type=write size=1877499 2023-12-03T11:32:41.014 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.014+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=9LZG2M2548FK type=del size=2241771 2023-12-03T11:32:41.016 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.015+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=28ECADWVOC8T type=del 2023-12-03T11:32:41.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.016+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=MMG1GGHDI11I type=del size=2899063 2023-12-03T11:32:41.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.017+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~JALCCCK9HFPC.0 size=927308 2023-12-03T11:32:41.020 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.019+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=JALCCCK9HFPC tag=26JBSCCA4TGD type=write size=1975884 2023-12-03T11:32:41.021 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.021+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=G2C1B9MWQHW9 type=write size=287849 2023-12-03T11:32:41.023 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.022+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~LGFYK0VKQJBK.0 size=84020 2023-12-03T11:32:41.025 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.024+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=LGFYK0VKQJBK tag=WWZMR6A58YBM type=write size=1132596 2023-12-03T11:32:41.026 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.025+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=AXHEM4QUL2GX type=del size=3585870 2023-12-03T11:32:41.027 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.026+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=3Q94QQVTGOND type=del 2023-12-03T11:32:41.028 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.028+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=ZMAZZ8FIK4LM type=del size=1306637 2023-12-03T11:32:41.030 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.029+0000 7f4d50c67780 1 < completed delete operation key=QQDBWLVSXIHP tag=QHADD949RRPA type=del 2023-12-03T11:32:41.031 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.030+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=YCQ3KJ3IVNBF type=write size=987737 2023-12-03T11:32:41.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.032+0000 7f4d50c67780 1 < suggested remove operation key=YDRAH5EE39R4 tag=P3NWNT328HVS type=write 2023-12-03T11:32:41.034 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.034+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=I0Q2N3405IOI type=write size=1044490 2023-12-03T11:32:41.036 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.035+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~ER8BCH7E572L.0 size=1048576 2023-12-03T11:32:41.036 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.035+0000 7f4d50c67780 1 < canceled part key=_multipart_ZE19S5UCCZ3C.2~ER8BCH7E572L.1 size=663002 2023-12-03T11:32:41.038 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.037+0000 7f4d50c67780 1 < canceled multipart upload key=ZE19S5UCCZ3C upload=ER8BCH7E572L tag=JI0TW06ZOYP6 type=write size=2760154 2023-12-03T11:32:41.040 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.039+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~WL5EJV1HHPPT.0 size=1048576 2023-12-03T11:32:41.041 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.041+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~WL5EJV1HHPPT.1 size=1048576 2023-12-03T11:32:41.042 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.042+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~WL5EJV1HHPPT.2 size=837806 2023-12-03T11:32:41.043 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.042+0000 7f4d50c67780 1 > prepared multipart upload key=73SL3ZBBDA6Q upload=WL5EJV1HHPPT tag=LZ2LH0Y2QHLF type=write size=3983534 2023-12-03T11:32:41.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.044+0000 7f4d50c67780 1 < suggested remove operation key=7C7UX0231SHV tag=J40TL35QEC4K type=write 2023-12-03T11:32:41.046 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.045+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=RA5Y0M4M9A0Z type=del size=3906883 2023-12-03T11:32:41.047 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.047+0000 7f4d50c67780 1 < completed delete operation key=MLKGLDFFDC3W tag=LY2XNLUZLQZK type=del 2023-12-03T11:32:41.049 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.049+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~BB602KEPRUPD.0 size=1048576 2023-12-03T11:32:41.050 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.050+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~BB602KEPRUPD.1 size=1048576 2023-12-03T11:32:41.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.050+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~BB602KEPRUPD.2 size=312842 2023-12-03T11:32:41.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.050+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=BB602KEPRUPD tag=6G08PL2G9WOB type=write size=3458570 2023-12-03T11:32:41.052 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.052+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=F53KUPC9IP14 type=del 2023-12-03T11:32:41.055 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.054+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~931L21HL51UF.0 size=510357 2023-12-03T11:32:41.055 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.054+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=931L21HL51UF tag=L86KEJIR74NM type=write size=1558933 2023-12-03T11:32:41.056 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.055+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~IC7OZ4LSBVQM.0 size=1048576 2023-12-03T11:32:41.057 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.056+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~IC7OZ4LSBVQM.1 size=1048576 2023-12-03T11:32:41.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.057+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~IC7OZ4LSBVQM.2 size=917235 2023-12-03T11:32:41.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.059+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=IC7OZ4LSBVQM tag=WA9RHTXRH1CF type=write size=4062963 2023-12-03T11:32:41.061 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.060+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=P7QBO9SWLPHR type=del size=3260357 2023-12-03T11:32:41.063 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.062+0000 7f4d50c67780 1 < canceled operation key=QQDBWLVSXIHP tag=3LSQ28BNDCHN type=write size=638547 2023-12-03T11:32:41.065 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.064+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~28WL25VGZ3MR.0 size=625975 2023-12-03T11:32:41.065 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.064+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=28WL25VGZ3MR tag=SV22QRR4PNI1 type=write size=1674551 2023-12-03T11:32:41.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.065+0000 7f4d50c67780 1 < completed delete operation key=CQPZ0X62207Z tag=TUL3UR0DJTBO type=del 2023-12-03T11:32:41.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.067+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=L2EHZVNX181Q type=del size=2523852 2023-12-03T11:32:41.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.068+0000 7f4d50c67780 1 < completed delete operation key=JR8CIONID4QC tag=69UQ9OYI1KPI type=del 2023-12-03T11:32:41.070 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.069+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=I2V04C7MYAL4 type=del size=3706225 2023-12-03T11:32:41.071 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.071+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~2YXZBSNRAJ59.0 size=1048576 2023-12-03T11:32:41.072 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.072+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~2YXZBSNRAJ59.1 size=922329 2023-12-03T11:32:41.075 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.074+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=2YXZBSNRAJ59 tag=3QSMHQNEIKGD type=write size=3019481 2023-12-03T11:32:41.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.075+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=3AG35PV0S6EH type=del size=3016287 2023-12-03T11:32:41.078 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.077+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=9LZG2M2548FK type=del 2023-12-03T11:32:41.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.078+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=QMZNDTHSZNX9 type=del size=4136912 2023-12-03T11:32:41.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.080+0000 7f4d50c67780 1 < completed delete operation key=EAP0BYZTTT2E tag=MMG1GGHDI11I type=del 2023-12-03T11:32:41.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.081+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=DJR4WG1PN71E type=del size=1863937 2023-12-03T11:32:41.084 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.083+0000 7f4d50c67780 1 < completed write operation key=TOGV2BZ99FRF tag=G2C1B9MWQHW9 type=write size=287849 2023-12-03T11:32:41.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.085+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~WGP5FRD5BQ23.0 size=1048576 2023-12-03T11:32:41.087 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.086+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~WGP5FRD5BQ23.1 size=149884 2023-12-03T11:32:41.087 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.086+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=WGP5FRD5BQ23 tag=VRRVGP64FCGI type=write size=2247036 2023-12-03T11:32:41.088 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.087+0000 7f4d50c67780 1 < completed delete operation key=EAP0BYZTTT2E tag=AXHEM4QUL2GX type=del 2023-12-03T11:32:41.089 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.088+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=BB756870MET1 type=del size=1598006 2023-12-03T11:32:41.090 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.090+0000 7f4d50c67780 1 < completed delete operation key=EY1RBO15PCRR tag=ZMAZZ8FIK4LM type=del 2023-12-03T11:32:41.092 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.091+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=1XJVJZ9CQFBJ type=del size=1892575 2023-12-03T11:32:41.093 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.092+0000 7f4d50c67780 1 < completed write operation key=CQPZ0X62207Z tag=YCQ3KJ3IVNBF type=write size=987737 2023-12-03T11:32:41.094 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.094+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=QV1KGC46TZFV type=write size=573860 2023-12-03T11:32:41.096 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.095+0000 7f4d50c67780 1 < canceled operation key=8J1EO2JDQUQH tag=I0Q2N3405IOI type=write size=1044490 2023-12-03T11:32:41.097 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.096+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=VM1UPLLT6CIM type=del size=3572311 2023-12-03T11:32:41.098 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.098+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~WL5EJV1HHPPT.0 size=1048576 2023-12-03T11:32:41.099 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.099+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~WL5EJV1HHPPT.1 size=1048576 2023-12-03T11:32:41.100 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.099+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~WL5EJV1HHPPT.2 size=837806 2023-12-03T11:32:41.102 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.102+0000 7f4d50c67780 1 < completed multipart upload key=73SL3ZBBDA6Q upload=WL5EJV1HHPPT tag=LZ2LH0Y2QHLF type=write size=3983534 2023-12-03T11:32:41.105 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.104+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~IZNUM5UC29FP.0 size=408077 2023-12-03T11:32:41.105 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.104+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=IZNUM5UC29FP tag=AQTT37ROZ302 type=write size=1456653 2023-12-03T11:32:41.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.105+0000 7f4d50c67780 1 < completed delete operation key=MLKGLDFFDC3W tag=RA5Y0M4M9A0Z type=del 2023-12-03T11:32:41.107 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.106+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=9JSEF4NMS2M2 type=del size=2918285 2023-12-03T11:32:41.107 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.106+0000 7f4d50c67780 1 < canceled part key=_multipart_0M6ZAD39I852.2~BB602KEPRUPD.0 size=1048576 2023-12-03T11:32:41.108 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.107+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~BB602KEPRUPD.1 size=1048576 2023-12-03T11:32:41.109 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.108+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~BB602KEPRUPD.2 size=312842 2023-12-03T11:32:41.111 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.110+0000 7f4d50c67780 1 < canceled multipart upload key=0M6ZAD39I852 upload=BB602KEPRUPD tag=6G08PL2G9WOB type=write size=3458570 2023-12-03T11:32:41.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.112+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=TT0FXCPVVU60 type=del size=876746 2023-12-03T11:32:41.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.113+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~931L21HL51UF.0 size=510357 2023-12-03T11:32:41.116 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.115+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=931L21HL51UF tag=L86KEJIR74NM type=write size=1558933 2023-12-03T11:32:41.118 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.117+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~1RBBFC48NESU.0 size=1048576 2023-12-03T11:32:41.119 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.118+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~1RBBFC48NESU.1 size=1048576 2023-12-03T11:32:41.120 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.119+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~1RBBFC48NESU.2 size=563291 2023-12-03T11:32:41.120 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.119+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=1RBBFC48NESU tag=PVKWFPJPFWJS type=write size=3709019 2023-12-03T11:32:41.121 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.120+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=P7QBO9SWLPHR type=del 2023-12-03T11:32:41.123 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.122+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~9A5Q1CD7HT8M.0 size=1048576 2023-12-03T11:32:41.124 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.123+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~9A5Q1CD7HT8M.1 size=1048576 2023-12-03T11:32:41.125 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.124+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~9A5Q1CD7HT8M.2 size=61272 2023-12-03T11:32:41.125 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.124+0000 7f4d50c67780 1 > prepared multipart upload key=ULLPV2G10BME upload=9A5Q1CD7HT8M tag=LFV614ULBVR4 type=write size=3207000 2023-12-03T11:32:41.126 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.125+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~28WL25VGZ3MR.0 size=625975 2023-12-03T11:32:41.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.127+0000 7f4d50c67780 1 < completed multipart upload key=K7YVVH7SAKMC upload=28WL25VGZ3MR tag=SV22QRR4PNI1 type=write size=1674551 2023-12-03T11:32:41.129 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.128+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=11BI5OOBQOW5 type=del size=1684833 2023-12-03T11:32:41.132 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.131+0000 7f4d50c67780 1 < suggested update operation key=8J1EO2JDQUQH tag=L2EHZVNX181Q type=del size=2523852 2023-12-03T11:32:41.133 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.132+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=MWSG5RJM9NWO type=del size=450094 2023-12-03T11:32:41.135 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.134+0000 7f4d50c67780 1 < canceled operation key=0M6ZAD39I852 tag=I2V04C7MYAL4 type=del size=3706225 2023-12-03T11:32:41.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.136+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~3227OU3E754S.0 size=736433 2023-12-03T11:32:41.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.136+0000 7f4d50c67780 1 > prepared multipart upload key=RF2Q24GI24HJ upload=3227OU3E754S tag=EX5GUJSOQUUU type=write size=1785009 2023-12-03T11:32:41.138 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.137+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=3AG35PV0S6EH type=del 2023-12-03T11:32:41.140 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.139+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~DI7H2VWQ855E.0 size=1048576 2023-12-03T11:32:41.141 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.140+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~DI7H2VWQ855E.1 size=1048576 2023-12-03T11:32:41.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.141+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~DI7H2VWQ855E.2 size=643309 2023-12-03T11:32:41.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.141+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=DI7H2VWQ855E tag=SU3JDFRZTPVU type=write size=3789037 2023-12-03T11:32:41.143 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.142+0000 7f4d50c67780 1 < completed delete operation key=02W4TX7ZCDI6 tag=QMZNDTHSZNX9 type=del 2023-12-03T11:32:41.145 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.145+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~7SVNW1PEGWN8.0 size=1048576 2023-12-03T11:32:41.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.145+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~7SVNW1PEGWN8.1 size=434326 2023-12-03T11:32:41.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.145+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=7SVNW1PEGWN8 tag=RK329CRBSWRW type=write size=2531478 2023-12-03T11:32:41.147 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.147+0000 7f4d50c67780 1 < canceled operation key=BX5POXMMYLB7 tag=DJR4WG1PN71E type=del size=1863937 2023-12-03T11:32:41.150 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.149+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~PUKOWTR4QB0Q.0 size=919690 2023-12-03T11:32:41.150 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.149+0000 7f4d50c67780 1 > prepared multipart upload key=JBL6IOJC4TT0 upload=PUKOWTR4QB0Q tag=93F7OMXLN7UE type=write size=1968266 2023-12-03T11:32:41.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.150+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~WGP5FRD5BQ23.0 size=1048576 2023-12-03T11:32:41.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.151+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~WGP5FRD5BQ23.1 size=149884 2023-12-03T11:32:41.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.153+0000 7f4d50c67780 1 < completed multipart upload key=V0ND3OBFJJUB upload=WGP5FRD5BQ23 tag=VRRVGP64FCGI type=write size=2247036 2023-12-03T11:32:41.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.154+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=1E9IY81P8S5Y type=del size=1572575 2023-12-03T11:32:41.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.156+0000 7f4d50c67780 1 < suggested update operation key=8J1EO2JDQUQH tag=BB756870MET1 type=del size=1598006 2023-12-03T11:32:41.158 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.158+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=5RZG1I05OWE0 type=del size=1047703 2023-12-03T11:32:41.160 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.159+0000 7f4d50c67780 1 < canceled operation key=EX93BYX10WJB tag=1XJVJZ9CQFBJ type=del size=1892575 2023-12-03T11:32:41.162 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.161+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~QAUFBD9P9D18.0 size=1048576 2023-12-03T11:32:41.163 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.162+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~QAUFBD9P9D18.1 size=647785 2023-12-03T11:32:41.163 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.162+0000 7f4d50c67780 1 > prepared multipart upload key=JR8CIONID4QC upload=QAUFBD9P9D18 tag=WAZHCGLLMRY5 type=write size=2744937 2023-12-03T11:32:41.164 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.163+0000 7f4d50c67780 1 < completed write operation key=V0ND3OBFJJUB tag=QV1KGC46TZFV type=write size=573860 2023-12-03T11:32:41.165 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.164+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=Z2YUUUIJSQEI type=del size=3826414 2023-12-03T11:32:41.166 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.166+0000 7f4d50c67780 1 < completed delete operation key=GTLP2WZUX7U8 tag=VM1UPLLT6CIM type=del 2023-12-03T11:32:41.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.167+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=9KE6JMV1AZ3T type=write size=573146 2023-12-03T11:32:41.169 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.168+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~IZNUM5UC29FP.0 size=408077 2023-12-03T11:32:41.171 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.170+0000 7f4d50c67780 1 < completed multipart upload key=WUM939BATDG9 upload=IZNUM5UC29FP tag=AQTT37ROZ302 type=write size=1456653 2023-12-03T11:32:41.173 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.172+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~6ZKOSQ2RNQXH.0 size=1048576 2023-12-03T11:32:41.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.173+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~6ZKOSQ2RNQXH.1 size=290006 2023-12-03T11:32:41.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.173+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=6ZKOSQ2RNQXH tag=9U1XMJ155XRM type=write size=2387158 2023-12-03T11:32:41.175 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.175+0000 7f4d50c67780 1 < completed delete operation key=73SL3ZBBDA6Q tag=9JSEF4NMS2M2 type=del 2023-12-03T11:32:41.178 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.177+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~28C2C5HI2JBE.0 size=814096 2023-12-03T11:32:41.178 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.177+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=28C2C5HI2JBE tag=6IIMSLIATF39 type=write size=1862672 2023-12-03T11:32:41.179 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.178+0000 7f4d50c67780 1 < completed delete operation key=0M6ZAD39I852 tag=TT0FXCPVVU60 type=del 2023-12-03T11:32:41.180 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.179+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=NND9RKBGYYOB type=del size=3186122 2023-12-03T11:32:41.181 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.181+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~1RBBFC48NESU.0 size=1048576 2023-12-03T11:32:41.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.182+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~1RBBFC48NESU.1 size=1048576 2023-12-03T11:32:41.183 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.183+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~1RBBFC48NESU.2 size=563291 2023-12-03T11:32:41.186 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.185+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=1RBBFC48NESU tag=PVKWFPJPFWJS type=write size=3709019 2023-12-03T11:32:41.187 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.186+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=36R7X7NXU3SX type=del size=3555967 2023-12-03T11:32:41.188 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.187+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~9A5Q1CD7HT8M.0 size=1048576 2023-12-03T11:32:41.189 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.188+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~9A5Q1CD7HT8M.1 size=1048576 2023-12-03T11:32:41.189 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.188+0000 7f4d50c67780 1 < canceled part key=_multipart_ULLPV2G10BME.2~9A5Q1CD7HT8M.2 size=61272 2023-12-03T11:32:41.191 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.190+0000 7f4d50c67780 1 < canceled multipart upload key=ULLPV2G10BME upload=9A5Q1CD7HT8M tag=LFV614ULBVR4 type=write size=3207000 2023-12-03T11:32:41.192 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.192+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=5YLXR75IHN70 type=del size=3021840 2023-12-03T11:32:41.195 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.194+0000 7f4d50c67780 1 < suggested update operation key=EX93BYX10WJB tag=11BI5OOBQOW5 type=del size=1684833 2023-12-03T11:32:41.197 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.196+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~E1FGEQ0Y64DB.0 size=1048576 2023-12-03T11:32:41.198 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.197+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~E1FGEQ0Y64DB.1 size=728744 2023-12-03T11:32:41.198 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.197+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=E1FGEQ0Y64DB tag=C1BO10216QF6 type=write size=2825896 2023-12-03T11:32:41.199 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.199+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=MWSG5RJM9NWO type=del 2023-12-03T11:32:41.201 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.200+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=GJ1YOVMXFODN type=del size=1876884 2023-12-03T11:32:41.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.201+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~3227OU3E754S.0 size=736433 2023-12-03T11:32:41.204 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.203+0000 7f4d50c67780 1 < completed multipart upload key=RF2Q24GI24HJ upload=3227OU3E754S tag=EX5GUJSOQUUU type=write size=1785009 2023-12-03T11:32:41.205 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.204+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=I0EUHWBHF6R4 type=del size=2858173 2023-12-03T11:32:41.206 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.205+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~DI7H2VWQ855E.0 size=1048576 2023-12-03T11:32:41.207 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.206+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~DI7H2VWQ855E.1 size=1048576 2023-12-03T11:32:41.208 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.207+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~DI7H2VWQ855E.2 size=643309 2023-12-03T11:32:41.210 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.209+0000 7f4d50c67780 1 < completed multipart upload key=K7YVVH7SAKMC upload=DI7H2VWQ855E tag=SU3JDFRZTPVU type=write size=3789037 2023-12-03T11:32:41.213 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.212+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~LAQDP4U4IGST.0 size=95198 2023-12-03T11:32:41.213 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.212+0000 7f4d50c67780 1 > prepared multipart upload key=ZE19S5UCCZ3C upload=LAQDP4U4IGST tag=5LH4LAPH710T type=write size=1143774 2023-12-03T11:32:41.214 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.213+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~7SVNW1PEGWN8.0 size=1048576 2023-12-03T11:32:41.215 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.214+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~7SVNW1PEGWN8.1 size=434326 2023-12-03T11:32:41.217 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.216+0000 7f4d50c67780 1 < completed multipart upload key=CQPZ0X62207Z upload=7SVNW1PEGWN8 tag=RK329CRBSWRW type=write size=2531478 2023-12-03T11:32:41.218 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.217+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=E6RRQJKTQW24 type=del size=3457452 2023-12-03T11:32:41.219 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.219+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~PUKOWTR4QB0Q.0 size=919690 2023-12-03T11:32:41.221 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.221+0000 7f4d50c67780 1 < completed multipart upload key=JBL6IOJC4TT0 upload=PUKOWTR4QB0Q tag=93F7OMXLN7UE type=write size=1968266 2023-12-03T11:32:41.222 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.222+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=SWVN80QK9P6O type=del size=1870435 2023-12-03T11:32:41.224 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.223+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=1E9IY81P8S5Y type=del 2023-12-03T11:32:41.225 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.224+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=40OPQ1N58LYX type=del size=1251259 2023-12-03T11:32:41.227 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.227+0000 7f4d50c67780 1 < suggested update operation key=EAP0BYZTTT2E tag=5RZG1I05OWE0 type=del size=1047703 2023-12-03T11:32:41.230 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.229+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~RIWRBJPDQYVD.0 size=1048576 2023-12-03T11:32:41.230 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.230+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~RIWRBJPDQYVD.1 size=729505 2023-12-03T11:32:41.230 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.230+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=RIWRBJPDQYVD tag=21RQNNSDAXMA type=write size=2826657 2023-12-03T11:32:41.232 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.231+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~QAUFBD9P9D18.0 size=1048576 2023-12-03T11:32:41.233 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.232+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~QAUFBD9P9D18.1 size=647785 2023-12-03T11:32:41.235 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.234+0000 7f4d50c67780 1 < completed multipart upload key=JR8CIONID4QC upload=QAUFBD9P9D18 tag=WAZHCGLLMRY5 type=write size=2744937 2023-12-03T11:32:41.236 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.235+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=231JB3PPOX53 type=del size=1500295 2023-12-03T11:32:41.237 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.236+0000 7f4d50c67780 1 < canceled operation key=MLKGLDFFDC3W tag=Z2YUUUIJSQEI type=del size=3826414 2023-12-03T11:32:41.238 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.237+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=J9H2U35U0LCW type=del size=2310309 2023-12-03T11:32:41.239 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.239+0000 7f4d50c67780 1 < completed write operation key=U6R5Y9JXKT32 tag=9KE6JMV1AZ3T type=write size=573146 2023-12-03T11:32:41.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.241+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~4CSQH1904MUF.0 size=1048576 2023-12-03T11:32:41.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.243+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~4CSQH1904MUF.1 size=1048576 2023-12-03T11:32:41.244 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.244+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~4CSQH1904MUF.2 size=342726 2023-12-03T11:32:41.245 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.244+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=4CSQH1904MUF tag=THCYAC4HG0LP type=write size=3488454 2023-12-03T11:32:41.246 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.245+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~6ZKOSQ2RNQXH.0 size=1048576 2023-12-03T11:32:41.247 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.246+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~6ZKOSQ2RNQXH.1 size=290006 2023-12-03T11:32:41.249 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.248+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=6ZKOSQ2RNQXH tag=9U1XMJ155XRM type=write size=2387158 2023-12-03T11:32:41.251 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.250+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~SM5TM1UI12YI.0 size=433186 2023-12-03T11:32:41.251 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.250+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=SM5TM1UI12YI tag=KIPJKE3Z0UTM type=write size=1481762 2023-12-03T11:32:41.252 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.251+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~28C2C5HI2JBE.0 size=814096 2023-12-03T11:32:41.254 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.254+0000 7f4d50c67780 1 < completed multipart upload key=EAP0BYZTTT2E upload=28C2C5HI2JBE tag=6IIMSLIATF39 type=write size=1862672 2023-12-03T11:32:41.256 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.255+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=CH9J080Q693X type=write size=265883 2023-12-03T11:32:41.257 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.256+0000 7f4d50c67780 1 < completed delete operation key=02W4TX7ZCDI6 tag=NND9RKBGYYOB type=del 2023-12-03T11:32:41.258 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.257+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=7DVNJXN2EEKH type=del size=776017 2023-12-03T11:32:41.259 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.258+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=36R7X7NXU3SX type=del 2023-12-03T11:32:41.260 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.260+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=79EYTVI3WVCQ type=del size=307283 2023-12-03T11:32:41.262 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.261+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=5YLXR75IHN70 type=del 2023-12-03T11:32:41.264 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.263+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~KMT4CQV5PTMP.0 size=773835 2023-12-03T11:32:41.264 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.263+0000 7f4d50c67780 1 > prepared multipart upload key=JR8CIONID4QC upload=KMT4CQV5PTMP tag=8NCQLMQN9I3O type=write size=1822411 2023-12-03T11:32:41.265 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.264+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~E1FGEQ0Y64DB.0 size=1048576 2023-12-03T11:32:41.266 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.265+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~E1FGEQ0Y64DB.1 size=728744 2023-12-03T11:32:41.268 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.268+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=E1FGEQ0Y64DB tag=C1BO10216QF6 type=write size=2825896 2023-12-03T11:32:41.270 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.269+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=LR1WJ99CUL1J type=del size=64368 2023-12-03T11:32:41.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.270+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=GJ1YOVMXFODN type=del 2023-12-03T11:32:41.273 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.272+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~HB0K1H7F9IM7.0 size=1048576 2023-12-03T11:32:41.274 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.273+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~HB0K1H7F9IM7.1 size=503428 2023-12-03T11:32:41.274 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.273+0000 7f4d50c67780 1 > prepared multipart upload key=52E31L45TN7V upload=HB0K1H7F9IM7 tag=X198J1NIRKO4 type=write size=2600580 2023-12-03T11:32:41.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.275+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=I0EUHWBHF6R4 type=del 2023-12-03T11:32:41.277 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.276+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=A7C7NEUOP4HE type=del size=2808656 2023-12-03T11:32:41.278 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.277+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~LAQDP4U4IGST.0 size=95198 2023-12-03T11:32:41.280 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.279+0000 7f4d50c67780 1 < completed multipart upload key=ZE19S5UCCZ3C upload=LAQDP4U4IGST tag=5LH4LAPH710T type=write size=1143774 2023-12-03T11:32:41.282 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.281+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~BBIHVC9YSN6T.0 size=1048576 2023-12-03T11:32:41.283 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.282+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~BBIHVC9YSN6T.1 size=1048576 2023-12-03T11:32:41.284 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.283+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~BBIHVC9YSN6T.2 size=627895 2023-12-03T11:32:41.284 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.283+0000 7f4d50c67780 1 > prepared multipart upload key=ENMJS0KEVS2S upload=BBIHVC9YSN6T tag=SFZURANDEAAE type=write size=3773623 2023-12-03T11:32:41.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.285+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=E6RRQJKTQW24 type=del 2023-12-03T11:32:41.287 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.286+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=XAN9LF7J27M7 type=del size=2634099 2023-12-03T11:32:41.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.287+0000 7f4d50c67780 1 < completed delete operation key=QQDBWLVSXIHP tag=SWVN80QK9P6O type=del 2023-12-03T11:32:41.289 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.288+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=D15H8J1C2V4T type=del size=823161 2023-12-03T11:32:41.290 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.289+0000 7f4d50c67780 1 < canceled operation key=73SL3ZBBDA6Q tag=40OPQ1N58LYX type=del size=1251259 2023-12-03T11:32:41.293 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.291+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=Z0M3PJFZYXOA type=write size=480081 2023-12-03T11:32:41.293 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.292+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~RIWRBJPDQYVD.0 size=1048576 2023-12-03T11:32:41.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.293+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~RIWRBJPDQYVD.1 size=729505 2023-12-03T11:32:41.296 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.295+0000 7f4d50c67780 1 < completed multipart upload key=CQPZ0X62207Z upload=RIWRBJPDQYVD tag=21RQNNSDAXMA type=write size=2826657 2023-12-03T11:32:41.298 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.297+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~6M97WLHGXJ1C.0 size=1048576 2023-12-03T11:32:41.299 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.298+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~6M97WLHGXJ1C.1 size=1048576 2023-12-03T11:32:41.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.299+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~6M97WLHGXJ1C.2 size=644256 2023-12-03T11:32:41.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.299+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=6M97WLHGXJ1C tag=HYH6GSAQD4LI type=write size=3789984 2023-12-03T11:32:41.302 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.301+0000 7f4d50c67780 1 < suggested update operation key=K7YVVH7SAKMC tag=231JB3PPOX53 type=del size=1500295 2023-12-03T11:32:41.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.303+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~31Q31BYLUS0S.0 size=639480 2023-12-03T11:32:41.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.303+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=31Q31BYLUS0S tag=8T15SKN57AGI type=write size=1688056 2023-12-03T11:32:41.305 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.305+0000 7f4d50c67780 1 < completed delete operation key=V0ND3OBFJJUB tag=J9H2U35U0LCW type=del 2023-12-03T11:32:41.307 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.306+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=2XIV3KG27RHI type=del size=1655179 2023-12-03T11:32:41.308 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.307+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~4CSQH1904MUF.0 size=1048576 2023-12-03T11:32:41.309 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.308+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~4CSQH1904MUF.1 size=1048576 2023-12-03T11:32:41.310 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.309+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~4CSQH1904MUF.2 size=342726 2023-12-03T11:32:41.312 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.311+0000 7f4d50c67780 1 < completed multipart upload key=K7YVVH7SAKMC upload=4CSQH1904MUF tag=THCYAC4HG0LP type=write size=3488454 2023-12-03T11:32:41.313 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.312+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=4X8B01UTLY23 type=write size=845487 2023-12-03T11:32:41.314 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.313+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~SM5TM1UI12YI.0 size=433186 2023-12-03T11:32:41.316 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.315+0000 7f4d50c67780 1 < completed multipart upload key=CQPZ0X62207Z upload=SM5TM1UI12YI tag=KIPJKE3Z0UTM type=write size=1481762 2023-12-03T11:32:41.317 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.317+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=YQLWBFFNDG2C type=del size=955872 2023-12-03T11:32:41.319 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.318+0000 7f4d50c67780 1 < completed write operation key=52E31L45TN7V tag=CH9J080Q693X type=write size=265883 2023-12-03T11:32:41.320 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.319+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=S8CL2VAWRTU4 type=del size=1734799 2023-12-03T11:32:41.321 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.320+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=7DVNJXN2EEKH type=del 2023-12-03T11:32:41.322 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.322+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=BK0N6EM9QOC1 type=del size=3348210 2023-12-03T11:32:41.324 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.323+0000 7f4d50c67780 1 < completed delete operation key=JR8CIONID4QC tag=79EYTVI3WVCQ type=del 2023-12-03T11:32:41.325 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.324+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=7FA5V795KU44 type=del size=2322937 2023-12-03T11:32:41.325 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.324+0000 7f4d50c67780 1 < canceled part key=_multipart_JR8CIONID4QC.2~KMT4CQV5PTMP.0 size=773835 2023-12-03T11:32:41.327 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.326+0000 7f4d50c67780 1 < canceled multipart upload key=JR8CIONID4QC upload=KMT4CQV5PTMP tag=8NCQLMQN9I3O type=write size=1822411 2023-12-03T11:32:41.329 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.328+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~O5D4FXAIQUC1.0 size=170662 2023-12-03T11:32:41.329 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.328+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=O5D4FXAIQUC1 tag=YW9X7SQRLSFV type=write size=1219238 2023-12-03T11:32:41.330 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.330+0000 7f4d50c67780 1 < canceled operation key=G0O8EC405LYM tag=LR1WJ99CUL1J type=del size=64368 2023-12-03T11:32:41.333 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.332+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~16AAOMSMACHP.0 size=1048576 2023-12-03T11:32:41.333 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.333+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~16AAOMSMACHP.1 size=1048576 2023-12-03T11:32:41.334 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.334+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~16AAOMSMACHP.2 size=935946 2023-12-03T11:32:41.335 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.334+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=16AAOMSMACHP tag=3GLVISCMWU5E type=write size=4081674 2023-12-03T11:32:41.336 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.335+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~HB0K1H7F9IM7.0 size=1048576 2023-12-03T11:32:41.337 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.336+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~HB0K1H7F9IM7.1 size=503428 2023-12-03T11:32:41.339 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.338+0000 7f4d50c67780 1 < completed multipart upload key=52E31L45TN7V upload=HB0K1H7F9IM7 tag=X198J1NIRKO4 type=write size=2600580 2023-12-03T11:32:41.340 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.339+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=OKCU2Y7O10I1 type=del size=888760 2023-12-03T11:32:41.341 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.340+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=A7C7NEUOP4HE type=del 2023-12-03T11:32:41.343 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.342+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~1MPJF807DU2V.0 size=1048576 2023-12-03T11:32:41.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.343+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~1MPJF807DU2V.1 size=1048576 2023-12-03T11:32:41.345 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.344+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~1MPJF807DU2V.2 size=609886 2023-12-03T11:32:41.345 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.344+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=1MPJF807DU2V tag=R7J4QP0JP3QC type=write size=3755614 2023-12-03T11:32:41.346 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.346+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~BBIHVC9YSN6T.0 size=1048576 2023-12-03T11:32:41.347 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.347+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~BBIHVC9YSN6T.1 size=1048576 2023-12-03T11:32:41.348 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.348+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~BBIHVC9YSN6T.2 size=627895 2023-12-03T11:32:41.351 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.350+0000 7f4d50c67780 1 < completed multipart upload key=ENMJS0KEVS2S upload=BBIHVC9YSN6T tag=SFZURANDEAAE type=write size=3773623 2023-12-03T11:32:41.352 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.351+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=AIZW2WFYMD6O type=del size=1645336 2023-12-03T11:32:41.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.353+0000 7f4d50c67780 1 < suggested update operation key=83I1M5WIVKAA tag=XAN9LF7J27M7 type=del size=2634099 2023-12-03T11:32:41.357 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.356+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=DR5967ZDZZWM type=write size=592057 2023-12-03T11:32:41.358 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.357+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=D15H8J1C2V4T type=del 2023-12-03T11:32:41.359 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.358+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=UMXN70LHTIV9 type=del size=1667779 2023-12-03T11:32:41.361 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.360+0000 7f4d50c67780 1 < completed write operation key=TOGV2BZ99FRF tag=Z0M3PJFZYXOA type=write size=480081 2023-12-03T11:32:41.362 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.361+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=F30G3ZCJXU4H type=write size=90426 2023-12-03T11:32:41.363 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.362+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~6M97WLHGXJ1C.0 size=1048576 2023-12-03T11:32:41.364 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.363+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~6M97WLHGXJ1C.1 size=1048576 2023-12-03T11:32:41.365 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.364+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~6M97WLHGXJ1C.2 size=644256 2023-12-03T11:32:41.367 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.366+0000 7f4d50c67780 1 < completed multipart upload key=83I1M5WIVKAA upload=6M97WLHGXJ1C tag=HYH6GSAQD4LI type=write size=3789984 2023-12-03T11:32:41.368 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.367+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=VPOZC81B8T3F type=write size=123458 2023-12-03T11:32:41.370 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.369+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~31Q31BYLUS0S.0 size=639480 2023-12-03T11:32:41.372 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.371+0000 7f4d50c67780 1 < completed multipart upload key=02W4TX7ZCDI6 upload=31Q31BYLUS0S tag=8T15SKN57AGI type=write size=1688056 2023-12-03T11:32:41.374 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.373+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~KVRM020NEW3M.0 size=1048576 2023-12-03T11:32:41.375 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.374+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~KVRM020NEW3M.1 size=1048576 2023-12-03T11:32:41.376 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.375+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~KVRM020NEW3M.2 size=995006 2023-12-03T11:32:41.376 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.375+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=KVRM020NEW3M tag=DLJ4NNSNJCD4 type=write size=4140734 2023-12-03T11:32:41.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.376+0000 7f4d50c67780 1 < completed delete operation key=7C7UX0231SHV tag=2XIV3KG27RHI type=del 2023-12-03T11:32:41.378 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.377+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=05XR66I50FNT type=del size=3855165 2023-12-03T11:32:41.379 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.379+0000 7f4d50c67780 1 < completed write operation key=73SL3ZBBDA6Q tag=4X8B01UTLY23 type=write size=845487 2023-12-03T11:32:41.381 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.380+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=S49HVU6OW35E type=del size=1712157 2023-12-03T11:32:41.382 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.381+0000 7f4d50c67780 1 < completed delete operation key=02W4TX7ZCDI6 tag=YQLWBFFNDG2C type=del 2023-12-03T11:32:41.384 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.383+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~6Y4FW6GCE54R.0 size=794763 2023-12-03T11:32:41.384 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.383+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=6Y4FW6GCE54R tag=6MCKCTAN8E7T type=write size=1843339 2023-12-03T11:32:41.385 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.384+0000 7f4d50c67780 1 < canceled operation key=2H6AFQ362OGP tag=S8CL2VAWRTU4 type=del size=1734799 2023-12-03T11:32:41.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.387+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~UR9QB76A9WLW.0 size=1048576 2023-12-03T11:32:41.389 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.388+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~UR9QB76A9WLW.1 size=556677 2023-12-03T11:32:41.389 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.388+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=UR9QB76A9WLW tag=7V43UMD4DST2 type=write size=2653829 2023-12-03T11:32:41.390 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.389+0000 7f4d50c67780 1 < completed delete operation key=52E31L45TN7V tag=BK0N6EM9QOC1 type=del 2023-12-03T11:32:41.392 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.392+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~H0DW71XI4SJ4.0 size=1048576 2023-12-03T11:32:41.393 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.393+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~H0DW71XI4SJ4.1 size=1048576 2023-12-03T11:32:41.394 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.394+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~H0DW71XI4SJ4.2 size=451080 2023-12-03T11:32:41.395 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.394+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=H0DW71XI4SJ4 tag=4FCFVS9IIY3T type=write size=3596808 2023-12-03T11:32:41.396 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.395+0000 7f4d50c67780 1 < completed delete operation key=YDRAH5EE39R4 tag=7FA5V795KU44 type=del 2023-12-03T11:32:41.397 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.396+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=SE6HEYNSAVY0 type=write size=301356 2023-12-03T11:32:41.398 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.397+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~O5D4FXAIQUC1.0 size=170662 2023-12-03T11:32:41.400 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.399+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=O5D4FXAIQUC1 tag=YW9X7SQRLSFV type=write size=1219238 2023-12-03T11:32:41.401 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.401+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=L1LC3NJQH087 type=del size=16447 2023-12-03T11:32:41.403 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.402+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~16AAOMSMACHP.0 size=1048576 2023-12-03T11:32:41.404 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.403+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~16AAOMSMACHP.1 size=1048576 2023-12-03T11:32:41.405 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.404+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~16AAOMSMACHP.2 size=935946 2023-12-03T11:32:41.407 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.406+0000 7f4d50c67780 1 < completed multipart upload key=7C7UX0231SHV upload=16AAOMSMACHP tag=3GLVISCMWU5E type=write size=4081674 2023-12-03T11:32:41.408 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.407+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=706CWK5HC6AH type=del size=3476354 2023-12-03T11:32:41.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.408+0000 7f4d50c67780 1 < completed delete operation key=GTLP2WZUX7U8 tag=OKCU2Y7O10I1 type=del 2023-12-03T11:32:41.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.410+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=XQ7IS24OHI90 type=del size=2466578 2023-12-03T11:32:41.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.411+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~1MPJF807DU2V.0 size=1048576 2023-12-03T11:32:41.413 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.412+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~1MPJF807DU2V.1 size=1048576 2023-12-03T11:32:41.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.413+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~1MPJF807DU2V.2 size=609886 2023-12-03T11:32:41.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.415+0000 7f4d50c67780 1 < completed multipart upload key=EH4B2QP1C42H upload=1MPJF807DU2V tag=R7J4QP0JP3QC type=write size=3755614 2023-12-03T11:32:41.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.416+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=22HBQ0EHJKZP type=del size=491099 2023-12-03T11:32:41.418 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.417+0000 7f4d50c67780 1 < canceled operation key=EY1RBO15PCRR tag=AIZW2WFYMD6O type=del size=1645336 2023-12-03T11:32:41.419 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.419+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=V0GRQGI8GRQM type=write size=955280 2023-12-03T11:32:41.421 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.420+0000 7f4d50c67780 1 < completed write operation key=RF2Q24GI24HJ tag=DR5967ZDZZWM type=write size=592057 2023-12-03T11:32:41.422 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.421+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=M28WG4TF2R6A type=del size=1087740 2023-12-03T11:32:41.424 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.423+0000 7f4d50c67780 1 < suggested update operation key=7C7UX0231SHV tag=UMXN70LHTIV9 type=del size=1667779 2023-12-03T11:32:41.426 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.426+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~M2PJAQ2UMXEO.0 size=506295 2023-12-03T11:32:41.426 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.426+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=M2PJAQ2UMXEO tag=WBMB1NPSBCMR type=write size=1554871 2023-12-03T11:32:41.428 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.427+0000 7f4d50c67780 1 < completed write operation key=TEIYINZFFG76 tag=F30G3ZCJXU4H type=write size=90426 2023-12-03T11:32:41.429 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.428+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=KTU04NBZY3VY type=del size=3012407 2023-12-03T11:32:41.430 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.430+0000 7f4d50c67780 1 < completed write operation key=ENMJS0KEVS2S tag=VPOZC81B8T3F type=write size=123458 2023-12-03T11:32:41.433 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.432+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~L39L8XK1B6LC.0 size=1048576 2023-12-03T11:32:41.434 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.433+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~L39L8XK1B6LC.1 size=427375 2023-12-03T11:32:41.434 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.433+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=L39L8XK1B6LC tag=WBG65XKDT4SI type=write size=2524527 2023-12-03T11:32:41.435 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.434+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~KVRM020NEW3M.0 size=1048576 2023-12-03T11:32:41.435 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.434+0000 7f4d50c67780 1 < canceled part key=_multipart_CQPZ0X62207Z.2~KVRM020NEW3M.1 size=1048576 2023-12-03T11:32:41.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.435+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~KVRM020NEW3M.2 size=995006 2023-12-03T11:32:41.438 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.437+0000 7f4d50c67780 1 < canceled multipart upload key=CQPZ0X62207Z upload=KVRM020NEW3M tag=DLJ4NNSNJCD4 type=write size=4140734 2023-12-03T11:32:41.439 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.438+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=S20VLX24NV2A type=del size=1359288 2023-12-03T11:32:41.441 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.441+0000 7f4d50c67780 1 < suggested update operation key=73SL3ZBBDA6Q tag=05XR66I50FNT type=del size=3855165 2023-12-03T11:32:41.442 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.442+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=P94V6LBLAE20 type=del size=1375140 2023-12-03T11:32:41.444 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.443+0000 7f4d50c67780 1 < completed delete operation key=0M6ZAD39I852 tag=S49HVU6OW35E type=del 2023-12-03T11:32:41.445 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.444+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=SRHVPA5JNB1N type=del size=2358441 2023-12-03T11:32:41.445 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.444+0000 7f4d50c67780 1 < canceled part key=_multipart_V0ND3OBFJJUB.2~6Y4FW6GCE54R.0 size=794763 2023-12-03T11:32:41.447 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.446+0000 7f4d50c67780 1 < canceled multipart upload key=V0ND3OBFJJUB upload=6Y4FW6GCE54R tag=6MCKCTAN8E7T type=write size=1843339 2023-12-03T11:32:41.448 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.447+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=CG4WUW4TSHUR type=del size=220096 2023-12-03T11:32:41.449 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.448+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~UR9QB76A9WLW.0 size=1048576 2023-12-03T11:32:41.450 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.449+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~UR9QB76A9WLW.1 size=556677 2023-12-03T11:32:41.452 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.451+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=UR9QB76A9WLW tag=7V43UMD4DST2 type=write size=2653829 2023-12-03T11:32:41.453 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.453+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=8BCXBVTG89EC type=del size=845257 2023-12-03T11:32:41.455 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.454+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~H0DW71XI4SJ4.0 size=1048576 2023-12-03T11:32:41.456 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.455+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~H0DW71XI4SJ4.1 size=1048576 2023-12-03T11:32:41.456 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.455+0000 7f4d50c67780 1 < canceled part key=_multipart_8J1EO2JDQUQH.2~H0DW71XI4SJ4.2 size=451080 2023-12-03T11:32:41.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.457+0000 7f4d50c67780 1 < canceled multipart upload key=8J1EO2JDQUQH upload=H0DW71XI4SJ4 tag=4FCFVS9IIY3T type=write size=3596808 2023-12-03T11:32:41.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.458+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=7K483YD57H4V type=del size=2103605 2023-12-03T11:32:41.460 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.459+0000 7f4d50c67780 1 < completed write operation key=BX5POXMMYLB7 tag=SE6HEYNSAVY0 type=write size=301356 2023-12-03T11:32:41.461 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.460+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=QT9H452IX25P type=del size=3999920 2023-12-03T11:32:41.462 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.461+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=L1LC3NJQH087 type=del 2023-12-03T11:32:41.463 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.462+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=GJ4PNA3HAII4 type=del size=836591 2023-12-03T11:32:41.464 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.464+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=706CWK5HC6AH type=del 2023-12-03T11:32:41.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.465+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=IVDC6KKM5OHJ type=del size=1196675 2023-12-03T11:32:41.467 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.466+0000 7f4d50c67780 -1 < failed to complete operation key=7C7UX0231SHV tag=XQ7IS24OHI90 type=del size=2466578: (22) Invalid argument 2023-12-03T11:32:41.469 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.468+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~PIBO2EN28BBZ.0 size=1048576 2023-12-03T11:32:41.471 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.470+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~PIBO2EN28BBZ.1 size=447747 2023-12-03T11:32:41.471 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.470+0000 7f4d50c67780 1 > prepared multipart upload key=JBL6IOJC4TT0 upload=PIBO2EN28BBZ tag=BFSD162E8B2Y type=write size=2544899 2023-12-03T11:32:41.472 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.471+0000 7f4d50c67780 1 < completed delete operation key=YDRAH5EE39R4 tag=22HBQ0EHJKZP type=del 2023-12-03T11:32:41.474 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.474+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~NG7GNXW5J4AQ.0 size=902408 2023-12-03T11:32:41.474 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.474+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=NG7GNXW5J4AQ tag=XNQ1BLLLE4RP type=write size=1950984 2023-12-03T11:32:41.476 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.475+0000 7f4d50c67780 1 < completed write operation key=8J1EO2JDQUQH tag=V0GRQGI8GRQM type=write size=955280 2023-12-03T11:32:41.477 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.476+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=U3RCEU27SD0H type=del size=3445568 2023-12-03T11:32:41.478 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.477+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=M28WG4TF2R6A type=del 2023-12-03T11:32:41.479 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.479+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=DY5AOSJHHAPN type=del size=2143132 2023-12-03T11:32:41.481 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.480+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~M2PJAQ2UMXEO.0 size=506295 2023-12-03T11:32:41.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.482+0000 7f4d50c67780 1 < completed multipart upload key=EAP0BYZTTT2E upload=M2PJAQ2UMXEO tag=WBMB1NPSBCMR type=write size=1554871 2023-12-03T11:32:41.484 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.483+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=24B2F995KKVG type=del size=608450 2023-12-03T11:32:41.485 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.484+0000 7f4d50c67780 1 < completed delete operation key=EX93BYX10WJB tag=KTU04NBZY3VY type=del 2023-12-03T11:32:41.486 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.486+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=ELXBCLP42QAE type=del size=168535 2023-12-03T11:32:41.487 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.486+0000 7f4d50c67780 1 < canceled part key=_multipart_EH4B2QP1C42H.2~L39L8XK1B6LC.0 size=1048576 2023-12-03T11:32:41.488 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.487+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~L39L8XK1B6LC.1 size=427375 2023-12-03T11:32:41.490 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.489+0000 7f4d50c67780 1 < canceled multipart upload key=EH4B2QP1C42H upload=L39L8XK1B6LC tag=WBG65XKDT4SI type=write size=2524527 2023-12-03T11:32:41.492 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.491+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~K0HVF56WKKFB.0 size=1048576 2023-12-03T11:32:41.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.492+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~K0HVF56WKKFB.1 size=1048576 2023-12-03T11:32:41.494 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.493+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~K0HVF56WKKFB.2 size=325551 2023-12-03T11:32:41.494 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.493+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=K0HVF56WKKFB tag=EV92U4HPV9UI type=write size=3471279 2023-12-03T11:32:41.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.495+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=S20VLX24NV2A type=del 2023-12-03T11:32:41.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.496+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=675NLNE7WLM9 type=del size=1568724 2023-12-03T11:32:41.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.497+0000 7f4d50c67780 1 < completed delete operation key=73SL3ZBBDA6Q tag=P94V6LBLAE20 type=del 2023-12-03T11:32:41.500 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.500+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~47KDCV3YKYHY.0 size=879872 2023-12-03T11:32:41.501 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.500+0000 7f4d50c67780 1 > prepared multipart upload key=TOGV2BZ99FRF upload=47KDCV3YKYHY tag=HHFVZH1YE1MV type=write size=1928448 2023-12-03T11:32:41.502 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.501+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=SRHVPA5JNB1N type=del 2023-12-03T11:32:41.503 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.502+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=X5LV67BAT2SN type=del size=1350211 2023-12-03T11:32:41.505 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.504+0000 7f4d50c67780 1 < completed delete operation key=GTLP2WZUX7U8 tag=CG4WUW4TSHUR type=del 2023-12-03T11:32:41.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.505+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=MXUJXEWPG8EG type=del size=2713174 2023-12-03T11:32:41.507 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.506+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=8BCXBVTG89EC type=del 2023-12-03T11:32:41.509 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.508+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~P22WSLEH8EMS.0 size=605111 2023-12-03T11:32:41.509 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.508+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=P22WSLEH8EMS tag=9V2G14F5L2TT type=write size=1653687 2023-12-03T11:32:41.510 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.510+0000 7f4d50c67780 1 < completed delete operation key=ZE19S5UCCZ3C tag=7K483YD57H4V type=del 2023-12-03T11:32:41.513 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.512+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~ZCXBE6YD3VSW.0 size=1048576 2023-12-03T11:32:41.514 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.513+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~ZCXBE6YD3VSW.1 size=337500 2023-12-03T11:32:41.514 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.513+0000 7f4d50c67780 1 > prepared multipart upload key=RF2Q24GI24HJ upload=ZCXBE6YD3VSW tag=B5RQ3EFFIYOB type=write size=2434652 2023-12-03T11:32:41.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.514+0000 7f4d50c67780 1 < completed delete operation key=0M6ZAD39I852 tag=QT9H452IX25P type=del 2023-12-03T11:32:41.516 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.515+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=TH436FVASJ9Q type=del size=3635576 2023-12-03T11:32:41.517 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.517+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=GJ4PNA3HAII4 type=del 2023-12-03T11:32:41.519 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.518+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=JFD6NK12PHSR type=del size=1982302 2023-12-03T11:32:41.520 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.519+0000 7f4d50c67780 1 < completed delete operation key=MLKGLDFFDC3W tag=IVDC6KKM5OHJ type=del 2023-12-03T11:32:41.522 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.521+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~2GOAGOK5OCNY.0 size=1048576 2023-12-03T11:32:41.523 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.522+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~2GOAGOK5OCNY.1 size=948241 2023-12-03T11:32:41.523 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.522+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=2GOAGOK5OCNY tag=TQB89J0SK3UM type=write size=3045393 2023-12-03T11:32:41.524 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.523+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~PIBO2EN28BBZ.0 size=1048576 2023-12-03T11:32:41.524 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.523+0000 7f4d50c67780 1 < canceled part key=_multipart_JBL6IOJC4TT0.2~PIBO2EN28BBZ.1 size=447747 2023-12-03T11:32:41.526 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.525+0000 7f4d50c67780 1 < canceled multipart upload key=JBL6IOJC4TT0 upload=PIBO2EN28BBZ tag=BFSD162E8B2Y type=write size=2544899 2023-12-03T11:32:41.528 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.527+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~4KEHINXFTY3L.0 size=692709 2023-12-03T11:32:41.528 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.527+0000 7f4d50c67780 1 > prepared multipart upload key=JBL6IOJC4TT0 upload=4KEHINXFTY3L tag=Y41K5EWCDPG5 type=write size=1741285 2023-12-03T11:32:41.529 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.529+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~NG7GNXW5J4AQ.0 size=902408 2023-12-03T11:32:41.532 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.531+0000 7f4d50c67780 1 < completed multipart upload key=EH4B2QP1C42H upload=NG7GNXW5J4AQ tag=XNQ1BLLLE4RP type=write size=1950984 2023-12-03T11:32:41.534 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.533+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~24RPDJ2SQXNN.0 size=1048576 2023-12-03T11:32:41.535 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.534+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~24RPDJ2SQXNN.1 size=482456 2023-12-03T11:32:41.535 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.534+0000 7f4d50c67780 1 > prepared multipart upload key=TEIYINZFFG76 upload=24RPDJ2SQXNN tag=48V5MP6RYTEL type=write size=2579608 2023-12-03T11:32:41.536 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.535+0000 7f4d50c67780 1 < completed delete operation key=EH4B2QP1C42H tag=U3RCEU27SD0H type=del 2023-12-03T11:32:41.537 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.537+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=UWO7MYTYPJ3J type=write size=795527 2023-12-03T11:32:41.539 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.538+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=DY5AOSJHHAPN type=del 2023-12-03T11:32:41.540 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.539+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=8EIVMW2JBHDO type=del size=595749 2023-12-03T11:32:41.541 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.540+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=24B2F995KKVG type=del 2023-12-03T11:32:41.543 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.542+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~J9ESDLR3X2JI.0 size=781002 2023-12-03T11:32:41.543 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.542+0000 7f4d50c67780 1 > prepared multipart upload key=U6R5Y9JXKT32 upload=J9ESDLR3X2JI tag=AU3YEHM4K9O5 type=write size=1829578 2023-12-03T11:32:41.544 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.543+0000 7f4d50c67780 1 < completed delete operation key=CQPZ0X62207Z tag=ELXBCLP42QAE type=del 2023-12-03T11:32:41.546 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.545+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=AMSV3L2YA5GU type=del size=3354829 2023-12-03T11:32:41.547 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.546+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~K0HVF56WKKFB.0 size=1048576 2023-12-03T11:32:41.547 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.547+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~K0HVF56WKKFB.1 size=1048576 2023-12-03T11:32:41.548 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.548+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~K0HVF56WKKFB.2 size=325551 2023-12-03T11:32:41.551 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.550+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=K0HVF56WKKFB tag=EV92U4HPV9UI type=write size=3471279 2023-12-03T11:32:41.552 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.551+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=PIS41CYYQ1RA type=del size=1549037 2023-12-03T11:32:41.553 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.553+0000 7f4d50c67780 1 < canceled operation key=73SL3ZBBDA6Q tag=675NLNE7WLM9 type=del size=1568724 2023-12-03T11:32:41.555 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.554+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=7EURIEDCOFIV type=del size=773333 2023-12-03T11:32:41.556 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.556+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~47KDCV3YKYHY.0 size=879872 2023-12-03T11:32:41.559 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.558+0000 7f4d50c67780 1 < completed multipart upload key=TOGV2BZ99FRF upload=47KDCV3YKYHY tag=HHFVZH1YE1MV type=write size=1928448 2023-12-03T11:32:41.561 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.560+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~564H0P8RU0BA.0 size=1048576 2023-12-03T11:32:41.562 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.561+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~564H0P8RU0BA.1 size=1016276 2023-12-03T11:32:41.562 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.561+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=564H0P8RU0BA tag=0P07JAQQFYT8 type=write size=3113428 2023-12-03T11:32:41.564 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.563+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=X5LV67BAT2SN type=del 2023-12-03T11:32:41.565 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.564+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=OHWX7OA3DECH type=write size=167258 2023-12-03T11:32:41.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.566+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=MXUJXEWPG8EG type=del 2023-12-03T11:32:41.568 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.567+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=GFP6HHRGOFOO type=del size=2260653 2023-12-03T11:32:41.569 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.568+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~P22WSLEH8EMS.0 size=605111 2023-12-03T11:32:41.571 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.570+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=P22WSLEH8EMS tag=9V2G14F5L2TT type=write size=1653687 2023-12-03T11:32:41.572 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.572+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=J5DD6QWS2JTI type=write size=501598 2023-12-03T11:32:41.573 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.572+0000 7f4d50c67780 1 < canceled part key=_multipart_RF2Q24GI24HJ.2~ZCXBE6YD3VSW.0 size=1048576 2023-12-03T11:32:41.574 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.573+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~ZCXBE6YD3VSW.1 size=337500 2023-12-03T11:32:41.576 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.575+0000 7f4d50c67780 1 < canceled multipart upload key=RF2Q24GI24HJ upload=ZCXBE6YD3VSW tag=B5RQ3EFFIYOB type=write size=2434652 2023-12-03T11:32:41.577 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.576+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=HQA0Z2MVZOV2 type=del size=3447919 2023-12-03T11:32:41.579 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.579+0000 7f4d50c67780 1 < suggested update operation key=JR8CIONID4QC tag=TH436FVASJ9Q type=del size=3635576 2023-12-03T11:32:41.581 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.580+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=OAP210J4N92I type=del size=1977147 2023-12-03T11:32:41.583 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.582+0000 7f4d50c67780 1 < suggested update operation key=8J1EO2JDQUQH tag=JFD6NK12PHSR type=del size=1982302 2023-12-03T11:32:41.584 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.583+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=352PHEQZ11M8 type=del size=2205501 2023-12-03T11:32:41.586 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.585+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~2GOAGOK5OCNY.0 size=1048576 2023-12-03T11:32:41.586 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.586+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~2GOAGOK5OCNY.1 size=948241 2023-12-03T11:32:41.590 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.589+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=2GOAGOK5OCNY tag=TQB89J0SK3UM type=write size=3045393 2023-12-03T11:32:41.592 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.591+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~1QGOCVCRU7FG.0 size=40588 2023-12-03T11:32:41.592 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.591+0000 7f4d50c67780 1 > prepared multipart upload key=JR8CIONID4QC upload=1QGOCVCRU7FG tag=MTFV2FVLFZTX type=write size=1089164 2023-12-03T11:32:41.593 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.592+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~4KEHINXFTY3L.0 size=692709 2023-12-03T11:32:41.595 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.594+0000 7f4d50c67780 1 < completed multipart upload key=JBL6IOJC4TT0 upload=4KEHINXFTY3L tag=Y41K5EWCDPG5 type=write size=1741285 2023-12-03T11:32:41.598 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.597+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~VX0XZNBCZWDQ.0 size=581923 2023-12-03T11:32:41.598 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.597+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=VX0XZNBCZWDQ tag=CSP82MK627V8 type=write size=1630499 2023-12-03T11:32:41.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.598+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~24RPDJ2SQXNN.0 size=1048576 2023-12-03T11:32:41.600 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.599+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~24RPDJ2SQXNN.1 size=482456 2023-12-03T11:32:41.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.601+0000 7f4d50c67780 1 < completed multipart upload key=TEIYINZFFG76 upload=24RPDJ2SQXNN tag=48V5MP6RYTEL type=write size=2579608 2023-12-03T11:32:41.604 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.603+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~LLYNOS8R9CZZ.0 size=779626 2023-12-03T11:32:41.604 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.603+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=LLYNOS8R9CZZ tag=PUM92FFXZE6U type=write size=1828202 2023-12-03T11:32:41.605 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.604+0000 7f4d50c67780 1 < completed write operation key=0M6ZAD39I852 tag=UWO7MYTYPJ3J type=write size=795527 2023-12-03T11:32:41.607 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.607+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~ZHJZYK5PUC0I.0 size=1048576 2023-12-03T11:32:41.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.607+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~ZHJZYK5PUC0I.1 size=1048576 2023-12-03T11:32:41.609 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.608+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~ZHJZYK5PUC0I.2 size=123369 2023-12-03T11:32:41.609 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.608+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=ZHJZYK5PUC0I tag=3JC1ZPUA2RXA type=write size=3269097 2023-12-03T11:32:41.610 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.609+0000 7f4d50c67780 1 < canceled operation key=K7YVVH7SAKMC tag=8EIVMW2JBHDO type=del size=595749 2023-12-03T11:32:41.613 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.612+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~TZC2V70W8AMI.0 size=378667 2023-12-03T11:32:41.613 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.612+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=TZC2V70W8AMI tag=9XM2TLBLKDH6 type=write size=1427243 2023-12-03T11:32:41.614 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.613+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~J9ESDLR3X2JI.0 size=781002 2023-12-03T11:32:41.616 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.615+0000 7f4d50c67780 1 < completed multipart upload key=U6R5Y9JXKT32 upload=J9ESDLR3X2JI tag=AU3YEHM4K9O5 type=write size=1829578 2023-12-03T11:32:41.617 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.616+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=5NPKM0MQ6UEN type=del size=1639896 2023-12-03T11:32:41.618 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.617+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=AMSV3L2YA5GU type=del 2023-12-03T11:32:41.619 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.619+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=8SD2J4Z1V8I1 type=del size=2596064 2023-12-03T11:32:41.621 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.620+0000 7f4d50c67780 1 < completed delete operation key=73SL3ZBBDA6Q tag=PIS41CYYQ1RA type=del 2023-12-03T11:32:41.622 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.621+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=NTHRYZUJP949 type=del size=1509513 2023-12-03T11:32:41.623 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.622+0000 7f4d50c67780 1 < completed delete operation key=MLKGLDFFDC3W tag=7EURIEDCOFIV type=del 2023-12-03T11:32:41.625 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.625+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~L6N0S57RHOKK.0 size=203600 2023-12-03T11:32:41.626 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.625+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=L6N0S57RHOKK tag=06WXVFEGYHET type=write size=1252176 2023-12-03T11:32:41.627 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.626+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~564H0P8RU0BA.0 size=1048576 2023-12-03T11:32:41.628 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.627+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~564H0P8RU0BA.1 size=1016276 2023-12-03T11:32:41.630 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.629+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=564H0P8RU0BA tag=0P07JAQQFYT8 type=write size=3113428 2023-12-03T11:32:41.632 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.631+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~YA1ZOR1AA1C3.0 size=611815 2023-12-03T11:32:41.632 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.631+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=YA1ZOR1AA1C3 tag=U8N9YS9ZUZBF type=write size=1660391 2023-12-03T11:32:41.633 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.633+0000 7f4d50c67780 1 < completed write operation key=ZE19S5UCCZ3C tag=OHWX7OA3DECH type=write size=167258 2023-12-03T11:32:41.636 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.635+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~IEBIBG6KIXAD.0 size=1048576 2023-12-03T11:32:41.637 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.636+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~IEBIBG6KIXAD.1 size=1048576 2023-12-03T11:32:41.637 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.637+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~IEBIBG6KIXAD.2 size=7118 2023-12-03T11:32:41.638 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.637+0000 7f4d50c67780 1 > prepared multipart upload key=JR8CIONID4QC upload=IEBIBG6KIXAD tag=04R60KEZI8ML type=write size=3152846 2023-12-03T11:32:41.639 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.638+0000 7f4d50c67780 1 < canceled operation key=02W4TX7ZCDI6 tag=GFP6HHRGOFOO type=del size=2260653 2023-12-03T11:32:41.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.639+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=R4T2DB7NTB2G type=write size=949901 2023-12-03T11:32:41.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.640+0000 7f4d50c67780 1 < completed write operation key=0M6ZAD39I852 tag=J5DD6QWS2JTI type=write size=501598 2023-12-03T11:32:41.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.642+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=6ZSEV9ES6185 type=del size=108011 2023-12-03T11:32:41.644 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.643+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=HQA0Z2MVZOV2 type=del 2023-12-03T11:32:41.646 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.645+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~JXNZIMD7SWN1.0 size=1048576 2023-12-03T11:32:41.647 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.646+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~JXNZIMD7SWN1.1 size=1048576 2023-12-03T11:32:41.648 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.647+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~JXNZIMD7SWN1.2 size=342745 2023-12-03T11:32:41.648 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.647+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=JXNZIMD7SWN1 tag=KQLWU0JS6JOL type=write size=3488473 2023-12-03T11:32:41.649 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.648+0000 7f4d50c67780 1 < completed delete operation key=GTLP2WZUX7U8 tag=OAP210J4N92I type=del 2023-12-03T11:32:41.650 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.649+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=1O6AV10EM82A type=write size=520712 2023-12-03T11:32:41.651 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.650+0000 7f4d50c67780 1 < completed delete operation key=EY1RBO15PCRR tag=352PHEQZ11M8 type=del 2023-12-03T11:32:41.652 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.652+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=6QFZOUZZ0KHG type=del size=3704324 2023-12-03T11:32:41.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.653+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~1QGOCVCRU7FG.0 size=40588 2023-12-03T11:32:41.655 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.655+0000 7f4d50c67780 1 < completed multipart upload key=JR8CIONID4QC upload=1QGOCVCRU7FG tag=MTFV2FVLFZTX type=write size=1089164 2023-12-03T11:32:41.657 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.656+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=BSPPR4CJIT4J type=del size=156367 2023-12-03T11:32:41.658 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.657+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~VX0XZNBCZWDQ.0 size=581923 2023-12-03T11:32:41.660 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.659+0000 7f4d50c67780 1 < completed multipart upload key=CQPZ0X62207Z upload=VX0XZNBCZWDQ tag=CSP82MK627V8 type=write size=1630499 2023-12-03T11:32:41.661 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.660+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=UBUGZ6A2NC2C type=del size=1975770 2023-12-03T11:32:41.662 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.661+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~LLYNOS8R9CZZ.0 size=779626 2023-12-03T11:32:41.664 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.663+0000 7f4d50c67780 1 < completed multipart upload key=7C7UX0231SHV upload=LLYNOS8R9CZZ tag=PUM92FFXZE6U type=write size=1828202 2023-12-03T11:32:41.665 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.664+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=SVH0WFHG11G7 type=del size=3150620 2023-12-03T11:32:41.666 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.665+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~ZHJZYK5PUC0I.0 size=1048576 2023-12-03T11:32:41.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.666+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~ZHJZYK5PUC0I.1 size=1048576 2023-12-03T11:32:41.668 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.667+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~ZHJZYK5PUC0I.2 size=123369 2023-12-03T11:32:41.670 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.669+0000 7f4d50c67780 1 < completed multipart upload key=EAP0BYZTTT2E upload=ZHJZYK5PUC0I tag=3JC1ZPUA2RXA type=write size=3269097 2023-12-03T11:32:41.672 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.671+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~BCYGFO7C18NO.0 size=4770 2023-12-03T11:32:41.672 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.671+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=BCYGFO7C18NO tag=SG5T6KTEE0O3 type=write size=1053346 2023-12-03T11:32:41.673 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.673+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~TZC2V70W8AMI.0 size=378667 2023-12-03T11:32:41.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.675+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=TZC2V70W8AMI tag=9XM2TLBLKDH6 type=write size=1427243 2023-12-03T11:32:41.677 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.676+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=K4DBPSIYP4FC type=del size=3000573 2023-12-03T11:32:41.679 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.679+0000 7f4d50c67780 1 < suggested update operation key=BX5POXMMYLB7 tag=5NPKM0MQ6UEN type=del size=1639896 2023-12-03T11:32:41.681 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.680+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=FP8AOJ2EH35F type=del size=3997381 2023-12-03T11:32:41.682 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.681+0000 7f4d50c67780 1 < completed delete operation key=WUM939BATDG9 tag=8SD2J4Z1V8I1 type=del 2023-12-03T11:32:41.685 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.684+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~1IDB6N68VJO4.0 size=1048576 2023-12-03T11:32:41.686 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.685+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~1IDB6N68VJO4.1 size=15474 2023-12-03T11:32:41.686 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.685+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=1IDB6N68VJO4 tag=I8ELVFDR9OA6 type=write size=2112626 2023-12-03T11:32:41.687 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.686+0000 7f4d50c67780 1 < completed delete operation key=YDRAH5EE39R4 tag=NTHRYZUJP949 type=del 2023-12-03T11:32:41.688 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.688+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=T7G4IJQ7QQLQ type=del size=2586986 2023-12-03T11:32:41.689 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.688+0000 7f4d50c67780 1 < canceled part key=_multipart_02W4TX7ZCDI6.2~L6N0S57RHOKK.0 size=203600 2023-12-03T11:32:41.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.690+0000 7f4d50c67780 1 < canceled multipart upload key=02W4TX7ZCDI6 upload=L6N0S57RHOKK tag=06WXVFEGYHET type=write size=1252176 2023-12-03T11:32:41.693 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.692+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~SUKWBRCNSK0P.0 size=1048576 2023-12-03T11:32:41.694 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.693+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~SUKWBRCNSK0P.1 size=1048576 2023-12-03T11:32:41.695 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.694+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~SUKWBRCNSK0P.2 size=520793 2023-12-03T11:32:41.695 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.694+0000 7f4d50c67780 1 > prepared multipart upload key=QQDBWLVSXIHP upload=SUKWBRCNSK0P tag=5SRIS5ABJ1VO type=write size=3666521 2023-12-03T11:32:41.696 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.695+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~YA1ZOR1AA1C3.0 size=611815 2023-12-03T11:32:41.702 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.698+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=YA1ZOR1AA1C3 tag=U8N9YS9ZUZBF type=write size=1660391 2023-12-03T11:32:41.702 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.699+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=6VTIMORVF73O type=del size=32780 2023-12-03T11:32:41.702 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.699+0000 7f4d50c67780 1 < canceled part key=_multipart_JR8CIONID4QC.2~IEBIBG6KIXAD.0 size=1048576 2023-12-03T11:32:41.702 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.700+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~IEBIBG6KIXAD.1 size=1048576 2023-12-03T11:32:41.703 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.702+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~IEBIBG6KIXAD.2 size=7118 2023-12-03T11:32:41.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.704+0000 7f4d50c67780 1 < canceled multipart upload key=JR8CIONID4QC upload=IEBIBG6KIXAD tag=04R60KEZI8ML type=write size=3152846 2023-12-03T11:32:41.707 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.706+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~XKNTRZT9D9RD.0 size=1048576 2023-12-03T11:32:41.708 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.707+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~XKNTRZT9D9RD.1 size=1048576 2023-12-03T11:32:41.709 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.708+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~XKNTRZT9D9RD.2 size=327247 2023-12-03T11:32:41.709 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.708+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=XKNTRZT9D9RD tag=WL9TI9MKCR09 type=write size=3472975 2023-12-03T11:32:41.710 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.710+0000 7f4d50c67780 1 < completed write operation key=U6R5Y9JXKT32 tag=R4T2DB7NTB2G type=write size=949901 2023-12-03T11:32:41.713 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.712+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~ZN0VKZS6CALS.0 size=1048576 2023-12-03T11:32:41.714 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.713+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~ZN0VKZS6CALS.1 size=675832 2023-12-03T11:32:41.714 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.713+0000 7f4d50c67780 1 > prepared multipart upload key=52E31L45TN7V upload=ZN0VKZS6CALS tag=YL63RQKOQTVD type=write size=2772984 2023-12-03T11:32:41.715 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.714+0000 7f4d50c67780 1 < completed delete operation key=GTLP2WZUX7U8 tag=6ZSEV9ES6185 type=del 2023-12-03T11:32:41.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.715+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=44SMBB9DQGUP type=del size=4100732 2023-12-03T11:32:41.717 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.717+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~JXNZIMD7SWN1.0 size=1048576 2023-12-03T11:32:41.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.718+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~JXNZIMD7SWN1.1 size=1048576 2023-12-03T11:32:41.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.719+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~JXNZIMD7SWN1.2 size=342745 2023-12-03T11:32:41.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.721+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=JXNZIMD7SWN1 tag=KQLWU0JS6JOL type=write size=3488473 2023-12-03T11:32:41.723 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.722+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=L1BIOVQ8HQKA type=write size=783188 2023-12-03T11:32:41.726 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.725+0000 7f4d50c67780 1 < suggested update operation key=XM5E3D99MXVA tag=1O6AV10EM82A type=write size=520712 2023-12-03T11:32:41.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.727+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~H26Z1RJUT9O9.0 size=1048576 2023-12-03T11:32:41.729 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.728+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~H26Z1RJUT9O9.1 size=1048576 2023-12-03T11:32:41.730 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.729+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~H26Z1RJUT9O9.2 size=801555 2023-12-03T11:32:41.730 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.729+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=H26Z1RJUT9O9 tag=TX7M7DTFJZW4 type=write size=3947283 2023-12-03T11:32:41.732 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.732+0000 7f4d50c67780 1 < suggested remove operation key=73SL3ZBBDA6Q tag=6QFZOUZZ0KHG type=del 2023-12-03T11:32:41.734 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.733+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=A3HEZQMVOQMX type=del size=1216468 2023-12-03T11:32:41.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.734+0000 7f4d50c67780 1 < completed delete operation key=CQPZ0X62207Z tag=BSPPR4CJIT4J type=del 2023-12-03T11:32:41.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.735+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=PVC9HRQCLN1L type=del size=1182045 2023-12-03T11:32:41.737 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.736+0000 7f4d50c67780 1 < completed delete operation key=V0ND3OBFJJUB tag=UBUGZ6A2NC2C type=del 2023-12-03T11:32:41.738 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.738+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=E1F4XKOQUJ7F type=del size=1776493 2023-12-03T11:32:41.740 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.739+0000 7f4d50c67780 1 < completed delete operation key=QQDBWLVSXIHP tag=SVH0WFHG11G7 type=del 2023-12-03T11:32:41.742 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.741+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~GK6W9T1F6SU4.0 size=1048576 2023-12-03T11:32:41.743 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.742+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~GK6W9T1F6SU4.1 size=379145 2023-12-03T11:32:41.743 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.742+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=GK6W9T1F6SU4 tag=HZ04CIDVS004 type=write size=2476297 2023-12-03T11:32:41.744 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.743+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~BCYGFO7C18NO.0 size=4770 2023-12-03T11:32:41.746 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.745+0000 7f4d50c67780 1 < completed multipart upload key=CQPZ0X62207Z upload=BCYGFO7C18NO tag=SG5T6KTEE0O3 type=write size=1053346 2023-12-03T11:32:41.748 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.747+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=K2G8PY9OQ30I type=del size=1154018 2023-12-03T11:32:41.751 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.750+0000 7f4d50c67780 1 < suggested remove operation key=ULLPV2G10BME tag=K4DBPSIYP4FC type=del 2023-12-03T11:32:41.752 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.751+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=J908NHIV7O1E type=del size=1301994 2023-12-03T11:32:41.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.753+0000 7f4d50c67780 1 < canceled operation key=2H6AFQ362OGP tag=FP8AOJ2EH35F type=del size=3997381 2023-12-03T11:32:41.755 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.754+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=MURYBD5LN41E type=del size=1390163 2023-12-03T11:32:41.756 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.756+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~1IDB6N68VJO4.0 size=1048576 2023-12-03T11:32:41.758 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.757+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~1IDB6N68VJO4.1 size=15474 2023-12-03T11:32:41.760 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.759+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=1IDB6N68VJO4 tag=I8ELVFDR9OA6 type=write size=2112626 2023-12-03T11:32:41.761 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.760+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=YWFI9LUOXK1H type=del size=2088817 2023-12-03T11:32:41.762 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.762+0000 7f4d50c67780 -1 < failed to complete operation key=73SL3ZBBDA6Q tag=T7G4IJQ7QQLQ type=del size=2586986: (22) Invalid argument 2023-12-03T11:32:41.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.763+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=2P5KUSGAAZYC type=del size=3740691 2023-12-03T11:32:41.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.763+0000 7f4d50c67780 1 < canceled part key=_multipart_QQDBWLVSXIHP.2~SUKWBRCNSK0P.0 size=1048576 2023-12-03T11:32:41.765 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.764+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~SUKWBRCNSK0P.1 size=1048576 2023-12-03T11:32:41.766 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.765+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~SUKWBRCNSK0P.2 size=520793 2023-12-03T11:32:41.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.767+0000 7f4d50c67780 1 < canceled multipart upload key=QQDBWLVSXIHP upload=SUKWBRCNSK0P tag=5SRIS5ABJ1VO type=write size=3666521 2023-12-03T11:32:41.769 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.768+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=QQ2DYPTNIUPM type=del size=167859 2023-12-03T11:32:41.771 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.770+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=6VTIMORVF73O type=del 2023-12-03T11:32:41.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.772+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~94AEOVK2WUMR.0 size=1048576 2023-12-03T11:32:41.774 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.773+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~94AEOVK2WUMR.1 size=20546 2023-12-03T11:32:41.774 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.773+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=94AEOVK2WUMR tag=90V0DKTFC28K type=write size=2117698 2023-12-03T11:32:41.775 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.774+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~XKNTRZT9D9RD.0 size=1048576 2023-12-03T11:32:41.776 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.775+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~XKNTRZT9D9RD.1 size=1048576 2023-12-03T11:32:41.777 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.776+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~XKNTRZT9D9RD.2 size=327247 2023-12-03T11:32:41.779 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.778+0000 7f4d50c67780 1 < completed multipart upload key=7C7UX0231SHV upload=XKNTRZT9D9RD tag=WL9TI9MKCR09 type=write size=3472975 2023-12-03T11:32:41.780 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.779+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=YJB2HABZE4EE type=del size=1499897 2023-12-03T11:32:41.781 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.780+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~ZN0VKZS6CALS.0 size=1048576 2023-12-03T11:32:41.782 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.781+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~ZN0VKZS6CALS.1 size=675832 2023-12-03T11:32:41.784 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.783+0000 7f4d50c67780 1 < completed multipart upload key=52E31L45TN7V upload=ZN0VKZS6CALS tag=YL63RQKOQTVD type=write size=2772984 2023-12-03T11:32:41.786 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.785+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~M1MRETPF3G2B.0 size=1048576 2023-12-03T11:32:41.787 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.786+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~M1MRETPF3G2B.1 size=13162 2023-12-03T11:32:41.787 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.786+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=M1MRETPF3G2B tag=IH6BFKDK4YGY type=write size=2110314 2023-12-03T11:32:41.788 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.787+0000 7f4d50c67780 1 < completed delete operation key=CQPZ0X62207Z tag=44SMBB9DQGUP type=del 2023-12-03T11:32:41.789 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.789+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=SM4ZWPXNKPR7 type=write size=808554 2023-12-03T11:32:41.791 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.790+0000 7f4d50c67780 1 < completed write operation key=EY1RBO15PCRR tag=L1BIOVQ8HQKA type=write size=783188 2023-12-03T11:32:41.793 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.793+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~4ZSQVJ3IITXW.0 size=603728 2023-12-03T11:32:41.794 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.793+0000 7f4d50c67780 1 > prepared multipart upload key=YDRAH5EE39R4 upload=4ZSQVJ3IITXW tag=70X0LBU0X2F5 type=write size=1652304 2023-12-03T11:32:41.794 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.793+0000 7f4d50c67780 1 < canceled part key=_multipart_8J1EO2JDQUQH.2~H26Z1RJUT9O9.0 size=1048576 2023-12-03T11:32:41.795 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.794+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~H26Z1RJUT9O9.1 size=1048576 2023-12-03T11:32:41.796 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.795+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~H26Z1RJUT9O9.2 size=801555 2023-12-03T11:32:41.798 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.797+0000 7f4d50c67780 1 < canceled multipart upload key=8J1EO2JDQUQH upload=H26Z1RJUT9O9 tag=TX7M7DTFJZW4 type=write size=3947283 2023-12-03T11:32:41.800 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.800+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~MYR2S6K1IHEY.0 size=1048576 2023-12-03T11:32:41.802 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.801+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~MYR2S6K1IHEY.1 size=1048576 2023-12-03T11:32:41.803 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.802+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~MYR2S6K1IHEY.2 size=794173 2023-12-03T11:32:41.803 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.802+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=MYR2S6K1IHEY tag=30HJW2TCEDSO type=write size=3939901 2023-12-03T11:32:41.804 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.803+0000 7f4d50c67780 1 < completed delete operation key=EH4B2QP1C42H tag=A3HEZQMVOQMX type=del 2023-12-03T11:32:41.805 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.804+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=UGJ5NAH2NH58 type=del size=1801291 2023-12-03T11:32:41.806 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.806+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=PVC9HRQCLN1L type=del 2023-12-03T11:32:41.807 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.807+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=J5IIXA43SFBC type=del size=3983408 2023-12-03T11:32:41.809 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.808+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=E1F4XKOQUJ7F type=del 2023-12-03T11:32:41.810 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.809+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=CAPRZI8B30JF type=write size=644976 2023-12-03T11:32:41.811 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.810+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~GK6W9T1F6SU4.0 size=1048576 2023-12-03T11:32:41.812 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.811+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~GK6W9T1F6SU4.1 size=379145 2023-12-03T11:32:41.814 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.813+0000 7f4d50c67780 1 < completed multipart upload key=V0ND3OBFJJUB upload=GK6W9T1F6SU4 tag=HZ04CIDVS004 type=write size=2476297 2023-12-03T11:32:41.815 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.814+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=IROJUTABINVF type=del size=3300383 2023-12-03T11:32:41.816 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.815+0000 7f4d50c67780 -1 < no bi entry to suggest for operation key=ULLPV2G10BME tag=K2G8PY9OQ30I type=del size=1154018: (2) No such file or directory 2023-12-03T11:32:41.818 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.817+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~QTO1OSMYGBYN.0 size=1048576 2023-12-03T11:32:41.820 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.819+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~QTO1OSMYGBYN.1 size=206234 2023-12-03T11:32:41.820 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.819+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=QTO1OSMYGBYN tag=B2JDJVSQYAIQ type=write size=2303386 2023-12-03T11:32:41.821 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.821+0000 7f4d50c67780 1 < completed delete operation key=K7YVVH7SAKMC tag=J908NHIV7O1E type=del 2023-12-03T11:32:41.824 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.823+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~HG5E0XGT4WHM.0 size=1048576 2023-12-03T11:32:41.825 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.824+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~HG5E0XGT4WHM.1 size=95247 2023-12-03T11:32:41.825 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.824+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=HG5E0XGT4WHM tag=QFG3KX1GHZUK type=write size=2192399 2023-12-03T11:32:41.826 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.825+0000 7f4d50c67780 1 < canceled operation key=K7YVVH7SAKMC tag=MURYBD5LN41E type=del size=1390163 2023-12-03T11:32:41.827 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.826+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=TXHO493RVA8X type=del size=785640 2023-12-03T11:32:41.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.828+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=YWFI9LUOXK1H type=del 2023-12-03T11:32:41.831 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.830+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~B2DDKT2PM9KR.0 size=1048576 2023-12-03T11:32:41.832 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.831+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~B2DDKT2PM9KR.1 size=1048576 2023-12-03T11:32:41.833 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.832+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~B2DDKT2PM9KR.2 size=986486 2023-12-03T11:32:41.833 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.832+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=B2DDKT2PM9KR tag=73PA8V5KVOEY type=write size=4132214 2023-12-03T11:32:41.834 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.833+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=2P5KUSGAAZYC type=del 2023-12-03T11:32:41.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.835+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~DF1OTV0862CJ.0 size=1048576 2023-12-03T11:32:41.837 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.836+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~DF1OTV0862CJ.1 size=325837 2023-12-03T11:32:41.837 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.836+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=DF1OTV0862CJ tag=WR05GML883XO type=write size=2422989 2023-12-03T11:32:41.839 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.839+0000 7f4d50c67780 1 < suggested update operation key=BX5POXMMYLB7 tag=QQ2DYPTNIUPM type=del size=167859 2023-12-03T11:32:41.841 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.840+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=S45CQE492XDQ type=del size=3081678 2023-12-03T11:32:41.842 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.841+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~94AEOVK2WUMR.0 size=1048576 2023-12-03T11:32:41.843 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.842+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~94AEOVK2WUMR.1 size=20546 2023-12-03T11:32:41.845 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.845+0000 7f4d50c67780 1 < completed multipart upload key=02W4TX7ZCDI6 upload=94AEOVK2WUMR tag=90V0DKTFC28K type=write size=2117698 2023-12-03T11:32:41.847 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.846+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=29P8VZ20IU8Z type=del size=1530157 2023-12-03T11:32:41.848 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.847+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=YJB2HABZE4EE type=del 2023-12-03T11:32:41.849 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.848+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=LY0KTHNUXQ4V type=write size=749761 2023-12-03T11:32:41.850 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.849+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~M1MRETPF3G2B.0 size=1048576 2023-12-03T11:32:41.851 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.850+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~M1MRETPF3G2B.1 size=13162 2023-12-03T11:32:41.853 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.853+0000 7f4d50c67780 1 < completed multipart upload key=EAP0BYZTTT2E upload=M1MRETPF3G2B tag=IH6BFKDK4YGY type=write size=2110314 2023-12-03T11:32:41.855 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.854+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=WYDSTPBZB3LX type=del size=1690173 2023-12-03T11:32:41.856 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.855+0000 7f4d50c67780 1 < completed write operation key=TEIYINZFFG76 tag=SM4ZWPXNKPR7 type=write size=808554 2023-12-03T11:32:41.857 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.856+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=CKC4E2OWLH7T type=write size=258109 2023-12-03T11:32:41.859 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.858+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~4ZSQVJ3IITXW.0 size=603728 2023-12-03T11:32:41.862 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.860+0000 7f4d50c67780 1 < completed multipart upload key=YDRAH5EE39R4 upload=4ZSQVJ3IITXW tag=70X0LBU0X2F5 type=write size=1652304 2023-12-03T11:32:41.862 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.861+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=LUPDA776521B type=write size=73615 2023-12-03T11:32:41.863 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.862+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~MYR2S6K1IHEY.0 size=1048576 2023-12-03T11:32:41.864 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.863+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~MYR2S6K1IHEY.1 size=1048576 2023-12-03T11:32:41.865 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.864+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~MYR2S6K1IHEY.2 size=794173 2023-12-03T11:32:41.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.866+0000 7f4d50c67780 1 < completed multipart upload key=EAP0BYZTTT2E upload=MYR2S6K1IHEY tag=30HJW2TCEDSO type=write size=3939901 2023-12-03T11:32:41.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.868+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=TUX3KY6GYUGG type=del size=4018980 2023-12-03T11:32:41.870 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.869+0000 7f4d50c67780 1 < canceled operation key=JR8CIONID4QC tag=UGJ5NAH2NH58 type=del size=1801291 2023-12-03T11:32:41.871 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.870+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=S210RXMZY3SR type=del size=949615 2023-12-03T11:32:41.872 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.871+0000 7f4d50c67780 1 < completed delete operation key=WUM939BATDG9 tag=J5IIXA43SFBC type=del 2023-12-03T11:32:41.874 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.873+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~880ALI8WP5FN.0 size=1048576 2023-12-03T11:32:41.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.874+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~880ALI8WP5FN.1 size=1048576 2023-12-03T11:32:41.876 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.875+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~880ALI8WP5FN.2 size=898972 2023-12-03T11:32:41.876 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.875+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=880ALI8WP5FN tag=XWAE82K4XRRW type=write size=4044700 2023-12-03T11:32:41.877 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.877+0000 7f4d50c67780 1 < completed write operation key=EY1RBO15PCRR tag=CAPRZI8B30JF type=write size=644976 2023-12-03T11:32:41.879 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.878+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=4ZPZX8DCLPCE type=del size=1294903 2023-12-03T11:32:41.880 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.879+0000 7f4d50c67780 -1 < failed to complete operation key=BX5POXMMYLB7 tag=IROJUTABINVF type=del size=3300383: (22) Invalid argument 2023-12-03T11:32:41.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.881+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~O8O6OOR2S0WT.0 size=1048576 2023-12-03T11:32:41.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.882+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~O8O6OOR2S0WT.1 size=265058 2023-12-03T11:32:41.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.882+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=O8O6OOR2S0WT tag=FUM972S90MI1 type=write size=2362210 2023-12-03T11:32:41.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.884+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~QTO1OSMYGBYN.0 size=1048576 2023-12-03T11:32:41.885 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.885+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~QTO1OSMYGBYN.1 size=206234 2023-12-03T11:32:41.888 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.887+0000 7f4d50c67780 1 < completed multipart upload key=7C7UX0231SHV upload=QTO1OSMYGBYN tag=B2JDJVSQYAIQ type=write size=2303386 2023-12-03T11:32:41.889 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.888+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=A78W9A2YES77 type=del size=74979 2023-12-03T11:32:41.890 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.889+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~HG5E0XGT4WHM.0 size=1048576 2023-12-03T11:32:41.891 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.890+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~HG5E0XGT4WHM.1 size=95247 2023-12-03T11:32:41.893 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.892+0000 7f4d50c67780 1 < completed multipart upload key=02W4TX7ZCDI6 upload=HG5E0XGT4WHM tag=QFG3KX1GHZUK type=write size=2192399 2023-12-03T11:32:41.894 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.893+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=K99VBX96GB7Y type=del size=3151024 2023-12-03T11:32:41.895 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.895+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=TXHO493RVA8X type=del 2023-12-03T11:32:41.897 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.896+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=LYHTXOV6SZVP type=del size=3306858 2023-12-03T11:32:41.897 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.896+0000 7f4d50c67780 1 < canceled part key=_multipart_EX93BYX10WJB.2~B2DDKT2PM9KR.0 size=1048576 2023-12-03T11:32:41.898 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.897+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~B2DDKT2PM9KR.1 size=1048576 2023-12-03T11:32:41.899 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.898+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~B2DDKT2PM9KR.2 size=986486 2023-12-03T11:32:41.901 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.900+0000 7f4d50c67780 1 < canceled multipart upload key=EX93BYX10WJB upload=B2DDKT2PM9KR tag=73PA8V5KVOEY type=write size=4132214 2023-12-03T11:32:41.902 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.901+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=7Z5G6XK954DV type=write size=862003 2023-12-03T11:32:41.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.902+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~DF1OTV0862CJ.0 size=1048576 2023-12-03T11:32:41.904 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.903+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~DF1OTV0862CJ.1 size=325837 2023-12-03T11:32:41.906 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.905+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=DF1OTV0862CJ tag=WR05GML883XO type=write size=2422989 2023-12-03T11:32:41.907 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.907+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=B8AOH6BT68AK type=del size=1645164 2023-12-03T11:32:41.909 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.908+0000 7f4d50c67780 1 < completed delete operation key=JR8CIONID4QC tag=S45CQE492XDQ type=del 2023-12-03T11:32:41.910 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.909+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=Y39KXYPKYAK2 type=del size=1638109 2023-12-03T11:32:41.912 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.911+0000 7f4d50c67780 1 < suggested remove operation key=JBL6IOJC4TT0 tag=29P8VZ20IU8Z type=del 2023-12-03T11:32:41.913 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.913+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=98UQKNKJQRBI type=del size=574326 2023-12-03T11:32:41.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.914+0000 7f4d50c67780 1 < completed write operation key=7C7UX0231SHV tag=LY0KTHNUXQ4V type=write size=749761 2023-12-03T11:32:41.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.915+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=4VU38PT2TDFG type=del size=965323 2023-12-03T11:32:41.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.916+0000 7f4d50c67780 1 < completed delete operation key=52E31L45TN7V tag=WYDSTPBZB3LX type=del 2023-12-03T11:32:41.920 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.919+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~66YQMAUHOR35.0 size=685659 2023-12-03T11:32:41.920 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.919+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=66YQMAUHOR35 tag=YO5DCVB0YZID type=write size=1734235 2023-12-03T11:32:41.921 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.920+0000 7f4d50c67780 1 < completed write operation key=K7YVVH7SAKMC tag=CKC4E2OWLH7T type=write size=258109 2023-12-03T11:32:41.922 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.921+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=HHHN4XHTMMGN type=del size=3448688 2023-12-03T11:32:41.924 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.924+0000 7f4d50c67780 1 < suggested remove operation key=YDRAH5EE39R4 tag=LUPDA776521B type=write 2023-12-03T11:32:41.926 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.925+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=LQE3CMATXL8K type=del size=670669 2023-12-03T11:32:41.928 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.927+0000 7f4d50c67780 1 < suggested update operation key=TOGV2BZ99FRF tag=TUX3KY6GYUGG type=del size=4018980 2023-12-03T11:32:41.929 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.928+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=7DPZ1985FH6B type=del size=3964317 2023-12-03T11:32:41.930 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.930+0000 7f4d50c67780 1 < completed delete operation key=WUM939BATDG9 tag=S210RXMZY3SR type=del 2023-12-03T11:32:41.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.931+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=2KWP8O2FRWE2 type=write size=893440 2023-12-03T11:32:41.933 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.932+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~880ALI8WP5FN.0 size=1048576 2023-12-03T11:32:41.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.933+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~880ALI8WP5FN.1 size=1048576 2023-12-03T11:32:41.936 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.935+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~880ALI8WP5FN.2 size=898972 2023-12-03T11:32:41.938 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.937+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=880ALI8WP5FN tag=XWAE82K4XRRW type=write size=4044700 2023-12-03T11:32:41.940 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.939+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~CVBNWD7EYO0V.0 size=1048576 2023-12-03T11:32:41.941 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.940+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~CVBNWD7EYO0V.1 size=741694 2023-12-03T11:32:41.941 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.940+0000 7f4d50c67780 1 > prepared multipart upload key=ZE19S5UCCZ3C upload=CVBNWD7EYO0V tag=VVKHAFUL5XMX type=write size=2838846 2023-12-03T11:32:41.942 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.941+0000 7f4d50c67780 1 < completed delete operation key=EY1RBO15PCRR tag=4ZPZX8DCLPCE type=del 2023-12-03T11:32:41.943 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.943+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=0Z13HQ7HSGNF type=del size=546270 2023-12-03T11:32:41.945 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.944+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~O8O6OOR2S0WT.0 size=1048576 2023-12-03T11:32:41.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.945+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~O8O6OOR2S0WT.1 size=265058 2023-12-03T11:32:41.948 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.947+0000 7f4d50c67780 1 < completed multipart upload key=K7YVVH7SAKMC upload=O8O6OOR2S0WT tag=FUM972S90MI1 type=write size=2362210 2023-12-03T11:32:41.949 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.949+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=FY00KIHHFJJ7 type=write size=32758 2023-12-03T11:32:41.951 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.950+0000 7f4d50c67780 1 < canceled operation key=EAP0BYZTTT2E tag=A78W9A2YES77 type=del size=74979 2023-12-03T11:32:41.953 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.952+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~L6R7YIDDK44C.0 size=1048576 2023-12-03T11:32:41.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.953+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~L6R7YIDDK44C.1 size=1048576 2023-12-03T11:32:41.955 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.954+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~L6R7YIDDK44C.2 size=119155 2023-12-03T11:32:41.955 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.954+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=L6R7YIDDK44C tag=0EX62UDP15BU type=write size=3264883 2023-12-03T11:32:41.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.957+0000 7f4d50c67780 1 < suggested update operation key=7C7UX0231SHV tag=K99VBX96GB7Y type=del size=3151024 2023-12-03T11:32:41.959 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.958+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=UJAJL31OB4N0 type=del size=3485868 2023-12-03T11:32:41.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.959+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=LYHTXOV6SZVP type=del 2023-12-03T11:32:41.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.962+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~V7P201210KS1.0 size=1048576 2023-12-03T11:32:41.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.963+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~V7P201210KS1.1 size=1048576 2023-12-03T11:32:41.964 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.964+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~V7P201210KS1.2 size=368962 2023-12-03T11:32:41.965 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.964+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=V7P201210KS1 tag=RXVBMLVHNOIO type=write size=3514690 2023-12-03T11:32:41.967 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.966+0000 7f4d50c67780 1 < suggested remove operation key=G0O8EC405LYM tag=7Z5G6XK954DV type=write 2023-12-03T11:32:41.969 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.968+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~WEGLQRYWYO0R.0 size=662137 2023-12-03T11:32:41.969 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.968+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=WEGLQRYWYO0R tag=4VOMVYT8C66B type=write size=1710713 2023-12-03T11:32:41.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.969+0000 7f4d50c67780 1 < completed delete operation key=02W4TX7ZCDI6 tag=B8AOH6BT68AK type=del 2023-12-03T11:32:41.971 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.970+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=9FMAVVZLTD1C type=write size=739433 2023-12-03T11:32:41.973 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.972+0000 7f4d50c67780 1 < suggested update operation key=52E31L45TN7V tag=Y39KXYPKYAK2 type=del size=1638109 2023-12-03T11:32:41.974 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.974+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=4HU1FZO8L54B type=del size=322897 2023-12-03T11:32:41.975 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.975+0000 7f4d50c67780 1 < completed delete operation key=MLKGLDFFDC3W tag=98UQKNKJQRBI type=del 2023-12-03T11:32:41.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.977+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~5YB58R7GEWZ0.0 size=1048576 2023-12-03T11:32:41.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.978+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~5YB58R7GEWZ0.1 size=1048576 2023-12-03T11:32:41.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.978+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~5YB58R7GEWZ0.2 size=17211 2023-12-03T11:32:41.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.978+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=5YB58R7GEWZ0 tag=LBOI9T7O9B90 type=write size=3162939 2023-12-03T11:32:41.980 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.980+0000 7f4d50c67780 1 < completed delete operation key=CQPZ0X62207Z tag=4VU38PT2TDFG type=del 2023-12-03T11:32:41.981 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.981+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=00JCU77DT1WL type=del size=4146928 2023-12-03T11:32:41.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.982+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~66YQMAUHOR35.0 size=685659 2023-12-03T11:32:41.984 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.984+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=66YQMAUHOR35 tag=YO5DCVB0YZID type=write size=1734235 2023-12-03T11:32:41.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.986+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~JT0B374CORJS.0 size=1048576 2023-12-03T11:32:41.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.987+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~JT0B374CORJS.1 size=178946 2023-12-03T11:32:41.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.987+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=JT0B374CORJS tag=JJTMYQPP5E20 type=write size=2276098 2023-12-03T11:32:41.989 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.988+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=HHHN4XHTMMGN type=del 2023-12-03T11:32:41.992 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.991+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~M7JFVT4PUXB5.0 size=1048576 2023-12-03T11:32:41.992 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.992+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~M7JFVT4PUXB5.1 size=1048576 2023-12-03T11:32:41.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.993+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~M7JFVT4PUXB5.2 size=740832 2023-12-03T11:32:41.994 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.993+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=M7JFVT4PUXB5 tag=XS0451W2DWGZ type=write size=3886560 2023-12-03T11:32:41.995 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.994+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=LQE3CMATXL8K type=del 2023-12-03T11:32:41.996 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.995+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=Y05VW4KWMZRO type=del size=3665233 2023-12-03T11:32:41.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:41.997+0000 7f4d50c67780 1 < suggested remove operation key=2H6AFQ362OGP tag=7DPZ1985FH6B type=del 2023-12-03T11:32:42.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.000+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~V7TIAIA84HET.0 size=1048576 2023-12-03T11:32:42.002 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.001+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~V7TIAIA84HET.1 size=916860 2023-12-03T11:32:42.002 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.001+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=V7TIAIA84HET tag=531QGYNSH2PJ type=write size=3014012 2023-12-03T11:32:42.003 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.002+0000 7f4d50c67780 1 < completed write operation key=U6R5Y9JXKT32 tag=2KWP8O2FRWE2 type=write size=893440 2023-12-03T11:32:42.004 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.003+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=10X7ATQXOBXO type=del size=1523087 2023-12-03T11:32:42.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.004+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~CVBNWD7EYO0V.0 size=1048576 2023-12-03T11:32:42.006 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.005+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~CVBNWD7EYO0V.1 size=741694 2023-12-03T11:32:42.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.007+0000 7f4d50c67780 1 < completed multipart upload key=ZE19S5UCCZ3C upload=CVBNWD7EYO0V tag=VVKHAFUL5XMX type=write size=2838846 2023-12-03T11:32:42.010 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.009+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~6LSQT9VDGOVS.0 size=57074 2023-12-03T11:32:42.010 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.009+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=6LSQT9VDGOVS tag=2UMP0CNJSHQD type=write size=1105650 2023-12-03T11:32:42.012 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.011+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=0Z13HQ7HSGNF type=del 2023-12-03T11:32:42.014 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.013+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~TLVYA103E0KE.0 size=950656 2023-12-03T11:32:42.014 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.013+0000 7f4d50c67780 1 > prepared multipart upload key=ZE19S5UCCZ3C upload=TLVYA103E0KE tag=LVKU4NAOMMCP type=write size=1999232 2023-12-03T11:32:42.015 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.014+0000 7f4d50c67780 -1 < failed to complete operation key=G0O8EC405LYM tag=FY00KIHHFJJ7 type=write size=32758: (22) Invalid argument 2023-12-03T11:32:42.016 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.015+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=MS7JUZZ5YASR type=del size=514279 2023-12-03T11:32:42.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.017+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~L6R7YIDDK44C.0 size=1048576 2023-12-03T11:32:42.019 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.018+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~L6R7YIDDK44C.1 size=1048576 2023-12-03T11:32:42.020 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.019+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~L6R7YIDDK44C.2 size=119155 2023-12-03T11:32:42.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.021+0000 7f4d50c67780 1 < completed multipart upload key=K7YVVH7SAKMC upload=L6R7YIDDK44C tag=0EX62UDP15BU type=write size=3264883 2023-12-03T11:32:42.023 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.022+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=OA4DUHDNPQ7Q type=del size=738238 2023-12-03T11:32:42.024 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.024+0000 7f4d50c67780 1 < completed delete operation key=GTLP2WZUX7U8 tag=UJAJL31OB4N0 type=del 2023-12-03T11:32:42.026 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.026+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~SQLVFSAAA1OE.0 size=1048576 2023-12-03T11:32:42.028 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.027+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~SQLVFSAAA1OE.1 size=10939 2023-12-03T11:32:42.028 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.027+0000 7f4d50c67780 1 > prepared multipart upload key=ENMJS0KEVS2S upload=SQLVFSAAA1OE tag=PVLI6LX8TP4A type=write size=2108091 2023-12-03T11:32:42.029 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.028+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~V7P201210KS1.0 size=1048576 2023-12-03T11:32:42.030 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.029+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~V7P201210KS1.1 size=1048576 2023-12-03T11:32:42.030 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.029+0000 7f4d50c67780 1 < canceled part key=_multipart_XM5E3D99MXVA.2~V7P201210KS1.2 size=368962 2023-12-03T11:32:42.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.031+0000 7f4d50c67780 1 < canceled multipart upload key=XM5E3D99MXVA upload=V7P201210KS1 tag=RXVBMLVHNOIO type=write size=3514690 2023-12-03T11:32:42.034 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.033+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~E29MES8PEZ55.0 size=1048576 2023-12-03T11:32:42.035 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.034+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~E29MES8PEZ55.1 size=218414 2023-12-03T11:32:42.035 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.034+0000 7f4d50c67780 1 > prepared multipart upload key=G0O8EC405LYM upload=E29MES8PEZ55 tag=KDD6FUYNEJCA type=write size=2315566 2023-12-03T11:32:42.037 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.036+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~WEGLQRYWYO0R.0 size=662137 2023-12-03T11:32:42.039 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.038+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=WEGLQRYWYO0R tag=4VOMVYT8C66B type=write size=1710713 2023-12-03T11:32:42.041 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.040+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=AB0OPC61V7CS type=write size=550480 2023-12-03T11:32:42.042 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.041+0000 7f4d50c67780 1 < completed write operation key=ULLPV2G10BME tag=9FMAVVZLTD1C type=write size=739433 2023-12-03T11:32:42.044 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.044+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~U28MC6YHU6FI.0 size=411942 2023-12-03T11:32:42.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.044+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=U28MC6YHU6FI tag=QZSSWFYJ0TLR type=write size=1460518 2023-12-03T11:32:42.046 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.045+0000 7f4d50c67780 1 < canceled operation key=TEIYINZFFG76 tag=4HU1FZO8L54B type=del size=322897 2023-12-03T11:32:42.048 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.047+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~SXJJEDU44T02.0 size=1048576 2023-12-03T11:32:42.050 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.049+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~SXJJEDU44T02.1 size=1048576 2023-12-03T11:32:42.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.050+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~SXJJEDU44T02.2 size=230304 2023-12-03T11:32:42.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.050+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=SXJJEDU44T02 tag=2U7KE3PPP5T6 type=write size=3376032 2023-12-03T11:32:42.052 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.051+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~5YB58R7GEWZ0.0 size=1048576 2023-12-03T11:32:42.053 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.052+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~5YB58R7GEWZ0.1 size=1048576 2023-12-03T11:32:42.053 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.052+0000 7f4d50c67780 1 < canceled part key=_multipart_BX5POXMMYLB7.2~5YB58R7GEWZ0.2 size=17211 2023-12-03T11:32:42.055 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.054+0000 7f4d50c67780 1 < canceled multipart upload key=BX5POXMMYLB7 upload=5YB58R7GEWZ0 tag=LBOI9T7O9B90 type=write size=3162939 2023-12-03T11:32:42.056 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.056+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=D5YBY3TBHKZ8 type=del size=4152652 2023-12-03T11:32:42.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.057+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=00JCU77DT1WL type=del 2023-12-03T11:32:42.059 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.058+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=FOJNWVY6VPFG type=del size=4157425 2023-12-03T11:32:42.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.060+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~JT0B374CORJS.0 size=1048576 2023-12-03T11:32:42.062 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.061+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~JT0B374CORJS.1 size=178946 2023-12-03T11:32:42.064 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.063+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=JT0B374CORJS tag=JJTMYQPP5E20 type=write size=2276098 2023-12-03T11:32:42.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.065+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=20VBEPO9B1S4 type=write size=905050 2023-12-03T11:32:42.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.066+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~M7JFVT4PUXB5.0 size=1048576 2023-12-03T11:32:42.068 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.067+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~M7JFVT4PUXB5.1 size=1048576 2023-12-03T11:32:42.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.068+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~M7JFVT4PUXB5.2 size=740832 2023-12-03T11:32:42.071 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.070+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=M7JFVT4PUXB5 tag=XS0451W2DWGZ type=write size=3886560 2023-12-03T11:32:42.072 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.071+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=VWQAJ4NRAM9F type=del size=3284287 2023-12-03T11:32:42.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.072+0000 7f4d50c67780 1 < completed delete operation key=V0ND3OBFJJUB tag=Y05VW4KWMZRO type=del 2023-12-03T11:32:42.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.074+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=VZWDH1BWSKDO type=del size=2093721 2023-12-03T11:32:42.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.075+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~V7TIAIA84HET.0 size=1048576 2023-12-03T11:32:42.077 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.076+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~V7TIAIA84HET.1 size=916860 2023-12-03T11:32:42.078 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.078+0000 7f4d50c67780 1 < completed multipart upload key=02W4TX7ZCDI6 upload=V7TIAIA84HET tag=531QGYNSH2PJ type=write size=3014012 2023-12-03T11:32:42.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.080+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~VHFEZ1TTUX1Q.0 size=1048576 2023-12-03T11:32:42.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.081+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~VHFEZ1TTUX1Q.1 size=1048576 2023-12-03T11:32:42.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.081+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~VHFEZ1TTUX1Q.2 size=268111 2023-12-03T11:32:42.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.081+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=VHFEZ1TTUX1Q tag=7QG6VQ5N5VQ7 type=write size=3413839 2023-12-03T11:32:42.083 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.083+0000 7f4d50c67780 1 < completed delete operation key=TEIYINZFFG76 tag=10X7ATQXOBXO type=del 2023-12-03T11:32:42.085 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.084+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=D4JXOSFPX583 type=del size=2982118 2023-12-03T11:32:42.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.085+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~6LSQT9VDGOVS.0 size=57074 2023-12-03T11:32:42.088 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.087+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=6LSQT9VDGOVS tag=2UMP0CNJSHQD type=write size=1105650 2023-12-03T11:32:42.089 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.088+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=VQZI808BVD9C type=write size=672943 2023-12-03T11:32:42.090 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.089+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~TLVYA103E0KE.0 size=950656 2023-12-03T11:32:42.092 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.091+0000 7f4d50c67780 1 < completed multipart upload key=ZE19S5UCCZ3C upload=TLVYA103E0KE tag=LVKU4NAOMMCP type=write size=1999232 2023-12-03T11:32:42.095 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.094+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~BAG9TKK4NENG.0 size=1048576 2023-12-03T11:32:42.096 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.095+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~BAG9TKK4NENG.1 size=420556 2023-12-03T11:32:42.096 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.095+0000 7f4d50c67780 1 > prepared multipart upload key=ULLPV2G10BME upload=BAG9TKK4NENG tag=GKW2Q4DJ2CKH type=write size=2517708 2023-12-03T11:32:42.097 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.096+0000 7f4d50c67780 1 < canceled operation key=EH4B2QP1C42H tag=MS7JUZZ5YASR type=del size=514279 2023-12-03T11:32:42.098 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.097+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=LTD4PNG3HDW9 type=write size=772800 2023-12-03T11:32:42.099 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.099+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=OA4DUHDNPQ7Q type=del 2023-12-03T11:32:42.102 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.101+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~PZ65PXY0N474.0 size=725320 2023-12-03T11:32:42.102 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.101+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=PZ65PXY0N474 tag=2OVF69Z2DX2I type=write size=1773896 2023-12-03T11:32:42.103 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.102+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~SQLVFSAAA1OE.0 size=1048576 2023-12-03T11:32:42.104 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.103+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~SQLVFSAAA1OE.1 size=10939 2023-12-03T11:32:42.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.105+0000 7f4d50c67780 1 < completed multipart upload key=ENMJS0KEVS2S upload=SQLVFSAAA1OE tag=PVLI6LX8TP4A type=write size=2108091 2023-12-03T11:32:42.108 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.107+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~ZTVTCXD9EXCA.0 size=1048576 2023-12-03T11:32:42.109 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.108+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~ZTVTCXD9EXCA.1 size=674418 2023-12-03T11:32:42.109 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.108+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=ZTVTCXD9EXCA tag=UH70ZOFNI7OA type=write size=2771570 2023-12-03T11:32:42.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.109+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~E29MES8PEZ55.0 size=1048576 2023-12-03T11:32:42.111 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.110+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~E29MES8PEZ55.1 size=218414 2023-12-03T11:32:42.113 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.112+0000 7f4d50c67780 1 < completed multipart upload key=G0O8EC405LYM upload=E29MES8PEZ55 tag=KDD6FUYNEJCA type=write size=2315566 2023-12-03T11:32:42.115 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.114+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~TMPUYFJVBB85.0 size=344307 2023-12-03T11:32:42.115 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.114+0000 7f4d50c67780 1 > prepared multipart upload key=G0O8EC405LYM upload=TMPUYFJVBB85 tag=P6F2QHJFR3VK type=write size=1392883 2023-12-03T11:32:42.116 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.115+0000 7f4d50c67780 1 < completed write operation key=2H6AFQ362OGP tag=AB0OPC61V7CS type=write size=550480 2023-12-03T11:32:42.117 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.117+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=VN3UGODP42S5 type=del size=2554010 2023-12-03T11:32:42.119 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.118+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~U28MC6YHU6FI.0 size=411942 2023-12-03T11:32:42.121 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.120+0000 7f4d50c67780 1 < completed multipart upload key=WUM939BATDG9 upload=U28MC6YHU6FI tag=QZSSWFYJ0TLR type=write size=1460518 2023-12-03T11:32:42.122 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.121+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=0S3QX7ATA5NH type=del size=3522911 2023-12-03T11:32:42.122 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.122+0000 7f4d50c67780 1 < canceled part key=_multipart_8J1EO2JDQUQH.2~SXJJEDU44T02.0 size=1048576 2023-12-03T11:32:42.123 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.122+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~SXJJEDU44T02.1 size=1048576 2023-12-03T11:32:42.124 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.124+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~SXJJEDU44T02.2 size=230304 2023-12-03T11:32:42.127 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.126+0000 7f4d50c67780 1 < canceled multipart upload key=8J1EO2JDQUQH upload=SXJJEDU44T02 tag=2U7KE3PPP5T6 type=write size=3376032 2023-12-03T11:32:42.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.127+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=2A27KWKAHC6E type=del size=598946 2023-12-03T11:32:42.129 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.128+0000 7f4d50c67780 1 < completed delete operation key=K7YVVH7SAKMC tag=D5YBY3TBHKZ8 type=del 2023-12-03T11:32:42.132 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.131+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~844Z64K8MYCH.0 size=393519 2023-12-03T11:32:42.132 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.131+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=844Z64K8MYCH tag=OLR6S8X04RAX type=write size=1442095 2023-12-03T11:32:42.133 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.132+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=FOJNWVY6VPFG type=del 2023-12-03T11:32:42.135 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.134+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~XWB6Y3RK996R.0 size=1048576 2023-12-03T11:32:42.136 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.135+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~XWB6Y3RK996R.1 size=722840 2023-12-03T11:32:42.136 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.135+0000 7f4d50c67780 1 > prepared multipart upload key=ZE19S5UCCZ3C upload=XWB6Y3RK996R tag=4J9M3J0U5MPG type=write size=2819992 2023-12-03T11:32:42.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.136+0000 7f4d50c67780 1 < completed write operation key=73SL3ZBBDA6Q tag=20VBEPO9B1S4 type=write size=905050 2023-12-03T11:32:42.138 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.137+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=77RAHKYBZJCO type=del size=1382326 2023-12-03T11:32:42.141 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.140+0000 7f4d50c67780 1 < suggested remove operation key=V0ND3OBFJJUB tag=VWQAJ4NRAM9F type=del 2023-12-03T11:32:42.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.141+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=0R2QO3TEZIE1 type=del size=459729 2023-12-03T11:32:42.143 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.142+0000 7f4d50c67780 1 < completed delete operation key=EX93BYX10WJB tag=VZWDH1BWSKDO type=del 2023-12-03T11:32:42.144 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.143+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=PH9VH8U0GPE5 type=write size=395197 2023-12-03T11:32:42.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.145+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~VHFEZ1TTUX1Q.0 size=1048576 2023-12-03T11:32:42.147 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.146+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~VHFEZ1TTUX1Q.1 size=1048576 2023-12-03T11:32:42.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.147+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~VHFEZ1TTUX1Q.2 size=268111 2023-12-03T11:32:42.150 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.149+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=VHFEZ1TTUX1Q tag=7QG6VQ5N5VQ7 type=write size=3413839 2023-12-03T11:32:42.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.151+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~UZEJKW47S5WL.0 size=9802 2023-12-03T11:32:42.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.151+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=UZEJKW47S5WL tag=S4UBI81CDFHU type=write size=1058378 2023-12-03T11:32:42.153 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.152+0000 7f4d50c67780 1 < completed delete operation key=73SL3ZBBDA6Q tag=D4JXOSFPX583 type=del 2023-12-03T11:32:42.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.154+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=JHI75IMOE40N type=del size=3262559 2023-12-03T11:32:42.156 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.155+0000 7f4d50c67780 1 < completed write operation key=CQPZ0X62207Z tag=VQZI808BVD9C type=write size=672943 2023-12-03T11:32:42.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.156+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=QHSDIOIVD9J7 type=del size=2090443 2023-12-03T11:32:42.158 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.157+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~BAG9TKK4NENG.0 size=1048576 2023-12-03T11:32:42.159 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.158+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~BAG9TKK4NENG.1 size=420556 2023-12-03T11:32:42.161 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.160+0000 7f4d50c67780 1 < completed multipart upload key=ULLPV2G10BME upload=BAG9TKK4NENG tag=GKW2Q4DJ2CKH type=write size=2517708 2023-12-03T11:32:42.163 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.162+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=83P00C5Z6WJF type=del size=1562439 2023-12-03T11:32:42.165 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.164+0000 7f4d50c67780 1 < completed write operation key=G0O8EC405LYM tag=LTD4PNG3HDW9 type=write size=772800 2023-12-03T11:32:42.167 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.166+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~GAITM1ZXDY0V.0 size=1048576 2023-12-03T11:32:42.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.167+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~GAITM1ZXDY0V.1 size=762471 2023-12-03T11:32:42.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.167+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=GAITM1ZXDY0V tag=LDKRQF4EHSCR type=write size=2859623 2023-12-03T11:32:42.169 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.168+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~PZ65PXY0N474.0 size=725320 2023-12-03T11:32:42.171 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.170+0000 7f4d50c67780 1 < completed multipart upload key=MLKGLDFFDC3W upload=PZ65PXY0N474 tag=2OVF69Z2DX2I type=write size=1773896 2023-12-03T11:32:42.172 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.171+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=TO7MHI01H9UK type=write size=420644 2023-12-03T11:32:42.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.173+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~ZTVTCXD9EXCA.0 size=1048576 2023-12-03T11:32:42.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.174+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~ZTVTCXD9EXCA.1 size=674418 2023-12-03T11:32:42.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.176+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=ZTVTCXD9EXCA tag=UH70ZOFNI7OA type=write size=2771570 2023-12-03T11:32:42.178 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.177+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=QN9L6BDDEO53 type=write size=221760 2023-12-03T11:32:42.179 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.178+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~TMPUYFJVBB85.0 size=344307 2023-12-03T11:32:42.181 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.180+0000 7f4d50c67780 1 < completed multipart upload key=G0O8EC405LYM upload=TMPUYFJVBB85 tag=P6F2QHJFR3VK type=write size=1392883 2023-12-03T11:32:42.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.181+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=SVZC76WRWYGV type=write size=978661 2023-12-03T11:32:42.183 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.182+0000 7f4d50c67780 1 < completed delete operation key=73SL3ZBBDA6Q tag=VN3UGODP42S5 type=del 2023-12-03T11:32:42.184 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.184+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=P1V2OP4MF0DC type=del size=1563552 2023-12-03T11:32:42.186 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.185+0000 7f4d50c67780 1 < canceled operation key=02W4TX7ZCDI6 tag=0S3QX7ATA5NH type=del size=3522911 2023-12-03T11:32:42.187 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.186+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=JC8T0R19VMMV type=write size=8162 2023-12-03T11:32:42.188 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.187+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=2A27KWKAHC6E type=del 2023-12-03T11:32:42.189 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.188+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=QXVV22GM8RBJ type=del size=2495487 2023-12-03T11:32:42.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.190+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~844Z64K8MYCH.0 size=393519 2023-12-03T11:32:42.192 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.191+0000 7f4d50c67780 1 < completed multipart upload key=K7YVVH7SAKMC upload=844Z64K8MYCH tag=OLR6S8X04RAX type=write size=1442095 2023-12-03T11:32:42.195 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.194+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~8OVVOSQI0REJ.0 size=1048576 2023-12-03T11:32:42.196 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.195+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~8OVVOSQI0REJ.1 size=573599 2023-12-03T11:32:42.196 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.195+0000 7f4d50c67780 1 > prepared multipart upload key=ULLPV2G10BME upload=8OVVOSQI0REJ tag=SBF1BSZKSI87 type=write size=2670751 2023-12-03T11:32:42.196 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.195+0000 7f4d50c67780 1 < canceled part key=_multipart_ZE19S5UCCZ3C.2~XWB6Y3RK996R.0 size=1048576 2023-12-03T11:32:42.196 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.195+0000 7f4d50c67780 1 < canceled part key=_multipart_ZE19S5UCCZ3C.2~XWB6Y3RK996R.1 size=722840 2023-12-03T11:32:42.198 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.197+0000 7f4d50c67780 1 < canceled multipart upload key=ZE19S5UCCZ3C upload=XWB6Y3RK996R tag=4J9M3J0U5MPG type=write size=2819992 2023-12-03T11:32:42.200 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.199+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~GM25JCB3RBP3.0 size=20032 2023-12-03T11:32:42.200 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.199+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=GM25JCB3RBP3 tag=59UWP4IYD1P8 type=write size=1068608 2023-12-03T11:32:42.201 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.200+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=77RAHKYBZJCO type=del 2023-12-03T11:32:42.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.202+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=HKNB4IEC58OR type=del size=2415576 2023-12-03T11:32:42.204 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.203+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=0R2QO3TEZIE1 type=del 2023-12-03T11:32:42.205 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.204+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=TUEEL0E5USAO type=del size=3043359 2023-12-03T11:32:42.207 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.206+0000 7f4d50c67780 1 < suggested remove operation key=EX93BYX10WJB tag=PH9VH8U0GPE5 type=write 2023-12-03T11:32:42.208 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.207+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=EE3R1LX8QHL1 type=del size=3312572 2023-12-03T11:32:42.210 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.209+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~UZEJKW47S5WL.0 size=9802 2023-12-03T11:32:42.211 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.211+0000 7f4d50c67780 1 < completed multipart upload key=V0ND3OBFJJUB upload=UZEJKW47S5WL tag=S4UBI81CDFHU type=write size=1058378 2023-12-03T11:32:42.214 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.213+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~UMLE543H3ASL.0 size=1048576 2023-12-03T11:32:42.215 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.214+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~UMLE543H3ASL.1 size=179104 2023-12-03T11:32:42.215 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.214+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=UMLE543H3ASL tag=YG3VIEUA9TNK type=write size=2276256 2023-12-03T11:32:42.216 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.215+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=JHI75IMOE40N type=del 2023-12-03T11:32:42.217 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.216+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=LPAZYSNFJ132 type=del size=1060577 2023-12-03T11:32:42.218 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.217+0000 7f4d50c67780 1 < completed delete operation key=CQPZ0X62207Z tag=QHSDIOIVD9J7 type=del 2023-12-03T11:32:42.220 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.219+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=RK4M0CN9MQN9 type=del size=3782682 2023-12-03T11:32:42.221 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.220+0000 7f4d50c67780 1 < completed delete operation key=QQDBWLVSXIHP tag=83P00C5Z6WJF type=del 2023-12-03T11:32:42.222 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.221+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=F1N77ESIFF93 type=del size=784920 2023-12-03T11:32:42.223 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.223+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~GAITM1ZXDY0V.0 size=1048576 2023-12-03T11:32:42.224 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.224+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~GAITM1ZXDY0V.1 size=762471 2023-12-03T11:32:42.226 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.226+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=GAITM1ZXDY0V tag=LDKRQF4EHSCR type=write size=2859623 2023-12-03T11:32:42.228 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.228+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~UN4TL0ZDNLTB.0 size=612771 2023-12-03T11:32:42.229 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.228+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=UN4TL0ZDNLTB tag=NAZ31QEPIA8B type=write size=1661347 2023-12-03T11:32:42.231 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.230+0000 7f4d50c67780 1 < suggested update operation key=8J1EO2JDQUQH tag=TO7MHI01H9UK type=write size=420644 2023-12-03T11:32:42.232 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.231+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=WRQ54D7047OA type=del size=1423553 2023-12-03T11:32:42.235 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.234+0000 7f4d50c67780 1 < suggested update operation key=EH4B2QP1C42H tag=QN9L6BDDEO53 type=write size=221760 2023-12-03T11:32:42.236 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.235+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=Q2FJ2U7I3X55 type=write size=261427 2023-12-03T11:32:42.237 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.236+0000 7f4d50c67780 -1 < failed to complete operation key=EX93BYX10WJB tag=SVZC76WRWYGV type=write size=978661: (22) Invalid argument 2023-12-03T11:32:42.238 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.237+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=P8VCOW6E93EV type=del size=3188453 2023-12-03T11:32:42.239 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.238+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=P1V2OP4MF0DC type=del 2023-12-03T11:32:42.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.241+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~IUF8W05PJL11.0 size=944612 2023-12-03T11:32:42.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.241+0000 7f4d50c67780 1 > prepared multipart upload key=YDRAH5EE39R4 upload=IUF8W05PJL11 tag=UXFZM8G7X4YV type=write size=1993188 2023-12-03T11:32:42.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.242+0000 7f4d50c67780 1 < completed write operation key=73SL3ZBBDA6Q tag=JC8T0R19VMMV type=write size=8162 2023-12-03T11:32:42.244 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.243+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=DDFTPQH0Z0UQ type=del size=3264921 2023-12-03T11:32:42.245 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.244+0000 7f4d50c67780 1 < completed delete operation key=02W4TX7ZCDI6 tag=QXVV22GM8RBJ type=del 2023-12-03T11:32:42.247 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.246+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~C3TRGM9WPWO6.0 size=1048576 2023-12-03T11:32:42.248 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.247+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~C3TRGM9WPWO6.1 size=479079 2023-12-03T11:32:42.248 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.247+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=C3TRGM9WPWO6 tag=BCFZSR7VP38E type=write size=2576231 2023-12-03T11:32:42.248 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.247+0000 7f4d50c67780 1 < canceled part key=_multipart_ULLPV2G10BME.2~8OVVOSQI0REJ.0 size=1048576 2023-12-03T11:32:42.249 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.248+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~8OVVOSQI0REJ.1 size=573599 2023-12-03T11:32:42.251 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.250+0000 7f4d50c67780 1 < canceled multipart upload key=ULLPV2G10BME upload=8OVVOSQI0REJ tag=SBF1BSZKSI87 type=write size=2670751 2023-12-03T11:32:42.252 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.252+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=BZVGCDV31KYL type=del size=1613664 2023-12-03T11:32:42.254 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.253+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~GM25JCB3RBP3.0 size=20032 2023-12-03T11:32:42.256 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.255+0000 7f4d50c67780 1 < completed multipart upload key=CQPZ0X62207Z upload=GM25JCB3RBP3 tag=59UWP4IYD1P8 type=write size=1068608 2023-12-03T11:32:42.257 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.256+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=ZKQY96ON4VMM type=write size=499185 2023-12-03T11:32:42.258 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.257+0000 7f4d50c67780 1 < completed delete operation key=ZE19S5UCCZ3C tag=HKNB4IEC58OR type=del 2023-12-03T11:32:42.259 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.258+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=81O01GYNWLAZ type=del size=3574084 2023-12-03T11:32:42.260 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.259+0000 7f4d50c67780 -1 < failed to complete operation key=EH4B2QP1C42H tag=TUEEL0E5USAO type=del size=3043359: (22) Invalid argument 2023-12-03T11:32:42.262 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.261+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=8UVTEY9H5HM6 type=write size=326737 2023-12-03T11:32:42.263 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.262+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=EE3R1LX8QHL1 type=del 2023-12-03T11:32:42.265 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.264+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~0526BDFSXWC7.0 size=987402 2023-12-03T11:32:42.265 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.264+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=0526BDFSXWC7 tag=RKX8M53MC6HM type=write size=2035978 2023-12-03T11:32:42.266 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.265+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~UMLE543H3ASL.0 size=1048576 2023-12-03T11:32:42.267 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.266+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~UMLE543H3ASL.1 size=179104 2023-12-03T11:32:42.269 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.268+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=UMLE543H3ASL tag=YG3VIEUA9TNK type=write size=2276256 2023-12-03T11:32:42.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.270+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~0IAN08R9GMT4.0 size=1048576 2023-12-03T11:32:42.272 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.271+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~0IAN08R9GMT4.1 size=1048576 2023-12-03T11:32:42.273 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.272+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~0IAN08R9GMT4.2 size=373519 2023-12-03T11:32:42.273 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.272+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=0IAN08R9GMT4 tag=SHFFWCX8OERU type=write size=3519247 2023-12-03T11:32:42.274 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.273+0000 7f4d50c67780 -1 < failed to complete operation key=8J1EO2JDQUQH tag=LPAZYSNFJ132 type=del size=1060577: (22) Invalid argument 2023-12-03T11:32:42.276 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.275+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=BWN1DNHU68GW type=del size=1550619 2023-12-03T11:32:42.278 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.277+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=RK4M0CN9MQN9 type=del 2023-12-03T11:32:42.280 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.279+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~W80XE034LAMJ.0 size=1048576 2023-12-03T11:32:42.280 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.280+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~W80XE034LAMJ.1 size=1048576 2023-12-03T11:32:42.281 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.281+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~W80XE034LAMJ.2 size=783579 2023-12-03T11:32:42.282 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.281+0000 7f4d50c67780 1 > prepared multipart upload key=G0O8EC405LYM upload=W80XE034LAMJ tag=IQ6N3Z4RXAGK type=write size=3929307 2023-12-03T11:32:42.283 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.282+0000 7f4d50c67780 1 < completed delete operation key=JR8CIONID4QC tag=F1N77ESIFF93 type=del 2023-12-03T11:32:42.284 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.283+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=XYB5M78FE1IJ type=del size=434757 2023-12-03T11:32:42.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.284+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~UN4TL0ZDNLTB.0 size=612771 2023-12-03T11:32:42.287 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.286+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=UN4TL0ZDNLTB tag=NAZ31QEPIA8B type=write size=1661347 2023-12-03T11:32:42.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.288+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=PCCN38SJUEO0 type=del size=927141 2023-12-03T11:32:42.290 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.289+0000 7f4d50c67780 1 < completed delete operation key=EX93BYX10WJB tag=WRQ54D7047OA type=del 2023-12-03T11:32:42.292 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.291+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~9ZR9RBWZADI9.0 size=205816 2023-12-03T11:32:42.292 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.291+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=9ZR9RBWZADI9 tag=DG5NLZXQRILU type=write size=1254392 2023-12-03T11:32:42.293 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.292+0000 7f4d50c67780 1 < completed write operation key=XM5E3D99MXVA tag=Q2FJ2U7I3X55 type=write size=261427 2023-12-03T11:32:42.295 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.294+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~PO9THMWE1O8Y.0 size=152173 2023-12-03T11:32:42.295 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.294+0000 7f4d50c67780 1 > prepared multipart upload key=TEIYINZFFG76 upload=PO9THMWE1O8Y tag=Q9E8MTQLFB9Z type=write size=1200749 2023-12-03T11:32:42.297 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.297+0000 7f4d50c67780 1 < suggested update operation key=QQDBWLVSXIHP tag=P8VCOW6E93EV type=del size=3188453 2023-12-03T11:32:42.299 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.299+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~DU65E13DAM82.0 size=1048576 2023-12-03T11:32:42.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.300+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~DU65E13DAM82.1 size=1048576 2023-12-03T11:32:42.301 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.301+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~DU65E13DAM82.2 size=966524 2023-12-03T11:32:42.302 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.301+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=DU65E13DAM82 tag=6FJIND4NNNUD type=write size=4112252 2023-12-03T11:32:42.302 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.301+0000 7f4d50c67780 1 < canceled part key=_multipart_YDRAH5EE39R4.2~IUF8W05PJL11.0 size=944612 2023-12-03T11:32:42.303 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.303+0000 7f4d50c67780 1 < canceled multipart upload key=YDRAH5EE39R4 upload=IUF8W05PJL11 tag=UXFZM8G7X4YV type=write size=1993188 2023-12-03T11:32:42.305 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.304+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=TVHTLC7O6G2J type=write size=229721 2023-12-03T11:32:42.306 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.306+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=DDFTPQH0Z0UQ type=del 2023-12-03T11:32:42.308 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.307+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=6ID1AQT233DZ type=del size=87798 2023-12-03T11:32:42.309 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.308+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~C3TRGM9WPWO6.0 size=1048576 2023-12-03T11:32:42.310 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.309+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~C3TRGM9WPWO6.1 size=479079 2023-12-03T11:32:42.312 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.311+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=C3TRGM9WPWO6 tag=BCFZSR7VP38E type=write size=2576231 2023-12-03T11:32:42.313 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.312+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=7EPS3W5KNIUJ type=del size=2461474 2023-12-03T11:32:42.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.314+0000 7f4d50c67780 1 < suggested update operation key=TEIYINZFFG76 tag=BZVGCDV31KYL type=del size=1613664 2023-12-03T11:32:42.316 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.315+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=1K7TNBHO6U81 type=del size=831071 2023-12-03T11:32:42.318 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.317+0000 7f4d50c67780 1 < completed write operation key=ULLPV2G10BME tag=ZKQY96ON4VMM type=write size=499185 2023-12-03T11:32:42.322 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.319+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~SXWKR9PCECX6.0 size=1048576 2023-12-03T11:32:42.322 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.320+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~SXWKR9PCECX6.1 size=144909 2023-12-03T11:32:42.323 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.320+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=SXWKR9PCECX6 tag=NWYTY0U8EBWN type=write size=2242061 2023-12-03T11:32:42.323 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.321+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=81O01GYNWLAZ type=del 2023-12-03T11:32:42.323 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.322+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=GP2VZRCX9VIF type=del size=186389 2023-12-03T11:32:42.324 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.324+0000 7f4d50c67780 1 < completed write operation key=2H6AFQ362OGP tag=8UVTEY9H5HM6 type=write size=326737 2023-12-03T11:32:42.326 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.325+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=3LBTAH2NTYHI type=write size=672903 2023-12-03T11:32:42.327 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.326+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~0526BDFSXWC7.0 size=987402 2023-12-03T11:32:42.329 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.328+0000 7f4d50c67780 1 < completed multipart upload key=83I1M5WIVKAA upload=0526BDFSXWC7 tag=RKX8M53MC6HM type=write size=2035978 2023-12-03T11:32:42.330 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.329+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=N5ISE1LKP381 type=del size=2247071 2023-12-03T11:32:42.331 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.331+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~0IAN08R9GMT4.0 size=1048576 2023-12-03T11:32:42.333 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.332+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~0IAN08R9GMT4.1 size=1048576 2023-12-03T11:32:42.334 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.333+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~0IAN08R9GMT4.2 size=373519 2023-12-03T11:32:42.336 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.335+0000 7f4d50c67780 1 < completed multipart upload key=EAP0BYZTTT2E upload=0IAN08R9GMT4 tag=SHFFWCX8OERU type=write size=3519247 2023-12-03T11:32:42.337 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.336+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=0PDAVVH85DMT type=del size=3588488 2023-12-03T11:32:42.338 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.338+0000 7f4d50c67780 1 < completed delete operation key=EAP0BYZTTT2E tag=BWN1DNHU68GW type=del 2023-12-03T11:32:42.340 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.339+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=DQ01HD1VWG9F type=write size=24756 2023-12-03T11:32:42.340 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.340+0000 7f4d50c67780 1 < canceled part key=_multipart_G0O8EC405LYM.2~W80XE034LAMJ.0 size=1048576 2023-12-03T11:32:42.341 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.341+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~W80XE034LAMJ.1 size=1048576 2023-12-03T11:32:42.343 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.342+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~W80XE034LAMJ.2 size=783579 2023-12-03T11:32:42.345 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.344+0000 7f4d50c67780 1 < canceled multipart upload key=G0O8EC405LYM upload=W80XE034LAMJ tag=IQ6N3Z4RXAGK type=write size=3929307 2023-12-03T11:32:42.347 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.346+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~C9S0Z2EKMBZN.0 size=1048576 2023-12-03T11:32:42.348 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.347+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~C9S0Z2EKMBZN.1 size=683666 2023-12-03T11:32:42.348 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.347+0000 7f4d50c67780 1 > prepared multipart upload key=RF2Q24GI24HJ upload=C9S0Z2EKMBZN tag=DD7T5D0KOIKX type=write size=2780818 2023-12-03T11:32:42.350 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.349+0000 7f4d50c67780 1 < suggested remove operation key=EAP0BYZTTT2E tag=XYB5M78FE1IJ type=del 2023-12-03T11:32:42.352 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.352+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~ZJVCNL25W4OD.0 size=1048576 2023-12-03T11:32:42.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.352+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~ZJVCNL25W4OD.1 size=1048576 2023-12-03T11:32:42.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.353+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~ZJVCNL25W4OD.2 size=125798 2023-12-03T11:32:42.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.353+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=ZJVCNL25W4OD tag=1HSIMKBCQ1W5 type=write size=3271526 2023-12-03T11:32:42.355 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.354+0000 7f4d50c67780 -1 < failed to complete operation key=TEIYINZFFG76 tag=PCCN38SJUEO0 type=del size=927141: (22) Invalid argument 2023-12-03T11:32:42.356 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.356+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=12W0W9ZBNMO2 type=del size=139043 2023-12-03T11:32:42.357 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.356+0000 7f4d50c67780 1 < canceled part key=_multipart_GTLP2WZUX7U8.2~9ZR9RBWZADI9.0 size=205816 2023-12-03T11:32:42.359 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.358+0000 7f4d50c67780 1 < canceled multipart upload key=GTLP2WZUX7U8 upload=9ZR9RBWZADI9 tag=DG5NLZXQRILU type=write size=1254392 2023-12-03T11:32:42.360 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.359+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=Z1XX6456AJ9U type=del size=2886379 2023-12-03T11:32:42.361 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.360+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~PO9THMWE1O8Y.0 size=152173 2023-12-03T11:32:42.363 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.362+0000 7f4d50c67780 1 < completed multipart upload key=TEIYINZFFG76 upload=PO9THMWE1O8Y tag=Q9E8MTQLFB9Z type=write size=1200749 2023-12-03T11:32:42.365 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.364+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=W9YHYCTJ4MBQ type=del size=532554 2023-12-03T11:32:42.366 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.365+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~DU65E13DAM82.0 size=1048576 2023-12-03T11:32:42.367 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.366+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~DU65E13DAM82.1 size=1048576 2023-12-03T11:32:42.368 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.367+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~DU65E13DAM82.2 size=966524 2023-12-03T11:32:42.370 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.369+0000 7f4d50c67780 1 < completed multipart upload key=WUM939BATDG9 upload=DU65E13DAM82 tag=6FJIND4NNNUD type=write size=4112252 2023-12-03T11:32:42.373 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.372+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~ON1Z56E1GYWL.0 size=1029295 2023-12-03T11:32:42.373 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.372+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=ON1Z56E1GYWL tag=90HAGV5Z0O2K type=write size=2077871 2023-12-03T11:32:42.374 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.373+0000 7f4d50c67780 1 < completed write operation key=ZE19S5UCCZ3C tag=TVHTLC7O6G2J type=write size=229721 2023-12-03T11:32:42.376 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.375+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~9NCAOZR12A06.0 size=1048576 2023-12-03T11:32:42.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.377+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~9NCAOZR12A06.1 size=854106 2023-12-03T11:32:42.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.377+0000 7f4d50c67780 1 > prepared multipart upload key=ZE19S5UCCZ3C upload=9NCAOZR12A06 tag=PVME0XLKI9UC type=write size=2951258 2023-12-03T11:32:42.379 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.378+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=6ID1AQT233DZ type=del 2023-12-03T11:32:42.381 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.380+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~BYI2MD4XYXZ9.0 size=1048576 2023-12-03T11:32:42.382 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.381+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~BYI2MD4XYXZ9.1 size=1048576 2023-12-03T11:32:42.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.382+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~BYI2MD4XYXZ9.2 size=534630 2023-12-03T11:32:42.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.382+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=BYI2MD4XYXZ9 tag=0ZLITD8I9PKO type=write size=3680358 2023-12-03T11:32:42.384 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.383+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=7EPS3W5KNIUJ type=del 2023-12-03T11:32:42.385 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.385+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=QSBWJBIWPVYR type=write size=598649 2023-12-03T11:32:42.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.387+0000 7f4d50c67780 1 < suggested update operation key=JR8CIONID4QC tag=1K7TNBHO6U81 type=del size=831071 2023-12-03T11:32:42.389 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.388+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=OYV2WJLGLKT5 type=write size=368666 2023-12-03T11:32:42.392 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.391+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~SXWKR9PCECX6.0 size=1048576 2023-12-03T11:32:42.393 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.392+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~SXWKR9PCECX6.1 size=144909 2023-12-03T11:32:42.395 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.394+0000 7f4d50c67780 1 < completed multipart upload key=V0ND3OBFJJUB upload=SXWKR9PCECX6 tag=NWYTY0U8EBWN type=write size=2242061 2023-12-03T11:32:42.396 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.396+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=ONSWP1SMVRX7 type=del size=1856604 2023-12-03T11:32:42.398 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.397+0000 7f4d50c67780 1 < canceled operation key=QQDBWLVSXIHP tag=GP2VZRCX9VIF type=del size=186389 2023-12-03T11:32:42.400 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.399+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=9QA0SCGN4WVE type=write size=351082 2023-12-03T11:32:42.401 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.400+0000 7f4d50c67780 1 < canceled operation key=WUM939BATDG9 tag=3LBTAH2NTYHI type=write size=672903 2023-12-03T11:32:42.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.401+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=XT4V25C3FKIW type=del size=3318010 2023-12-03T11:32:42.403 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.402+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=N5ISE1LKP381 type=del 2023-12-03T11:32:42.404 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.404+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=WPZMHSSQV3Y3 type=del size=3360357 2023-12-03T11:32:42.406 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.405+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=0PDAVVH85DMT type=del 2023-12-03T11:32:42.407 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.406+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=8Z2BXS25Z8OD type=del size=2612617 2023-12-03T11:32:42.408 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.407+0000 7f4d50c67780 1 < completed write operation key=ULLPV2G10BME tag=DQ01HD1VWG9F type=write size=24756 2023-12-03T11:32:42.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.408+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=0VFU8TTVTIQP type=del size=2011577 2023-12-03T11:32:42.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.410+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~C9S0Z2EKMBZN.0 size=1048576 2023-12-03T11:32:42.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.410+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~C9S0Z2EKMBZN.1 size=683666 2023-12-03T11:32:42.413 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.413+0000 7f4d50c67780 1 < completed multipart upload key=RF2Q24GI24HJ upload=C9S0Z2EKMBZN tag=DD7T5D0KOIKX type=write size=2780818 2023-12-03T11:32:42.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.415+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~5TQWMFI9TIBB.0 size=1048576 2023-12-03T11:32:42.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.416+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~5TQWMFI9TIBB.1 size=315528 2023-12-03T11:32:42.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.416+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=5TQWMFI9TIBB tag=2OSYRX7U8WX6 type=write size=2412680 2023-12-03T11:32:42.418 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.417+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~ZJVCNL25W4OD.0 size=1048576 2023-12-03T11:32:42.419 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.418+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~ZJVCNL25W4OD.1 size=1048576 2023-12-03T11:32:42.420 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.419+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~ZJVCNL25W4OD.2 size=125798 2023-12-03T11:32:42.422 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.421+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=ZJVCNL25W4OD tag=1HSIMKBCQ1W5 type=write size=3271526 2023-12-03T11:32:42.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.422+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=BWYQXRE8A4KP type=del size=2829196 2023-12-03T11:32:42.424 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.423+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=12W0W9ZBNMO2 type=del 2023-12-03T11:32:42.425 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.424+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=L8VF8Q1C3CPN type=del size=56364 2023-12-03T11:32:42.427 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.426+0000 7f4d50c67780 1 < completed delete operation key=WUM939BATDG9 tag=Z1XX6456AJ9U type=del 2023-12-03T11:32:42.429 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.428+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~Y6Z64YVCPR0S.0 size=61407 2023-12-03T11:32:42.429 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.428+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=Y6Z64YVCPR0S tag=OGRWVKJHW0QV type=write size=1109983 2023-12-03T11:32:42.431 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.430+0000 7f4d50c67780 1 < suggested update operation key=MLKGLDFFDC3W tag=W9YHYCTJ4MBQ type=del size=532554 2023-12-03T11:32:42.433 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.432+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~XJXEOI340O82.0 size=135557 2023-12-03T11:32:42.433 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.432+0000 7f4d50c67780 1 > prepared multipart upload key=U6R5Y9JXKT32 upload=XJXEOI340O82 tag=61CH2M3XCWCH type=write size=1184133 2023-12-03T11:32:42.434 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.433+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~ON1Z56E1GYWL.0 size=1029295 2023-12-03T11:32:42.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.435+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=ON1Z56E1GYWL tag=90HAGV5Z0O2K type=write size=2077871 2023-12-03T11:32:42.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.436+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=B8R2OCRT9D88 type=write size=444966 2023-12-03T11:32:42.438 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.438+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~9NCAOZR12A06.0 size=1048576 2023-12-03T11:32:42.440 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.439+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~9NCAOZR12A06.1 size=854106 2023-12-03T11:32:42.442 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.441+0000 7f4d50c67780 1 < completed multipart upload key=ZE19S5UCCZ3C upload=9NCAOZR12A06 tag=PVME0XLKI9UC type=write size=2951258 2023-12-03T11:32:42.444 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.443+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=OC3BFCRR8XEF type=del size=1470287 2023-12-03T11:32:42.444 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.443+0000 7f4d50c67780 1 < canceled part key=_multipart_83I1M5WIVKAA.2~BYI2MD4XYXZ9.0 size=1048576 2023-12-03T11:32:42.444 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.443+0000 7f4d50c67780 1 < canceled part key=_multipart_83I1M5WIVKAA.2~BYI2MD4XYXZ9.1 size=1048576 2023-12-03T11:32:42.444 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.443+0000 7f4d50c67780 1 < canceled part key=_multipart_83I1M5WIVKAA.2~BYI2MD4XYXZ9.2 size=534630 2023-12-03T11:32:42.446 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.445+0000 7f4d50c67780 1 < canceled multipart upload key=83I1M5WIVKAA upload=BYI2MD4XYXZ9 tag=0ZLITD8I9PKO type=write size=3680358 2023-12-03T11:32:42.447 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.446+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=U8M5DYYHWGUC type=write size=1024862 2023-12-03T11:32:42.449 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.448+0000 7f4d50c67780 1 < completed write operation key=XM5E3D99MXVA tag=QSBWJBIWPVYR type=write size=598649 2023-12-03T11:32:42.451 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.450+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~P3BI9S0DJ4VN.0 size=1048576 2023-12-03T11:32:42.452 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.451+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~P3BI9S0DJ4VN.1 size=1048576 2023-12-03T11:32:42.453 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.452+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~P3BI9S0DJ4VN.2 size=859597 2023-12-03T11:32:42.453 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.452+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=P3BI9S0DJ4VN tag=UZ4TGR8DOK7N type=write size=4005325 2023-12-03T11:32:42.454 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.453+0000 7f4d50c67780 1 < completed write operation key=ENMJS0KEVS2S tag=OYV2WJLGLKT5 type=write size=368666 2023-12-03T11:32:42.456 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.455+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~RWEJHRRED1X1.0 size=1048576 2023-12-03T11:32:42.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.456+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~RWEJHRRED1X1.1 size=1048576 2023-12-03T11:32:42.458 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.457+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~RWEJHRRED1X1.2 size=103398 2023-12-03T11:32:42.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.457+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=RWEJHRRED1X1 tag=7W1VYOYDS5OR type=write size=3249126 2023-12-03T11:32:42.461 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.460+0000 7f4d50c67780 1 < suggested update operation key=83I1M5WIVKAA tag=ONSWP1SMVRX7 type=del size=1856604 2023-12-03T11:32:42.463 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.462+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~3CJLEVPSLGA3.0 size=1048576 2023-12-03T11:32:42.464 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.463+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~3CJLEVPSLGA3.1 size=835020 2023-12-03T11:32:42.464 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.463+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=3CJLEVPSLGA3 tag=GEBB7F77H0ZJ type=write size=2932172 2023-12-03T11:32:42.465 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.464+0000 7f4d50c67780 -1 < failed to complete operation key=MLKGLDFFDC3W tag=9QA0SCGN4WVE type=write size=351082: (22) Invalid argument 2023-12-03T11:32:42.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.465+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=DR7PR30YAH5Y type=del size=832340 2023-12-03T11:32:42.467 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.467+0000 7f4d50c67780 1 < completed delete operation key=YDRAH5EE39R4 tag=XT4V25C3FKIW type=del 2023-12-03T11:32:42.470 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.469+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~FTNU24JBQ8DX.0 size=1048576 2023-12-03T11:32:42.470 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.470+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~FTNU24JBQ8DX.1 size=1033004 2023-12-03T11:32:42.471 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.470+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=FTNU24JBQ8DX tag=TO8W3RDJ00SJ type=write size=3130156 2023-12-03T11:32:42.472 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.471+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=WPZMHSSQV3Y3 type=del 2023-12-03T11:32:42.474 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.473+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~7NWO838LPBHV.0 size=1048576 2023-12-03T11:32:42.475 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.474+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~7NWO838LPBHV.1 size=463774 2023-12-03T11:32:42.475 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.474+0000 7f4d50c67780 1 > prepared multipart upload key=TEIYINZFFG76 upload=7NWO838LPBHV tag=BMCKVCA0P40N type=write size=2560926 2023-12-03T11:32:42.476 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.475+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=8Z2BXS25Z8OD type=del 2023-12-03T11:32:42.478 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.477+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~N00K7H0LO7U5.0 size=1048576 2023-12-03T11:32:42.479 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.478+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~N00K7H0LO7U5.1 size=587412 2023-12-03T11:32:42.479 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.478+0000 7f4d50c67780 1 > prepared multipart upload key=TOGV2BZ99FRF upload=N00K7H0LO7U5 tag=45J13YVMGV7X type=write size=2684564 2023-12-03T11:32:42.480 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.479+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=0VFU8TTVTIQP type=del 2023-12-03T11:32:42.482 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.481+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=VE858MFO5M1O type=del size=3918568 2023-12-03T11:32:42.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.482+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~5TQWMFI9TIBB.0 size=1048576 2023-12-03T11:32:42.484 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.483+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~5TQWMFI9TIBB.1 size=315528 2023-12-03T11:32:42.486 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.485+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=5TQWMFI9TIBB tag=2OSYRX7U8WX6 type=write size=2412680 2023-12-03T11:32:42.488 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.487+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~UHW1RRCE31W7.0 size=673014 2023-12-03T11:32:42.488 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.487+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=UHW1RRCE31W7 tag=1N0HLTP1RL4U type=write size=1721590 2023-12-03T11:32:42.491 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.490+0000 7f4d50c67780 1 < suggested update operation key=ZE19S5UCCZ3C tag=BWYQXRE8A4KP type=del size=2829196 2023-12-03T11:32:42.492 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.491+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=TGQ3NN3PC74G type=del size=2657912 2023-12-03T11:32:42.494 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.493+0000 7f4d50c67780 1 < completed delete operation key=CQPZ0X62207Z tag=L8VF8Q1C3CPN type=del 2023-12-03T11:32:42.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.495+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~JXEQ3B83VSJE.0 size=382192 2023-12-03T11:32:42.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.495+0000 7f4d50c67780 1 > prepared multipart upload key=G0O8EC405LYM upload=JXEQ3B83VSJE tag=GG2XJ773DEHS type=write size=1430768 2023-12-03T11:32:42.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.495+0000 7f4d50c67780 1 < canceled part key=_multipart_EH4B2QP1C42H.2~Y6Z64YVCPR0S.0 size=61407 2023-12-03T11:32:42.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.497+0000 7f4d50c67780 1 < canceled multipart upload key=EH4B2QP1C42H upload=Y6Z64YVCPR0S tag=OGRWVKJHW0QV type=write size=1109983 2023-12-03T11:32:42.500 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.499+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=NLT72Q4N4OAM type=del size=1802627 2023-12-03T11:32:42.501 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.500+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~XJXEOI340O82.0 size=135557 2023-12-03T11:32:42.503 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.502+0000 7f4d50c67780 1 < completed multipart upload key=U6R5Y9JXKT32 upload=XJXEOI340O82 tag=61CH2M3XCWCH type=write size=1184133 2023-12-03T11:32:42.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.505+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~WO0RMBROZLXN.0 size=1506 2023-12-03T11:32:42.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.505+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=WO0RMBROZLXN tag=F274SPLNYWZE type=write size=1050082 2023-12-03T11:32:42.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.507+0000 7f4d50c67780 1 < completed write operation key=EY1RBO15PCRR tag=B8R2OCRT9D88 type=write size=444966 2023-12-03T11:32:42.511 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.510+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~KS1KUMGD356R.0 size=634072 2023-12-03T11:32:42.511 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.510+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=KS1KUMGD356R tag=F0VGT8959IKZ type=write size=1682648 2023-12-03T11:32:42.512 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.511+0000 7f4d50c67780 1 < completed delete operation key=QQDBWLVSXIHP tag=OC3BFCRR8XEF type=del 2023-12-03T11:32:42.514 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.513+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~FGTL8BLD7KNO.0 size=1048576 2023-12-03T11:32:42.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.514+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~FGTL8BLD7KNO.1 size=852999 2023-12-03T11:32:42.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.514+0000 7f4d50c67780 1 > prepared multipart upload key=ENMJS0KEVS2S upload=FGTL8BLD7KNO tag=QAXAEB40YPFV type=write size=2950151 2023-12-03T11:32:42.516 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.515+0000 7f4d50c67780 1 < completed write operation key=8J1EO2JDQUQH tag=U8M5DYYHWGUC type=write size=1024862 2023-12-03T11:32:42.517 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.517+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=WYXDSBHRJAMQ type=del size=2176890 2023-12-03T11:32:42.518 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.518+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~P3BI9S0DJ4VN.0 size=1048576 2023-12-03T11:32:42.519 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.519+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~P3BI9S0DJ4VN.1 size=1048576 2023-12-03T11:32:42.520 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.520+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~P3BI9S0DJ4VN.2 size=859597 2023-12-03T11:32:42.522 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.522+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=P3BI9S0DJ4VN tag=UZ4TGR8DOK7N type=write size=4005325 2023-12-03T11:32:42.525 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.524+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~OS6G791FHHPP.0 size=1048576 2023-12-03T11:32:42.526 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.525+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~OS6G791FHHPP.1 size=374247 2023-12-03T11:32:42.526 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.525+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=OS6G791FHHPP tag=39100QNE63JT type=write size=2471399 2023-12-03T11:32:42.527 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.526+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~RWEJHRRED1X1.0 size=1048576 2023-12-03T11:32:42.528 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.527+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~RWEJHRRED1X1.1 size=1048576 2023-12-03T11:32:42.528 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.527+0000 7f4d50c67780 1 < canceled part key=_multipart_EAP0BYZTTT2E.2~RWEJHRRED1X1.2 size=103398 2023-12-03T11:32:42.530 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.529+0000 7f4d50c67780 1 < canceled multipart upload key=EAP0BYZTTT2E upload=RWEJHRRED1X1 tag=7W1VYOYDS5OR type=write size=3249126 2023-12-03T11:32:42.532 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.531+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~AJ5EC0WUFSCG.0 size=1048576 2023-12-03T11:32:42.533 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.532+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~AJ5EC0WUFSCG.1 size=261534 2023-12-03T11:32:42.533 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.532+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=AJ5EC0WUFSCG tag=NEZUY5Z0ENIJ type=write size=2358686 2023-12-03T11:32:42.534 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.533+0000 7f4d50c67780 1 < canceled part key=_multipart_0M6ZAD39I852.2~3CJLEVPSLGA3.0 size=1048576 2023-12-03T11:32:42.535 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.534+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~3CJLEVPSLGA3.1 size=835020 2023-12-03T11:32:42.537 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.535+0000 7f4d50c67780 1 < canceled multipart upload key=0M6ZAD39I852 upload=3CJLEVPSLGA3 tag=GEBB7F77H0ZJ type=write size=2932172 2023-12-03T11:32:42.539 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.538+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~TNCN0H6YD6EA.0 size=109263 2023-12-03T11:32:42.539 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.538+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=TNCN0H6YD6EA tag=7V6OGPAPJGNF type=write size=1157839 2023-12-03T11:32:42.540 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.539+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=DR7PR30YAH5Y type=del 2023-12-03T11:32:42.541 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.540+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=GEZX0EQVEV1M type=write size=97468 2023-12-03T11:32:42.542 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.541+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~FTNU24JBQ8DX.0 size=1048576 2023-12-03T11:32:42.543 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.542+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~FTNU24JBQ8DX.1 size=1033004 2023-12-03T11:32:42.545 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.545+0000 7f4d50c67780 1 < completed multipart upload key=CQPZ0X62207Z upload=FTNU24JBQ8DX tag=TO8W3RDJ00SJ type=write size=3130156 2023-12-03T11:32:42.547 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.547+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~BNX9OXM3J4X4.0 size=796904 2023-12-03T11:32:42.548 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.547+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=BNX9OXM3J4X4 tag=CDRRWW38YVPV type=write size=1845480 2023-12-03T11:32:42.549 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.548+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~7NWO838LPBHV.0 size=1048576 2023-12-03T11:32:42.550 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.549+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~7NWO838LPBHV.1 size=463774 2023-12-03T11:32:42.552 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.551+0000 7f4d50c67780 1 < completed multipart upload key=TEIYINZFFG76 upload=7NWO838LPBHV tag=BMCKVCA0P40N type=write size=2560926 2023-12-03T11:32:42.553 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.553+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=CI4UHFMTI782 type=del size=2177841 2023-12-03T11:32:42.555 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.554+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~N00K7H0LO7U5.0 size=1048576 2023-12-03T11:32:42.556 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.555+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~N00K7H0LO7U5.1 size=587412 2023-12-03T11:32:42.558 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.557+0000 7f4d50c67780 1 < completed multipart upload key=TOGV2BZ99FRF upload=N00K7H0LO7U5 tag=45J13YVMGV7X type=write size=2684564 2023-12-03T11:32:42.559 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.558+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=2QUTK8PXQONK type=del size=2985460 2023-12-03T11:32:42.560 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.559+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=VE858MFO5M1O type=del 2023-12-03T11:32:42.561 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.560+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=RUKWQDFZ4KEX type=del size=938452 2023-12-03T11:32:42.563 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.562+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~UHW1RRCE31W7.0 size=673014 2023-12-03T11:32:42.565 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.564+0000 7f4d50c67780 1 < completed multipart upload key=83I1M5WIVKAA upload=UHW1RRCE31W7 tag=1N0HLTP1RL4U type=write size=1721590 2023-12-03T11:32:42.566 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.565+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=L949DR0MRZLN type=del size=913615 2023-12-03T11:32:42.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.566+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=TGQ3NN3PC74G type=del 2023-12-03T11:32:42.568 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.568+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=SD356GBDN5UP type=del size=1991934 2023-12-03T11:32:42.570 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.569+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~JXEQ3B83VSJE.0 size=382192 2023-12-03T11:32:42.572 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.571+0000 7f4d50c67780 1 < completed multipart upload key=G0O8EC405LYM upload=JXEQ3B83VSJE tag=GG2XJ773DEHS type=write size=1430768 2023-12-03T11:32:42.573 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.572+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=SS5LNC4QDRAJ type=del size=3523604 2023-12-03T11:32:42.574 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.574+0000 7f4d50c67780 1 < completed delete operation key=JR8CIONID4QC tag=NLT72Q4N4OAM type=del 2023-12-03T11:32:42.576 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.575+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=D2WLOXLWU1CD type=del size=1227952 2023-12-03T11:32:42.577 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.576+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~WO0RMBROZLXN.0 size=1506 2023-12-03T11:32:42.579 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.578+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=WO0RMBROZLXN tag=F274SPLNYWZE type=write size=1050082 2023-12-03T11:32:42.580 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.579+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=FOLQ5J48WG1P type=del size=1171135 2023-12-03T11:32:42.581 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.580+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~KS1KUMGD356R.0 size=634072 2023-12-03T11:32:42.583 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.582+0000 7f4d50c67780 1 < completed multipart upload key=V0ND3OBFJJUB upload=KS1KUMGD356R tag=F0VGT8959IKZ type=write size=1682648 2023-12-03T11:32:42.584 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.583+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=QLRVKBMEQ9DZ type=del size=3145883 2023-12-03T11:32:42.586 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.585+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~FGTL8BLD7KNO.0 size=1048576 2023-12-03T11:32:42.587 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.586+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~FGTL8BLD7KNO.1 size=852999 2023-12-03T11:32:42.588 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.588+0000 7f4d50c67780 1 < completed multipart upload key=ENMJS0KEVS2S upload=FGTL8BLD7KNO tag=QAXAEB40YPFV type=write size=2950151 2023-12-03T11:32:42.591 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.590+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~1TIMC1RA7ZM0.0 size=577076 2023-12-03T11:32:42.591 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.590+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=1TIMC1RA7ZM0 tag=M1LWCV2M453D type=write size=1625652 2023-12-03T11:32:42.592 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.591+0000 7f4d50c67780 1 < completed delete operation key=52E31L45TN7V tag=WYXDSBHRJAMQ type=del 2023-12-03T11:32:42.593 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.592+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=V3NPUM1EP2JO type=del size=1703598 2023-12-03T11:32:42.594 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.593+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~OS6G791FHHPP.0 size=1048576 2023-12-03T11:32:42.595 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.594+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~OS6G791FHHPP.1 size=374247 2023-12-03T11:32:42.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.596+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=OS6G791FHHPP tag=39100QNE63JT type=write size=2471399 2023-12-03T11:32:42.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.599+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~TB2IZTD2NJ9D.0 size=1048576 2023-12-03T11:32:42.600 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.599+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~TB2IZTD2NJ9D.1 size=701190 2023-12-03T11:32:42.600 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.599+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=TB2IZTD2NJ9D tag=2LX906YH81ZH type=write size=2798342 2023-12-03T11:32:42.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.601+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~AJ5EC0WUFSCG.0 size=1048576 2023-12-03T11:32:42.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.602+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~AJ5EC0WUFSCG.1 size=261534 2023-12-03T11:32:42.604 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.604+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=AJ5EC0WUFSCG tag=NEZUY5Z0ENIJ type=write size=2358686 2023-12-03T11:32:42.607 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.606+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~1JGEJH5LNE6U.0 size=1048576 2023-12-03T11:32:42.607 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.607+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~1JGEJH5LNE6U.1 size=686668 2023-12-03T11:32:42.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.607+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=1JGEJH5LNE6U tag=HGMIHNO1IKOP type=write size=2783820 2023-12-03T11:32:42.609 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.608+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~TNCN0H6YD6EA.0 size=109263 2023-12-03T11:32:42.611 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.610+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=TNCN0H6YD6EA tag=7V6OGPAPJGNF type=write size=1157839 2023-12-03T11:32:42.612 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.611+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=QAXE8UQONGN0 type=del size=2586736 2023-12-03T11:32:42.613 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.612+0000 7f4d50c67780 1 < canceled operation key=G0O8EC405LYM tag=GEZX0EQVEV1M type=write size=97468 2023-12-03T11:32:42.615 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.614+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=EZIXV7XRU6TI type=del size=483954 2023-12-03T11:32:42.616 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.615+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~BNX9OXM3J4X4.0 size=796904 2023-12-03T11:32:42.618 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.617+0000 7f4d50c67780 1 < completed multipart upload key=WUM939BATDG9 upload=BNX9OXM3J4X4 tag=CDRRWW38YVPV type=write size=1845480 2023-12-03T11:32:42.622 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.621+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~2R5A2MMC4GAI.0 size=1048576 2023-12-03T11:32:42.622 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.622+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~2R5A2MMC4GAI.1 size=344173 2023-12-03T11:32:42.623 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.622+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=2R5A2MMC4GAI tag=FGFM3MFKTXSC type=write size=2441325 2023-12-03T11:32:42.624 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.623+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=CI4UHFMTI782 type=del 2023-12-03T11:32:42.625 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.624+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=0CI1X16WB8VO type=del size=3702604 2023-12-03T11:32:42.626 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.625+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=2QUTK8PXQONK type=del 2023-12-03T11:32:42.628 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.627+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=P4A8HX278UY4 type=del size=1453891 2023-12-03T11:32:42.629 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.628+0000 7f4d50c67780 1 < completed delete operation key=0M6ZAD39I852 tag=RUKWQDFZ4KEX type=del 2023-12-03T11:32:42.632 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.631+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~Q6W6KIGJC4W5.0 size=361202 2023-12-03T11:32:42.632 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.631+0000 7f4d50c67780 1 > prepared multipart upload key=U6R5Y9JXKT32 upload=Q6W6KIGJC4W5 tag=DYZF3XMCUDG3 type=write size=1409778 2023-12-03T11:32:42.633 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.632+0000 7f4d50c67780 1 < canceled operation key=83I1M5WIVKAA tag=L949DR0MRZLN type=del size=913615 2023-12-03T11:32:42.635 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.634+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~0P1N17HLHCUM.0 size=99250 2023-12-03T11:32:42.635 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.634+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=0P1N17HLHCUM tag=C7P4QS5IW3W8 type=write size=1147826 2023-12-03T11:32:42.636 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.635+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=SD356GBDN5UP type=del 2023-12-03T11:32:42.637 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.637+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=UMOMZ0T5Z5LO type=write size=653703 2023-12-03T11:32:42.639 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.638+0000 7f4d50c67780 1 < completed delete operation key=GTLP2WZUX7U8 tag=SS5LNC4QDRAJ type=del 2023-12-03T11:32:42.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.639+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=3W14UW4SDYIY type=write size=407914 2023-12-03T11:32:42.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.640+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=D2WLOXLWU1CD type=del 2023-12-03T11:32:42.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.641+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=TLILJSM0GGEC type=del size=3980013 2023-12-03T11:32:42.644 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.644+0000 7f4d50c67780 1 < suggested update operation key=JR8CIONID4QC tag=FOLQ5J48WG1P type=del size=1171135 2023-12-03T11:32:42.646 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.645+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=8BYDBGFBVUUM type=del size=2003939 2023-12-03T11:32:42.647 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.646+0000 7f4d50c67780 1 < completed delete operation key=EAP0BYZTTT2E tag=QLRVKBMEQ9DZ type=del 2023-12-03T11:32:42.648 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.647+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=3UU8A3TNBLBU type=del size=91832 2023-12-03T11:32:42.649 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.648+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~1TIMC1RA7ZM0.0 size=577076 2023-12-03T11:32:42.651 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.650+0000 7f4d50c67780 1 < completed multipart upload key=02W4TX7ZCDI6 upload=1TIMC1RA7ZM0 tag=M1LWCV2M453D type=write size=1625652 2023-12-03T11:32:42.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.652+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=IRDTBITV0FGS type=del size=1233806 2023-12-03T11:32:42.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.653+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=V3NPUM1EP2JO type=del 2023-12-03T11:32:42.655 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.654+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=8OGY63RDOPWT type=del size=685273 2023-12-03T11:32:42.657 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.656+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~TB2IZTD2NJ9D.0 size=1048576 2023-12-03T11:32:42.658 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.657+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~TB2IZTD2NJ9D.1 size=701190 2023-12-03T11:32:42.659 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.658+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=TB2IZTD2NJ9D tag=2LX906YH81ZH type=write size=2798342 2023-12-03T11:32:42.660 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.660+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=DN0R42E5PTD2 type=del size=2963856 2023-12-03T11:32:42.662 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.661+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~1JGEJH5LNE6U.0 size=1048576 2023-12-03T11:32:42.663 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.662+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~1JGEJH5LNE6U.1 size=686668 2023-12-03T11:32:42.665 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.664+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=1JGEJH5LNE6U tag=HGMIHNO1IKOP type=write size=2783820 2023-12-03T11:32:42.666 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.665+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=ANQ65SWJEOVJ type=del size=4014556 2023-12-03T11:32:42.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.666+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=QAXE8UQONGN0 type=del 2023-12-03T11:32:42.668 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.667+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=3EIC9DU9OUN5 type=del size=2626959 2023-12-03T11:32:42.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.669+0000 7f4d50c67780 1 < completed delete operation key=EH4B2QP1C42H tag=EZIXV7XRU6TI type=del 2023-12-03T11:32:42.672 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.671+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~NJ6SNNCMNFE2.0 size=1048576 2023-12-03T11:32:42.673 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.672+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~NJ6SNNCMNFE2.1 size=1048576 2023-12-03T11:32:42.674 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.673+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~NJ6SNNCMNFE2.2 size=465152 2023-12-03T11:32:42.674 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.673+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=NJ6SNNCMNFE2 tag=Z2TAJVHXU6ZK type=write size=3610880 2023-12-03T11:32:42.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.674+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~2R5A2MMC4GAI.0 size=1048576 2023-12-03T11:32:42.676 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.675+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~2R5A2MMC4GAI.1 size=344173 2023-12-03T11:32:42.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.677+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=2R5A2MMC4GAI tag=FGFM3MFKTXSC type=write size=2441325 2023-12-03T11:32:42.680 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.679+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=66WJ9RFFFXXL type=del size=3429686 2023-12-03T11:32:42.682 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.681+0000 7f4d50c67780 1 < suggested remove operation key=GTLP2WZUX7U8 tag=0CI1X16WB8VO type=del 2023-12-03T11:32:42.683 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.682+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=XBUVMWZ93873 type=del size=11181 2023-12-03T11:32:42.685 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.684+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=P4A8HX278UY4 type=del 2023-12-03T11:32:42.686 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.685+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=N9J8HLC1V3PA type=del size=2126199 2023-12-03T11:32:42.687 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.687+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~Q6W6KIGJC4W5.0 size=361202 2023-12-03T11:32:42.689 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.689+0000 7f4d50c67780 1 < completed multipart upload key=U6R5Y9JXKT32 upload=Q6W6KIGJC4W5 tag=DYZF3XMCUDG3 type=write size=1409778 2023-12-03T11:32:42.692 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.691+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~UGUIOK4Z4RYK.0 size=1048576 2023-12-03T11:32:42.693 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.692+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~UGUIOK4Z4RYK.1 size=767144 2023-12-03T11:32:42.693 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.692+0000 7f4d50c67780 1 > prepared multipart upload key=52E31L45TN7V upload=UGUIOK4Z4RYK tag=3H7CA0HQS75F type=write size=2864296 2023-12-03T11:32:42.694 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.693+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~0P1N17HLHCUM.0 size=99250 2023-12-03T11:32:42.696 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.695+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=0P1N17HLHCUM tag=C7P4QS5IW3W8 type=write size=1147826 2023-12-03T11:32:42.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.696+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=T0JB3MLABC2Z type=del size=184203 2023-12-03T11:32:42.698 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.698+0000 7f4d50c67780 1 < completed write operation key=BX5POXMMYLB7 tag=UMOMZ0T5Z5LO type=write size=653703 2023-12-03T11:32:42.701 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.700+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~65K01C03LEJS.0 size=1048576 2023-12-03T11:32:42.701 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.701+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~65K01C03LEJS.1 size=1048576 2023-12-03T11:32:42.702 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.702+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~65K01C03LEJS.2 size=704641 2023-12-03T11:32:42.703 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.702+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=65K01C03LEJS tag=W72KT7HV7VFY type=write size=3850369 2023-12-03T11:32:42.704 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.703+0000 7f4d50c67780 1 < completed write operation key=EAP0BYZTTT2E tag=3W14UW4SDYIY type=write size=407914 2023-12-03T11:32:42.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.704+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=POBX3Z0THZ5C type=del size=1308752 2023-12-03T11:32:42.706 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.706+0000 7f4d50c67780 1 < canceled operation key=TEIYINZFFG76 tag=TLILJSM0GGEC type=del size=3980013 2023-12-03T11:32:42.708 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.707+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=MXCPARF935I5 type=del size=3871354 2023-12-03T11:32:42.709 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.708+0000 7f4d50c67780 1 < completed delete operation key=73SL3ZBBDA6Q tag=8BYDBGFBVUUM type=del 2023-12-03T11:32:42.711 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.710+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=0T79246MVXMM type=del size=3819786 2023-12-03T11:32:42.712 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.711+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=3UU8A3TNBLBU type=del 2023-12-03T11:32:42.713 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.712+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=2KIGEMOYOX0M type=del size=2611795 2023-12-03T11:32:42.715 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.715+0000 7f4d50c67780 1 < suggested remove operation key=JBL6IOJC4TT0 tag=IRDTBITV0FGS type=del 2023-12-03T11:32:42.717 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.716+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=Z0ZWKHC4AUB1 type=del size=2597698 2023-12-03T11:32:42.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.717+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=8OGY63RDOPWT type=del 2023-12-03T11:32:42.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.718+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=R4CZ1N3Y09DJ type=del size=801867 2023-12-03T11:32:42.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.720+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=DN0R42E5PTD2 type=del 2023-12-03T11:32:42.723 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.722+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~PV2J9RWRVJ00.0 size=302786 2023-12-03T11:32:42.723 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.722+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=PV2J9RWRVJ00 tag=9BCBVNTMVW5H type=write size=1351362 2023-12-03T11:32:42.724 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.723+0000 7f4d50c67780 1 < completed delete operation key=0M6ZAD39I852 tag=ANQ65SWJEOVJ type=del 2023-12-03T11:32:42.726 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.725+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~LL1NVRA98L11.0 size=969480 2023-12-03T11:32:42.726 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.725+0000 7f4d50c67780 1 > prepared multipart upload key=52E31L45TN7V upload=LL1NVRA98L11 tag=GPCPFHO3BIG9 type=write size=2018056 2023-12-03T11:32:42.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.727+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=3EIC9DU9OUN5 type=del 2023-12-03T11:32:42.729 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.728+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=JEZ3PVJYAZW5 type=del size=179310 2023-12-03T11:32:42.730 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.729+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~NJ6SNNCMNFE2.0 size=1048576 2023-12-03T11:32:42.731 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.730+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~NJ6SNNCMNFE2.1 size=1048576 2023-12-03T11:32:42.732 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.731+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~NJ6SNNCMNFE2.2 size=465152 2023-12-03T11:32:42.734 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.733+0000 7f4d50c67780 1 < completed multipart upload key=EAP0BYZTTT2E upload=NJ6SNNCMNFE2 tag=Z2TAJVHXU6ZK type=write size=3610880 2023-12-03T11:32:42.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.735+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~MU91P2I15IX6.0 size=1048576 2023-12-03T11:32:42.739 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.738+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~MU91P2I15IX6.1 size=264533 2023-12-03T11:32:42.739 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.738+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=MU91P2I15IX6 tag=PD56XO0BGHRK type=write size=2361685 2023-12-03T11:32:42.740 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.739+0000 7f4d50c67780 -1 < failed to complete operation key=GTLP2WZUX7U8 tag=66WJ9RFFFXXL type=del size=3429686: (22) Invalid argument 2023-12-03T11:32:42.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.740+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=TZGOWSGC5D9L type=write size=981169 2023-12-03T11:32:42.742 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.741+0000 7f4d50c67780 1 < completed delete operation key=GTLP2WZUX7U8 tag=XBUVMWZ93873 type=del 2023-12-03T11:32:42.744 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.743+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=VFYZMC4R71FY type=del size=938541 2023-12-03T11:32:42.745 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.744+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=N9J8HLC1V3PA type=del 2023-12-03T11:32:42.746 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.746+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=0UHSXOZ755A5 type=del size=131508 2023-12-03T11:32:42.748 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.747+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~UGUIOK4Z4RYK.0 size=1048576 2023-12-03T11:32:42.749 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.748+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~UGUIOK4Z4RYK.1 size=767144 2023-12-03T11:32:42.751 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.750+0000 7f4d50c67780 1 < completed multipart upload key=52E31L45TN7V upload=UGUIOK4Z4RYK tag=3H7CA0HQS75F type=write size=2864296 2023-12-03T11:32:42.753 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.752+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~GMVG1RQ775DE.0 size=1048576 2023-12-03T11:32:42.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.753+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~GMVG1RQ775DE.1 size=390995 2023-12-03T11:32:42.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.753+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=GMVG1RQ775DE tag=43XKRSRP90XH type=write size=2488147 2023-12-03T11:32:42.755 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.754+0000 7f4d50c67780 1 < completed delete operation key=QQDBWLVSXIHP tag=T0JB3MLABC2Z type=del 2023-12-03T11:32:42.757 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.756+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~00SR3WAG20DG.0 size=1048576 2023-12-03T11:32:42.758 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.757+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~00SR3WAG20DG.1 size=1048576 2023-12-03T11:32:42.759 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.758+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~00SR3WAG20DG.2 size=670020 2023-12-03T11:32:42.759 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.758+0000 7f4d50c67780 1 > prepared multipart upload key=ULLPV2G10BME upload=00SR3WAG20DG tag=I5ICZ270CI36 type=write size=3815748 2023-12-03T11:32:42.760 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.759+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~65K01C03LEJS.0 size=1048576 2023-12-03T11:32:42.761 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.760+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~65K01C03LEJS.1 size=1048576 2023-12-03T11:32:42.761 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.760+0000 7f4d50c67780 1 < canceled part key=_multipart_0M6ZAD39I852.2~65K01C03LEJS.2 size=704641 2023-12-03T11:32:42.763 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.762+0000 7f4d50c67780 1 < canceled multipart upload key=0M6ZAD39I852 upload=65K01C03LEJS tag=W72KT7HV7VFY type=write size=3850369 2023-12-03T11:32:42.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.763+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=95O38N9SZKNJ type=del size=1989859 2023-12-03T11:32:42.765 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.765+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=POBX3Z0THZ5C type=del 2023-12-03T11:32:42.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.767+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~VG8QIWGAVS5Q.0 size=1048576 2023-12-03T11:32:42.769 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.768+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~VG8QIWGAVS5Q.1 size=553170 2023-12-03T11:32:42.769 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.768+0000 7f4d50c67780 1 > prepared multipart upload key=RF2Q24GI24HJ upload=VG8QIWGAVS5Q tag=6JBTUGFPSWM2 type=write size=2650322 2023-12-03T11:32:42.770 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.770+0000 7f4d50c67780 1 < completed delete operation key=YDRAH5EE39R4 tag=MXCPARF935I5 type=del 2023-12-03T11:32:42.772 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.771+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=BE3FL0ZZ3H3P type=del size=1456350 2023-12-03T11:32:42.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.772+0000 7f4d50c67780 1 < completed delete operation key=73SL3ZBBDA6Q tag=0T79246MVXMM type=del 2023-12-03T11:32:42.775 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.774+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=0VQWCH4OIHV9 type=del size=3415482 2023-12-03T11:32:42.776 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.775+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=2KIGEMOYOX0M type=del 2023-12-03T11:32:42.778 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.777+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~14HJ1DYV9XDZ.0 size=1048576 2023-12-03T11:32:42.779 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.778+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~14HJ1DYV9XDZ.1 size=334088 2023-12-03T11:32:42.779 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.778+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=14HJ1DYV9XDZ tag=DDQ1ERP4544I type=write size=2431240 2023-12-03T11:32:42.782 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.781+0000 7f4d50c67780 1 < suggested update operation key=TEIYINZFFG76 tag=Z0ZWKHC4AUB1 type=del size=2597698 2023-12-03T11:32:42.783 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.782+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=17M0PDV6W3IF type=write size=89167 2023-12-03T11:32:42.784 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.783+0000 7f4d50c67780 1 < completed delete operation key=EH4B2QP1C42H tag=R4CZ1N3Y09DJ type=del 2023-12-03T11:32:42.786 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.785+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~040PZOG4OG3R.0 size=1048576 2023-12-03T11:32:42.787 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.786+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~040PZOG4OG3R.1 size=789939 2023-12-03T11:32:42.787 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.786+0000 7f4d50c67780 1 > prepared multipart upload key=U6R5Y9JXKT32 upload=040PZOG4OG3R tag=6AZQXUPLMANX type=write size=2887091 2023-12-03T11:32:42.788 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.787+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~PV2J9RWRVJ00.0 size=302786 2023-12-03T11:32:42.790 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.789+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=PV2J9RWRVJ00 tag=9BCBVNTMVW5H type=write size=1351362 2023-12-03T11:32:42.792 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.792+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~3E72VUZLFT67.0 size=1048576 2023-12-03T11:32:42.793 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.793+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~3E72VUZLFT67.1 size=1048576 2023-12-03T11:32:42.794 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.794+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~3E72VUZLFT67.2 size=581565 2023-12-03T11:32:42.795 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.794+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=3E72VUZLFT67 tag=8SIR0K025U5R type=write size=3727293 2023-12-03T11:32:42.796 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.795+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~LL1NVRA98L11.0 size=969480 2023-12-03T11:32:42.798 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.797+0000 7f4d50c67780 1 < completed multipart upload key=52E31L45TN7V upload=LL1NVRA98L11 tag=GPCPFHO3BIG9 type=write size=2018056 2023-12-03T11:32:42.799 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.798+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=EWH1O1LL1Y0S type=del size=995296 2023-12-03T11:32:42.800 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.799+0000 7f4d50c67780 1 < completed delete operation key=EAP0BYZTTT2E tag=JEZ3PVJYAZW5 type=del 2023-12-03T11:32:42.801 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.800+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=1EGAA2Y7XHCC type=del size=3097965 2023-12-03T11:32:42.803 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.802+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~MU91P2I15IX6.0 size=1048576 2023-12-03T11:32:42.803 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.802+0000 7f4d50c67780 1 < canceled part key=_multipart_WUM939BATDG9.2~MU91P2I15IX6.1 size=264533 2023-12-03T11:32:42.805 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.804+0000 7f4d50c67780 1 < canceled multipart upload key=WUM939BATDG9 upload=MU91P2I15IX6 tag=PD56XO0BGHRK type=write size=2361685 2023-12-03T11:32:42.806 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.805+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=FIQV1HZYX0S4 type=del size=575028 2023-12-03T11:32:42.807 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.806+0000 7f4d50c67780 1 < completed write operation key=02W4TX7ZCDI6 tag=TZGOWSGC5D9L type=write size=981169 2023-12-03T11:32:42.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.807+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=CJ5SS0BF0EZS type=del size=1173284 2023-12-03T11:32:42.811 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.810+0000 7f4d50c67780 1 < suggested remove operation key=GTLP2WZUX7U8 tag=VFYZMC4R71FY type=del 2023-12-03T11:32:42.812 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.811+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=R6AAS4PPYSV8 type=del size=2250041 2023-12-03T11:32:42.814 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.813+0000 7f4d50c67780 1 < completed delete operation key=EH4B2QP1C42H tag=0UHSXOZ755A5 type=del 2023-12-03T11:32:42.815 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.814+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=0WZ5B9KSH1BV type=write size=807020 2023-12-03T11:32:42.816 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.815+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~GMVG1RQ775DE.0 size=1048576 2023-12-03T11:32:42.817 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.816+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~GMVG1RQ775DE.1 size=390995 2023-12-03T11:32:42.819 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.818+0000 7f4d50c67780 1 < completed multipart upload key=02W4TX7ZCDI6 upload=GMVG1RQ775DE tag=43XKRSRP90XH type=write size=2488147 2023-12-03T11:32:42.820 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.820+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=MQ0CDR90XXFD type=del size=3868023 2023-12-03T11:32:42.822 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.821+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~00SR3WAG20DG.0 size=1048576 2023-12-03T11:32:42.823 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.822+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~00SR3WAG20DG.1 size=1048576 2023-12-03T11:32:42.823 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.822+0000 7f4d50c67780 1 < canceled part key=_multipart_ULLPV2G10BME.2~00SR3WAG20DG.2 size=670020 2023-12-03T11:32:42.825 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.824+0000 7f4d50c67780 1 < canceled multipart upload key=ULLPV2G10BME upload=00SR3WAG20DG tag=I5ICZ270CI36 type=write size=3815748 2023-12-03T11:32:42.826 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.825+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=JQE5793DTCJ4 type=del size=296730 2023-12-03T11:32:42.827 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.826+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=95O38N9SZKNJ type=del 2023-12-03T11:32:42.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.828+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=G8EI5S2OWBHM type=del size=3934058 2023-12-03T11:32:42.830 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.829+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~VG8QIWGAVS5Q.0 size=1048576 2023-12-03T11:32:42.830 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.829+0000 7f4d50c67780 1 < canceled part key=_multipart_RF2Q24GI24HJ.2~VG8QIWGAVS5Q.1 size=553170 2023-12-03T11:32:42.832 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.831+0000 7f4d50c67780 1 < canceled multipart upload key=RF2Q24GI24HJ upload=VG8QIWGAVS5Q tag=6JBTUGFPSWM2 type=write size=2650322 2023-12-03T11:32:42.834 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.833+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=5O39Z8LU6WVG type=del size=1521339 2023-12-03T11:32:42.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.835+0000 7f4d50c67780 1 < suggested remove operation key=EAP0BYZTTT2E tag=BE3FL0ZZ3H3P type=del 2023-12-03T11:32:42.838 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.837+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~7I7WWNEKZW7K.0 size=1048576 2023-12-03T11:32:42.839 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.838+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~7I7WWNEKZW7K.1 size=1048576 2023-12-03T11:32:42.840 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.839+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~7I7WWNEKZW7K.2 size=232004 2023-12-03T11:32:42.840 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.839+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=7I7WWNEKZW7K tag=4YIASFV554HY type=write size=3377732 2023-12-03T11:32:42.841 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.840+0000 7f4d50c67780 1 < completed delete operation key=WUM939BATDG9 tag=0VQWCH4OIHV9 type=del 2023-12-03T11:32:42.842 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.842+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=PQ8C2AUDUA25 type=del size=2588535 2023-12-03T11:32:42.844 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.843+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~14HJ1DYV9XDZ.0 size=1048576 2023-12-03T11:32:42.845 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.844+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~14HJ1DYV9XDZ.1 size=334088 2023-12-03T11:32:42.847 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.846+0000 7f4d50c67780 1 < completed multipart upload key=EH4B2QP1C42H upload=14HJ1DYV9XDZ tag=DDQ1ERP4544I type=write size=2431240 2023-12-03T11:32:42.848 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.848+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=Y6YP7L3GVU5F type=del size=962225 2023-12-03T11:32:42.851 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.850+0000 7f4d50c67780 1 < suggested remove operation key=ULLPV2G10BME tag=17M0PDV6W3IF type=write 2023-12-03T11:32:42.852 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.851+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=9W69JXJJEUSV type=del size=2364989 2023-12-03T11:32:42.853 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.853+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~040PZOG4OG3R.0 size=1048576 2023-12-03T11:32:42.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.853+0000 7f4d50c67780 1 < canceled part key=_multipart_U6R5Y9JXKT32.2~040PZOG4OG3R.1 size=789939 2023-12-03T11:32:42.857 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.856+0000 7f4d50c67780 1 < canceled multipart upload key=U6R5Y9JXKT32 upload=040PZOG4OG3R tag=6AZQXUPLMANX type=write size=2887091 2023-12-03T11:32:42.859 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.858+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~E1PAWN9SKADZ.0 size=572227 2023-12-03T11:32:42.859 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.858+0000 7f4d50c67780 1 > prepared multipart upload key=73SL3ZBBDA6Q upload=E1PAWN9SKADZ tag=ESV2E81DAORE type=write size=1620803 2023-12-03T11:32:42.860 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.859+0000 7f4d50c67780 1 < canceled part key=_multipart_02W4TX7ZCDI6.2~3E72VUZLFT67.0 size=1048576 2023-12-03T11:32:42.860 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.859+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~3E72VUZLFT67.1 size=1048576 2023-12-03T11:32:42.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.860+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~3E72VUZLFT67.2 size=581565 2023-12-03T11:32:42.863 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.862+0000 7f4d50c67780 1 < canceled multipart upload key=02W4TX7ZCDI6 upload=3E72VUZLFT67 tag=8SIR0K025U5R type=write size=3727293 2023-12-03T11:32:42.864 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.864+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=YJ1R2CEFB570 type=del size=609126 2023-12-03T11:32:42.866 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.865+0000 7f4d50c67780 1 < canceled operation key=EY1RBO15PCRR tag=EWH1O1LL1Y0S type=del size=995296 2023-12-03T11:32:42.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.866+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=QNRNY2YT0H5C type=del size=2902373 2023-12-03T11:32:42.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.867+0000 7f4d50c67780 1 < completed delete operation key=JR8CIONID4QC tag=1EGAA2Y7XHCC type=del 2023-12-03T11:32:42.870 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.869+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~KD2AF0DBGRD1.0 size=1048576 2023-12-03T11:32:42.871 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.870+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~KD2AF0DBGRD1.1 size=711258 2023-12-03T11:32:42.871 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.870+0000 7f4d50c67780 1 > prepared multipart upload key=YDRAH5EE39R4 upload=KD2AF0DBGRD1 tag=4KWKOOLXMVGQ type=write size=2808410 2023-12-03T11:32:42.872 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.871+0000 7f4d50c67780 -1 < failed to complete operation key=GTLP2WZUX7U8 tag=FIQV1HZYX0S4 type=del size=575028: (22) Invalid argument 2023-12-03T11:32:42.873 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.873+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=Q84AL70KV02I type=write size=21293 2023-12-03T11:32:42.876 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.875+0000 7f4d50c67780 1 < suggested update operation key=G0O8EC405LYM tag=CJ5SS0BF0EZS type=del size=1173284 2023-12-03T11:32:42.877 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.876+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=OWF24SO2T83O type=del size=541033 2023-12-03T11:32:42.878 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.878+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=R6AAS4PPYSV8 type=del 2023-12-03T11:32:42.880 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.879+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=VBQX3R0Z27DA type=del size=1242795 2023-12-03T11:32:42.882 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.881+0000 7f4d50c67780 1 < suggested remove operation key=MLKGLDFFDC3W tag=0WZ5B9KSH1BV type=write 2023-12-03T11:32:42.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.883+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~YDG5U6CTB27V.0 size=1048576 2023-12-03T11:32:42.885 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.884+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~YDG5U6CTB27V.1 size=1048576 2023-12-03T11:32:42.886 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.885+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~YDG5U6CTB27V.2 size=756480 2023-12-03T11:32:42.886 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.885+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=YDG5U6CTB27V tag=XE10NHF4HS28 type=write size=3902208 2023-12-03T11:32:42.888 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.887+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=MQ0CDR90XXFD type=del 2023-12-03T11:32:42.890 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.889+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~22Y89HRYMW4V.0 size=1048576 2023-12-03T11:32:42.891 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.890+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~22Y89HRYMW4V.1 size=1048576 2023-12-03T11:32:42.892 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.891+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~22Y89HRYMW4V.2 size=341850 2023-12-03T11:32:42.892 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.891+0000 7f4d50c67780 1 > prepared multipart upload key=G0O8EC405LYM upload=22Y89HRYMW4V tag=07ES5RNN6OJA type=write size=3487578 2023-12-03T11:32:42.893 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.892+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=JQE5793DTCJ4 type=del 2023-12-03T11:32:42.894 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.893+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=2KRBJ3T3EN10 type=del size=2360273 2023-12-03T11:32:42.895 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.895+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=G8EI5S2OWBHM type=del 2023-12-03T11:32:42.897 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.896+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=42AWKKZ2CRWG type=del size=3117086 2023-12-03T11:32:42.898 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.897+0000 7f4d50c67780 1 < canceled operation key=JBL6IOJC4TT0 tag=5O39Z8LU6WVG type=del size=1521339 2023-12-03T11:32:42.900 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.899+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~XUGTUNQ02SWH.0 size=1048576 2023-12-03T11:32:42.901 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.900+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~XUGTUNQ02SWH.1 size=159574 2023-12-03T11:32:42.901 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.900+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=XUGTUNQ02SWH tag=75JP13IPFSBP type=write size=2256726 2023-12-03T11:32:42.902 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.901+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~7I7WWNEKZW7K.0 size=1048576 2023-12-03T11:32:42.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.902+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~7I7WWNEKZW7K.1 size=1048576 2023-12-03T11:32:42.904 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.903+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~7I7WWNEKZW7K.2 size=232004 2023-12-03T11:32:42.906 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.905+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=7I7WWNEKZW7K tag=4YIASFV554HY type=write size=3377732 2023-12-03T11:32:42.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.908+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~UK1MR9VD461Q.0 size=1048576 2023-12-03T11:32:42.909 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.909+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~UK1MR9VD461Q.1 size=611962 2023-12-03T11:32:42.910 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.909+0000 7f4d50c67780 1 > prepared multipart upload key=RF2Q24GI24HJ upload=UK1MR9VD461Q tag=OF5GB71LKZQ9 type=write size=2709114 2023-12-03T11:32:42.911 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.910+0000 7f4d50c67780 1 < completed delete operation key=EAP0BYZTTT2E tag=PQ8C2AUDUA25 type=del 2023-12-03T11:32:42.912 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.911+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=CW6P9MY5SOJN type=del size=1713677 2023-12-03T11:32:42.913 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.912+0000 7f4d50c67780 1 < completed delete operation key=7C7UX0231SHV tag=Y6YP7L3GVU5F type=del 2023-12-03T11:32:42.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.914+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~HO6A5VHZN56M.0 size=1048576 2023-12-03T11:32:42.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.916+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~HO6A5VHZN56M.1 size=1048576 2023-12-03T11:32:42.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.917+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~HO6A5VHZN56M.2 size=29677 2023-12-03T11:32:42.918 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.917+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=HO6A5VHZN56M tag=WWB93HBXO3Y0 type=write size=3175405 2023-12-03T11:32:42.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.918+0000 7f4d50c67780 1 < completed delete operation key=V0ND3OBFJJUB tag=9W69JXJJEUSV type=del 2023-12-03T11:32:42.920 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.919+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=CV8AHMQYDZIE type=write size=937242 2023-12-03T11:32:42.921 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.920+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~E1PAWN9SKADZ.0 size=572227 2023-12-03T11:32:42.923 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.922+0000 7f4d50c67780 1 < completed multipart upload key=73SL3ZBBDA6Q upload=E1PAWN9SKADZ tag=ESV2E81DAORE type=write size=1620803 2023-12-03T11:32:42.924 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.923+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=JXRCDZRPHH1J type=write size=565437 2023-12-03T11:32:42.926 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.925+0000 7f4d50c67780 1 < completed delete operation key=K7YVVH7SAKMC tag=YJ1R2CEFB570 type=del 2023-12-03T11:32:42.927 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.926+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=L6BGXW2FZ82Z type=del size=432345 2023-12-03T11:32:42.928 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.927+0000 7f4d50c67780 1 < canceled operation key=GTLP2WZUX7U8 tag=QNRNY2YT0H5C type=del size=2902373 2023-12-03T11:32:42.930 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.929+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~BRHYKDMI7FBT.0 size=527624 2023-12-03T11:32:42.930 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.929+0000 7f4d50c67780 1 > prepared multipart upload key=G0O8EC405LYM upload=BRHYKDMI7FBT tag=A0CU0UY15GDH type=write size=1576200 2023-12-03T11:32:42.933 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.930+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~KD2AF0DBGRD1.0 size=1048576 2023-12-03T11:32:42.933 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.931+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~KD2AF0DBGRD1.1 size=711258 2023-12-03T11:32:42.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.933+0000 7f4d50c67780 1 < completed multipart upload key=YDRAH5EE39R4 upload=KD2AF0DBGRD1 tag=4KWKOOLXMVGQ type=write size=2808410 2023-12-03T11:32:42.936 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.935+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=OJFXDMCERPZB type=del size=3648966 2023-12-03T11:32:42.938 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.937+0000 7f4d50c67780 1 < suggested remove operation key=EY1RBO15PCRR tag=Q84AL70KV02I type=write 2023-12-03T11:32:42.939 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.938+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=ZA8EA8Y2PUHY type=del size=3033390 2023-12-03T11:32:42.941 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.940+0000 7f4d50c67780 1 < completed delete operation key=EAP0BYZTTT2E tag=OWF24SO2T83O type=del 2023-12-03T11:32:42.942 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.941+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=5Q4VZVI2ZFB8 type=write size=126167 2023-12-03T11:32:42.944 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.943+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=VBQX3R0Z27DA type=del 2023-12-03T11:32:42.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.945+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~RC90W78DYDZ7.0 size=600485 2023-12-03T11:32:42.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.945+0000 7f4d50c67780 1 > prepared multipart upload key=ENMJS0KEVS2S upload=RC90W78DYDZ7 tag=X3KUAKSR1AW2 type=write size=1649061 2023-12-03T11:32:42.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.946+0000 7f4d50c67780 1 < canceled part key=_multipart_EY1RBO15PCRR.2~YDG5U6CTB27V.0 size=1048576 2023-12-03T11:32:42.948 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.947+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~YDG5U6CTB27V.1 size=1048576 2023-12-03T11:32:42.949 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.948+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~YDG5U6CTB27V.2 size=756480 2023-12-03T11:32:42.951 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.950+0000 7f4d50c67780 1 < canceled multipart upload key=EY1RBO15PCRR upload=YDG5U6CTB27V tag=XE10NHF4HS28 type=write size=3902208 2023-12-03T11:32:42.953 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.952+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~GBDD9HDU3D7E.0 size=1048576 2023-12-03T11:32:42.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.953+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~GBDD9HDU3D7E.1 size=1048576 2023-12-03T11:32:42.955 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.954+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~GBDD9HDU3D7E.2 size=11429 2023-12-03T11:32:42.955 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.954+0000 7f4d50c67780 1 > prepared multipart upload key=JR8CIONID4QC upload=GBDD9HDU3D7E tag=OSFDNKE07HN2 type=write size=3157157 2023-12-03T11:32:42.957 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.956+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~22Y89HRYMW4V.0 size=1048576 2023-12-03T11:32:42.957 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.957+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~22Y89HRYMW4V.1 size=1048576 2023-12-03T11:32:42.959 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.958+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~22Y89HRYMW4V.2 size=341850 2023-12-03T11:32:42.961 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.960+0000 7f4d50c67780 1 < completed multipart upload key=G0O8EC405LYM upload=22Y89HRYMW4V tag=07ES5RNN6OJA type=write size=3487578 2023-12-03T11:32:42.962 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.961+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=KRKU82LKR7Y6 type=del size=1543284 2023-12-03T11:32:42.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.962+0000 7f4d50c67780 1 < canceled operation key=JR8CIONID4QC tag=2KRBJ3T3EN10 type=del size=2360273 2023-12-03T11:32:42.965 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.964+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~PUM33GKR80IS.0 size=1048576 2023-12-03T11:32:42.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.965+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~PUM33GKR80IS.1 size=1048576 2023-12-03T11:32:42.967 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.966+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~PUM33GKR80IS.2 size=963080 2023-12-03T11:32:42.967 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.966+0000 7f4d50c67780 1 > prepared multipart upload key=YDRAH5EE39R4 upload=PUM33GKR80IS tag=NTP4C33IA2FY type=write size=4108808 2023-12-03T11:32:42.971 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.970+0000 7f4d50c67780 1 < suggested remove operation key=TEIYINZFFG76 tag=42AWKKZ2CRWG type=del 2023-12-03T11:32:42.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.971+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=TIPE4DRCE24O type=del size=3871852 2023-12-03T11:32:42.973 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.972+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~XUGTUNQ02SWH.0 size=1048576 2023-12-03T11:32:42.974 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.973+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~XUGTUNQ02SWH.1 size=159574 2023-12-03T11:32:42.976 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.975+0000 7f4d50c67780 1 < completed multipart upload key=7C7UX0231SHV upload=XUGTUNQ02SWH tag=75JP13IPFSBP type=write size=2256726 2023-12-03T11:32:42.977 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.977+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=TEVC0F47ZCBS type=del size=1645205 2023-12-03T11:32:42.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.978+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~UK1MR9VD461Q.0 size=1048576 2023-12-03T11:32:42.980 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.979+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~UK1MR9VD461Q.1 size=611962 2023-12-03T11:32:42.982 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.981+0000 7f4d50c67780 1 < completed multipart upload key=RF2Q24GI24HJ upload=UK1MR9VD461Q tag=OF5GB71LKZQ9 type=write size=2709114 2023-12-03T11:32:42.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.982+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=NMJSK7N1W5ZU type=del size=4129040 2023-12-03T11:32:42.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.985+0000 7f4d50c67780 1 < suggested update operation key=K7YVVH7SAKMC tag=CW6P9MY5SOJN type=del size=1713677 2023-12-03T11:32:42.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.986+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=36I0S82KK8LV type=del size=1147825 2023-12-03T11:32:42.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.987+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~HO6A5VHZN56M.0 size=1048576 2023-12-03T11:32:42.989 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.988+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~HO6A5VHZN56M.1 size=1048576 2023-12-03T11:32:42.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.989+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~HO6A5VHZN56M.2 size=29677 2023-12-03T11:32:42.992 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.991+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=HO6A5VHZN56M tag=WWB93HBXO3Y0 type=write size=3175405 2023-12-03T11:32:42.995 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.994+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~PHEUAXYHVL6M.0 size=1048576 2023-12-03T11:32:42.995 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.995+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~PHEUAXYHVL6M.1 size=393380 2023-12-03T11:32:42.996 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.995+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=PHEUAXYHVL6M tag=PAPE8DXT34Z7 type=write size=2490532 2023-12-03T11:32:42.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.996+0000 7f4d50c67780 1 < completed write operation key=8J1EO2JDQUQH tag=CV8AHMQYDZIE type=write size=937242 2023-12-03T11:32:42.999 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.998+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~SKDN2WUZFWCY.0 size=1048576 2023-12-03T11:32:43.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:42.999+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~SKDN2WUZFWCY.1 size=1048576 2023-12-03T11:32:43.001 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.000+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~SKDN2WUZFWCY.2 size=194149 2023-12-03T11:32:43.001 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.000+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=SKDN2WUZFWCY tag=MU8E0UQ4QOJ4 type=write size=3339877 2023-12-03T11:32:43.002 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.002+0000 7f4d50c67780 1 < canceled operation key=8J1EO2JDQUQH tag=JXRCDZRPHH1J type=write size=565437 2023-12-03T11:32:43.004 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.003+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=77LV0PY8EL67 type=del size=400111 2023-12-03T11:32:43.004 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.004+0000 7f4d50c67780 -1 < no bi entry to suggest for operation key=EY1RBO15PCRR tag=L6BGXW2FZ82Z type=del size=432345: (2) No such file or directory 2023-12-03T11:32:43.006 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.006+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~2KB4UJVRK8QO.0 size=1048576 2023-12-03T11:32:43.007 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.006+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~2KB4UJVRK8QO.1 size=1048576 2023-12-03T11:32:43.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.007+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~2KB4UJVRK8QO.2 size=511054 2023-12-03T11:32:43.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.007+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=2KB4UJVRK8QO tag=S1DA4PQ29MXF type=write size=3656782 2023-12-03T11:32:43.009 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.009+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~BRHYKDMI7FBT.0 size=527624 2023-12-03T11:32:43.012 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.011+0000 7f4d50c67780 1 < completed multipart upload key=G0O8EC405LYM upload=BRHYKDMI7FBT tag=A0CU0UY15GDH type=write size=1576200 2023-12-03T11:32:43.014 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.013+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~GNXT3IYP1VGW.0 size=97342 2023-12-03T11:32:43.014 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.013+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=GNXT3IYP1VGW tag=LC4HPP9I160C type=write size=1145918 2023-12-03T11:32:43.015 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.014+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=OJFXDMCERPZB type=del 2023-12-03T11:32:43.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.017+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~29XOPVG60GLT.0 size=1048576 2023-12-03T11:32:43.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.017+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~29XOPVG60GLT.1 size=1048576 2023-12-03T11:32:43.019 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.019+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~29XOPVG60GLT.2 size=139215 2023-12-03T11:32:43.020 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.019+0000 7f4d50c67780 1 > prepared multipart upload key=YDRAH5EE39R4 upload=29XOPVG60GLT tag=Z9EJWRYC11R9 type=write size=3284943 2023-12-03T11:32:43.021 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.020+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=ZA8EA8Y2PUHY type=del 2023-12-03T11:32:43.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.021+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=EWIT5A7WPUO2 type=del size=3036352 2023-12-03T11:32:43.025 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.024+0000 7f4d50c67780 1 < suggested remove operation key=JBL6IOJC4TT0 tag=5Q4VZVI2ZFB8 type=write 2023-12-03T11:32:43.026 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.025+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=73FIS31WQAT2 type=del size=1605532 2023-12-03T11:32:43.028 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.027+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~RC90W78DYDZ7.0 size=600485 2023-12-03T11:32:43.030 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.029+0000 7f4d50c67780 1 < completed multipart upload key=ENMJS0KEVS2S upload=RC90W78DYDZ7 tag=X3KUAKSR1AW2 type=write size=1649061 2023-12-03T11:32:43.031 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.031+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=TEMH722GZZY4 type=write size=189093 2023-12-03T11:32:43.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.032+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~GBDD9HDU3D7E.0 size=1048576 2023-12-03T11:32:43.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.032+0000 7f4d50c67780 1 < canceled part key=_multipart_JR8CIONID4QC.2~GBDD9HDU3D7E.1 size=1048576 2023-12-03T11:32:43.034 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.033+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~GBDD9HDU3D7E.2 size=11429 2023-12-03T11:32:43.036 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.035+0000 7f4d50c67780 1 < canceled multipart upload key=JR8CIONID4QC upload=GBDD9HDU3D7E tag=OSFDNKE07HN2 type=write size=3157157 2023-12-03T11:32:43.038 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.038+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~LTVNMGZQ2789.0 size=1048576 2023-12-03T11:32:43.039 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.039+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~LTVNMGZQ2789.1 size=166012 2023-12-03T11:32:43.039 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.039+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=LTVNMGZQ2789 tag=DIZ7ODQBZL8L type=write size=2263164 2023-12-03T11:32:43.041 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.040+0000 7f4d50c67780 1 < canceled operation key=XM5E3D99MXVA tag=KRKU82LKR7Y6 type=del size=1543284 2023-12-03T11:32:43.042 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.041+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=CJLSA9W2827Q type=del size=4132664 2023-12-03T11:32:43.043 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.042+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~PUM33GKR80IS.0 size=1048576 2023-12-03T11:32:43.044 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.043+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~PUM33GKR80IS.1 size=1048576 2023-12-03T11:32:43.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.044+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~PUM33GKR80IS.2 size=963080 2023-12-03T11:32:43.047 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.046+0000 7f4d50c67780 1 < completed multipart upload key=YDRAH5EE39R4 upload=PUM33GKR80IS tag=NTP4C33IA2FY type=write size=4108808 2023-12-03T11:32:43.050 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.049+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~698N0ZVWYD9E.0 size=1048576 2023-12-03T11:32:43.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.050+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~698N0ZVWYD9E.1 size=625842 2023-12-03T11:32:43.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.050+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=698N0ZVWYD9E tag=24VOKPAZAAPH type=write size=2722994 2023-12-03T11:32:43.052 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.052+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=TIPE4DRCE24O type=del 2023-12-03T11:32:43.054 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.053+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=L5L4Q2XFKQ63 type=del size=614326 2023-12-03T11:32:43.055 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.054+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=TEVC0F47ZCBS type=del 2023-12-03T11:32:43.056 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.055+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=DEB04UV613HG type=write size=259173 2023-12-03T11:32:43.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.057+0000 7f4d50c67780 1 < completed delete operation key=EX93BYX10WJB tag=NMJSK7N1W5ZU type=del 2023-12-03T11:32:43.059 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.058+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=EC4AMBCH5HRQ type=del size=2639137 2023-12-03T11:32:43.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.059+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=36I0S82KK8LV type=del 2023-12-03T11:32:43.061 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.061+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=C3MZKRJ9UMQH type=del size=2548548 2023-12-03T11:32:43.063 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.062+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~PHEUAXYHVL6M.0 size=1048576 2023-12-03T11:32:43.064 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.063+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~PHEUAXYHVL6M.1 size=393380 2023-12-03T11:32:43.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.065+0000 7f4d50c67780 1 < completed multipart upload key=02W4TX7ZCDI6 upload=PHEUAXYHVL6M tag=PAPE8DXT34Z7 type=write size=2490532 2023-12-03T11:32:43.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.066+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=U8RPUAC1N7AO type=del size=3141125 2023-12-03T11:32:43.068 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.068+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~SKDN2WUZFWCY.0 size=1048576 2023-12-03T11:32:43.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.069+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~SKDN2WUZFWCY.1 size=1048576 2023-12-03T11:32:43.071 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.070+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~SKDN2WUZFWCY.2 size=194149 2023-12-03T11:32:43.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.072+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=SKDN2WUZFWCY tag=MU8E0UQ4QOJ4 type=write size=3339877 2023-12-03T11:32:43.075 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.074+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~YLO7AH9ETPRA.0 size=492421 2023-12-03T11:32:43.075 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.074+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=YLO7AH9ETPRA tag=PPDK3Y7L4G86 type=write size=1540997 2023-12-03T11:32:43.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.075+0000 7f4d50c67780 1 < completed delete operation key=YDRAH5EE39R4 tag=77LV0PY8EL67 type=del 2023-12-03T11:32:43.078 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.077+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~BYZRAXBFCFNJ.0 size=1048576 2023-12-03T11:32:43.079 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.078+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~BYZRAXBFCFNJ.1 size=198184 2023-12-03T11:32:43.079 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.078+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=BYZRAXBFCFNJ tag=Q0USUQR79ZD4 type=write size=2295336 2023-12-03T11:32:43.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.080+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~2KB4UJVRK8QO.0 size=1048576 2023-12-03T11:32:43.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.081+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~2KB4UJVRK8QO.1 size=1048576 2023-12-03T11:32:43.083 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.082+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~2KB4UJVRK8QO.2 size=511054 2023-12-03T11:32:43.085 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.084+0000 7f4d50c67780 1 < completed multipart upload key=02W4TX7ZCDI6 upload=2KB4UJVRK8QO tag=S1DA4PQ29MXF type=write size=3656782 2023-12-03T11:32:43.088 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.087+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~LP1128QHSO1D.0 size=1048576 2023-12-03T11:32:43.088 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.088+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~LP1128QHSO1D.1 size=420394 2023-12-03T11:32:43.089 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.088+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=LP1128QHSO1D tag=LYDNJY4QAOS7 type=write size=2517546 2023-12-03T11:32:43.090 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.089+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~GNXT3IYP1VGW.0 size=97342 2023-12-03T11:32:43.092 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.091+0000 7f4d50c67780 1 < completed multipart upload key=EAP0BYZTTT2E upload=GNXT3IYP1VGW tag=LC4HPP9I160C type=write size=1145918 2023-12-03T11:32:43.093 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.092+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=XLP32UNPEP7R type=del size=1286421 2023-12-03T11:32:43.094 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.094+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~29XOPVG60GLT.0 size=1048576 2023-12-03T11:32:43.096 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.095+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~29XOPVG60GLT.1 size=1048576 2023-12-03T11:32:43.097 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.096+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~29XOPVG60GLT.2 size=139215 2023-12-03T11:32:43.099 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.098+0000 7f4d50c67780 1 < completed multipart upload key=YDRAH5EE39R4 upload=29XOPVG60GLT tag=Z9EJWRYC11R9 type=write size=3284943 2023-12-03T11:32:43.100 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.100+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=KFRLM0CCJETE type=del size=909988 2023-12-03T11:32:43.103 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.102+0000 7f4d50c67780 1 < suggested remove operation key=MLKGLDFFDC3W tag=EWIT5A7WPUO2 type=del 2023-12-03T11:32:43.105 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.104+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~XRUQCU7O6G3E.0 size=260123 2023-12-03T11:32:43.105 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.104+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=XRUQCU7O6G3E tag=RBGPVK5Z6EVD type=write size=1308699 2023-12-03T11:32:43.107 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.106+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=73FIS31WQAT2 type=del 2023-12-03T11:32:43.108 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.107+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=YEVDHZWZDJNQ type=del size=1640860 2023-12-03T11:32:43.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.109+0000 7f4d50c67780 1 < suggested remove operation key=YDRAH5EE39R4 tag=TEMH722GZZY4 type=write 2023-12-03T11:32:43.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.111+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=SL8YPR2CL5X4 type=del size=1848406 2023-12-03T11:32:43.113 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.112+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~LTVNMGZQ2789.0 size=1048576 2023-12-03T11:32:43.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.113+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~LTVNMGZQ2789.1 size=166012 2023-12-03T11:32:43.116 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.115+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=LTVNMGZQ2789 tag=DIZ7ODQBZL8L type=write size=2263164 2023-12-03T11:32:43.117 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.116+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=WGTG12U6XR5L type=del size=201068 2023-12-03T11:32:43.119 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.119+0000 7f4d50c67780 1 < suggested update operation key=U6R5Y9JXKT32 tag=CJLSA9W2827Q type=del size=4132664 2023-12-03T11:32:43.121 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.120+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=UEH8FEUD6N4I type=del size=828039 2023-12-03T11:32:43.122 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.121+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~698N0ZVWYD9E.0 size=1048576 2023-12-03T11:32:43.123 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.122+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~698N0ZVWYD9E.1 size=625842 2023-12-03T11:32:43.125 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.124+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=698N0ZVWYD9E tag=24VOKPAZAAPH type=write size=2722994 2023-12-03T11:32:43.126 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.125+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=3F6O8CHEXLD0 type=del size=3786738 2023-12-03T11:32:43.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.127+0000 7f4d50c67780 1 < suggested remove operation key=QQDBWLVSXIHP tag=L5L4Q2XFKQ63 type=del 2023-12-03T11:32:43.129 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.129+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=CHCU6J6A5DP1 type=del size=1768084 2023-12-03T11:32:43.131 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.130+0000 7f4d50c67780 1 < canceled operation key=JBL6IOJC4TT0 tag=DEB04UV613HG type=write size=259173 2023-12-03T11:32:43.132 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.131+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=ZAOZ616CBZHV type=del size=2035021 2023-12-03T11:32:43.133 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.132+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=EC4AMBCH5HRQ type=del 2023-12-03T11:32:43.134 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.134+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=PFAE5K99U5AV type=del size=1321085 2023-12-03T11:32:43.138 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.135+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=C3MZKRJ9UMQH type=del 2023-12-03T11:32:43.138 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.137+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~2OQ8HZQPP0SK.0 size=1048576 2023-12-03T11:32:43.139 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.138+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~2OQ8HZQPP0SK.1 size=1048576 2023-12-03T11:32:43.140 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.139+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~2OQ8HZQPP0SK.2 size=806332 2023-12-03T11:32:43.140 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.139+0000 7f4d50c67780 1 > prepared multipart upload key=ULLPV2G10BME upload=2OQ8HZQPP0SK tag=85LGDRLP1VQK type=write size=3952060 2023-12-03T11:32:43.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.141+0000 7f4d50c67780 1 < completed delete operation key=7C7UX0231SHV tag=U8RPUAC1N7AO type=del 2023-12-03T11:32:43.143 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.142+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=H48T6ZSXK8WN type=write size=501632 2023-12-03T11:32:43.144 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.143+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~YLO7AH9ETPRA.0 size=492421 2023-12-03T11:32:43.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.145+0000 7f4d50c67780 1 < completed multipart upload key=7C7UX0231SHV upload=YLO7AH9ETPRA tag=PPDK3Y7L4G86 type=write size=1540997 2023-12-03T11:32:43.147 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.146+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=78TI521FKUY1 type=del size=3941420 2023-12-03T11:32:43.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.148+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~BYZRAXBFCFNJ.0 size=1048576 2023-12-03T11:32:43.149 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.148+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~BYZRAXBFCFNJ.1 size=198184 2023-12-03T11:32:43.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.151+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=BYZRAXBFCFNJ tag=Q0USUQR79ZD4 type=write size=2295336 2023-12-03T11:32:43.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.153+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~FNW3K4JSCD3B.0 size=1048576 2023-12-03T11:32:43.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.154+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~FNW3K4JSCD3B.1 size=1048576 2023-12-03T11:32:43.156 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.155+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~FNW3K4JSCD3B.2 size=64140 2023-12-03T11:32:43.156 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.155+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=FNW3K4JSCD3B tag=7L79O9LUY3U3 type=write size=3209868 2023-12-03T11:32:43.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.156+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~LP1128QHSO1D.0 size=1048576 2023-12-03T11:32:43.158 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.157+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~LP1128QHSO1D.1 size=420394 2023-12-03T11:32:43.160 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.159+0000 7f4d50c67780 1 < completed multipart upload key=EAP0BYZTTT2E upload=LP1128QHSO1D tag=LYDNJY4QAOS7 type=write size=2517546 2023-12-03T11:32:43.162 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.161+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=TYU0D1V9CVQ4 type=write size=314626 2023-12-03T11:32:43.164 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.164+0000 7f4d50c67780 1 < suggested remove operation key=ENMJS0KEVS2S tag=XLP32UNPEP7R type=del 2023-12-03T11:32:43.166 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.165+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=SLB6RICB3I1V type=del size=1458026 2023-12-03T11:32:43.167 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.166+0000 7f4d50c67780 -1 < failed to complete operation key=QQDBWLVSXIHP tag=KFRLM0CCJETE type=del size=909988: (22) Invalid argument 2023-12-03T11:32:43.169 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.168+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~IZ3L2LX94Q21.0 size=1048576 2023-12-03T11:32:43.170 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.169+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~IZ3L2LX94Q21.1 size=1048576 2023-12-03T11:32:43.171 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.170+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~IZ3L2LX94Q21.2 size=533733 2023-12-03T11:32:43.171 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.170+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=IZ3L2LX94Q21 tag=LVF2JFRXI74H type=write size=3679461 2023-12-03T11:32:43.173 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.172+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~XRUQCU7O6G3E.0 size=260123 2023-12-03T11:32:43.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.174+0000 7f4d50c67780 1 < completed multipart upload key=WUM939BATDG9 upload=XRUQCU7O6G3E tag=RBGPVK5Z6EVD type=write size=1308699 2023-12-03T11:32:43.177 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.176+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~PI4MIZM540NJ.0 size=1048576 2023-12-03T11:32:43.178 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.177+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~PI4MIZM540NJ.1 size=1048576 2023-12-03T11:32:43.179 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.178+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~PI4MIZM540NJ.2 size=922569 2023-12-03T11:32:43.179 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.178+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=PI4MIZM540NJ tag=18PY8RL34AHP type=write size=4068297 2023-12-03T11:32:43.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.181+0000 7f4d50c67780 1 < suggested remove operation key=V0ND3OBFJJUB tag=YEVDHZWZDJNQ type=del 2023-12-03T11:32:43.184 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.183+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~PSST1ALGZBR4.0 size=1048576 2023-12-03T11:32:43.185 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.184+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~PSST1ALGZBR4.1 size=201787 2023-12-03T11:32:43.185 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.184+0000 7f4d50c67780 1 > prepared multipart upload key=YDRAH5EE39R4 upload=PSST1ALGZBR4 tag=YEHETGME35QY type=write size=2298939 2023-12-03T11:32:43.186 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.185+0000 7f4d50c67780 1 < canceled operation key=7C7UX0231SHV tag=SL8YPR2CL5X4 type=del size=1848406 2023-12-03T11:32:43.188 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.187+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=C7Y7P00ZJRL8 type=del size=570880 2023-12-03T11:32:43.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.189+0000 7f4d50c67780 1 < suggested update operation key=QQDBWLVSXIHP tag=WGTG12U6XR5L type=del size=201068 2023-12-03T11:32:43.191 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.191+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=PPLBMG6T4IEF type=del size=670901 2023-12-03T11:32:43.194 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.193+0000 7f4d50c67780 1 < suggested update operation key=BX5POXMMYLB7 tag=UEH8FEUD6N4I type=del size=828039 2023-12-03T11:32:43.195 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.194+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=DK8UG5Y7UCVP type=del size=3246305 2023-12-03T11:32:43.196 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.196+0000 7f4d50c67780 1 < completed delete operation key=0M6ZAD39I852 tag=3F6O8CHEXLD0 type=del 2023-12-03T11:32:43.199 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.198+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~YXCCKQ2EMV0J.0 size=428514 2023-12-03T11:32:43.199 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.198+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=YXCCKQ2EMV0J tag=IUH9RKEY1UJ3 type=write size=1477090 2023-12-03T11:32:43.201 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.200+0000 7f4d50c67780 1 < suggested remove operation key=ZE19S5UCCZ3C tag=CHCU6J6A5DP1 type=del 2023-12-03T11:32:43.203 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.202+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~T6E7SJ5GJKLZ.0 size=1048576 2023-12-03T11:32:43.205 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.205+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~T6E7SJ5GJKLZ.1 size=212704 2023-12-03T11:32:43.206 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.205+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=T6E7SJ5GJKLZ tag=J7AY3YOMW7Z1 type=write size=2309856 2023-12-03T11:32:43.207 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.206+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=ZAOZ616CBZHV type=del 2023-12-03T11:32:43.209 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.208+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=RBDDE1A0WD9X type=del size=453014 2023-12-03T11:32:43.210 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.209+0000 7f4d50c67780 -1 < failed to complete operation key=QQDBWLVSXIHP tag=PFAE5K99U5AV type=del size=1321085: (22) Invalid argument 2023-12-03T11:32:43.211 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.210+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=09BKSSEXOVCW type=del size=99823 2023-12-03T11:32:43.213 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.212+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~2OQ8HZQPP0SK.0 size=1048576 2023-12-03T11:32:43.214 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.213+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~2OQ8HZQPP0SK.1 size=1048576 2023-12-03T11:32:43.215 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.214+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~2OQ8HZQPP0SK.2 size=806332 2023-12-03T11:32:43.217 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.216+0000 7f4d50c67780 1 < completed multipart upload key=ULLPV2G10BME upload=2OQ8HZQPP0SK tag=85LGDRLP1VQK type=write size=3952060 2023-12-03T11:32:43.220 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.219+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~BJPWPBK2ZIY9.0 size=1048576 2023-12-03T11:32:43.221 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.220+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~BJPWPBK2ZIY9.1 size=491945 2023-12-03T11:32:43.221 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.220+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=BJPWPBK2ZIY9 tag=XUWAOVI7RQKP type=write size=2589097 2023-12-03T11:32:43.222 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.221+0000 7f4d50c67780 1 < completed write operation key=TEIYINZFFG76 tag=H48T6ZSXK8WN type=write size=501632 2023-12-03T11:32:43.223 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.222+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=K12852VEN3BC type=write size=867990 2023-12-03T11:32:43.225 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.224+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=78TI521FKUY1 type=del 2023-12-03T11:32:43.226 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.225+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=2MPJM0XF4Z42 type=del size=3179224 2023-12-03T11:32:43.227 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.226+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~FNW3K4JSCD3B.0 size=1048576 2023-12-03T11:32:43.228 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.228+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~FNW3K4JSCD3B.1 size=1048576 2023-12-03T11:32:43.230 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.229+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~FNW3K4JSCD3B.2 size=64140 2023-12-03T11:32:43.232 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.231+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=FNW3K4JSCD3B tag=7L79O9LUY3U3 type=write size=3209868 2023-12-03T11:32:43.233 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.233+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=FNXRP1W7PSBJ type=del size=2116351 2023-12-03T11:32:43.235 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.234+0000 7f4d50c67780 1 < completed write operation key=YDRAH5EE39R4 tag=TYU0D1V9CVQ4 type=write size=314626 2023-12-03T11:32:43.236 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.235+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=J2L3ATMEY4WE type=write size=817186 2023-12-03T11:32:43.239 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.238+0000 7f4d50c67780 1 < suggested update operation key=EAP0BYZTTT2E tag=SLB6RICB3I1V type=del size=1458026 2023-12-03T11:32:43.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.241+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~F7S6N2EES33B.0 size=1048576 2023-12-03T11:32:43.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.242+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~F7S6N2EES33B.1 size=513798 2023-12-03T11:32:43.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.242+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=F7S6N2EES33B tag=M2QNG1G3TMHC type=write size=2610950 2023-12-03T11:32:43.244 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.243+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~IZ3L2LX94Q21.0 size=1048576 2023-12-03T11:32:43.245 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.244+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~IZ3L2LX94Q21.1 size=1048576 2023-12-03T11:32:43.246 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.246+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~IZ3L2LX94Q21.2 size=533733 2023-12-03T11:32:43.249 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.248+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=IZ3L2LX94Q21 tag=LVF2JFRXI74H type=write size=3679461 2023-12-03T11:32:43.250 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.250+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=UMID95E59M8O type=del size=358017 2023-12-03T11:32:43.252 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.251+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~PI4MIZM540NJ.0 size=1048576 2023-12-03T11:32:43.253 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.252+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~PI4MIZM540NJ.1 size=1048576 2023-12-03T11:32:43.254 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.253+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~PI4MIZM540NJ.2 size=922569 2023-12-03T11:32:43.257 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.256+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=PI4MIZM540NJ tag=18PY8RL34AHP type=write size=4068297 2023-12-03T11:32:43.258 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.257+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=50EPERY7YO2N type=write size=333460 2023-12-03T11:32:43.259 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.259+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~PSST1ALGZBR4.0 size=1048576 2023-12-03T11:32:43.261 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.260+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~PSST1ALGZBR4.1 size=201787 2023-12-03T11:32:43.263 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.262+0000 7f4d50c67780 1 < completed multipart upload key=YDRAH5EE39R4 upload=PSST1ALGZBR4 tag=YEHETGME35QY type=write size=2298939 2023-12-03T11:32:43.264 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.263+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=1SPV9TFUE3TR type=del size=488176 2023-12-03T11:32:43.265 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.264+0000 7f4d50c67780 1 < completed delete operation key=TEIYINZFFG76 tag=C7Y7P00ZJRL8 type=del 2023-12-03T11:32:43.267 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.266+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=XQMLXEEBN17W type=write size=1004999 2023-12-03T11:32:43.270 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.269+0000 7f4d50c67780 1 < suggested remove operation key=MLKGLDFFDC3W tag=PPLBMG6T4IEF type=del 2023-12-03T11:32:43.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.270+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=KR88UQ7GDYMZ type=del size=2692410 2023-12-03T11:32:43.272 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.271+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=DK8UG5Y7UCVP type=del 2023-12-03T11:32:43.274 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.274+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~152R6QJQOHX4.0 size=1048576 2023-12-03T11:32:43.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.274+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~152R6QJQOHX4.1 size=1048576 2023-12-03T11:32:43.276 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.276+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~152R6QJQOHX4.2 size=727147 2023-12-03T11:32:43.277 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.276+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=152R6QJQOHX4 tag=EMJ1WB86GRV3 type=write size=3872875 2023-12-03T11:32:43.278 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.277+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~YXCCKQ2EMV0J.0 size=428514 2023-12-03T11:32:43.280 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.279+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=YXCCKQ2EMV0J tag=IUH9RKEY1UJ3 type=write size=1477090 2023-12-03T11:32:43.281 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.280+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=0JL3VC9182R3 type=write size=639640 2023-12-03T11:32:43.281 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.280+0000 7f4d50c67780 1 < canceled part key=_multipart_MLKGLDFFDC3W.2~T6E7SJ5GJKLZ.0 size=1048576 2023-12-03T11:32:43.282 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.282+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~T6E7SJ5GJKLZ.1 size=212704 2023-12-03T11:32:43.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.284+0000 7f4d50c67780 1 < canceled multipart upload key=MLKGLDFFDC3W upload=T6E7SJ5GJKLZ tag=J7AY3YOMW7Z1 type=write size=2309856 2023-12-03T11:32:43.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.285+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=KAR74F9073C2 type=del size=3702257 2023-12-03T11:32:43.287 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.286+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=RBDDE1A0WD9X type=del 2023-12-03T11:32:43.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.288+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=34CSF0340MUG type=del size=3283030 2023-12-03T11:32:43.290 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.289+0000 7f4d50c67780 1 < completed delete operation key=0M6ZAD39I852 tag=09BKSSEXOVCW type=del 2023-12-03T11:32:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.291+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~RESM3BS1LXKZ.0 size=1048576 2023-12-03T11:32:43.293 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.292+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~RESM3BS1LXKZ.1 size=1048576 2023-12-03T11:32:43.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.293+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~RESM3BS1LXKZ.2 size=996524 2023-12-03T11:32:43.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.293+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=RESM3BS1LXKZ tag=J9OBJH2XI8MG type=write size=4142252 2023-12-03T11:32:43.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.293+0000 7f4d50c67780 1 < canceled part key=_multipart_GTLP2WZUX7U8.2~BJPWPBK2ZIY9.0 size=1048576 2023-12-03T11:32:43.295 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.294+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~BJPWPBK2ZIY9.1 size=491945 2023-12-03T11:32:43.297 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.296+0000 7f4d50c67780 1 < canceled multipart upload key=GTLP2WZUX7U8 upload=BJPWPBK2ZIY9 tag=XUWAOVI7RQKP type=write size=2589097 2023-12-03T11:32:43.299 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.298+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=VUVOTB6H3Q3L type=del size=1706717 2023-12-03T11:32:43.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.299+0000 7f4d50c67780 1 < completed write operation key=2H6AFQ362OGP tag=K12852VEN3BC type=write size=867990 2023-12-03T11:32:43.301 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.300+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=WA0HDM4LCYD5 type=del size=2011790 2023-12-03T11:32:43.302 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.301+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=2MPJM0XF4Z42 type=del 2023-12-03T11:32:43.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.303+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=PRLLQ76JEZW9 type=write size=904409 2023-12-03T11:32:43.305 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.304+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=FNXRP1W7PSBJ type=del 2023-12-03T11:32:43.306 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.305+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=GUQCMMX1EAH1 type=del size=3555831 2023-12-03T11:32:43.307 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.306+0000 7f4d50c67780 1 < completed write operation key=EY1RBO15PCRR tag=J2L3ATMEY4WE type=write size=817186 2023-12-03T11:32:43.309 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.308+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=WH8106T6JJVL type=del size=1784729 2023-12-03T11:32:43.310 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.309+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~F7S6N2EES33B.0 size=1048576 2023-12-03T11:32:43.311 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.310+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~F7S6N2EES33B.1 size=513798 2023-12-03T11:32:43.313 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.312+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=F7S6N2EES33B tag=M2QNG1G3TMHC type=write size=2610950 2023-12-03T11:32:43.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.315+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~5L2K4RXAY0GH.0 size=1048576 2023-12-03T11:32:43.316 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.315+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~5L2K4RXAY0GH.1 size=522603 2023-12-03T11:32:43.316 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.315+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=5L2K4RXAY0GH tag=TKRXJ1NH3LCQ type=write size=2619755 2023-12-03T11:32:43.319 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.318+0000 7f4d50c67780 1 < suggested update operation key=0M6ZAD39I852 tag=UMID95E59M8O type=del size=358017 2023-12-03T11:32:43.320 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.319+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=F9SU7EH2T7XW type=write size=61030 2023-12-03T11:32:43.321 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.321+0000 7f4d50c67780 1 < canceled operation key=QQDBWLVSXIHP tag=50EPERY7YO2N type=write size=333460 2023-12-03T11:32:43.324 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.323+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~GHLHTXRSH3UP.0 size=1048576 2023-12-03T11:32:43.325 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.324+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~GHLHTXRSH3UP.1 size=1048576 2023-12-03T11:32:43.326 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.325+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~GHLHTXRSH3UP.2 size=389266 2023-12-03T11:32:43.326 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.325+0000 7f4d50c67780 1 > prepared multipart upload key=TOGV2BZ99FRF upload=GHLHTXRSH3UP tag=YM7SKV052FYM type=write size=3534994 2023-12-03T11:32:43.327 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.326+0000 7f4d50c67780 1 < completed delete operation key=QQDBWLVSXIHP tag=1SPV9TFUE3TR type=del 2023-12-03T11:32:43.330 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.330+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~B059E9AL3QNR.0 size=981074 2023-12-03T11:32:43.331 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.330+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=B059E9AL3QNR tag=8UPQEVW08KIY type=write size=2029650 2023-12-03T11:32:43.333 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.332+0000 7f4d50c67780 1 < suggested update operation key=8J1EO2JDQUQH tag=XQMLXEEBN17W type=write size=1004999 2023-12-03T11:32:43.335 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.335+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~6W7ZD1E7I2LC.0 size=1048576 2023-12-03T11:32:43.337 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.336+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~6W7ZD1E7I2LC.1 size=386465 2023-12-03T11:32:43.337 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.336+0000 7f4d50c67780 1 > prepared multipart upload key=JR8CIONID4QC upload=6W7ZD1E7I2LC tag=6HJBUKHZIXQU type=write size=2483617 2023-12-03T11:32:43.338 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.337+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=KR88UQ7GDYMZ type=del 2023-12-03T11:32:43.340 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.339+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~IFOIFDJLEQA8.0 size=1048576 2023-12-03T11:32:43.341 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.340+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~IFOIFDJLEQA8.1 size=572900 2023-12-03T11:32:43.341 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.340+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=IFOIFDJLEQA8 tag=RIL9HNIXUMJM type=write size=2670052 2023-12-03T11:32:43.343 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.342+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~152R6QJQOHX4.0 size=1048576 2023-12-03T11:32:43.345 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.343+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~152R6QJQOHX4.1 size=1048576 2023-12-03T11:32:43.345 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.344+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~152R6QJQOHX4.2 size=727147 2023-12-03T11:32:43.347 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.347+0000 7f4d50c67780 1 < completed multipart upload key=MLKGLDFFDC3W upload=152R6QJQOHX4 tag=EMJ1WB86GRV3 type=write size=3872875 2023-12-03T11:32:43.349 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.348+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=AM3V3YRVR8B5 type=write size=303507 2023-12-03T11:32:43.351 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.350+0000 7f4d50c67780 1 < completed write operation key=WUM939BATDG9 tag=0JL3VC9182R3 type=write size=639640 2023-12-03T11:32:43.352 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.351+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=50U7DOTNWLDZ type=del size=1341555 2023-12-03T11:32:43.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.354+0000 7f4d50c67780 1 < suggested remove operation key=7C7UX0231SHV tag=KAR74F9073C2 type=del 2023-12-03T11:32:43.356 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.355+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=U3FKNAAZ4N5T type=del size=3591205 2023-12-03T11:32:43.358 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.357+0000 7f4d50c67780 1 < suggested remove operation key=EY1RBO15PCRR tag=34CSF0340MUG type=del 2023-12-03T11:32:43.359 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.358+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=VLZXW6S01OQD type=del size=1576769 2023-12-03T11:32:43.361 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.360+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~RESM3BS1LXKZ.0 size=1048576 2023-12-03T11:32:43.361 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.360+0000 7f4d50c67780 1 < canceled part key=_multipart_GTLP2WZUX7U8.2~RESM3BS1LXKZ.1 size=1048576 2023-12-03T11:32:43.362 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.361+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~RESM3BS1LXKZ.2 size=996524 2023-12-03T11:32:43.364 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.363+0000 7f4d50c67780 1 < canceled multipart upload key=GTLP2WZUX7U8 upload=RESM3BS1LXKZ tag=J9OBJH2XI8MG type=write size=4142252 2023-12-03T11:32:43.366 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.365+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~EYLR0T7ETU39.0 size=962226 2023-12-03T11:32:43.366 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.365+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=EYLR0T7ETU39 tag=EEPMHQLN60JO type=write size=2010802 2023-12-03T11:32:43.367 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.367+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=VUVOTB6H3Q3L type=del 2023-12-03T11:32:43.369 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.368+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=664FCB2HL7YW type=del size=11313 2023-12-03T11:32:43.371 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.370+0000 7f4d50c67780 1 < suggested remove operation key=EH4B2QP1C42H tag=WA0HDM4LCYD5 type=del 2023-12-03T11:32:43.372 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.371+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=TRBP5ABS0VXW type=del size=3436016 2023-12-03T11:32:43.373 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.373+0000 7f4d50c67780 -1 < failed to complete operation key=EY1RBO15PCRR tag=PRLLQ76JEZW9 type=write size=904409: (22) Invalid argument 2023-12-03T11:32:43.375 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.374+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=U4C3FHV25DKP type=del size=1129639 2023-12-03T11:32:43.376 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.375+0000 7f4d50c67780 1 < completed delete operation key=02W4TX7ZCDI6 tag=GUQCMMX1EAH1 type=del 2023-12-03T11:32:43.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.376+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=M19JQNUDDFRW type=write size=933014 2023-12-03T11:32:43.378 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.378+0000 7f4d50c67780 1 < completed delete operation key=MLKGLDFFDC3W tag=WH8106T6JJVL type=del 2023-12-03T11:32:43.380 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.379+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=HSKPBGPNG124 type=del size=3814253 2023-12-03T11:32:43.381 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.380+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~5L2K4RXAY0GH.0 size=1048576 2023-12-03T11:32:43.382 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.381+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~5L2K4RXAY0GH.1 size=522603 2023-12-03T11:32:43.384 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.383+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=5L2K4RXAY0GH tag=TKRXJ1NH3LCQ type=write size=2619755 2023-12-03T11:32:43.385 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.384+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=56TLJ4GT1TJT type=del size=725137 2023-12-03T11:32:43.387 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.386+0000 7f4d50c67780 1 < canceled operation key=GTLP2WZUX7U8 tag=F9SU7EH2T7XW type=write size=61030 2023-12-03T11:32:43.389 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.388+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~7TTFQVGSFSJ0.0 size=1048576 2023-12-03T11:32:43.390 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.389+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~7TTFQVGSFSJ0.1 size=1048576 2023-12-03T11:32:43.391 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.390+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~7TTFQVGSFSJ0.2 size=821288 2023-12-03T11:32:43.391 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.390+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=7TTFQVGSFSJ0 tag=SFNOR26KG7AW type=write size=3967016 2023-12-03T11:32:43.392 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.391+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~GHLHTXRSH3UP.0 size=1048576 2023-12-03T11:32:43.393 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.392+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~GHLHTXRSH3UP.1 size=1048576 2023-12-03T11:32:43.394 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.393+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~GHLHTXRSH3UP.2 size=389266 2023-12-03T11:32:43.396 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.395+0000 7f4d50c67780 1 < completed multipart upload key=TOGV2BZ99FRF upload=GHLHTXRSH3UP tag=YM7SKV052FYM type=write size=3534994 2023-12-03T11:32:43.399 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.398+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~WDYLO20Q3AXK.0 size=1048576 2023-12-03T11:32:43.400 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.399+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~WDYLO20Q3AXK.1 size=528627 2023-12-03T11:32:43.400 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.399+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=WDYLO20Q3AXK tag=XOAWA6XK981M type=write size=2625779 2023-12-03T11:32:43.401 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.400+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~B059E9AL3QNR.0 size=981074 2023-12-03T11:32:43.403 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.403+0000 7f4d50c67780 1 < completed multipart upload key=MLKGLDFFDC3W upload=B059E9AL3QNR tag=8UPQEVW08KIY type=write size=2029650 2023-12-03T11:32:43.406 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.405+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~7P2G8MOTHBC0.0 size=1048576 2023-12-03T11:32:43.407 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.406+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~7P2G8MOTHBC0.1 size=215166 2023-12-03T11:32:43.407 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.406+0000 7f4d50c67780 1 > prepared multipart upload key=JBL6IOJC4TT0 upload=7P2G8MOTHBC0 tag=G30L1DINMGMH type=write size=2312318 2023-12-03T11:32:43.408 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.407+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~6W7ZD1E7I2LC.0 size=1048576 2023-12-03T11:32:43.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.408+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~6W7ZD1E7I2LC.1 size=386465 2023-12-03T11:32:43.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.410+0000 7f4d50c67780 1 < completed multipart upload key=JR8CIONID4QC upload=6W7ZD1E7I2LC tag=6HJBUKHZIXQU type=write size=2483617 2023-12-03T11:32:43.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.412+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=PB1JQN08M9D2 type=del size=1066865 2023-12-03T11:32:43.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.413+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~IFOIFDJLEQA8.0 size=1048576 2023-12-03T11:32:43.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.414+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~IFOIFDJLEQA8.1 size=572900 2023-12-03T11:32:43.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.416+0000 7f4d50c67780 1 < completed multipart upload key=EAP0BYZTTT2E upload=IFOIFDJLEQA8 tag=RIL9HNIXUMJM type=write size=2670052 2023-12-03T11:32:43.419 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.418+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~IK3SAMNCA0IK.0 size=737819 2023-12-03T11:32:43.419 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.418+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=IK3SAMNCA0IK tag=35HE6HJ1W17I type=write size=1786395 2023-12-03T11:32:43.422 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.421+0000 7f4d50c67780 1 < suggested remove operation key=XM5E3D99MXVA tag=AM3V3YRVR8B5 type=write 2023-12-03T11:32:43.424 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.423+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~FLO7CST6Z0L1.0 size=1048576 2023-12-03T11:32:43.425 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.424+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~FLO7CST6Z0L1.1 size=24586 2023-12-03T11:32:43.425 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.424+0000 7f4d50c67780 1 > prepared multipart upload key=TOGV2BZ99FRF upload=FLO7CST6Z0L1 tag=64W4MU85KXL9 type=write size=2121738 2023-12-03T11:32:43.426 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.425+0000 7f4d50c67780 1 < completed delete operation key=02W4TX7ZCDI6 tag=50U7DOTNWLDZ type=del 2023-12-03T11:32:43.428 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.427+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~VYVGMMM6NY5S.0 size=1048576 2023-12-03T11:32:43.429 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.428+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~VYVGMMM6NY5S.1 size=713351 2023-12-03T11:32:43.430 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.428+0000 7f4d50c67780 1 > prepared multipart upload key=U6R5Y9JXKT32 upload=VYVGMMM6NY5S tag=P51QTVYZ6VTO type=write size=2810503 2023-12-03T11:32:43.431 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.430+0000 7f4d50c67780 -1 < failed to complete operation key=XM5E3D99MXVA tag=U3FKNAAZ4N5T type=del size=3591205: (22) Invalid argument 2023-12-03T11:32:43.432 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.431+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=CJFT15EBKABT type=write size=151202 2023-12-03T11:32:43.433 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.432+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=VLZXW6S01OQD type=del 2023-12-03T11:32:43.434 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.433+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=2T78XNDVT2BD type=write size=549975 2023-12-03T11:32:43.435 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.434+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~EYLR0T7ETU39.0 size=962226 2023-12-03T11:32:43.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.436+0000 7f4d50c67780 1 < completed multipart upload key=CQPZ0X62207Z upload=EYLR0T7ETU39 tag=EEPMHQLN60JO type=write size=2010802 2023-12-03T11:32:43.438 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.437+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=X1LUZRBLK6G2 type=del size=239300 2023-12-03T11:32:43.440 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.439+0000 7f4d50c67780 1 < canceled operation key=QQDBWLVSXIHP tag=664FCB2HL7YW type=del size=11313 2023-12-03T11:32:43.441 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.440+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=6GDYZVDEP1ZY type=del size=3360930 2023-12-03T11:32:43.443 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.442+0000 7f4d50c67780 1 < suggested remove operation key=7C7UX0231SHV tag=TRBP5ABS0VXW type=del 2023-12-03T11:32:43.444 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.443+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=LWYPDYVQ0QLD type=del size=3206204 2023-12-03T11:32:43.445 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.444+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=U4C3FHV25DKP type=del 2023-12-03T11:32:43.447 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.447+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=I1HXR16LZA3L type=del size=3442246 2023-12-03T11:32:43.449 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.448+0000 7f4d50c67780 1 < completed write operation key=BX5POXMMYLB7 tag=M19JQNUDDFRW type=write size=933014 2023-12-03T11:32:43.451 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.450+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~VKNVXHR182ZM.0 size=916437 2023-12-03T11:32:43.451 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.450+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=VKNVXHR182ZM tag=L6QAQSYNYVJZ type=write size=1965013 2023-12-03T11:32:43.452 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.451+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=HSKPBGPNG124 type=del 2023-12-03T11:32:43.453 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.453+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=AIEX1IM3Y9W1 type=del size=817558 2023-12-03T11:32:43.455 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.454+0000 7f4d50c67780 1 < completed delete operation key=EH4B2QP1C42H tag=56TLJ4GT1TJT type=del 2023-12-03T11:32:43.456 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.455+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=OV62YYXM583D type=write size=676972 2023-12-03T11:32:43.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.456+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~7TTFQVGSFSJ0.0 size=1048576 2023-12-03T11:32:43.458 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.457+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~7TTFQVGSFSJ0.1 size=1048576 2023-12-03T11:32:43.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.459+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~7TTFQVGSFSJ0.2 size=821288 2023-12-03T11:32:43.461 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.461+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=7TTFQVGSFSJ0 tag=SFNOR26KG7AW type=write size=3967016 2023-12-03T11:32:43.464 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.463+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~UHLR1AROWE33.0 size=155544 2023-12-03T11:32:43.464 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.463+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=UHLR1AROWE33 tag=ZIUIF8F3SZHS type=write size=1204120 2023-12-03T11:32:43.465 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.464+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~WDYLO20Q3AXK.0 size=1048576 2023-12-03T11:32:43.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.465+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~WDYLO20Q3AXK.1 size=528627 2023-12-03T11:32:43.468 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.467+0000 7f4d50c67780 1 < completed multipart upload key=7C7UX0231SHV upload=WDYLO20Q3AXK tag=XOAWA6XK981M type=write size=2625779 2023-12-03T11:32:43.470 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.469+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~BAO92WTCBBFY.0 size=1048576 2023-12-03T11:32:43.471 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.470+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~BAO92WTCBBFY.1 size=652370 2023-12-03T11:32:43.471 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.470+0000 7f4d50c67780 1 > prepared multipart upload key=52E31L45TN7V upload=BAO92WTCBBFY tag=OJKO4XETSQLV type=write size=2749522 2023-12-03T11:32:43.471 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.470+0000 7f4d50c67780 1 < canceled part key=_multipart_JBL6IOJC4TT0.2~7P2G8MOTHBC0.0 size=1048576 2023-12-03T11:32:43.472 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.471+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~7P2G8MOTHBC0.1 size=215166 2023-12-03T11:32:43.474 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.473+0000 7f4d50c67780 1 < canceled multipart upload key=JBL6IOJC4TT0 upload=7P2G8MOTHBC0 tag=G30L1DINMGMH type=write size=2312318 2023-12-03T11:32:43.475 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.474+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=8OVASUBEYUFD type=del size=300546 2023-12-03T11:32:43.476 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.476+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=PB1JQN08M9D2 type=del 2023-12-03T11:32:43.478 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.477+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=SAICR1SAVB7I type=del size=826656 2023-12-03T11:32:43.478 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.477+0000 7f4d50c67780 1 < canceled part key=_multipart_83I1M5WIVKAA.2~IK3SAMNCA0IK.0 size=737819 2023-12-03T11:32:43.480 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.480+0000 7f4d50c67780 1 < canceled multipart upload key=83I1M5WIVKAA upload=IK3SAMNCA0IK tag=35HE6HJ1W17I type=write size=1786395 2023-12-03T11:32:43.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.482+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~ZLTEUWRW5U32.0 size=1048576 2023-12-03T11:32:43.484 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.483+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~ZLTEUWRW5U32.1 size=1048576 2023-12-03T11:32:43.485 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.484+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~ZLTEUWRW5U32.2 size=432961 2023-12-03T11:32:43.485 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.484+0000 7f4d50c67780 1 > prepared multipart upload key=JR8CIONID4QC upload=ZLTEUWRW5U32 tag=DGD03PF9SK12 type=write size=3578689 2023-12-03T11:32:43.486 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.485+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~FLO7CST6Z0L1.0 size=1048576 2023-12-03T11:32:43.487 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.486+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~FLO7CST6Z0L1.1 size=24586 2023-12-03T11:32:43.489 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.488+0000 7f4d50c67780 1 < completed multipart upload key=TOGV2BZ99FRF upload=FLO7CST6Z0L1 tag=64W4MU85KXL9 type=write size=2121738 2023-12-03T11:32:43.491 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.490+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~LQ9VTNO6N658.0 size=1048576 2023-12-03T11:32:43.492 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.491+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~LQ9VTNO6N658.1 size=768346 2023-12-03T11:32:43.492 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.491+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=LQ9VTNO6N658 tag=0KBT0DAJDFSE type=write size=2865498 2023-12-03T11:32:43.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.492+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~VYVGMMM6NY5S.0 size=1048576 2023-12-03T11:32:43.494 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.493+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~VYVGMMM6NY5S.1 size=713351 2023-12-03T11:32:43.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.495+0000 7f4d50c67780 1 < completed multipart upload key=U6R5Y9JXKT32 upload=VYVGMMM6NY5S tag=P51QTVYZ6VTO type=write size=2810503 2023-12-03T11:32:43.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.496+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=DLLBS4HFDDOT type=del size=3333622 2023-12-03T11:32:43.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.498+0000 7f4d50c67780 1 < canceled operation key=TEIYINZFFG76 tag=CJFT15EBKABT type=write size=151202 2023-12-03T11:32:43.500 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.500+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~NPLO3EXY6N1M.0 size=1048576 2023-12-03T11:32:43.501 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.501+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~NPLO3EXY6N1M.1 size=1048576 2023-12-03T11:32:43.502 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.501+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~NPLO3EXY6N1M.2 size=714570 2023-12-03T11:32:43.502 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.501+0000 7f4d50c67780 1 > prepared multipart upload key=RF2Q24GI24HJ upload=NPLO3EXY6N1M tag=61UU4731WBHJ type=write size=3860298 2023-12-03T11:32:43.503 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.503+0000 7f4d50c67780 1 < completed write operation key=0M6ZAD39I852 tag=2T78XNDVT2BD type=write size=549975 2023-12-03T11:32:43.505 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.504+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=8M588C6U4V7M type=del size=3869114 2023-12-03T11:32:43.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.505+0000 7f4d50c67780 1 < completed delete operation key=JR8CIONID4QC tag=X1LUZRBLK6G2 type=del 2023-12-03T11:32:43.507 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.506+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=F5393RRNPJWR type=write size=242759 2023-12-03T11:32:43.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.507+0000 7f4d50c67780 1 < completed delete operation key=52E31L45TN7V tag=6GDYZVDEP1ZY type=del 2023-12-03T11:32:43.511 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.510+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~Q7Z2NJNSMJUK.0 size=1048576 2023-12-03T11:32:43.512 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.511+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~Q7Z2NJNSMJUK.1 size=897445 2023-12-03T11:32:43.512 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.511+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=Q7Z2NJNSMJUK tag=Y2PL6XUBUZAK type=write size=2994597 2023-12-03T11:32:43.514 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.513+0000 7f4d50c67780 1 < suggested remove operation key=ZE19S5UCCZ3C tag=LWYPDYVQ0QLD type=del 2023-12-03T11:32:43.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.514+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=FLW9MON6AMQ0 type=del size=4132934 2023-12-03T11:32:43.517 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.516+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=I1HXR16LZA3L type=del 2023-12-03T11:32:43.518 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.517+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=1NONOIFSFH07 type=del size=2323123 2023-12-03T11:32:43.519 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.518+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~VKNVXHR182ZM.0 size=916437 2023-12-03T11:32:43.521 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.521+0000 7f4d50c67780 1 < completed multipart upload key=7C7UX0231SHV upload=VKNVXHR182ZM tag=L6QAQSYNYVJZ type=write size=1965013 2023-12-03T11:32:43.524 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.523+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~DQJS9YWLCGE5.0 size=115556 2023-12-03T11:32:43.524 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.523+0000 7f4d50c67780 1 > prepared multipart upload key=G0O8EC405LYM upload=DQJS9YWLCGE5 tag=GW97ICLQ3I7K type=write size=1164132 2023-12-03T11:32:43.525 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.524+0000 7f4d50c67780 1 < completed delete operation key=EY1RBO15PCRR tag=AIEX1IM3Y9W1 type=del 2023-12-03T11:32:43.527 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.526+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~KZYPYUHHVWFO.0 size=1048576 2023-12-03T11:32:43.528 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.527+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~KZYPYUHHVWFO.1 size=381851 2023-12-03T11:32:43.529 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.527+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=KZYPYUHHVWFO tag=3SGWO0BP044W type=write size=2479003 2023-12-03T11:32:43.531 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.530+0000 7f4d50c67780 1 < suggested remove operation key=2H6AFQ362OGP tag=OV62YYXM583D type=write 2023-12-03T11:32:43.532 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.531+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=CFSA0DUR9R2Y type=del size=3418387 2023-12-03T11:32:43.532 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.531+0000 7f4d50c67780 1 < canceled part key=_multipart_EH4B2QP1C42H.2~UHLR1AROWE33.0 size=155544 2023-12-03T11:32:43.534 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.533+0000 7f4d50c67780 1 < canceled multipart upload key=EH4B2QP1C42H upload=UHLR1AROWE33 tag=ZIUIF8F3SZHS type=write size=1204120 2023-12-03T11:32:43.536 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.535+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~QTURV5XSU6A2.0 size=720048 2023-12-03T11:32:43.536 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.535+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=QTURV5XSU6A2 tag=AK15R0FEW3H8 type=write size=1768624 2023-12-03T11:32:43.538 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.537+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~BAO92WTCBBFY.0 size=1048576 2023-12-03T11:32:43.539 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.538+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~BAO92WTCBBFY.1 size=652370 2023-12-03T11:32:43.541 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.540+0000 7f4d50c67780 1 < completed multipart upload key=52E31L45TN7V upload=BAO92WTCBBFY tag=OJKO4XETSQLV type=write size=2749522 2023-12-03T11:32:43.542 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.541+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=JF6P7GGACFBZ type=del size=4119955 2023-12-03T11:32:43.545 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.542+0000 7f4d50c67780 1 < completed delete operation key=52E31L45TN7V tag=8OVASUBEYUFD type=del 2023-12-03T11:32:43.545 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.543+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=ON9BFOF9SVZQ type=del size=2265187 2023-12-03T11:32:43.546 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.546+0000 7f4d50c67780 1 < suggested update operation key=MLKGLDFFDC3W tag=SAICR1SAVB7I type=del size=826656 2023-12-03T11:32:43.548 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.548+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~6W3VYMSRWEJI.0 size=312597 2023-12-03T11:32:43.549 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.548+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=6W3VYMSRWEJI tag=Z2BULRL9S43L type=write size=1361173 2023-12-03T11:32:43.550 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.549+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~ZLTEUWRW5U32.0 size=1048576 2023-12-03T11:32:43.551 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.550+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~ZLTEUWRW5U32.1 size=1048576 2023-12-03T11:32:43.552 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.551+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~ZLTEUWRW5U32.2 size=432961 2023-12-03T11:32:43.554 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.553+0000 7f4d50c67780 1 < completed multipart upload key=JR8CIONID4QC upload=ZLTEUWRW5U32 tag=DGD03PF9SK12 type=write size=3578689 2023-12-03T11:32:43.556 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.555+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~H1K1AEEBIPH9.0 size=1048576 2023-12-03T11:32:43.557 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.556+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~H1K1AEEBIPH9.1 size=375540 2023-12-03T11:32:43.557 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.556+0000 7f4d50c67780 1 > prepared multipart upload key=TOGV2BZ99FRF upload=H1K1AEEBIPH9 tag=RE0BR3NJ527P type=write size=2472692 2023-12-03T11:32:43.558 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.557+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~LQ9VTNO6N658.0 size=1048576 2023-12-03T11:32:43.561 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.560+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~LQ9VTNO6N658.1 size=768346 2023-12-03T11:32:43.562 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.562+0000 7f4d50c67780 1 < completed multipart upload key=V0ND3OBFJJUB upload=LQ9VTNO6N658 tag=0KBT0DAJDFSE type=write size=2865498 2023-12-03T11:32:43.565 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.564+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~1RM26XFHCOJJ.0 size=1048576 2023-12-03T11:32:43.566 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.565+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~1RM26XFHCOJJ.1 size=421241 2023-12-03T11:32:43.566 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.565+0000 7f4d50c67780 1 > prepared multipart upload key=U6R5Y9JXKT32 upload=1RM26XFHCOJJ tag=KQVOS14BXVVE type=write size=2518393 2023-12-03T11:32:43.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.566+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=DLLBS4HFDDOT type=del 2023-12-03T11:32:43.568 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.567+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=682DC010GQIE type=write size=599391 2023-12-03T11:32:43.569 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.569+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~NPLO3EXY6N1M.0 size=1048576 2023-12-03T11:32:43.569 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.569+0000 7f4d50c67780 1 < canceled part key=_multipart_RF2Q24GI24HJ.2~NPLO3EXY6N1M.1 size=1048576 2023-12-03T11:32:43.570 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.569+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~NPLO3EXY6N1M.2 size=714570 2023-12-03T11:32:43.572 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.572+0000 7f4d50c67780 1 < canceled multipart upload key=RF2Q24GI24HJ upload=NPLO3EXY6N1M tag=61UU4731WBHJ type=write size=3860298 2023-12-03T11:32:43.573 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.573+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=XQVDW32BR4VI type=del size=3448026 2023-12-03T11:32:43.575 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.574+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=8M588C6U4V7M type=del 2023-12-03T11:32:43.577 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.576+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~FMDUZFKXSS7R.0 size=1048576 2023-12-03T11:32:43.578 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.577+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~FMDUZFKXSS7R.1 size=1048576 2023-12-03T11:32:43.579 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.578+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~FMDUZFKXSS7R.2 size=907251 2023-12-03T11:32:43.579 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.578+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=FMDUZFKXSS7R tag=MII78H5F8ESN type=write size=4052979 2023-12-03T11:32:43.580 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.579+0000 7f4d50c67780 1 < completed write operation key=WUM939BATDG9 tag=F5393RRNPJWR type=write size=242759 2023-12-03T11:32:43.582 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.582+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~1KW0OVSO6GGJ.0 size=1048576 2023-12-03T11:32:43.584 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.583+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~1KW0OVSO6GGJ.1 size=306328 2023-12-03T11:32:43.584 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.583+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=1KW0OVSO6GGJ tag=MK04241J98HC type=write size=2403480 2023-12-03T11:32:43.585 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.584+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~Q7Z2NJNSMJUK.0 size=1048576 2023-12-03T11:32:43.586 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.585+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~Q7Z2NJNSMJUK.1 size=897445 2023-12-03T11:32:43.588 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.587+0000 7f4d50c67780 1 < completed multipart upload key=83I1M5WIVKAA upload=Q7Z2NJNSMJUK tag=Y2PL6XUBUZAK type=write size=2994597 2023-12-03T11:32:43.589 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.588+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=51ZFV9BALIG8 type=del size=1902315 2023-12-03T11:32:43.591 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.590+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=FLW9MON6AMQ0 type=del 2023-12-03T11:32:43.593 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.592+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~0C6RGLJ8OSE7.0 size=698964 2023-12-03T11:32:43.593 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.592+0000 7f4d50c67780 1 > prepared multipart upload key=YDRAH5EE39R4 upload=0C6RGLJ8OSE7 tag=MKS7IC8K2STF type=write size=1747540 2023-12-03T11:32:43.595 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.594+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=1NONOIFSFH07 type=del 2023-12-03T11:32:43.596 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.596+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=NN07OKF6ZW5O type=del size=2588992 2023-12-03T11:32:43.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.596+0000 7f4d50c67780 1 < canceled part key=_multipart_G0O8EC405LYM.2~DQJS9YWLCGE5.0 size=115556 2023-12-03T11:32:43.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.598+0000 7f4d50c67780 1 < canceled multipart upload key=G0O8EC405LYM upload=DQJS9YWLCGE5 tag=GW97ICLQ3I7K type=write size=1164132 2023-12-03T11:32:43.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.601+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~W7VBUEHRC8NX.0 size=1048576 2023-12-03T11:32:43.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.602+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~W7VBUEHRC8NX.1 size=821310 2023-12-03T11:32:43.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.602+0000 7f4d50c67780 1 > prepared multipart upload key=YDRAH5EE39R4 upload=W7VBUEHRC8NX tag=CRAAS2XOO58I type=write size=2918462 2023-12-03T11:32:43.604 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.603+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~KZYPYUHHVWFO.0 size=1048576 2023-12-03T11:32:43.605 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.604+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~KZYPYUHHVWFO.1 size=381851 2023-12-03T11:32:43.607 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.606+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=KZYPYUHHVWFO tag=3SGWO0BP044W type=write size=2479003 2023-12-03T11:32:43.609 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.608+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=V7SCI4T25I97 type=del size=1564621 2023-12-03T11:32:43.610 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.609+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=CFSA0DUR9R2Y type=del 2023-12-03T11:32:43.611 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.611+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=PL2GWH9KMN6L type=del size=3971216 2023-12-03T11:32:43.613 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.612+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~QTURV5XSU6A2.0 size=720048 2023-12-03T11:32:43.615 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.614+0000 7f4d50c67780 1 < completed multipart upload key=EH4B2QP1C42H upload=QTURV5XSU6A2 tag=AK15R0FEW3H8 type=write size=1768624 2023-12-03T11:32:43.616 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.616+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=1Y8M2DM7DMDQ type=del size=1787025 2023-12-03T11:32:43.618 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.617+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=JF6P7GGACFBZ type=del 2023-12-03T11:32:43.619 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.618+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=GSPB6444W5NB type=del size=1503755 2023-12-03T11:32:43.621 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.620+0000 7f4d50c67780 1 < completed delete operation key=QQDBWLVSXIHP tag=ON9BFOF9SVZQ type=del 2023-12-03T11:32:43.622 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.621+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=7M0CW5PIUBYE type=del size=4071033 2023-12-03T11:32:43.623 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.623+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~6W3VYMSRWEJI.0 size=312597 2023-12-03T11:32:43.625 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.625+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=6W3VYMSRWEJI tag=Z2BULRL9S43L type=write size=1361173 2023-12-03T11:32:43.627 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.626+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=O6KE0TLOTKMD type=del size=2698094 2023-12-03T11:32:43.628 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.627+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~H1K1AEEBIPH9.0 size=1048576 2023-12-03T11:32:43.629 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.628+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~H1K1AEEBIPH9.1 size=375540 2023-12-03T11:32:43.631 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.630+0000 7f4d50c67780 1 < completed multipart upload key=TOGV2BZ99FRF upload=H1K1AEEBIPH9 tag=RE0BR3NJ527P type=write size=2472692 2023-12-03T11:32:43.632 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.632+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=L64UHUT4P5ZD type=del size=987429 2023-12-03T11:32:43.634 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.633+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~1RM26XFHCOJJ.0 size=1048576 2023-12-03T11:32:43.635 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.634+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~1RM26XFHCOJJ.1 size=421241 2023-12-03T11:32:43.637 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.636+0000 7f4d50c67780 1 < completed multipart upload key=U6R5Y9JXKT32 upload=1RM26XFHCOJJ tag=KQVOS14BXVVE type=write size=2518393 2023-12-03T11:32:43.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.639+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~IJUKTDXIXNZN.0 size=668401 2023-12-03T11:32:43.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.639+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=IJUKTDXIXNZN tag=0483IQWTCIYG type=write size=1716977 2023-12-03T11:32:43.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.640+0000 7f4d50c67780 1 < completed write operation key=JBL6IOJC4TT0 tag=682DC010GQIE type=write size=599391 2023-12-03T11:32:43.644 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.643+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~QE7OG07RGBNH.0 size=529975 2023-12-03T11:32:43.644 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.643+0000 7f4d50c67780 1 > prepared multipart upload key=U6R5Y9JXKT32 upload=QE7OG07RGBNH tag=L0PTPPHGWTGU type=write size=1578551 2023-12-03T11:32:43.645 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.644+0000 7f4d50c67780 1 < canceled operation key=ENMJS0KEVS2S tag=XQVDW32BR4VI type=del size=3448026 2023-12-03T11:32:43.647 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.646+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=1JB4X4PKW738 type=del size=3598632 2023-12-03T11:32:43.648 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.647+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~FMDUZFKXSS7R.0 size=1048576 2023-12-03T11:32:43.649 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.648+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~FMDUZFKXSS7R.1 size=1048576 2023-12-03T11:32:43.650 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.649+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~FMDUZFKXSS7R.2 size=907251 2023-12-03T11:32:43.652 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.651+0000 7f4d50c67780 1 < completed multipart upload key=MLKGLDFFDC3W upload=FMDUZFKXSS7R tag=MII78H5F8ESN type=write size=4052979 2023-12-03T11:32:43.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.654+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~2QYMEU1R1WQM.0 size=609410 2023-12-03T11:32:43.655 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.654+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=2QYMEU1R1WQM tag=QQI3WENDCOII type=write size=1657986 2023-12-03T11:32:43.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.655+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~1KW0OVSO6GGJ.0 size=1048576 2023-12-03T11:32:43.657 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.656+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~1KW0OVSO6GGJ.1 size=306328 2023-12-03T11:32:43.659 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.658+0000 7f4d50c67780 1 < completed multipart upload key=83I1M5WIVKAA upload=1KW0OVSO6GGJ tag=MK04241J98HC type=write size=2403480 2023-12-03T11:32:43.661 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.660+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~PUJ9M5T3P0VC.0 size=371996 2023-12-03T11:32:43.661 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.660+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=PUJ9M5T3P0VC tag=0H0VNBT616MC type=write size=1420572 2023-12-03T11:32:43.664 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.663+0000 7f4d50c67780 1 < suggested remove operation key=7C7UX0231SHV tag=51ZFV9BALIG8 type=del 2023-12-03T11:32:43.666 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.665+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~18TMSCYJIOSD.0 size=1048576 2023-12-03T11:32:43.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.666+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~18TMSCYJIOSD.1 size=118693 2023-12-03T11:32:43.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.666+0000 7f4d50c67780 1 > prepared multipart upload key=QQDBWLVSXIHP upload=18TMSCYJIOSD tag=RNAE3NFSOVMS type=write size=2215845 2023-12-03T11:32:43.668 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.667+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~0C6RGLJ8OSE7.0 size=698964 2023-12-03T11:32:43.670 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.669+0000 7f4d50c67780 1 < completed multipart upload key=YDRAH5EE39R4 upload=0C6RGLJ8OSE7 tag=MKS7IC8K2STF type=write size=1747540 2023-12-03T11:32:43.671 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.670+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=IV13QWP0AX5E type=write size=741981 2023-12-03T11:32:43.672 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.671+0000 7f4d50c67780 1 < completed delete operation key=73SL3ZBBDA6Q tag=NN07OKF6ZW5O type=del 2023-12-03T11:32:43.673 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.673+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=2EPDBYRFIEMH type=write size=979210 2023-12-03T11:32:43.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.674+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~W7VBUEHRC8NX.0 size=1048576 2023-12-03T11:32:43.676 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.675+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~W7VBUEHRC8NX.1 size=821310 2023-12-03T11:32:43.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.677+0000 7f4d50c67780 1 < completed multipart upload key=YDRAH5EE39R4 upload=W7VBUEHRC8NX tag=CRAAS2XOO58I type=write size=2918462 2023-12-03T11:32:43.680 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.679+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=G5NUXDPKFLPG type=del size=1761782 2023-12-03T11:32:43.681 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.680+0000 7f4d50c67780 1 < completed delete operation key=EY1RBO15PCRR tag=V7SCI4T25I97 type=del 2023-12-03T11:32:43.682 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.681+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=SYS8J3URVS1L type=write size=495616 2023-12-03T11:32:43.684 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.684+0000 7f4d50c67780 1 < suggested update operation key=EAP0BYZTTT2E tag=PL2GWH9KMN6L type=del size=3971216 2023-12-03T11:32:43.686 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.685+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=DC4N34G8YQWC type=del size=3458789 2023-12-03T11:32:43.687 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.686+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=1Y8M2DM7DMDQ type=del 2023-12-03T11:32:43.689 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.688+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~NMQYEZD9CXZI.0 size=1048576 2023-12-03T11:32:43.690 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.689+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~NMQYEZD9CXZI.1 size=165486 2023-12-03T11:32:43.690 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.689+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=NMQYEZD9CXZI tag=GCBZQBFBKCUT type=write size=2262638 2023-12-03T11:32:43.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.690+0000 7f4d50c67780 1 < completed delete operation key=GTLP2WZUX7U8 tag=GSPB6444W5NB type=del 2023-12-03T11:32:43.693 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.692+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~4M5IYXJSO64N.0 size=1048576 2023-12-03T11:32:43.694 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.693+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~4M5IYXJSO64N.1 size=1048576 2023-12-03T11:32:43.695 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.694+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~4M5IYXJSO64N.2 size=840918 2023-12-03T11:32:43.695 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.694+0000 7f4d50c67780 1 > prepared multipart upload key=52E31L45TN7V upload=4M5IYXJSO64N tag=8K5ZC36GYQRU type=write size=3986646 2023-12-03T11:32:43.696 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.695+0000 7f4d50c67780 1 < completed delete operation key=EH4B2QP1C42H tag=7M0CW5PIUBYE type=del 2023-12-03T11:32:43.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.696+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=AKF7D71MZEQZ type=del size=1330870 2023-12-03T11:32:43.698 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.697+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=O6KE0TLOTKMD type=del 2023-12-03T11:32:43.699 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.699+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=T84D73537QR9 type=del size=3090846 2023-12-03T11:32:43.702 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.701+0000 7f4d50c67780 1 < suggested update operation key=52E31L45TN7V tag=L64UHUT4P5ZD type=del size=987429 2023-12-03T11:32:43.703 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.702+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=TI98ZXKMY69B type=del size=446483 2023-12-03T11:32:43.704 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.703+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~IJUKTDXIXNZN.0 size=668401 2023-12-03T11:32:43.706 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.705+0000 7f4d50c67780 1 < completed multipart upload key=WUM939BATDG9 upload=IJUKTDXIXNZN tag=0483IQWTCIYG type=write size=1716977 2023-12-03T11:32:43.707 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.706+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=WGTJK7Y4M9ZX type=del size=3945959 2023-12-03T11:32:43.708 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.707+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~QE7OG07RGBNH.0 size=529975 2023-12-03T11:32:43.710 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.709+0000 7f4d50c67780 1 < completed multipart upload key=U6R5Y9JXKT32 upload=QE7OG07RGBNH tag=L0PTPPHGWTGU type=write size=1578551 2023-12-03T11:32:43.712 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.711+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~W726AXGP89SA.0 size=1048576 2023-12-03T11:32:43.713 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.712+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~W726AXGP89SA.1 size=1048576 2023-12-03T11:32:43.714 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.713+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~W726AXGP89SA.2 size=181584 2023-12-03T11:32:43.714 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.713+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=W726AXGP89SA tag=D839WDZ8EDL4 type=write size=3327312 2023-12-03T11:32:43.715 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.714+0000 7f4d50c67780 1 < completed delete operation key=0M6ZAD39I852 tag=1JB4X4PKW738 type=del 2023-12-03T11:32:43.717 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.716+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~R3XFLTFXCJUU.0 size=1048576 2023-12-03T11:32:43.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.717+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~R3XFLTFXCJUU.1 size=1048576 2023-12-03T11:32:43.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.718+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~R3XFLTFXCJUU.2 size=476418 2023-12-03T11:32:43.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.718+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=R3XFLTFXCJUU tag=GFTBOQQ5GR95 type=write size=3622146 2023-12-03T11:32:43.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.719+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~2QYMEU1R1WQM.0 size=609410 2023-12-03T11:32:43.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.721+0000 7f4d50c67780 1 < completed multipart upload key=EAP0BYZTTT2E upload=2QYMEU1R1WQM tag=QQI3WENDCOII type=write size=1657986 2023-12-03T11:32:43.723 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.722+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=QXTTPJM6MVPX type=del size=1363530 2023-12-03T11:32:43.724 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.724+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~PUJ9M5T3P0VC.0 size=371996 2023-12-03T11:32:43.726 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.726+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=PUJ9M5T3P0VC tag=0H0VNBT616MC type=write size=1420572 2023-12-03T11:32:43.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.727+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=CQDB48UHNICC type=del size=2712685 2023-12-03T11:32:43.729 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.728+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~18TMSCYJIOSD.0 size=1048576 2023-12-03T11:32:43.730 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.729+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~18TMSCYJIOSD.1 size=118693 2023-12-03T11:32:43.732 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.731+0000 7f4d50c67780 1 < completed multipart upload key=QQDBWLVSXIHP upload=18TMSCYJIOSD tag=RNAE3NFSOVMS type=write size=2215845 2023-12-03T11:32:43.734 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.733+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=NEHZE567HO0I type=del size=2707767 2023-12-03T11:32:43.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.736+0000 7f4d50c67780 1 < suggested update operation key=ENMJS0KEVS2S tag=IV13QWP0AX5E type=write size=741981 2023-12-03T11:32:43.739 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.738+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~WL7DBMJS1CBI.0 size=1048576 2023-12-03T11:32:43.739 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.739+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~WL7DBMJS1CBI.1 size=1048576 2023-12-03T11:32:43.740 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.740+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~WL7DBMJS1CBI.2 size=316135 2023-12-03T11:32:43.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.740+0000 7f4d50c67780 1 > prepared multipart upload key=JR8CIONID4QC upload=WL7DBMJS1CBI tag=19SNHD1V3CG0 type=write size=3461863 2023-12-03T11:32:43.742 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.741+0000 7f4d50c67780 1 < completed write operation key=73SL3ZBBDA6Q tag=2EPDBYRFIEMH type=write size=979210 2023-12-03T11:32:43.744 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.743+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~F5YL3Q0ZQDIT.0 size=784005 2023-12-03T11:32:43.744 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.743+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=F5YL3Q0ZQDIT tag=GY6FU51KSUK0 type=write size=1832581 2023-12-03T11:32:43.745 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.744+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=G5NUXDPKFLPG type=del 2023-12-03T11:32:43.746 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.745+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=THON9G0WD6KX type=del size=680617 2023-12-03T11:32:43.749 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.747+0000 7f4d50c67780 1 < completed write operation key=EH4B2QP1C42H tag=SYS8J3URVS1L type=write size=495616 2023-12-03T11:32:43.750 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.749+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~A837LOIKB0QJ.0 size=1048576 2023-12-03T11:32:43.751 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.750+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~A837LOIKB0QJ.1 size=1048576 2023-12-03T11:32:43.752 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.751+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~A837LOIKB0QJ.2 size=18897 2023-12-03T11:32:43.752 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.751+0000 7f4d50c67780 1 > prepared multipart upload key=52E31L45TN7V upload=A837LOIKB0QJ tag=7VYR32TYQBOX type=write size=3164625 2023-12-03T11:32:43.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.753+0000 7f4d50c67780 1 < suggested remove operation key=EY1RBO15PCRR tag=DC4N34G8YQWC type=del 2023-12-03T11:32:43.755 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.754+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=4A2AVSU39EP2 type=del size=1299642 2023-12-03T11:32:43.756 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.755+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~NMQYEZD9CXZI.0 size=1048576 2023-12-03T11:32:43.756 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.755+0000 7f4d50c67780 1 < canceled part key=_multipart_83I1M5WIVKAA.2~NMQYEZD9CXZI.1 size=165486 2023-12-03T11:32:43.758 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.757+0000 7f4d50c67780 1 < canceled multipart upload key=83I1M5WIVKAA upload=NMQYEZD9CXZI tag=GCBZQBFBKCUT type=write size=2262638 2023-12-03T11:32:43.760 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.760+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~9ZHZW96V23IR.0 size=1048576 2023-12-03T11:32:43.761 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.761+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~9ZHZW96V23IR.1 size=445625 2023-12-03T11:32:43.761 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.761+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=9ZHZW96V23IR tag=XCV74DDDM66B type=write size=2542777 2023-12-03T11:32:43.763 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.762+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~4M5IYXJSO64N.0 size=1048576 2023-12-03T11:32:43.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.763+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~4M5IYXJSO64N.1 size=1048576 2023-12-03T11:32:43.765 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.764+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~4M5IYXJSO64N.2 size=840918 2023-12-03T11:32:43.767 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.766+0000 7f4d50c67780 1 < completed multipart upload key=52E31L45TN7V upload=4M5IYXJSO64N tag=8K5ZC36GYQRU type=write size=3986646 2023-12-03T11:32:43.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.767+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=5AYMXW5FKQUQ type=del size=2090101 2023-12-03T11:32:43.770 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.769+0000 7f4d50c67780 1 < completed delete operation key=QQDBWLVSXIHP tag=AKF7D71MZEQZ type=del 2023-12-03T11:32:43.771 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.770+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=RYY5NHCGSMHV type=del size=6871 2023-12-03T11:32:43.772 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.771+0000 7f4d50c67780 1 < completed delete operation key=7C7UX0231SHV tag=T84D73537QR9 type=del 2023-12-03T11:32:43.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.772+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=CL8Y8649U1FD type=write size=138189 2023-12-03T11:32:43.774 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.774+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=TI98ZXKMY69B type=del 2023-12-03T11:32:43.776 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.775+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=ADYGM5D75RLC type=del size=2765290 2023-12-03T11:32:43.778 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.777+0000 7f4d50c67780 1 < suggested update operation key=ENMJS0KEVS2S tag=WGTJK7Y4M9ZX type=del size=3945959 2023-12-03T11:32:43.780 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.779+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~RMH0DJ2YYG0R.0 size=1048576 2023-12-03T11:32:43.781 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.780+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~RMH0DJ2YYG0R.1 size=1048576 2023-12-03T11:32:43.782 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.781+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~RMH0DJ2YYG0R.2 size=666066 2023-12-03T11:32:43.782 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.781+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=RMH0DJ2YYG0R tag=0PALQ73W8CCR type=write size=3811794 2023-12-03T11:32:43.783 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.782+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~W726AXGP89SA.0 size=1048576 2023-12-03T11:32:43.784 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.784+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~W726AXGP89SA.1 size=1048576 2023-12-03T11:32:43.785 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.785+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~W726AXGP89SA.2 size=181584 2023-12-03T11:32:43.787 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.787+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=W726AXGP89SA tag=D839WDZ8EDL4 type=write size=3327312 2023-12-03T11:32:43.791 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.790+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~CBM26GY2V26F.0 size=497889 2023-12-03T11:32:43.791 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.790+0000 7f4d50c67780 1 > prepared multipart upload key=YDRAH5EE39R4 upload=CBM26GY2V26F tag=A8Y8GV1EBM48 type=write size=1546465 2023-12-03T11:32:43.792 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.791+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~R3XFLTFXCJUU.0 size=1048576 2023-12-03T11:32:43.793 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.792+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~R3XFLTFXCJUU.1 size=1048576 2023-12-03T11:32:43.794 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.793+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~R3XFLTFXCJUU.2 size=476418 2023-12-03T11:32:43.796 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.795+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=R3XFLTFXCJUU tag=GFTBOQQ5GR95 type=write size=3622146 2023-12-03T11:32:43.798 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.797+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~8PWG0TEH9AGJ.0 size=274959 2023-12-03T11:32:43.798 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.797+0000 7f4d50c67780 1 > prepared multipart upload key=QQDBWLVSXIHP upload=8PWG0TEH9AGJ tag=BVXNLXLBLGVF type=write size=1323535 2023-12-03T11:32:43.801 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.800+0000 7f4d50c67780 1 < suggested update operation key=CQPZ0X62207Z tag=QXTTPJM6MVPX type=del size=1363530 2023-12-03T11:32:43.803 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.802+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~6JAYTW1ROEE8.0 size=1048576 2023-12-03T11:32:43.804 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.803+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~6JAYTW1ROEE8.1 size=919541 2023-12-03T11:32:43.804 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.803+0000 7f4d50c67780 1 > prepared multipart upload key=TEIYINZFFG76 upload=6JAYTW1ROEE8 tag=85P9ZFVCGGOU type=write size=3016693 2023-12-03T11:32:43.805 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.804+0000 7f4d50c67780 1 < completed delete operation key=K7YVVH7SAKMC tag=CQDB48UHNICC type=del 2023-12-03T11:32:43.806 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.806+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=K4293JC5ONXV type=del size=3660768 2023-12-03T11:32:43.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.807+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=NEHZE567HO0I type=del 2023-12-03T11:32:43.810 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.809+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~7OMXV5VKUP4Q.0 size=1048576 2023-12-03T11:32:43.811 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.810+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~7OMXV5VKUP4Q.1 size=1048576 2023-12-03T11:32:43.812 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.811+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~7OMXV5VKUP4Q.2 size=1047394 2023-12-03T11:32:43.812 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.811+0000 7f4d50c67780 1 > prepared multipart upload key=73SL3ZBBDA6Q upload=7OMXV5VKUP4Q tag=N2AAW0PQGA42 type=write size=4193122 2023-12-03T11:32:43.813 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.812+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~WL7DBMJS1CBI.0 size=1048576 2023-12-03T11:32:43.814 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.813+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~WL7DBMJS1CBI.1 size=1048576 2023-12-03T11:32:43.815 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.814+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~WL7DBMJS1CBI.2 size=316135 2023-12-03T11:32:43.817 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.816+0000 7f4d50c67780 1 < completed multipart upload key=JR8CIONID4QC upload=WL7DBMJS1CBI tag=19SNHD1V3CG0 type=write size=3461863 2023-12-03T11:32:43.819 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.818+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~MMFK9MHX94UW.0 size=1048576 2023-12-03T11:32:43.820 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.819+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~MMFK9MHX94UW.1 size=1048576 2023-12-03T11:32:43.821 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.820+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~MMFK9MHX94UW.2 size=102972 2023-12-03T11:32:43.821 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.820+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=MMFK9MHX94UW tag=J2XZPXSUSIVC type=write size=3248700 2023-12-03T11:32:43.822 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.821+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~F5YL3Q0ZQDIT.0 size=784005 2023-12-03T11:32:43.824 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.823+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=F5YL3Q0ZQDIT tag=GY6FU51KSUK0 type=write size=1832581 2023-12-03T11:32:43.825 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.825+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=J0WO3NRHIVFB type=del size=634445 2023-12-03T11:32:43.827 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.826+0000 7f4d50c67780 1 < completed delete operation key=JR8CIONID4QC tag=THON9G0WD6KX type=del 2023-12-03T11:32:43.828 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.827+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=ISLZG036MN84 type=del size=1793842 2023-12-03T11:32:43.828 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.827+0000 7f4d50c67780 1 < canceled part key=_multipart_52E31L45TN7V.2~A837LOIKB0QJ.0 size=1048576 2023-12-03T11:32:43.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.828+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~A837LOIKB0QJ.1 size=1048576 2023-12-03T11:32:43.830 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.829+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~A837LOIKB0QJ.2 size=18897 2023-12-03T11:32:43.832 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.831+0000 7f4d50c67780 1 < canceled multipart upload key=52E31L45TN7V upload=A837LOIKB0QJ tag=7VYR32TYQBOX type=write size=3164625 2023-12-03T11:32:43.834 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.833+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~ZFEOXAVRV5AQ.0 size=1048576 2023-12-03T11:32:43.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.834+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~ZFEOXAVRV5AQ.1 size=741169 2023-12-03T11:32:43.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.834+0000 7f4d50c67780 1 > prepared multipart upload key=TEIYINZFFG76 upload=ZFEOXAVRV5AQ tag=S3CV2BCH1ZYQ type=write size=2838321 2023-12-03T11:32:43.837 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.836+0000 7f4d50c67780 1 < suggested remove operation key=2H6AFQ362OGP tag=4A2AVSU39EP2 type=del 2023-12-03T11:32:43.838 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.838+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=RH3JPXJSAIAB type=del size=154457 2023-12-03T11:32:43.840 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.839+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~9ZHZW96V23IR.0 size=1048576 2023-12-03T11:32:43.840 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.840+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~9ZHZW96V23IR.1 size=445625 2023-12-03T11:32:43.842 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.842+0000 7f4d50c67780 1 < completed multipart upload key=CQPZ0X62207Z upload=9ZHZW96V23IR tag=XCV74DDDM66B type=write size=2542777 2023-12-03T11:32:43.844 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.843+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=DXI8QOF5OVCB type=del size=2513446 2023-12-03T11:32:43.845 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.844+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=5AYMXW5FKQUQ type=del 2023-12-03T11:32:43.847 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.846+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~N95KNDLGJOC1.0 size=600376 2023-12-03T11:32:43.847 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.846+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=N95KNDLGJOC1 tag=YZ1FJZUDGASA type=write size=1648952 2023-12-03T11:32:43.848 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.847+0000 7f4d50c67780 1 < completed delete operation key=GTLP2WZUX7U8 tag=RYY5NHCGSMHV type=del 2023-12-03T11:32:43.850 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.849+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~TPRB2GM4QKU3.0 size=1048576 2023-12-03T11:32:43.851 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.850+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~TPRB2GM4QKU3.1 size=106303 2023-12-03T11:32:43.851 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.850+0000 7f4d50c67780 1 > prepared multipart upload key=TOGV2BZ99FRF upload=TPRB2GM4QKU3 tag=WULWJ1VXUKS4 type=write size=2203455 2023-12-03T11:32:43.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.852+0000 7f4d50c67780 1 < suggested remove operation key=52E31L45TN7V tag=CL8Y8649U1FD type=write 2023-12-03T11:32:43.855 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.855+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~OJ7RPJ70H6A8.0 size=382830 2023-12-03T11:32:43.856 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.855+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=OJ7RPJ70H6A8 tag=AM5JQ2ZNBIBB type=write size=1431406 2023-12-03T11:32:43.857 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.856+0000 7f4d50c67780 1 < completed delete operation key=V0ND3OBFJJUB tag=ADYGM5D75RLC type=del 2023-12-03T11:32:43.858 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.857+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=54VHO3Z0BL87 type=del size=3494526 2023-12-03T11:32:43.859 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.858+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~RMH0DJ2YYG0R.0 size=1048576 2023-12-03T11:32:43.860 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.859+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~RMH0DJ2YYG0R.1 size=1048576 2023-12-03T11:32:43.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.860+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~RMH0DJ2YYG0R.2 size=666066 2023-12-03T11:32:43.863 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.862+0000 7f4d50c67780 1 < completed multipart upload key=WUM939BATDG9 upload=RMH0DJ2YYG0R tag=0PALQ73W8CCR type=write size=3811794 2023-12-03T11:32:43.865 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.864+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=F5Y17VPDI9U8 type=del size=3459939 2023-12-03T11:32:43.866 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.865+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~CBM26GY2V26F.0 size=497889 2023-12-03T11:32:43.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.867+0000 7f4d50c67780 1 < completed multipart upload key=YDRAH5EE39R4 upload=CBM26GY2V26F tag=A8Y8GV1EBM48 type=write size=1546465 2023-12-03T11:32:43.869 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.868+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=E89NYONCAYKL type=del size=1841338 2023-12-03T11:32:43.870 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.869+0000 7f4d50c67780 1 < canceled part key=_multipart_QQDBWLVSXIHP.2~8PWG0TEH9AGJ.0 size=274959 2023-12-03T11:32:43.871 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.871+0000 7f4d50c67780 1 < canceled multipart upload key=QQDBWLVSXIHP upload=8PWG0TEH9AGJ tag=BVXNLXLBLGVF type=write size=1323535 2023-12-03T11:32:43.873 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.872+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=OOIUNIZQ6C43 type=write size=880549 2023-12-03T11:32:43.874 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.873+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~6JAYTW1ROEE8.0 size=1048576 2023-12-03T11:32:43.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.874+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~6JAYTW1ROEE8.1 size=919541 2023-12-03T11:32:43.877 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.876+0000 7f4d50c67780 1 < completed multipart upload key=TEIYINZFFG76 upload=6JAYTW1ROEE8 tag=85P9ZFVCGGOU type=write size=3016693 2023-12-03T11:32:43.882 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.878+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~ROIW5STKO8V1.0 size=1048576 2023-12-03T11:32:43.882 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.880+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~ROIW5STKO8V1.1 size=291381 2023-12-03T11:32:43.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.880+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=ROIW5STKO8V1 tag=UJ0YC6CS5IP8 type=write size=2388533 2023-12-03T11:32:43.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.881+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=K4293JC5ONXV type=del 2023-12-03T11:32:43.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.883+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~SBO1B0742S7A.0 size=1048576 2023-12-03T11:32:43.885 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.884+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~SBO1B0742S7A.1 size=1048576 2023-12-03T11:32:43.886 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.885+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~SBO1B0742S7A.2 size=688382 2023-12-03T11:32:43.886 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.885+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=SBO1B0742S7A tag=BYG78F71Q4MY type=write size=3834110 2023-12-03T11:32:43.887 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.886+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~7OMXV5VKUP4Q.0 size=1048576 2023-12-03T11:32:43.888 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.887+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~7OMXV5VKUP4Q.1 size=1048576 2023-12-03T11:32:43.889 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.888+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~7OMXV5VKUP4Q.2 size=1047394 2023-12-03T11:32:43.891 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.891+0000 7f4d50c67780 1 < completed multipart upload key=73SL3ZBBDA6Q upload=7OMXV5VKUP4Q tag=N2AAW0PQGA42 type=write size=4193122 2023-12-03T11:32:43.893 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.892+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=8CI48AFKQMY6 type=del size=3291051 2023-12-03T11:32:43.894 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.893+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~MMFK9MHX94UW.0 size=1048576 2023-12-03T11:32:43.895 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.894+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~MMFK9MHX94UW.1 size=1048576 2023-12-03T11:32:43.896 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.895+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~MMFK9MHX94UW.2 size=102972 2023-12-03T11:32:43.898 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.897+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=MMFK9MHX94UW tag=J2XZPXSUSIVC type=write size=3248700 2023-12-03T11:32:43.902 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.901+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~7F7PNUUJUY1I.0 size=1048576 2023-12-03T11:32:43.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.902+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~7F7PNUUJUY1I.1 size=1048576 2023-12-03T11:32:43.904 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.903+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~7F7PNUUJUY1I.2 size=612519 2023-12-03T11:32:43.904 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.903+0000 7f4d50c67780 1 > prepared multipart upload key=U6R5Y9JXKT32 upload=7F7PNUUJUY1I tag=3B6M2PB92ADX type=write size=3758247 2023-12-03T11:32:43.906 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.906+0000 7f4d50c67780 1 < suggested remove operation key=CQPZ0X62207Z tag=J0WO3NRHIVFB type=del 2023-12-03T11:32:43.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.907+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=DU6RK9RG36MQ type=del size=3790448 2023-12-03T11:32:43.909 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.908+0000 7f4d50c67780 1 < canceled operation key=G0O8EC405LYM tag=ISLZG036MN84 type=del size=1793842 2023-12-03T11:32:43.910 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.909+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=LTZACBUPXAVK type=write size=607438 2023-12-03T11:32:43.911 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.911+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~ZFEOXAVRV5AQ.0 size=1048576 2023-12-03T11:32:43.912 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.912+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~ZFEOXAVRV5AQ.1 size=741169 2023-12-03T11:32:43.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.914+0000 7f4d50c67780 1 < completed multipart upload key=TEIYINZFFG76 upload=ZFEOXAVRV5AQ tag=S3CV2BCH1ZYQ type=write size=2838321 2023-12-03T11:32:43.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.916+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~6RP0WWH76SZ2.0 size=1048576 2023-12-03T11:32:43.918 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.917+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~6RP0WWH76SZ2.1 size=1048576 2023-12-03T11:32:43.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.918+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~6RP0WWH76SZ2.2 size=598466 2023-12-03T11:32:43.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.918+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=6RP0WWH76SZ2 tag=VQQIE02FVUBN type=write size=3744194 2023-12-03T11:32:43.920 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.919+0000 7f4d50c67780 1 < canceled operation key=K7YVVH7SAKMC tag=RH3JPXJSAIAB type=del size=154457 2023-12-03T11:32:43.923 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.922+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~D95ML61QWYR2.0 size=1048576 2023-12-03T11:32:43.924 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.923+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~D95ML61QWYR2.1 size=67801 2023-12-03T11:32:43.924 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.923+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=D95ML61QWYR2 tag=YW56RZNZ4L6P type=write size=2164953 2023-12-03T11:32:43.924 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.923+0000 7f4d50c67780 -1 < no bi entry to suggest for operation key=CQPZ0X62207Z tag=DXI8QOF5OVCB type=del size=2513446: (2) No such file or directory 2023-12-03T11:32:43.926 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.925+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~WFPO2C4F5GDS.0 size=484346 2023-12-03T11:32:43.927 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.925+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=WFPO2C4F5GDS tag=8KV2DMKRN4FS type=write size=1532922 2023-12-03T11:32:43.927 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.927+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~N95KNDLGJOC1.0 size=600376 2023-12-03T11:32:43.930 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.929+0000 7f4d50c67780 1 < completed multipart upload key=WUM939BATDG9 upload=N95KNDLGJOC1 tag=YZ1FJZUDGASA type=write size=1648952 2023-12-03T11:32:43.931 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.930+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=R24DR6Y9E0PY type=del size=579995 2023-12-03T11:32:43.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.931+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~TPRB2GM4QKU3.0 size=1048576 2023-12-03T11:32:43.933 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.932+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~TPRB2GM4QKU3.1 size=106303 2023-12-03T11:32:43.935 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.934+0000 7f4d50c67780 1 < completed multipart upload key=TOGV2BZ99FRF upload=TPRB2GM4QKU3 tag=WULWJ1VXUKS4 type=write size=2203455 2023-12-03T11:32:43.937 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.936+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=MVICOYF7ELSY type=del size=2043025 2023-12-03T11:32:43.938 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.937+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~OJ7RPJ70H6A8.0 size=382830 2023-12-03T11:32:43.940 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.939+0000 7f4d50c67780 1 < completed multipart upload key=EAP0BYZTTT2E upload=OJ7RPJ70H6A8 tag=AM5JQ2ZNBIBB type=write size=1431406 2023-12-03T11:32:43.941 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.940+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=D02F2W5SVX2A type=del size=2120519 2023-12-03T11:32:43.942 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.942+0000 7f4d50c67780 1 < completed delete operation key=V0ND3OBFJJUB tag=54VHO3Z0BL87 type=del 2023-12-03T11:32:43.944 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.943+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=LCVFO2G2AUXX type=del size=2607397 2023-12-03T11:32:43.945 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.944+0000 7f4d50c67780 1 < completed delete operation key=V0ND3OBFJJUB tag=F5Y17VPDI9U8 type=del 2023-12-03T11:32:43.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.946+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=NL83O7N6C7TK type=del size=646552 2023-12-03T11:32:43.950 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.949+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=E89NYONCAYKL type=del 2023-12-03T11:32:43.953 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.952+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=NZ2B9RVBYTDP type=del size=2665775 2023-12-03T11:32:43.955 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.954+0000 7f4d50c67780 1 < suggested update operation key=V0ND3OBFJJUB tag=OOIUNIZQ6C43 type=write size=880549 2023-12-03T11:32:43.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.957+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~YNTGR7EP3DG8.0 size=1048576 2023-12-03T11:32:43.959 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.958+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~YNTGR7EP3DG8.1 size=48792 2023-12-03T11:32:43.959 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.958+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=YNTGR7EP3DG8 tag=DVLAUI6VNUHE type=write size=2145944 2023-12-03T11:32:43.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.959+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~ROIW5STKO8V1.0 size=1048576 2023-12-03T11:32:43.961 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.960+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~ROIW5STKO8V1.1 size=291381 2023-12-03T11:32:43.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.962+0000 7f4d50c67780 1 < completed multipart upload key=EH4B2QP1C42H upload=ROIW5STKO8V1 tag=UJ0YC6CS5IP8 type=write size=2388533 2023-12-03T11:32:43.965 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.964+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~OZU9HMQEALB1.0 size=743364 2023-12-03T11:32:43.965 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.964+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=OZU9HMQEALB1 tag=N51QV29AGQPI type=write size=1791940 2023-12-03T11:32:43.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.965+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~SBO1B0742S7A.0 size=1048576 2023-12-03T11:32:43.967 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.966+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~SBO1B0742S7A.1 size=1048576 2023-12-03T11:32:43.968 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.967+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~SBO1B0742S7A.2 size=688382 2023-12-03T11:32:43.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.969+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=SBO1B0742S7A tag=BYG78F71Q4MY type=write size=3834110 2023-12-03T11:32:43.971 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.971+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=QK5E990UA06Q type=del size=4103238 2023-12-03T11:32:43.973 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.972+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=8CI48AFKQMY6 type=del 2023-12-03T11:32:43.974 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.973+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=C56DKX3LRYV1 type=del size=2963978 2023-12-03T11:32:43.975 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.974+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~7F7PNUUJUY1I.0 size=1048576 2023-12-03T11:32:43.975 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.974+0000 7f4d50c67780 1 < canceled part key=_multipart_U6R5Y9JXKT32.2~7F7PNUUJUY1I.1 size=1048576 2023-12-03T11:32:43.976 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.975+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~7F7PNUUJUY1I.2 size=612519 2023-12-03T11:32:43.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.977+0000 7f4d50c67780 1 < canceled multipart upload key=U6R5Y9JXKT32 upload=7F7PNUUJUY1I tag=3B6M2PB92ADX type=write size=3758247 2023-12-03T11:32:43.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.978+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=D4787K6EGKHO type=write size=670323 2023-12-03T11:32:43.981 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.980+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=DU6RK9RG36MQ type=del 2023-12-03T11:32:43.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.982+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~RPOEB1JVSA0C.0 size=1048576 2023-12-03T11:32:43.984 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.983+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~RPOEB1JVSA0C.1 size=422377 2023-12-03T11:32:43.984 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.983+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=RPOEB1JVSA0C tag=2L72I5RSX2SL type=write size=2519529 2023-12-03T11:32:43.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.986+0000 7f4d50c67780 1 < suggested remove operation key=0M6ZAD39I852 tag=LTZACBUPXAVK type=write 2023-12-03T11:32:43.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.987+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=JA2LROO0CV9B type=del size=2696529 2023-12-03T11:32:43.989 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.988+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~6RP0WWH76SZ2.0 size=1048576 2023-12-03T11:32:43.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.989+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~6RP0WWH76SZ2.1 size=1048576 2023-12-03T11:32:43.991 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.990+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~6RP0WWH76SZ2.2 size=598466 2023-12-03T11:32:43.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.992+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=6RP0WWH76SZ2 tag=VQQIE02FVUBN type=write size=3744194 2023-12-03T11:32:43.995 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.994+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~J1VOD6LI6X5B.0 size=1048576 2023-12-03T11:32:43.996 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.995+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~J1VOD6LI6X5B.1 size=963452 2023-12-03T11:32:43.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.995+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=J1VOD6LI6X5B tag=ZXUWNNDGTNH5 type=write size=3060604 2023-12-03T11:32:43.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.997+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~D95ML61QWYR2.0 size=1048576 2023-12-03T11:32:43.999 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:43.998+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~D95ML61QWYR2.1 size=67801 2023-12-03T11:32:44.001 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.000+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=D95ML61QWYR2 tag=YW56RZNZ4L6P type=write size=2164953 2023-12-03T11:32:44.003 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.002+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~DLOIGC5OYW5V.0 size=1048576 2023-12-03T11:32:44.004 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.003+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~DLOIGC5OYW5V.1 size=1048576 2023-12-03T11:32:44.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.004+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~DLOIGC5OYW5V.2 size=226351 2023-12-03T11:32:44.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.004+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=DLOIGC5OYW5V tag=0DQ8Y2QS2SF4 type=write size=3372079 2023-12-03T11:32:44.006 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.005+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~WFPO2C4F5GDS.0 size=484346 2023-12-03T11:32:44.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.007+0000 7f4d50c67780 1 < completed multipart upload key=WUM939BATDG9 upload=WFPO2C4F5GDS tag=8KV2DMKRN4FS type=write size=1532922 2023-12-03T11:32:44.009 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.008+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=E2A3D54WKWMG type=del size=2535982 2023-12-03T11:32:44.010 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.009+0000 7f4d50c67780 1 < canceled operation key=EX93BYX10WJB tag=R24DR6Y9E0PY type=del size=579995 2023-12-03T11:32:44.012 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.011+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=H8B7Z7R6G9IC type=write size=642446 2023-12-03T11:32:44.013 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.012+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=MVICOYF7ELSY type=del 2023-12-03T11:32:44.014 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.013+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=AA0EWUQ1YVYM type=del size=142765 2023-12-03T11:32:44.016 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.015+0000 7f4d50c67780 1 < completed delete operation key=MLKGLDFFDC3W tag=D02F2W5SVX2A type=del 2023-12-03T11:32:44.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.017+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~HDJB3GE1JX9D.0 size=1048576 2023-12-03T11:32:44.019 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.018+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~HDJB3GE1JX9D.1 size=677537 2023-12-03T11:32:44.019 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.018+0000 7f4d50c67780 1 > prepared multipart upload key=TEIYINZFFG76 upload=HDJB3GE1JX9D tag=FKCHQHS38XPI type=write size=2774689 2023-12-03T11:32:44.021 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.020+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=LCVFO2G2AUXX type=del 2023-12-03T11:32:44.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.022+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=K3XKS36110CA type=write size=795680 2023-12-03T11:32:44.025 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.024+0000 7f4d50c67780 1 < suggested update operation key=GTLP2WZUX7U8 tag=NL83O7N6C7TK type=del size=646552 2023-12-03T11:32:44.026 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.025+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=CW4OAY0B1BRN type=del size=2955458 2023-12-03T11:32:44.028 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.027+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=NZ2B9RVBYTDP type=del 2023-12-03T11:32:44.029 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.028+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=WT8HYMCYO1JT type=write size=215406 2023-12-03T11:32:44.030 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.029+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~YNTGR7EP3DG8.0 size=1048576 2023-12-03T11:32:44.031 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.030+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~YNTGR7EP3DG8.1 size=48792 2023-12-03T11:32:44.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.032+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=YNTGR7EP3DG8 tag=DVLAUI6VNUHE type=write size=2145944 2023-12-03T11:32:44.034 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.034+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=BS5ZWSN08GKL type=del size=3966523 2023-12-03T11:32:44.036 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.035+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~OZU9HMQEALB1.0 size=743364 2023-12-03T11:32:44.038 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.037+0000 7f4d50c67780 1 < completed multipart upload key=CQPZ0X62207Z upload=OZU9HMQEALB1 tag=N51QV29AGQPI type=write size=1791940 2023-12-03T11:32:44.039 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.038+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=C3D61GBHX37Z type=write size=356140 2023-12-03T11:32:44.041 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.040+0000 7f4d50c67780 1 < suggested remove operation key=TOGV2BZ99FRF tag=QK5E990UA06Q type=del 2023-12-03T11:32:44.043 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.042+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=NO7NF89VDO0H type=del size=3834493 2023-12-03T11:32:44.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.044+0000 7f4d50c67780 1 < suggested update operation key=0M6ZAD39I852 tag=C56DKX3LRYV1 type=del size=2963978 2023-12-03T11:32:44.046 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.045+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=PZWXNJST3IJP type=del size=4055694 2023-12-03T11:32:44.048 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.047+0000 7f4d50c67780 1 < completed write operation key=EY1RBO15PCRR tag=D4787K6EGKHO type=write size=670323 2023-12-03T11:32:44.050 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.049+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~RUDTCFZ00062.0 size=1048576 2023-12-03T11:32:44.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.050+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~RUDTCFZ00062.1 size=544363 2023-12-03T11:32:44.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.050+0000 7f4d50c67780 1 > prepared multipart upload key=ULLPV2G10BME upload=RUDTCFZ00062 tag=YLN8YKP0AZM2 type=write size=2641515 2023-12-03T11:32:44.052 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.051+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~RPOEB1JVSA0C.0 size=1048576 2023-12-03T11:32:44.053 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.052+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~RPOEB1JVSA0C.1 size=422377 2023-12-03T11:32:44.055 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.054+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=RPOEB1JVSA0C tag=2L72I5RSX2SL type=write size=2519529 2023-12-03T11:32:44.057 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.056+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=08BMXX3JTRUQ type=write size=741718 2023-12-03T11:32:44.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.057+0000 7f4d50c67780 -1 < failed to complete operation key=0M6ZAD39I852 tag=JA2LROO0CV9B type=del size=2696529: (22) Invalid argument 2023-12-03T11:32:44.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.059+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~30HJB8JH9EWS.0 size=121361 2023-12-03T11:32:44.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.059+0000 7f4d50c67780 1 > prepared multipart upload key=QQDBWLVSXIHP upload=30HJB8JH9EWS tag=EBVGF3JUT6HK type=write size=1169937 2023-12-03T11:32:44.062 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.061+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~J1VOD6LI6X5B.0 size=1048576 2023-12-03T11:32:44.063 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.062+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~J1VOD6LI6X5B.1 size=963452 2023-12-03T11:32:44.065 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.064+0000 7f4d50c67780 1 < completed multipart upload key=K7YVVH7SAKMC upload=J1VOD6LI6X5B tag=ZXUWNNDGTNH5 type=write size=3060604 2023-12-03T11:32:44.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.065+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=7WK3YIO1IFOZ type=del size=1057115 2023-12-03T11:32:44.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.067+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~DLOIGC5OYW5V.0 size=1048576 2023-12-03T11:32:44.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.067+0000 7f4d50c67780 1 < canceled part key=_multipart_0M6ZAD39I852.2~DLOIGC5OYW5V.1 size=1048576 2023-12-03T11:32:44.068 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.067+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~DLOIGC5OYW5V.2 size=226351 2023-12-03T11:32:44.071 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.070+0000 7f4d50c67780 1 < canceled multipart upload key=0M6ZAD39I852 upload=DLOIGC5OYW5V tag=0DQ8Y2QS2SF4 type=write size=3372079 2023-12-03T11:32:44.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.072+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~3I7H2TCURIZ1.0 size=1048576 2023-12-03T11:32:44.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.073+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~3I7H2TCURIZ1.1 size=1048576 2023-12-03T11:32:44.075 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.074+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~3I7H2TCURIZ1.2 size=221548 2023-12-03T11:32:44.075 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.074+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=3I7H2TCURIZ1 tag=NPYU7NLL15YU type=write size=3367276 2023-12-03T11:32:44.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.075+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=E2A3D54WKWMG type=del 2023-12-03T11:32:44.078 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.077+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=BBSG80GKGYMC type=del size=3248010 2023-12-03T11:32:44.079 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.078+0000 7f4d50c67780 1 < completed write operation key=RF2Q24GI24HJ tag=H8B7Z7R6G9IC type=write size=642446 2023-12-03T11:32:44.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.079+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=C93CAN4HN4QN type=del size=2694074 2023-12-03T11:32:44.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.080+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=AA0EWUQ1YVYM type=del 2023-12-03T11:32:44.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.082+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=VGKK7FX1ORV4 type=del size=3161627 2023-12-03T11:32:44.084 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.083+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~HDJB3GE1JX9D.0 size=1048576 2023-12-03T11:32:44.084 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.083+0000 7f4d50c67780 1 < canceled part key=_multipart_TEIYINZFFG76.2~HDJB3GE1JX9D.1 size=677537 2023-12-03T11:32:44.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.085+0000 7f4d50c67780 1 < canceled multipart upload key=TEIYINZFFG76 upload=HDJB3GE1JX9D tag=FKCHQHS38XPI type=write size=2774689 2023-12-03T11:32:44.088 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.087+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~UJNGCPC39XFA.0 size=823127 2023-12-03T11:32:44.088 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.087+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=UJNGCPC39XFA tag=VNG40CY81Z8E type=write size=1871703 2023-12-03T11:32:44.089 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.088+0000 7f4d50c67780 1 < completed write operation key=QQDBWLVSXIHP tag=K3XKS36110CA type=write size=795680 2023-12-03T11:32:44.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.090+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=1HOKH0DA6GVU type=del size=2956362 2023-12-03T11:32:44.092 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.091+0000 7f4d50c67780 1 < completed delete operation key=EH4B2QP1C42H tag=CW4OAY0B1BRN type=del 2023-12-03T11:32:44.094 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.093+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=M2PCCGRR38XD type=del size=3471995 2023-12-03T11:32:44.095 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.094+0000 7f4d50c67780 1 < completed write operation key=02W4TX7ZCDI6 tag=WT8HYMCYO1JT type=write size=215406 2023-12-03T11:32:44.098 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.097+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~LW4KTKYTIT1V.0 size=1048576 2023-12-03T11:32:44.099 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.098+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~LW4KTKYTIT1V.1 size=137113 2023-12-03T11:32:44.099 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.098+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=LW4KTKYTIT1V tag=ES0PE8GDBGLT type=write size=2234265 2023-12-03T11:32:44.100 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.099+0000 7f4d50c67780 1 < completed delete operation key=MLKGLDFFDC3W tag=BS5ZWSN08GKL type=del 2023-12-03T11:32:44.102 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.101+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=UCOTGJCFL7SA type=del size=1715882 2023-12-03T11:32:44.105 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.104+0000 7f4d50c67780 1 < suggested remove operation key=QQDBWLVSXIHP tag=C3D61GBHX37Z type=write 2023-12-03T11:32:44.107 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.106+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~2RCYSLJDCFFP.0 size=73498 2023-12-03T11:32:44.107 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.106+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=2RCYSLJDCFFP tag=DPBS585FGF9G type=write size=1122074 2023-12-03T11:32:44.108 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.107+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=NO7NF89VDO0H type=del 2023-12-03T11:32:44.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.109+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=X7FL2RV8AYXA type=del size=731842 2023-12-03T11:32:44.111 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.110+0000 7f4d50c67780 -1 < failed to complete operation key=QQDBWLVSXIHP tag=PZWXNJST3IJP type=del size=4055694: (22) Invalid argument 2023-12-03T11:32:44.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.111+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=Z874IH1TARWO type=del size=967879 2023-12-03T11:32:44.113 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.113+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~RUDTCFZ00062.0 size=1048576 2023-12-03T11:32:44.113 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.113+0000 7f4d50c67780 1 < canceled part key=_multipart_ULLPV2G10BME.2~RUDTCFZ00062.1 size=544363 2023-12-03T11:32:44.115 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.115+0000 7f4d50c67780 1 < canceled multipart upload key=ULLPV2G10BME upload=RUDTCFZ00062 tag=YLN8YKP0AZM2 type=write size=2641515 2023-12-03T11:32:44.118 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.117+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~WF2INSCT37WC.0 size=238277 2023-12-03T11:32:44.118 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.117+0000 7f4d50c67780 1 > prepared multipart upload key=QQDBWLVSXIHP upload=WF2INSCT37WC tag=HQRBMH94PYVP type=write size=1286853 2023-12-03T11:32:44.119 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.118+0000 7f4d50c67780 1 < completed write operation key=G0O8EC405LYM tag=08BMXX3JTRUQ type=write size=741718 2023-12-03T11:32:44.120 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.119+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=EB1TCMRV4TBU type=del size=50440 2023-12-03T11:32:44.121 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.120+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~30HJB8JH9EWS.0 size=121361 2023-12-03T11:32:44.123 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.122+0000 7f4d50c67780 1 < completed multipart upload key=QQDBWLVSXIHP upload=30HJB8JH9EWS tag=EBVGF3JUT6HK type=write size=1169937 2023-12-03T11:32:44.124 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.123+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=XPW3U0AJ7FI8 type=del size=2079948 2023-12-03T11:32:44.127 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.126+0000 7f4d50c67780 1 < suggested remove operation key=XM5E3D99MXVA tag=7WK3YIO1IFOZ type=del 2023-12-03T11:32:44.129 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.128+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~S4SMX6PGRJMN.0 size=484701 2023-12-03T11:32:44.129 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.128+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=S4SMX6PGRJMN tag=0SI6ZQ1ONOGO type=write size=1533277 2023-12-03T11:32:44.130 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.129+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~3I7H2TCURIZ1.0 size=1048576 2023-12-03T11:32:44.131 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.130+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~3I7H2TCURIZ1.1 size=1048576 2023-12-03T11:32:44.132 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.131+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~3I7H2TCURIZ1.2 size=221548 2023-12-03T11:32:44.134 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.133+0000 7f4d50c67780 1 < completed multipart upload key=EH4B2QP1C42H upload=3I7H2TCURIZ1 tag=NPYU7NLL15YU type=write size=3367276 2023-12-03T11:32:44.136 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.135+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~Q3SDHNHU1QEE.0 size=1048576 2023-12-03T11:32:44.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.136+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~Q3SDHNHU1QEE.1 size=1002023 2023-12-03T11:32:44.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.136+0000 7f4d50c67780 1 > prepared multipart upload key=ZE19S5UCCZ3C upload=Q3SDHNHU1QEE tag=MOEQBFLFO9K3 type=write size=3099175 2023-12-03T11:32:44.139 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.138+0000 7f4d50c67780 1 < completed delete operation key=MLKGLDFFDC3W tag=BBSG80GKGYMC type=del 2023-12-03T11:32:44.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.141+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~5GAFQRQ1H37H.0 size=1048576 2023-12-03T11:32:44.143 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.142+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~5GAFQRQ1H37H.1 size=1048576 2023-12-03T11:32:44.144 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.143+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~5GAFQRQ1H37H.2 size=997712 2023-12-03T11:32:44.144 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.143+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=5GAFQRQ1H37H tag=3J923X7AT3NP type=write size=4143440 2023-12-03T11:32:44.145 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.144+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=C93CAN4HN4QN type=del 2023-12-03T11:32:44.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.145+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=5SSWS3A6TAOT type=write size=460966 2023-12-03T11:32:44.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.147+0000 7f4d50c67780 1 < completed delete operation key=7C7UX0231SHV tag=VGKK7FX1ORV4 type=del 2023-12-03T11:32:44.149 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.148+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=YVG60IZRZOG9 type=del size=314569 2023-12-03T11:32:44.149 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.149+0000 7f4d50c67780 1 < canceled part key=_multipart_WUM939BATDG9.2~UJNGCPC39XFA.0 size=823127 2023-12-03T11:32:44.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.151+0000 7f4d50c67780 1 < canceled multipart upload key=WUM939BATDG9 upload=UJNGCPC39XFA tag=VNG40CY81Z8E type=write size=1871703 2023-12-03T11:32:44.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.153+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~BXI8YMFPMX7O.0 size=1048576 2023-12-03T11:32:44.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.154+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~BXI8YMFPMX7O.1 size=1048576 2023-12-03T11:32:44.158 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.155+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~BXI8YMFPMX7O.2 size=402816 2023-12-03T11:32:44.158 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.155+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=BXI8YMFPMX7O tag=ZPFHTVZZO05D type=write size=3548544 2023-12-03T11:32:44.158 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.156+0000 7f4d50c67780 1 < completed delete operation key=EAP0BYZTTT2E tag=1HOKH0DA6GVU type=del 2023-12-03T11:32:44.158 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.157+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=TZE8435GFW2Y type=del size=3366441 2023-12-03T11:32:44.159 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.158+0000 7f4d50c67780 -1 < failed to complete operation key=QQDBWLVSXIHP tag=M2PCCGRR38XD type=del size=3471995: (22) Invalid argument 2023-12-03T11:32:44.160 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.160+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=2KV9DQ6BNTNU type=del size=3042760 2023-12-03T11:32:44.162 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.161+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~LW4KTKYTIT1V.0 size=1048576 2023-12-03T11:32:44.162 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.161+0000 7f4d50c67780 1 < canceled part key=_multipart_02W4TX7ZCDI6.2~LW4KTKYTIT1V.1 size=137113 2023-12-03T11:32:44.164 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.163+0000 7f4d50c67780 1 < canceled multipart upload key=02W4TX7ZCDI6 upload=LW4KTKYTIT1V tag=ES0PE8GDBGLT type=write size=2234265 2023-12-03T11:32:44.165 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.164+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=26UW8L6R3VJL type=del size=1659599 2023-12-03T11:32:44.167 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.166+0000 7f4d50c67780 1 < suggested update operation key=CQPZ0X62207Z tag=UCOTGJCFL7SA type=del size=1715882 2023-12-03T11:32:44.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.167+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=7DNPHFBK9LS2 type=del size=429486 2023-12-03T11:32:44.169 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.169+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~2RCYSLJDCFFP.0 size=73498 2023-12-03T11:32:44.171 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.170+0000 7f4d50c67780 1 < completed multipart upload key=EH4B2QP1C42H upload=2RCYSLJDCFFP tag=DPBS585FGF9G type=write size=1122074 2023-12-03T11:32:44.173 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.172+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~GT7XM5626LLB.0 size=1048576 2023-12-03T11:32:44.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.173+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~GT7XM5626LLB.1 size=962838 2023-12-03T11:32:44.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.173+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=GT7XM5626LLB tag=KV0A0S9831UX type=write size=3059990 2023-12-03T11:32:44.175 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.175+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=X7FL2RV8AYXA type=del 2023-12-03T11:32:44.178 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.177+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~NVMZMAZ254VC.0 size=1048576 2023-12-03T11:32:44.179 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.178+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~NVMZMAZ254VC.1 size=1048576 2023-12-03T11:32:44.179 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.179+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~NVMZMAZ254VC.2 size=491511 2023-12-03T11:32:44.180 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.179+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=NVMZMAZ254VC tag=78L7Y3ZBQD23 type=write size=3637239 2023-12-03T11:32:44.181 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.180+0000 7f4d50c67780 -1 < failed to complete operation key=CQPZ0X62207Z tag=Z874IH1TARWO type=del size=967879: (22) Invalid argument 2023-12-03T11:32:44.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.181+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=0BICQ5NMJ07A type=del size=1740516 2023-12-03T11:32:44.183 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.182+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~WF2INSCT37WC.0 size=238277 2023-12-03T11:32:44.185 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.184+0000 7f4d50c67780 1 < completed multipart upload key=QQDBWLVSXIHP upload=WF2INSCT37WC tag=HQRBMH94PYVP type=write size=1286853 2023-12-03T11:32:44.186 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.186+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=P1OKL4XOR8S5 type=write size=59143 2023-12-03T11:32:44.188 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.187+0000 7f4d50c67780 1 < completed delete operation key=ZE19S5UCCZ3C tag=EB1TCMRV4TBU type=del 2023-12-03T11:32:44.189 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.188+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=ERVOO9J94T3Q type=del size=537046 2023-12-03T11:32:44.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.189+0000 7f4d50c67780 1 < completed delete operation key=0M6ZAD39I852 tag=XPW3U0AJ7FI8 type=del 2023-12-03T11:32:44.191 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.191+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=0BTGHRU5MBAC type=del size=2581958 2023-12-03T11:32:44.193 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.192+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~S4SMX6PGRJMN.0 size=484701 2023-12-03T11:32:44.194 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.194+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=S4SMX6PGRJMN tag=0SI6ZQ1ONOGO type=write size=1533277 2023-12-03T11:32:44.196 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.195+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=GIGWGZ9OXYZ0 type=del size=3753532 2023-12-03T11:32:44.197 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.196+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~Q3SDHNHU1QEE.0 size=1048576 2023-12-03T11:32:44.198 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.197+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~Q3SDHNHU1QEE.1 size=1002023 2023-12-03T11:32:44.200 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.199+0000 7f4d50c67780 1 < completed multipart upload key=ZE19S5UCCZ3C upload=Q3SDHNHU1QEE tag=MOEQBFLFO9K3 type=write size=3099175 2023-12-03T11:32:44.201 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.200+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=0MZD86TC0445 type=del size=2896208 2023-12-03T11:32:44.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.201+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~5GAFQRQ1H37H.0 size=1048576 2023-12-03T11:32:44.203 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.202+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~5GAFQRQ1H37H.1 size=1048576 2023-12-03T11:32:44.204 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.203+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~5GAFQRQ1H37H.2 size=997712 2023-12-03T11:32:44.206 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.205+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=5GAFQRQ1H37H tag=3J923X7AT3NP type=write size=4143440 2023-12-03T11:32:44.208 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.207+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~S3F1DEKEC0ZT.0 size=1048576 2023-12-03T11:32:44.209 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.208+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~S3F1DEKEC0ZT.1 size=382686 2023-12-03T11:32:44.210 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.208+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=S3F1DEKEC0ZT tag=71GIZKS6O1CZ type=write size=2479838 2023-12-03T11:32:44.210 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.209+0000 7f4d50c67780 1 < completed write operation key=XM5E3D99MXVA tag=5SSWS3A6TAOT type=write size=460966 2023-12-03T11:32:44.213 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.212+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~V2072QMOXS6C.0 size=1048576 2023-12-03T11:32:44.214 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.213+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~V2072QMOXS6C.1 size=1048576 2023-12-03T11:32:44.214 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.214+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~V2072QMOXS6C.2 size=256208 2023-12-03T11:32:44.215 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.214+0000 7f4d50c67780 1 > prepared multipart upload key=TOGV2BZ99FRF upload=V2072QMOXS6C tag=B12SI2M9FIZ8 type=write size=3401936 2023-12-03T11:32:44.217 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.216+0000 7f4d50c67780 1 < suggested remove operation key=K7YVVH7SAKMC tag=YVG60IZRZOG9 type=del 2023-12-03T11:32:44.219 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.219+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~3ATAFJFMQSUS.0 size=674582 2023-12-03T11:32:44.220 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.219+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=3ATAFJFMQSUS tag=HVW86UVVSHMJ type=write size=1723158 2023-12-03T11:32:44.221 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.220+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~BXI8YMFPMX7O.0 size=1048576 2023-12-03T11:32:44.221 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.220+0000 7f4d50c67780 1 < canceled part key=_multipart_7C7UX0231SHV.2~BXI8YMFPMX7O.1 size=1048576 2023-12-03T11:32:44.222 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.221+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~BXI8YMFPMX7O.2 size=402816 2023-12-03T11:32:44.224 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.223+0000 7f4d50c67780 1 < canceled multipart upload key=7C7UX0231SHV upload=BXI8YMFPMX7O tag=ZPFHTVZZO05D type=write size=3548544 2023-12-03T11:32:44.225 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.225+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=RIG1E62Z7LBL type=write size=377338 2023-12-03T11:32:44.227 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.226+0000 7f4d50c67780 1 < canceled operation key=EH4B2QP1C42H tag=TZE8435GFW2Y type=del size=3366441 2023-12-03T11:32:44.228 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.227+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=VGWWPGC1OVWK type=del size=2307975 2023-12-03T11:32:44.230 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.230+0000 7f4d50c67780 1 < suggested remove operation key=8J1EO2JDQUQH tag=2KV9DQ6BNTNU type=del 2023-12-03T11:32:44.232 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.231+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=TPKY20U2V1XG type=del size=2743445 2023-12-03T11:32:44.233 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.232+0000 7f4d50c67780 1 < completed delete operation key=QQDBWLVSXIHP tag=26UW8L6R3VJL type=del 2023-12-03T11:32:44.234 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.233+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=SUB7Q3MQX0WV type=del size=1849734 2023-12-03T11:32:44.236 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.235+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=7DNPHFBK9LS2 type=del 2023-12-03T11:32:44.238 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.237+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~AU7CA4QVPCNV.0 size=1048576 2023-12-03T11:32:44.239 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.238+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~AU7CA4QVPCNV.1 size=930032 2023-12-03T11:32:44.239 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.238+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=AU7CA4QVPCNV tag=YD6SPZPVWRK3 type=write size=3027184 2023-12-03T11:32:44.240 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.239+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~GT7XM5626LLB.0 size=1048576 2023-12-03T11:32:44.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.241+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~GT7XM5626LLB.1 size=962838 2023-12-03T11:32:44.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.243+0000 7f4d50c67780 1 < completed multipart upload key=7C7UX0231SHV upload=GT7XM5626LLB tag=KV0A0S9831UX type=write size=3059990 2023-12-03T11:32:44.245 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.244+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=15SIPY5G5BG8 type=del size=1099933 2023-12-03T11:32:44.246 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.246+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~NVMZMAZ254VC.0 size=1048576 2023-12-03T11:32:44.248 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.247+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~NVMZMAZ254VC.1 size=1048576 2023-12-03T11:32:44.249 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.248+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~NVMZMAZ254VC.2 size=491511 2023-12-03T11:32:44.251 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.250+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=NVMZMAZ254VC tag=78L7Y3ZBQD23 type=write size=3637239 2023-12-03T11:32:44.253 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.252+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=PJNDG279TA02 type=write size=784109 2023-12-03T11:32:44.254 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.253+0000 7f4d50c67780 1 < completed delete operation key=WUM939BATDG9 tag=0BICQ5NMJ07A type=del 2023-12-03T11:32:44.257 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.256+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=YKQ55PVRZZQ0 type=del size=3728312 2023-12-03T11:32:44.258 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.258+0000 7f4d50c67780 1 < completed write operation key=XM5E3D99MXVA tag=P1OKL4XOR8S5 type=write size=59143 2023-12-03T11:32:44.261 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.260+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~7A422553QRFT.0 size=971884 2023-12-03T11:32:44.261 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.260+0000 7f4d50c67780 1 > prepared multipart upload key=ULLPV2G10BME upload=7A422553QRFT tag=ME8TNQIP0Z35 type=write size=2020460 2023-12-03T11:32:44.263 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.262+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=ERVOO9J94T3Q type=del 2023-12-03T11:32:44.265 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.264+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~Y193SOIMOTZK.0 size=684004 2023-12-03T11:32:44.265 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.264+0000 7f4d50c67780 1 > prepared multipart upload key=ENMJS0KEVS2S upload=Y193SOIMOTZK tag=UXMWU1K5B9S4 type=write size=1732580 2023-12-03T11:32:44.267 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.266+0000 7f4d50c67780 1 < canceled operation key=CQPZ0X62207Z tag=0BTGHRU5MBAC type=del size=2581958 2023-12-03T11:32:44.268 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.267+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=S81SH10IRHOS type=del size=277883 2023-12-03T11:32:44.269 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.269+0000 7f4d50c67780 1 < completed delete operation key=02W4TX7ZCDI6 tag=GIGWGZ9OXYZ0 type=del 2023-12-03T11:32:44.270 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.270+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=OMCWNIABYN1F type=del size=2923705 2023-12-03T11:32:44.272 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.271+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=0MZD86TC0445 type=del 2023-12-03T11:32:44.274 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.273+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~L4U5XM09ECCP.0 size=166700 2023-12-03T11:32:44.274 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.273+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=L4U5XM09ECCP tag=B1MHO5N6WHLH type=write size=1215276 2023-12-03T11:32:44.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.275+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~S3F1DEKEC0ZT.0 size=1048576 2023-12-03T11:32:44.276 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.276+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~S3F1DEKEC0ZT.1 size=382686 2023-12-03T11:32:44.278 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.278+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=S3F1DEKEC0ZT tag=71GIZKS6O1CZ type=write size=2479838 2023-12-03T11:32:44.279 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.279+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=MQCI6AOACYF6 type=del size=2519058 2023-12-03T11:32:44.281 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.280+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~V2072QMOXS6C.0 size=1048576 2023-12-03T11:32:44.282 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.281+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~V2072QMOXS6C.1 size=1048576 2023-12-03T11:32:44.283 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.282+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~V2072QMOXS6C.2 size=256208 2023-12-03T11:32:44.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.284+0000 7f4d50c67780 1 < completed multipart upload key=TOGV2BZ99FRF upload=V2072QMOXS6C tag=B12SI2M9FIZ8 type=write size=3401936 2023-12-03T11:32:44.287 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.286+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~KJ6QUU2XIZYO.0 size=1048576 2023-12-03T11:32:44.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.287+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~KJ6QUU2XIZYO.1 size=781861 2023-12-03T11:32:44.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.287+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=KJ6QUU2XIZYO tag=A21OMFYU1LY0 type=write size=2879013 2023-12-03T11:32:44.289 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.288+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~3ATAFJFMQSUS.0 size=674582 2023-12-03T11:32:44.291 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.290+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=3ATAFJFMQSUS tag=HVW86UVVSHMJ type=write size=1723158 2023-12-03T11:32:44.293 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.292+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~8E9F60U909BQ.0 size=1048576 2023-12-03T11:32:44.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.293+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~8E9F60U909BQ.1 size=993836 2023-12-03T11:32:44.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.293+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=8E9F60U909BQ tag=HGSD893ZNRBP type=write size=3090988 2023-12-03T11:32:44.296 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.295+0000 7f4d50c67780 1 < completed write operation key=73SL3ZBBDA6Q tag=RIG1E62Z7LBL type=write size=377338 2023-12-03T11:32:44.297 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.296+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=J17AA2X5GIQ9 type=del size=794220 2023-12-03T11:32:44.298 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.297+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=VGWWPGC1OVWK type=del 2023-12-03T11:32:44.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.299+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~XOCX6QDQLRC4.0 size=836986 2023-12-03T11:32:44.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.299+0000 7f4d50c67780 1 > prepared multipart upload key=TOGV2BZ99FRF upload=XOCX6QDQLRC4 tag=Z4V1QM7H7KQ3 type=write size=1885562 2023-12-03T11:32:44.301 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.301+0000 7f4d50c67780 1 < completed delete operation key=ZE19S5UCCZ3C tag=TPKY20U2V1XG type=del 2023-12-03T11:32:44.302 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.302+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=SGMQ7YX7IJZE type=del size=1949547 2023-12-03T11:32:44.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.303+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=SUB7Q3MQX0WV type=del 2023-12-03T11:32:44.306 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.305+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~BRV1503HAJHS.0 size=996625 2023-12-03T11:32:44.306 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.305+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=BRV1503HAJHS tag=L1V6FL303L21 type=write size=2045201 2023-12-03T11:32:44.307 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.306+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~AU7CA4QVPCNV.0 size=1048576 2023-12-03T11:32:44.308 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.307+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~AU7CA4QVPCNV.1 size=930032 2023-12-03T11:32:44.310 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.309+0000 7f4d50c67780 1 < completed multipart upload key=MLKGLDFFDC3W upload=AU7CA4QVPCNV tag=YD6SPZPVWRK3 type=write size=3027184 2023-12-03T11:32:44.311 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.310+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=22NSK78J6V2T type=del size=1263552 2023-12-03T11:32:44.314 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.313+0000 7f4d50c67780 1 < suggested remove operation key=TOGV2BZ99FRF tag=15SIPY5G5BG8 type=del 2023-12-03T11:32:44.316 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.315+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~PW6JXK2UPF07.0 size=359691 2023-12-03T11:32:44.316 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.315+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=PW6JXK2UPF07 tag=M6ST1Z0IUSMZ type=write size=1408267 2023-12-03T11:32:44.317 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.316+0000 7f4d50c67780 1 < canceled operation key=GTLP2WZUX7U8 tag=PJNDG279TA02 type=write size=784109 2023-12-03T11:32:44.318 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.317+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=2PP02CPPAFDO type=del size=2914628 2023-12-03T11:32:44.319 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.318+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=YKQ55PVRZZQ0 type=del 2023-12-03T11:32:44.321 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.320+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=CJP3J25W982I type=del size=1228993 2023-12-03T11:32:44.321 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.320+0000 7f4d50c67780 1 < canceled part key=_multipart_ULLPV2G10BME.2~7A422553QRFT.0 size=971884 2023-12-03T11:32:44.323 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.322+0000 7f4d50c67780 1 < canceled multipart upload key=ULLPV2G10BME upload=7A422553QRFT tag=ME8TNQIP0Z35 type=write size=2020460 2023-12-03T11:32:44.325 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.324+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~IWOGSRMOV2NA.0 size=1048576 2023-12-03T11:32:44.326 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.325+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~IWOGSRMOV2NA.1 size=1048576 2023-12-03T11:32:44.327 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.326+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~IWOGSRMOV2NA.2 size=517807 2023-12-03T11:32:44.327 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.326+0000 7f4d50c67780 1 > prepared multipart upload key=ENMJS0KEVS2S upload=IWOGSRMOV2NA tag=6OR9O21DZ0LG type=write size=3663535 2023-12-03T11:32:44.328 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.327+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~Y193SOIMOTZK.0 size=684004 2023-12-03T11:32:44.330 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.329+0000 7f4d50c67780 1 < completed multipart upload key=ENMJS0KEVS2S upload=Y193SOIMOTZK tag=UXMWU1K5B9S4 type=write size=1732580 2023-12-03T11:32:44.332 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.331+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~5T6PP1T4T8A2.0 size=1048576 2023-12-03T11:32:44.333 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.332+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~5T6PP1T4T8A2.1 size=202225 2023-12-03T11:32:44.333 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.332+0000 7f4d50c67780 1 > prepared multipart upload key=G0O8EC405LYM upload=5T6PP1T4T8A2 tag=UG2IZIC7SECE type=write size=2299377 2023-12-03T11:32:44.334 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.333+0000 7f4d50c67780 1 < completed delete operation key=QQDBWLVSXIHP tag=S81SH10IRHOS type=del 2023-12-03T11:32:44.335 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.334+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=XJT1QXVIIOHY type=del size=1472947 2023-12-03T11:32:44.336 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.336+0000 7f4d50c67780 1 < completed delete operation key=EH4B2QP1C42H tag=OMCWNIABYN1F type=del 2023-12-03T11:32:44.339 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.338+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~N3H60S25FSUY.0 size=1048576 2023-12-03T11:32:44.339 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.339+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~N3H60S25FSUY.1 size=1048576 2023-12-03T11:32:44.340 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.340+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~N3H60S25FSUY.2 size=123181 2023-12-03T11:32:44.341 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.340+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=N3H60S25FSUY tag=CPA0HEXJRH9D type=write size=3268909 2023-12-03T11:32:44.342 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.341+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~L4U5XM09ECCP.0 size=166700 2023-12-03T11:32:44.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.343+0000 7f4d50c67780 1 < completed multipart upload key=K7YVVH7SAKMC upload=L4U5XM09ECCP tag=B1MHO5N6WHLH type=write size=1215276 2023-12-03T11:32:44.346 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.345+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~X4BVG9CRSWLH.0 size=1048576 2023-12-03T11:32:44.347 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.346+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~X4BVG9CRSWLH.1 size=1048576 2023-12-03T11:32:44.348 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.347+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~X4BVG9CRSWLH.2 size=1001488 2023-12-03T11:32:44.348 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.347+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=X4BVG9CRSWLH tag=L1JPYSXF309Q type=write size=4147216 2023-12-03T11:32:44.349 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.348+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=MQCI6AOACYF6 type=del 2023-12-03T11:32:44.350 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.350+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=5EGX59JJ4UNV type=del size=594276 2023-12-03T11:32:44.352 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.351+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~KJ6QUU2XIZYO.0 size=1048576 2023-12-03T11:32:44.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.352+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~KJ6QUU2XIZYO.1 size=781861 2023-12-03T11:32:44.355 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.354+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=KJ6QUU2XIZYO tag=A21OMFYU1LY0 type=write size=2879013 2023-12-03T11:32:44.356 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.355+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=DJ129ZVJOT0N type=write size=859648 2023-12-03T11:32:44.357 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.357+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~8E9F60U909BQ.0 size=1048576 2023-12-03T11:32:44.358 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.358+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~8E9F60U909BQ.1 size=993836 2023-12-03T11:32:44.361 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.360+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=8E9F60U909BQ tag=HGSD893ZNRBP type=write size=3090988 2023-12-03T11:32:44.362 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.361+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=2X27D3LQOXZB type=del size=1405037 2023-12-03T11:32:44.365 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.363+0000 7f4d50c67780 1 < suggested update operation key=G0O8EC405LYM tag=J17AA2X5GIQ9 type=del size=794220 2023-12-03T11:32:44.366 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.366+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~88S51KZ30K20.0 size=897453 2023-12-03T11:32:44.367 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.366+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=88S51KZ30K20 tag=Z3IIHDLV3778 type=write size=1946029 2023-12-03T11:32:44.368 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.367+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~XOCX6QDQLRC4.0 size=836986 2023-12-03T11:32:44.371 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.370+0000 7f4d50c67780 1 < completed multipart upload key=TOGV2BZ99FRF upload=XOCX6QDQLRC4 tag=Z4V1QM7H7KQ3 type=write size=1885562 2023-12-03T11:32:44.372 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.371+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=4K1AI7VOBM6I type=del size=855035 2023-12-03T11:32:44.373 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.372+0000 7f4d50c67780 1 < completed delete operation key=CQPZ0X62207Z tag=SGMQ7YX7IJZE type=del 2023-12-03T11:32:44.375 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.374+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~F4I11IO1S3N7.0 size=1048576 2023-12-03T11:32:44.376 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.375+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~F4I11IO1S3N7.1 size=1048576 2023-12-03T11:32:44.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.376+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~F4I11IO1S3N7.2 size=685765 2023-12-03T11:32:44.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.376+0000 7f4d50c67780 1 > prepared multipart upload key=TOGV2BZ99FRF upload=F4I11IO1S3N7 tag=C3GRCIBQGDWS type=write size=3831493 2023-12-03T11:32:44.378 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.378+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~BRV1503HAJHS.0 size=996625 2023-12-03T11:32:44.380 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.380+0000 7f4d50c67780 1 < completed multipart upload key=MLKGLDFFDC3W upload=BRV1503HAJHS tag=L1V6FL303L21 type=write size=2045201 2023-12-03T11:32:44.382 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.382+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~MJAJ0DVTDN2K.0 size=1048576 2023-12-03T11:32:44.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.383+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~MJAJ0DVTDN2K.1 size=1048576 2023-12-03T11:32:44.384 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.383+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~MJAJ0DVTDN2K.2 size=252240 2023-12-03T11:32:44.384 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.383+0000 7f4d50c67780 1 > prepared multipart upload key=TEIYINZFFG76 upload=MJAJ0DVTDN2K tag=RO1X4DNRLO68 type=write size=3397968 2023-12-03T11:32:44.385 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.385+0000 7f4d50c67780 1 < completed delete operation key=EAP0BYZTTT2E tag=22NSK78J6V2T type=del 2023-12-03T11:32:44.387 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.386+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=Y60AR4QMNO07 type=del size=2446758 2023-12-03T11:32:44.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.387+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~PW6JXK2UPF07.0 size=359691 2023-12-03T11:32:44.390 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.389+0000 7f4d50c67780 1 < completed multipart upload key=V0ND3OBFJJUB upload=PW6JXK2UPF07 tag=M6ST1Z0IUSMZ type=write size=1408267 2023-12-03T11:32:44.391 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.390+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=2FAEYUWC8213 type=del size=3453079 2023-12-03T11:32:44.392 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.391+0000 7f4d50c67780 1 < completed delete operation key=TEIYINZFFG76 tag=2PP02CPPAFDO type=del 2023-12-03T11:32:44.393 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.393+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=LL24RWE0H0IF type=write size=1026676 2023-12-03T11:32:44.395 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.394+0000 7f4d50c67780 1 < completed delete operation key=7C7UX0231SHV tag=CJP3J25W982I type=del 2023-12-03T11:32:44.396 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.395+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=6ESDU6R2FCXK type=del size=3445141 2023-12-03T11:32:44.396 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.395+0000 7f4d50c67780 1 < canceled part key=_multipart_ENMJS0KEVS2S.2~IWOGSRMOV2NA.0 size=1048576 2023-12-03T11:32:44.397 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.396+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~IWOGSRMOV2NA.1 size=1048576 2023-12-03T11:32:44.397 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.396+0000 7f4d50c67780 1 < canceled part key=_multipart_ENMJS0KEVS2S.2~IWOGSRMOV2NA.2 size=517807 2023-12-03T11:32:44.399 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.398+0000 7f4d50c67780 1 < canceled multipart upload key=ENMJS0KEVS2S upload=IWOGSRMOV2NA tag=6OR9O21DZ0LG type=write size=3663535 2023-12-03T11:32:44.401 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.400+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~OO52DLCQU2DX.0 size=1048576 2023-12-03T11:32:44.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.401+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~OO52DLCQU2DX.1 size=529525 2023-12-03T11:32:44.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.401+0000 7f4d50c67780 1 > prepared multipart upload key=JR8CIONID4QC upload=OO52DLCQU2DX tag=SFXFOQAQJPKB type=write size=2626677 2023-12-03T11:32:44.403 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.402+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~5T6PP1T4T8A2.0 size=1048576 2023-12-03T11:32:44.404 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.403+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~5T6PP1T4T8A2.1 size=202225 2023-12-03T11:32:44.406 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.405+0000 7f4d50c67780 1 < completed multipart upload key=G0O8EC405LYM upload=5T6PP1T4T8A2 tag=UG2IZIC7SECE type=write size=2299377 2023-12-03T11:32:44.407 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.406+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=V9Q2XFBZK0NZ type=del size=455998 2023-12-03T11:32:44.408 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.407+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=XJT1QXVIIOHY type=del 2023-12-03T11:32:44.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.409+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~AJN4UO16LVFA.0 size=1048576 2023-12-03T11:32:44.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.410+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~AJN4UO16LVFA.1 size=653842 2023-12-03T11:32:44.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.410+0000 7f4d50c67780 1 > prepared multipart upload key=ULLPV2G10BME upload=AJN4UO16LVFA tag=47VIIO3N932U type=write size=2750994 2023-12-03T11:32:44.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.411+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~N3H60S25FSUY.0 size=1048576 2023-12-03T11:32:44.413 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.412+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~N3H60S25FSUY.1 size=1048576 2023-12-03T11:32:44.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.413+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~N3H60S25FSUY.2 size=123181 2023-12-03T11:32:44.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.415+0000 7f4d50c67780 1 < completed multipart upload key=7C7UX0231SHV upload=N3H60S25FSUY tag=CPA0HEXJRH9D type=write size=3268909 2023-12-03T11:32:44.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.417+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=DR2HNQ5Y3GRU type=del size=3280356 2023-12-03T11:32:44.418 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.417+0000 7f4d50c67780 1 < canceled part key=_multipart_83I1M5WIVKAA.2~X4BVG9CRSWLH.0 size=1048576 2023-12-03T11:32:44.419 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.418+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~X4BVG9CRSWLH.1 size=1048576 2023-12-03T11:32:44.419 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.419+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~X4BVG9CRSWLH.2 size=1001488 2023-12-03T11:32:44.421 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.421+0000 7f4d50c67780 1 < canceled multipart upload key=83I1M5WIVKAA upload=X4BVG9CRSWLH tag=L1JPYSXF309Q type=write size=4147216 2023-12-03T11:32:44.424 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.423+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~1H3AMOX3E7QR.0 size=1048576 2023-12-03T11:32:44.424 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.424+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~1H3AMOX3E7QR.1 size=134133 2023-12-03T11:32:44.425 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.424+0000 7f4d50c67780 1 > prepared multipart upload key=JBL6IOJC4TT0 upload=1H3AMOX3E7QR tag=XCZ7NICQIPEU type=write size=2231285 2023-12-03T11:32:44.426 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.425+0000 7f4d50c67780 1 < completed delete operation key=JR8CIONID4QC tag=5EGX59JJ4UNV type=del 2023-12-03T11:32:44.428 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.427+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~K2VLOP3TN81O.0 size=1048576 2023-12-03T11:32:44.429 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.428+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~K2VLOP3TN81O.1 size=1048576 2023-12-03T11:32:44.429 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.429+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~K2VLOP3TN81O.2 size=754134 2023-12-03T11:32:44.430 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.429+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=K2VLOP3TN81O tag=P287G8K06HYS type=write size=3899862 2023-12-03T11:32:44.431 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.430+0000 7f4d50c67780 1 < completed write operation key=V0ND3OBFJJUB tag=DJ129ZVJOT0N type=write size=859648 2023-12-03T11:32:44.433 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.432+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~FCRFOFH4NPGA.0 size=1048576 2023-12-03T11:32:44.434 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.433+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~FCRFOFH4NPGA.1 size=429188 2023-12-03T11:32:44.434 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.433+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=FCRFOFH4NPGA tag=9KS8DGZM78B0 type=write size=2526340 2023-12-03T11:32:44.435 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.434+0000 7f4d50c67780 1 < completed delete operation key=JR8CIONID4QC tag=2X27D3LQOXZB type=del 2023-12-03T11:32:44.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.436+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~GI5K1X177CG9.0 size=808715 2023-12-03T11:32:44.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.436+0000 7f4d50c67780 1 > prepared multipart upload key=TOGV2BZ99FRF upload=GI5K1X177CG9 tag=NPY3FSUD9IWH type=write size=1857291 2023-12-03T11:32:44.438 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.437+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~88S51KZ30K20.0 size=897453 2023-12-03T11:32:44.440 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.439+0000 7f4d50c67780 1 < completed multipart upload key=7C7UX0231SHV upload=88S51KZ30K20 tag=Z3IIHDLV3778 type=write size=1946029 2023-12-03T11:32:44.441 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.440+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=VPNTDX53UNXO type=del size=1781188 2023-12-03T11:32:44.442 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.442+0000 7f4d50c67780 1 < completed delete operation key=QQDBWLVSXIHP tag=4K1AI7VOBM6I type=del 2023-12-03T11:32:44.444 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.443+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=U8C77NSLHSHC type=del size=2430962 2023-12-03T11:32:44.444 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.443+0000 7f4d50c67780 1 < canceled part key=_multipart_TOGV2BZ99FRF.2~F4I11IO1S3N7.0 size=1048576 2023-12-03T11:32:44.445 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.444+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~F4I11IO1S3N7.1 size=1048576 2023-12-03T11:32:44.446 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.445+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~F4I11IO1S3N7.2 size=685765 2023-12-03T11:32:44.448 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.447+0000 7f4d50c67780 1 < canceled multipart upload key=TOGV2BZ99FRF upload=F4I11IO1S3N7 tag=C3GRCIBQGDWS type=write size=3831493 2023-12-03T11:32:44.450 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.450+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~WSUJB58H7MK0.0 size=1048576 2023-12-03T11:32:44.451 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.451+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~WSUJB58H7MK0.1 size=649639 2023-12-03T11:32:44.451 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.451+0000 7f4d50c67780 1 > prepared multipart upload key=ENMJS0KEVS2S upload=WSUJB58H7MK0 tag=BIWIGG39XB7H type=write size=2746791 2023-12-03T11:32:44.453 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.452+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~MJAJ0DVTDN2K.0 size=1048576 2023-12-03T11:32:44.454 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.453+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~MJAJ0DVTDN2K.1 size=1048576 2023-12-03T11:32:44.455 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.454+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~MJAJ0DVTDN2K.2 size=252240 2023-12-03T11:32:44.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.456+0000 7f4d50c67780 1 < completed multipart upload key=TEIYINZFFG76 upload=MJAJ0DVTDN2K tag=RO1X4DNRLO68 type=write size=3397968 2023-12-03T11:32:44.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.459+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~NRYV2I6LI9HY.0 size=1048576 2023-12-03T11:32:44.461 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.460+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~NRYV2I6LI9HY.1 size=819696 2023-12-03T11:32:44.461 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.460+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=NRYV2I6LI9HY tag=KGDNG6I1AUAF type=write size=2916848 2023-12-03T11:32:44.463 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.462+0000 7f4d50c67780 1 < suggested remove operation key=JBL6IOJC4TT0 tag=Y60AR4QMNO07 type=del 2023-12-03T11:32:44.464 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.464+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=JPWE66E7LV8G type=del size=987546 2023-12-03T11:32:44.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.465+0000 7f4d50c67780 1 < completed delete operation key=GTLP2WZUX7U8 tag=2FAEYUWC8213 type=del 2023-12-03T11:32:44.468 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.467+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~TLYFIRGWR5Q7.0 size=413350 2023-12-03T11:32:44.468 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.467+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=TLYFIRGWR5Q7 tag=2HCT2RY7IOB7 type=write size=1461926 2023-12-03T11:32:44.469 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.469+0000 7f4d50c67780 1 < completed write operation key=0M6ZAD39I852 tag=LL24RWE0H0IF type=write size=1026676 2023-12-03T11:32:44.472 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.471+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~0RDW5KSA3KSW.0 size=763267 2023-12-03T11:32:44.472 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.471+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=0RDW5KSA3KSW tag=PJ9ESLILLKI8 type=write size=1811843 2023-12-03T11:32:44.473 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.472+0000 7f4d50c67780 1 < canceled operation key=YDRAH5EE39R4 tag=6ESDU6R2FCXK type=del size=3445141 2023-12-03T11:32:44.475 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.474+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=5L64P04B0ATO type=del size=2714827 2023-12-03T11:32:44.476 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.475+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~OO52DLCQU2DX.0 size=1048576 2023-12-03T11:32:44.477 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.476+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~OO52DLCQU2DX.1 size=529525 2023-12-03T11:32:44.480 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.479+0000 7f4d50c67780 1 < completed multipart upload key=JR8CIONID4QC upload=OO52DLCQU2DX tag=SFXFOQAQJPKB type=write size=2626677 2023-12-03T11:32:44.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.482+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~TA6TWZ7EOWJH.0 size=1048576 2023-12-03T11:32:44.484 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.483+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~TA6TWZ7EOWJH.1 size=1048576 2023-12-03T11:32:44.485 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.484+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~TA6TWZ7EOWJH.2 size=250100 2023-12-03T11:32:44.485 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.484+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=TA6TWZ7EOWJH tag=TVD4RHXYVA24 type=write size=3395828 2023-12-03T11:32:44.486 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.485+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=V9Q2XFBZK0NZ type=del 2023-12-03T11:32:44.487 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.487+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=HM8R6QD3HVRE type=del size=3706801 2023-12-03T11:32:44.489 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.488+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~AJN4UO16LVFA.0 size=1048576 2023-12-03T11:32:44.490 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.489+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~AJN4UO16LVFA.1 size=653842 2023-12-03T11:32:44.491 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.491+0000 7f4d50c67780 1 < completed multipart upload key=ULLPV2G10BME upload=AJN4UO16LVFA tag=47VIIO3N932U type=write size=2750994 2023-12-03T11:32:44.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.492+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=30ZO5F4ZFXOR type=del size=3959517 2023-12-03T11:32:44.495 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.494+0000 7f4d50c67780 1 < suggested update operation key=ENMJS0KEVS2S tag=DR2HNQ5Y3GRU type=del size=3280356 2023-12-03T11:32:44.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.495+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=1MUX3NLC1XCH type=del size=616394 2023-12-03T11:32:44.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.496+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~1H3AMOX3E7QR.0 size=1048576 2023-12-03T11:32:44.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.497+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~1H3AMOX3E7QR.1 size=134133 2023-12-03T11:32:44.500 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.499+0000 7f4d50c67780 1 < completed multipart upload key=JBL6IOJC4TT0 upload=1H3AMOX3E7QR tag=XCZ7NICQIPEU type=write size=2231285 2023-12-03T11:32:44.501 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.501+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=M2MR9FEQQKCN type=del size=1770061 2023-12-03T11:32:44.503 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.502+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~K2VLOP3TN81O.0 size=1048576 2023-12-03T11:32:44.504 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.503+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~K2VLOP3TN81O.1 size=1048576 2023-12-03T11:32:44.505 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.504+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~K2VLOP3TN81O.2 size=754134 2023-12-03T11:32:44.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.506+0000 7f4d50c67780 1 < completed multipart upload key=MLKGLDFFDC3W upload=K2VLOP3TN81O tag=P287G8K06HYS type=write size=3899862 2023-12-03T11:32:44.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.507+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=JNLZY40Y3JKB type=del size=1035724 2023-12-03T11:32:44.509 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.508+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~FCRFOFH4NPGA.0 size=1048576 2023-12-03T11:32:44.510 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.509+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~FCRFOFH4NPGA.1 size=429188 2023-12-03T11:32:44.512 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.511+0000 7f4d50c67780 1 < completed multipart upload key=EAP0BYZTTT2E upload=FCRFOFH4NPGA tag=9KS8DGZM78B0 type=write size=2526340 2023-12-03T11:32:44.514 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.513+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~Z4XK289M3TQH.0 size=817632 2023-12-03T11:32:44.514 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.513+0000 7f4d50c67780 1 > prepared multipart upload key=TOGV2BZ99FRF upload=Z4XK289M3TQH tag=U7ONZDTSIFDH type=write size=1866208 2023-12-03T11:32:44.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.514+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~GI5K1X177CG9.0 size=808715 2023-12-03T11:32:44.517 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.516+0000 7f4d50c67780 1 < completed multipart upload key=TOGV2BZ99FRF upload=GI5K1X177CG9 tag=NPY3FSUD9IWH type=write size=1857291 2023-12-03T11:32:44.518 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.517+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=ZRYW6LAPS2CK type=del size=1190265 2023-12-03T11:32:44.520 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.520+0000 7f4d50c67780 1 < suggested update operation key=2H6AFQ362OGP tag=VPNTDX53UNXO type=del size=1781188 2023-12-03T11:32:44.522 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.521+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=TR3CLYLGA83R type=del size=1682013 2023-12-03T11:32:44.523 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.523+0000 7f4d50c67780 1 < completed delete operation key=EH4B2QP1C42H tag=U8C77NSLHSHC type=del 2023-12-03T11:32:44.526 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.525+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~181E4XYULZSN.0 size=419074 2023-12-03T11:32:44.526 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.525+0000 7f4d50c67780 1 > prepared multipart upload key=73SL3ZBBDA6Q upload=181E4XYULZSN tag=1QNE4SGI0JH6 type=write size=1467650 2023-12-03T11:32:44.527 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.526+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~WSUJB58H7MK0.0 size=1048576 2023-12-03T11:32:44.527 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.526+0000 7f4d50c67780 1 < canceled part key=_multipart_ENMJS0KEVS2S.2~WSUJB58H7MK0.1 size=649639 2023-12-03T11:32:44.529 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.528+0000 7f4d50c67780 1 < canceled multipart upload key=ENMJS0KEVS2S upload=WSUJB58H7MK0 tag=BIWIGG39XB7H type=write size=2746791 2023-12-03T11:32:44.530 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.529+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=WNXC1JWR9JM3 type=del size=3837436 2023-12-03T11:32:44.531 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.530+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~NRYV2I6LI9HY.0 size=1048576 2023-12-03T11:32:44.532 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.532+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~NRYV2I6LI9HY.1 size=819696 2023-12-03T11:32:44.534 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.534+0000 7f4d50c67780 1 < completed multipart upload key=V0ND3OBFJJUB upload=NRYV2I6LI9HY tag=KGDNG6I1AUAF type=write size=2916848 2023-12-03T11:32:44.536 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.535+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=9ITW0W4UGA95 type=write size=884593 2023-12-03T11:32:44.537 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.536+0000 7f4d50c67780 1 < completed delete operation key=EH4B2QP1C42H tag=JPWE66E7LV8G type=del 2023-12-03T11:32:44.539 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.538+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~G8DTWOWIL0HG.0 size=1048576 2023-12-03T11:32:44.540 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.539+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~G8DTWOWIL0HG.1 size=1048576 2023-12-03T11:32:44.541 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.540+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~G8DTWOWIL0HG.2 size=589361 2023-12-03T11:32:44.541 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.540+0000 7f4d50c67780 1 > prepared multipart upload key=G0O8EC405LYM upload=G8DTWOWIL0HG tag=GE92QI9J431H type=write size=3735089 2023-12-03T11:32:44.542 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.542+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~TLYFIRGWR5Q7.0 size=413350 2023-12-03T11:32:44.545 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.544+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=TLYFIRGWR5Q7 tag=2HCT2RY7IOB7 type=write size=1461926 2023-12-03T11:32:44.546 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.545+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=F9HDBPE4DND3 type=del size=1678893 2023-12-03T11:32:44.547 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.546+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~0RDW5KSA3KSW.0 size=763267 2023-12-03T11:32:44.549 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.548+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=0RDW5KSA3KSW tag=PJ9ESLILLKI8 type=write size=1811843 2023-12-03T11:32:44.550 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.550+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=6X6UWT1YLQO2 type=del size=2752328 2023-12-03T11:32:44.552 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.551+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=5L64P04B0ATO type=del 2023-12-03T11:32:44.554 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.553+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~TW6S6WTACYRB.0 size=1048576 2023-12-03T11:32:44.555 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.554+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~TW6S6WTACYRB.1 size=1029354 2023-12-03T11:32:44.555 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.554+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=TW6S6WTACYRB tag=YUEM0YWGEN6Y type=write size=3126506 2023-12-03T11:32:44.556 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.555+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~TA6TWZ7EOWJH.0 size=1048576 2023-12-03T11:32:44.557 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.557+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~TA6TWZ7EOWJH.1 size=1048576 2023-12-03T11:32:44.558 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.558+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~TA6TWZ7EOWJH.2 size=250100 2023-12-03T11:32:44.561 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.560+0000 7f4d50c67780 1 < completed multipart upload key=7C7UX0231SHV upload=TA6TWZ7EOWJH tag=TVD4RHXYVA24 type=write size=3395828 2023-12-03T11:32:44.563 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.562+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~KI9IUM6SHBN8.0 size=1048576 2023-12-03T11:32:44.564 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.563+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~KI9IUM6SHBN8.1 size=990740 2023-12-03T11:32:44.564 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.563+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=KI9IUM6SHBN8 tag=6AF3RP8HU4EE type=write size=3087892 2023-12-03T11:32:44.565 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.564+0000 7f4d50c67780 1 < completed delete operation key=ZE19S5UCCZ3C tag=HM8R6QD3HVRE type=del 2023-12-03T11:32:44.566 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.566+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=RF5GBJTBVOLJ type=del size=3144509 2023-12-03T11:32:44.570 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.567+0000 7f4d50c67780 1 < completed delete operation key=ZE19S5UCCZ3C tag=30ZO5F4ZFXOR type=del 2023-12-03T11:32:44.570 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.568+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=QNR1PH3GCKNN type=del size=3413956 2023-12-03T11:32:44.570 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.569+0000 7f4d50c67780 1 < completed delete operation key=ZE19S5UCCZ3C tag=1MUX3NLC1XCH type=del 2023-12-03T11:32:44.572 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.571+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~4WY2AIFDURAC.0 size=1048576 2023-12-03T11:32:44.573 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.572+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~4WY2AIFDURAC.1 size=1048576 2023-12-03T11:32:44.574 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.573+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~4WY2AIFDURAC.2 size=530830 2023-12-03T11:32:44.574 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.573+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=4WY2AIFDURAC tag=G2XYXAJI78LS type=write size=3676558 2023-12-03T11:32:44.575 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.575+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=M2MR9FEQQKCN type=del 2023-12-03T11:32:44.578 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.577+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~O1XDSOCG5DA9.0 size=1048576 2023-12-03T11:32:44.579 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.578+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~O1XDSOCG5DA9.1 size=1037592 2023-12-03T11:32:44.579 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.578+0000 7f4d50c67780 1 > prepared multipart upload key=QQDBWLVSXIHP upload=O1XDSOCG5DA9 tag=VJRY4T9BRSSI type=write size=3134744 2023-12-03T11:32:44.580 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.579+0000 7f4d50c67780 1 < completed delete operation key=73SL3ZBBDA6Q tag=JNLZY40Y3JKB type=del 2023-12-03T11:32:44.582 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.581+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~X6OF8TUPX3F8.0 size=1048576 2023-12-03T11:32:44.583 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.582+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~X6OF8TUPX3F8.1 size=1048576 2023-12-03T11:32:44.584 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.583+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~X6OF8TUPX3F8.2 size=869286 2023-12-03T11:32:44.584 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.583+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=X6OF8TUPX3F8 tag=92MMYC68TRA9 type=write size=4015014 2023-12-03T11:32:44.585 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.584+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~Z4XK289M3TQH.0 size=817632 2023-12-03T11:32:44.587 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.586+0000 7f4d50c67780 1 < completed multipart upload key=TOGV2BZ99FRF upload=Z4XK289M3TQH tag=U7ONZDTSIFDH type=write size=1866208 2023-12-03T11:32:44.589 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.588+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~X2U51NM1FPQL.0 size=1048576 2023-12-03T11:32:44.590 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.589+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~X2U51NM1FPQL.1 size=1048576 2023-12-03T11:32:44.591 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.590+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~X2U51NM1FPQL.2 size=694355 2023-12-03T11:32:44.591 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.590+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=X2U51NM1FPQL tag=ED6X9SKVNCDZ type=write size=3840083 2023-12-03T11:32:44.593 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.592+0000 7f4d50c67780 1 < completed delete operation key=ULLPV2G10BME tag=ZRYW6LAPS2CK type=del 2023-12-03T11:32:44.595 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.594+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=72SFK999PN7H type=write size=818459 2023-12-03T11:32:44.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.596+0000 7f4d50c67780 1 < suggested remove operation key=MLKGLDFFDC3W tag=TR3CLYLGA83R type=del 2023-12-03T11:32:44.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.598+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~7I4U4M0LOU1C.0 size=1048576 2023-12-03T11:32:44.600 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.599+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~7I4U4M0LOU1C.1 size=1048576 2023-12-03T11:32:44.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.600+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~7I4U4M0LOU1C.2 size=224994 2023-12-03T11:32:44.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.600+0000 7f4d50c67780 1 > prepared multipart upload key=TEIYINZFFG76 upload=7I4U4M0LOU1C tag=O937W2ET4NNC type=write size=3370722 2023-12-03T11:32:44.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.601+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~181E4XYULZSN.0 size=419074 2023-12-03T11:32:44.604 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.603+0000 7f4d50c67780 1 < completed multipart upload key=73SL3ZBBDA6Q upload=181E4XYULZSN tag=1QNE4SGI0JH6 type=write size=1467650 2023-12-03T11:32:44.606 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.605+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~2D1NPVC0H27T.0 size=1048576 2023-12-03T11:32:44.607 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.606+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~2D1NPVC0H27T.1 size=1048576 2023-12-03T11:32:44.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.607+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~2D1NPVC0H27T.2 size=960059 2023-12-03T11:32:44.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.607+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=2D1NPVC0H27T tag=SMHL506P0AP2 type=write size=4105787 2023-12-03T11:32:44.610 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.609+0000 7f4d50c67780 1 < suggested update operation key=XM5E3D99MXVA tag=WNXC1JWR9JM3 type=del size=3837436 2023-12-03T11:32:44.612 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.611+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~1FTCXO9H6AQ0.0 size=1048576 2023-12-03T11:32:44.613 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.612+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~1FTCXO9H6AQ0.1 size=1048576 2023-12-03T11:32:44.614 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.613+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~1FTCXO9H6AQ0.2 size=286778 2023-12-03T11:32:44.614 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.613+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=1FTCXO9H6AQ0 tag=80IXVG05KXDS type=write size=3432506 2023-12-03T11:32:44.615 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.614+0000 7f4d50c67780 -1 < failed to complete operation key=MLKGLDFFDC3W tag=9ITW0W4UGA95 type=write size=884593: (22) Invalid argument 2023-12-03T11:32:44.617 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.616+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=WJORC7AJGJYE type=del size=483599 2023-12-03T11:32:44.617 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.616+0000 7f4d50c67780 1 < canceled part key=_multipart_G0O8EC405LYM.2~G8DTWOWIL0HG.0 size=1048576 2023-12-03T11:32:44.618 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.617+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~G8DTWOWIL0HG.1 size=1048576 2023-12-03T11:32:44.619 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.618+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~G8DTWOWIL0HG.2 size=589361 2023-12-03T11:32:44.621 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.620+0000 7f4d50c67780 1 < canceled multipart upload key=G0O8EC405LYM upload=G8DTWOWIL0HG tag=GE92QI9J431H type=write size=3735089 2023-12-03T11:32:44.623 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.623+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~4Z2KAZGT41W5.0 size=1048576 2023-12-03T11:32:44.624 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.624+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~4Z2KAZGT41W5.1 size=597800 2023-12-03T11:32:44.624 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.624+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=4Z2KAZGT41W5 tag=BL4A48NMWFI4 type=write size=2694952 2023-12-03T11:32:44.626 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.625+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=F9HDBPE4DND3 type=del 2023-12-03T11:32:44.627 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.626+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=WFHMA38J92R5 type=del size=211685 2023-12-03T11:32:44.628 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.627+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=6X6UWT1YLQO2 type=del 2023-12-03T11:32:44.630 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.630+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~K4PCJLQ6BFR3.0 size=1048576 2023-12-03T11:32:44.631 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.630+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~K4PCJLQ6BFR3.1 size=1048576 2023-12-03T11:32:44.632 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.632+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~K4PCJLQ6BFR3.2 size=763842 2023-12-03T11:32:44.632 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.632+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=K4PCJLQ6BFR3 tag=RG201TKT7XH6 type=write size=3909570 2023-12-03T11:32:44.634 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.633+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~TW6S6WTACYRB.0 size=1048576 2023-12-03T11:32:44.635 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.634+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~TW6S6WTACYRB.1 size=1029354 2023-12-03T11:32:44.637 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.636+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=TW6S6WTACYRB tag=YUEM0YWGEN6Y type=write size=3126506 2023-12-03T11:32:44.638 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.637+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=OOPDDMBBY3UA type=del size=3913198 2023-12-03T11:32:44.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.639+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~KI9IUM6SHBN8.0 size=1048576 2023-12-03T11:32:44.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.639+0000 7f4d50c67780 1 < canceled part key=_multipart_83I1M5WIVKAA.2~KI9IUM6SHBN8.1 size=990740 2023-12-03T11:32:44.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.641+0000 7f4d50c67780 1 < canceled multipart upload key=83I1M5WIVKAA upload=KI9IUM6SHBN8 tag=6AF3RP8HU4EE type=write size=3087892 2023-12-03T11:32:44.643 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.642+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=E9EEHULZ2PPE type=del size=916946 2023-12-03T11:32:44.646 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.645+0000 7f4d50c67780 1 < suggested update operation key=0M6ZAD39I852 tag=RF5GBJTBVOLJ type=del size=3144509 2023-12-03T11:32:44.648 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.647+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~63CTTGKMM189.0 size=1048576 2023-12-03T11:32:44.649 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.649+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~63CTTGKMM189.1 size=870681 2023-12-03T11:32:44.650 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.649+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=63CTTGKMM189 tag=3QGU1US1V4OI type=write size=2967833 2023-12-03T11:32:44.652 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.651+0000 7f4d50c67780 1 < suggested update operation key=52E31L45TN7V tag=QNR1PH3GCKNN type=del size=3413956 2023-12-03T11:32:44.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.653+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=OPJOSQBIFGBG type=del size=3236996 2023-12-03T11:32:44.655 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.654+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~4WY2AIFDURAC.0 size=1048576 2023-12-03T11:32:44.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.655+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~4WY2AIFDURAC.1 size=1048576 2023-12-03T11:32:44.657 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.656+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~4WY2AIFDURAC.2 size=530830 2023-12-03T11:32:44.660 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.659+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=4WY2AIFDURAC tag=G2XYXAJI78LS type=write size=3676558 2023-12-03T11:32:44.661 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.660+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=RAIOR9X8C9OB type=del size=2934388 2023-12-03T11:32:44.662 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.662+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~O1XDSOCG5DA9.0 size=1048576 2023-12-03T11:32:44.664 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.663+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~O1XDSOCG5DA9.1 size=1037592 2023-12-03T11:32:44.666 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.665+0000 7f4d50c67780 1 < completed multipart upload key=QQDBWLVSXIHP upload=O1XDSOCG5DA9 tag=VJRY4T9BRSSI type=write size=3134744 2023-12-03T11:32:44.668 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.667+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~MRDC05ILR58F.0 size=1048576 2023-12-03T11:32:44.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.668+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~MRDC05ILR58F.1 size=34406 2023-12-03T11:32:44.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.668+0000 7f4d50c67780 1 > prepared multipart upload key=G0O8EC405LYM upload=MRDC05ILR58F tag=T3N6Z3YGITDV type=write size=2131558 2023-12-03T11:32:44.671 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.670+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~X6OF8TUPX3F8.0 size=1048576 2023-12-03T11:32:44.672 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.671+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~X6OF8TUPX3F8.1 size=1048576 2023-12-03T11:32:44.673 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.672+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~X6OF8TUPX3F8.2 size=869286 2023-12-03T11:32:44.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.674+0000 7f4d50c67780 1 < completed multipart upload key=CQPZ0X62207Z upload=X6OF8TUPX3F8 tag=92MMYC68TRA9 type=write size=4015014 2023-12-03T11:32:44.677 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.677+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~EDHIGY31PYFZ.0 size=145074 2023-12-03T11:32:44.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.677+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=EDHIGY31PYFZ tag=7AJT2Q1AP12C type=write size=1193650 2023-12-03T11:32:44.679 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.678+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~X2U51NM1FPQL.0 size=1048576 2023-12-03T11:32:44.680 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.679+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~X2U51NM1FPQL.1 size=1048576 2023-12-03T11:32:44.681 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.680+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~X2U51NM1FPQL.2 size=694355 2023-12-03T11:32:44.683 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.682+0000 7f4d50c67780 1 < completed multipart upload key=EH4B2QP1C42H upload=X2U51NM1FPQL tag=ED6X9SKVNCDZ type=write size=3840083 2023-12-03T11:32:44.684 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.683+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=8D5VM9MYC327 type=del size=1044005 2023-12-03T11:32:44.687 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.686+0000 7f4d50c67780 1 < suggested remove operation key=YDRAH5EE39R4 tag=72SFK999PN7H type=write 2023-12-03T11:32:44.688 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.687+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=DLTX9VAHEBLG type=del size=3450812 2023-12-03T11:32:44.689 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.688+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~7I4U4M0LOU1C.0 size=1048576 2023-12-03T11:32:44.690 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.689+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~7I4U4M0LOU1C.1 size=1048576 2023-12-03T11:32:44.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.690+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~7I4U4M0LOU1C.2 size=224994 2023-12-03T11:32:44.693 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.692+0000 7f4d50c67780 1 < completed multipart upload key=TEIYINZFFG76 upload=7I4U4M0LOU1C tag=O937W2ET4NNC type=write size=3370722 2023-12-03T11:32:44.696 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.695+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~XREXAKJTSVGX.0 size=1048576 2023-12-03T11:32:44.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.696+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~XREXAKJTSVGX.1 size=690587 2023-12-03T11:32:44.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.696+0000 7f4d50c67780 1 > prepared multipart upload key=JR8CIONID4QC upload=XREXAKJTSVGX tag=PZXKXS32TEOH type=write size=2787739 2023-12-03T11:32:44.698 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.697+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~2D1NPVC0H27T.0 size=1048576 2023-12-03T11:32:44.699 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.698+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~2D1NPVC0H27T.1 size=1048576 2023-12-03T11:32:44.700 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.699+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~2D1NPVC0H27T.2 size=960059 2023-12-03T11:32:44.702 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.701+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=2D1NPVC0H27T tag=SMHL506P0AP2 type=write size=4105787 2023-12-03T11:32:44.703 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.702+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=3O5YR1LH29RQ type=del size=1101177 2023-12-03T11:32:44.704 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.703+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~1FTCXO9H6AQ0.0 size=1048576 2023-12-03T11:32:44.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.704+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~1FTCXO9H6AQ0.1 size=1048576 2023-12-03T11:32:44.706 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.705+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~1FTCXO9H6AQ0.2 size=286778 2023-12-03T11:32:44.710 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.709+0000 7f4d50c67780 1 < completed multipart upload key=WUM939BATDG9 upload=1FTCXO9H6AQ0 tag=80IXVG05KXDS type=write size=3432506 2023-12-03T11:32:44.711 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.710+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=WJ6QZ0S6R4BK type=del size=3699680 2023-12-03T11:32:44.712 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.712+0000 7f4d50c67780 1 < canceled operation key=TOGV2BZ99FRF tag=WJORC7AJGJYE type=del size=483599 2023-12-03T11:32:44.715 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.714+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~6MMIP53TONXC.0 size=606937 2023-12-03T11:32:44.715 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.714+0000 7f4d50c67780 1 > prepared multipart upload key=73SL3ZBBDA6Q upload=6MMIP53TONXC tag=JJVBLRDX63L8 type=write size=1655513 2023-12-03T11:32:44.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.715+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~4Z2KAZGT41W5.0 size=1048576 2023-12-03T11:32:44.717 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.716+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~4Z2KAZGT41W5.1 size=597800 2023-12-03T11:32:44.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.718+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=4Z2KAZGT41W5 tag=BL4A48NMWFI4 type=write size=2694952 2023-12-03T11:32:44.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.720+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~AULJ7QUIXNNA.0 size=1048576 2023-12-03T11:32:44.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.721+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~AULJ7QUIXNNA.1 size=999913 2023-12-03T11:32:44.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.721+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=AULJ7QUIXNNA tag=LBMP293M5MBI type=write size=3097065 2023-12-03T11:32:44.723 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.722+0000 7f4d50c67780 1 < canceled operation key=ULLPV2G10BME tag=WFHMA38J92R5 type=del size=211685 2023-12-03T11:32:44.724 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.723+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=4IAM7RT9S4QN type=del size=1860510 2023-12-03T11:32:44.725 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.724+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~K4PCJLQ6BFR3.0 size=1048576 2023-12-03T11:32:44.726 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.725+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~K4PCJLQ6BFR3.1 size=1048576 2023-12-03T11:32:44.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.726+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~K4PCJLQ6BFR3.2 size=763842 2023-12-03T11:32:44.729 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.728+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=K4PCJLQ6BFR3 tag=RG201TKT7XH6 type=write size=3909570 2023-12-03T11:32:44.731 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.730+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~KZJBUY1PYRU2.0 size=1048576 2023-12-03T11:32:44.732 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.731+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~KZJBUY1PYRU2.1 size=140926 2023-12-03T11:32:44.732 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.731+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=KZJBUY1PYRU2 tag=XA08GD8KMZPZ type=write size=2238078 2023-12-03T11:32:44.733 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.732+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=OOPDDMBBY3UA type=del 2023-12-03T11:32:44.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.734+0000 7f4d50c67780 1 > prepared part key=_multipart_JR8CIONID4QC.2~8RUXYMIACO43.0 size=512344 2023-12-03T11:32:44.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.734+0000 7f4d50c67780 1 > prepared multipart upload key=JR8CIONID4QC upload=8RUXYMIACO43 tag=C1TXD0PAQUNA type=write size=1560920 2023-12-03T11:32:44.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.735+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=E9EEHULZ2PPE type=del 2023-12-03T11:32:44.737 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.736+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=XDU2QTIVYU72 type=del size=1373690 2023-12-03T11:32:44.738 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.737+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~63CTTGKMM189.0 size=1048576 2023-12-03T11:32:44.739 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.738+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~63CTTGKMM189.1 size=870681 2023-12-03T11:32:44.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.740+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=63CTTGKMM189 tag=3QGU1US1V4OI type=write size=2967833 2023-12-03T11:32:44.742 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.741+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=9NDP5XG8WEW2 type=del size=3756225 2023-12-03T11:32:44.745 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.744+0000 7f4d50c67780 1 < suggested update operation key=EY1RBO15PCRR tag=OPJOSQBIFGBG type=del size=3236996 2023-12-03T11:32:44.746 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.745+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=ZWJQDHVJUG2S type=del size=751469 2023-12-03T11:32:44.747 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.746+0000 7f4d50c67780 1 < completed delete operation key=ZE19S5UCCZ3C tag=RAIOR9X8C9OB type=del 2023-12-03T11:32:44.749 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.749+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~0XMT4WYIUWKE.0 size=1048576 2023-12-03T11:32:44.750 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.750+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~0XMT4WYIUWKE.1 size=518739 2023-12-03T11:32:44.750 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.750+0000 7f4d50c67780 1 > prepared multipart upload key=TOGV2BZ99FRF upload=0XMT4WYIUWKE tag=E8EBGN6Y28WQ type=write size=2615891 2023-12-03T11:32:44.752 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.751+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~MRDC05ILR58F.0 size=1048576 2023-12-03T11:32:44.753 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.752+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~MRDC05ILR58F.1 size=34406 2023-12-03T11:32:44.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.754+0000 7f4d50c67780 1 < completed multipart upload key=G0O8EC405LYM upload=MRDC05ILR58F tag=T3N6Z3YGITDV type=write size=2131558 2023-12-03T11:32:44.756 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.755+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=QSW2KBY2W3V5 type=del size=2989576 2023-12-03T11:32:44.757 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.756+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~EDHIGY31PYFZ.0 size=145074 2023-12-03T11:32:44.759 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.758+0000 7f4d50c67780 1 < completed multipart upload key=WUM939BATDG9 upload=EDHIGY31PYFZ tag=7AJT2Q1AP12C type=write size=1193650 2023-12-03T11:32:44.760 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.759+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=J3V6AYTSPD8Z type=del size=1113124 2023-12-03T11:32:44.761 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.761+0000 7f4d50c67780 1 < completed delete operation key=WUM939BATDG9 tag=8D5VM9MYC327 type=del 2023-12-03T11:32:44.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.763+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~1LKLWURNMC9S.0 size=1048576 2023-12-03T11:32:44.765 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.764+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~1LKLWURNMC9S.1 size=746828 2023-12-03T11:32:44.765 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.764+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=1LKLWURNMC9S tag=9W7N5VQY56JP type=write size=2843980 2023-12-03T11:32:44.766 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.765+0000 7f4d50c67780 1 < completed delete operation key=MLKGLDFFDC3W tag=DLTX9VAHEBLG type=del 2023-12-03T11:32:44.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.767+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~TWJSB9S5P1MS.0 size=1039182 2023-12-03T11:32:44.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.767+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=TWJSB9S5P1MS tag=WNZRYFS993KE type=write size=2087758 2023-12-03T11:32:44.769 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.768+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~XREXAKJTSVGX.0 size=1048576 2023-12-03T11:32:44.770 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.769+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~XREXAKJTSVGX.1 size=690587 2023-12-03T11:32:44.772 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.771+0000 7f4d50c67780 1 < completed multipart upload key=JR8CIONID4QC upload=XREXAKJTSVGX tag=PZXKXS32TEOH type=write size=2787739 2023-12-03T11:32:44.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.773+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=29GC8STSESGD type=del size=3952201 2023-12-03T11:32:44.777 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.774+0000 7f4d50c67780 1 < completed delete operation key=ZE19S5UCCZ3C tag=3O5YR1LH29RQ type=del 2023-12-03T11:32:44.777 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.776+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~O5ROEPD7VCU7.0 size=1048576 2023-12-03T11:32:44.778 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.777+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~O5ROEPD7VCU7.1 size=1048576 2023-12-03T11:32:44.779 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.778+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~O5ROEPD7VCU7.2 size=889570 2023-12-03T11:32:44.779 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.778+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=O5ROEPD7VCU7 tag=DXIKPUUF43XF type=write size=4035298 2023-12-03T11:32:44.781 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.780+0000 7f4d50c67780 1 < suggested remove operation key=GTLP2WZUX7U8 tag=WJ6QZ0S6R4BK type=del 2023-12-03T11:32:44.782 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.781+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=55PVFT3IH678 type=del size=3977738 2023-12-03T11:32:44.782 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.781+0000 7f4d50c67780 1 < canceled part key=_multipart_73SL3ZBBDA6Q.2~6MMIP53TONXC.0 size=606937 2023-12-03T11:32:44.784 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.783+0000 7f4d50c67780 1 < canceled multipart upload key=73SL3ZBBDA6Q upload=6MMIP53TONXC tag=JJVBLRDX63L8 type=write size=1655513 2023-12-03T11:32:44.786 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.785+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~AECLYUMX6UKN.0 size=432713 2023-12-03T11:32:44.786 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.785+0000 7f4d50c67780 1 > prepared multipart upload key=ENMJS0KEVS2S upload=AECLYUMX6UKN tag=DQRIJSODQ322 type=write size=1481289 2023-12-03T11:32:44.787 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.786+0000 7f4d50c67780 1 < canceled part key=_multipart_MLKGLDFFDC3W.2~AULJ7QUIXNNA.0 size=1048576 2023-12-03T11:32:44.787 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.787+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~AULJ7QUIXNNA.1 size=999913 2023-12-03T11:32:44.790 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.788+0000 7f4d50c67780 1 < canceled multipart upload key=MLKGLDFFDC3W upload=AULJ7QUIXNNA tag=LBMP293M5MBI type=write size=3097065 2023-12-03T11:32:44.791 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.790+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=HRUNDR6MLOAP type=del size=69046 2023-12-03T11:32:44.793 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.792+0000 7f4d50c67780 1 < suggested update operation key=EY1RBO15PCRR tag=4IAM7RT9S4QN type=del size=1860510 2023-12-03T11:32:44.794 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.794+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=D03OKAO982IC type=del size=3665814 2023-12-03T11:32:44.796 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.795+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~KZJBUY1PYRU2.0 size=1048576 2023-12-03T11:32:44.797 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.796+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~KZJBUY1PYRU2.1 size=140926 2023-12-03T11:32:44.799 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.798+0000 7f4d50c67780 1 < completed multipart upload key=7C7UX0231SHV upload=KZJBUY1PYRU2 tag=XA08GD8KMZPZ type=write size=2238078 2023-12-03T11:32:44.800 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.799+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=QVHILT7K9PY8 type=del size=2083363 2023-12-03T11:32:44.801 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.800+0000 7f4d50c67780 1 < completed part key=_multipart_JR8CIONID4QC.2~8RUXYMIACO43.0 size=512344 2023-12-03T11:32:44.803 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.802+0000 7f4d50c67780 1 < completed multipart upload key=JR8CIONID4QC upload=8RUXYMIACO43 tag=C1TXD0PAQUNA type=write size=1560920 2023-12-03T11:32:44.805 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.804+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=44S4BOM1QY0G type=del size=2193116 2023-12-03T11:32:44.806 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.805+0000 7f4d50c67780 1 < completed delete operation key=K7YVVH7SAKMC tag=XDU2QTIVYU72 type=del 2023-12-03T11:32:44.807 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.806+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=RL2QG0V3CL3Z type=del size=731995 2023-12-03T11:32:44.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.807+0000 7f4d50c67780 1 < completed delete operation key=YDRAH5EE39R4 tag=9NDP5XG8WEW2 type=del 2023-12-03T11:32:44.809 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.809+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=2ZPTZJ566M3O type=del size=2149278 2023-12-03T11:32:44.811 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.810+0000 7f4d50c67780 1 < completed delete operation key=CQPZ0X62207Z tag=ZWJQDHVJUG2S type=del 2023-12-03T11:32:44.813 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.812+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~12QZAVYUAZWZ.0 size=899094 2023-12-03T11:32:44.813 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.812+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=12QZAVYUAZWZ tag=5SFXJ59GSVB9 type=write size=1947670 2023-12-03T11:32:44.814 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.813+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~0XMT4WYIUWKE.0 size=1048576 2023-12-03T11:32:44.815 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.814+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~0XMT4WYIUWKE.1 size=518739 2023-12-03T11:32:44.817 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.816+0000 7f4d50c67780 1 < completed multipart upload key=TOGV2BZ99FRF upload=0XMT4WYIUWKE tag=E8EBGN6Y28WQ type=write size=2615891 2023-12-03T11:32:44.820 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.819+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=L97WTQ36O27U type=write size=899022 2023-12-03T11:32:44.821 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.820+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=QSW2KBY2W3V5 type=del 2023-12-03T11:32:44.822 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.821+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=T55SXUZG7X79 type=del size=1598396 2023-12-03T11:32:44.823 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.822+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=J3V6AYTSPD8Z type=del 2023-12-03T11:32:44.825 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.824+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~D90UOUT5SXT1.0 size=1048576 2023-12-03T11:32:44.826 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.825+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~D90UOUT5SXT1.1 size=1048576 2023-12-03T11:32:44.827 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.826+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~D90UOUT5SXT1.2 size=555650 2023-12-03T11:32:44.827 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.826+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=D90UOUT5SXT1 tag=V0SO0XOX4POU type=write size=3701378 2023-12-03T11:32:44.828 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.827+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~1LKLWURNMC9S.0 size=1048576 2023-12-03T11:32:44.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.828+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~1LKLWURNMC9S.1 size=746828 2023-12-03T11:32:44.831 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.830+0000 7f4d50c67780 1 < completed multipart upload key=WUM939BATDG9 upload=1LKLWURNMC9S tag=9W7N5VQY56JP type=write size=2843980 2023-12-03T11:32:44.832 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.831+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=ZY5OCICOCWBB type=del size=3443193 2023-12-03T11:32:44.833 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.833+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~TWJSB9S5P1MS.0 size=1039182 2023-12-03T11:32:44.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.835+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=TWJSB9S5P1MS tag=WNZRYFS993KE type=write size=2087758 2023-12-03T11:32:44.838 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.837+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~S5IJSOYE9MDY.0 size=610312 2023-12-03T11:32:44.838 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.837+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=S5IJSOYE9MDY tag=3F7IEAN030MG type=write size=1658888 2023-12-03T11:32:44.839 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.838+0000 7f4d50c67780 1 < completed delete operation key=QQDBWLVSXIHP tag=29GC8STSESGD type=del 2023-12-03T11:32:44.840 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.839+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=4HLJ9QQZEB1F type=write size=965832 2023-12-03T11:32:44.841 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.841+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~O5ROEPD7VCU7.0 size=1048576 2023-12-03T11:32:44.842 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.842+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~O5ROEPD7VCU7.1 size=1048576 2023-12-03T11:32:44.843 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.842+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~O5ROEPD7VCU7.2 size=889570 2023-12-03T11:32:44.845 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.844+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=O5ROEPD7VCU7 tag=DXIKPUUF43XF type=write size=4035298 2023-12-03T11:32:44.846 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.846+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=GCYPEUTIGW4W type=del size=4149074 2023-12-03T11:32:44.849 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.848+0000 7f4d50c67780 1 < suggested remove operation key=ENMJS0KEVS2S tag=55PVFT3IH678 type=del 2023-12-03T11:32:44.850 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.849+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=DKRGN4JIB7ZX type=del size=2235627 2023-12-03T11:32:44.851 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.850+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~AECLYUMX6UKN.0 size=432713 2023-12-03T11:32:44.853 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.852+0000 7f4d50c67780 1 < completed multipart upload key=ENMJS0KEVS2S upload=AECLYUMX6UKN tag=DQRIJSODQ322 type=write size=1481289 2023-12-03T11:32:44.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.853+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=1OZ1SKK6C9D0 type=write size=810669 2023-12-03T11:32:44.855 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.855+0000 7f4d50c67780 -1 < failed to complete operation key=ENMJS0KEVS2S tag=HRUNDR6MLOAP type=del size=69046: (22) Invalid argument 2023-12-03T11:32:44.857 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.856+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=5Z6SHEHQU3CN type=write size=904621 2023-12-03T11:32:44.858 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.857+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=D03OKAO982IC type=del 2023-12-03T11:32:44.860 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.859+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~RDDUO2C1HIWQ.0 size=984632 2023-12-03T11:32:44.860 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.859+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=RDDUO2C1HIWQ tag=2YJ291POR1ZH type=write size=2033208 2023-12-03T11:32:44.862 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.861+0000 7f4d50c67780 1 < completed delete operation key=ZE19S5UCCZ3C tag=QVHILT7K9PY8 type=del 2023-12-03T11:32:44.864 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.863+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~OF7K8YK65XMZ.0 size=1048576 2023-12-03T11:32:44.865 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.864+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~OF7K8YK65XMZ.1 size=1048576 2023-12-03T11:32:44.866 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.865+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~OF7K8YK65XMZ.2 size=61823 2023-12-03T11:32:44.866 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.865+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=OF7K8YK65XMZ tag=791YBKNCAXHP type=write size=3207551 2023-12-03T11:32:44.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.866+0000 7f4d50c67780 1 < completed delete operation key=TEIYINZFFG76 tag=44S4BOM1QY0G type=del 2023-12-03T11:32:44.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.868+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=SNHFL2ZL4HRU type=del size=3122093 2023-12-03T11:32:44.871 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.870+0000 7f4d50c67780 1 < suggested update operation key=K7YVVH7SAKMC tag=RL2QG0V3CL3Z type=del size=731995 2023-12-03T11:32:44.872 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.871+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=UW144XHELBUO type=del size=2168358 2023-12-03T11:32:44.874 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.873+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=2ZPTZJ566M3O type=del 2023-12-03T11:32:44.876 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.875+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~4MGHDPV0C8KX.0 size=1048576 2023-12-03T11:32:44.877 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.876+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~4MGHDPV0C8KX.1 size=1048576 2023-12-03T11:32:44.878 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.877+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~4MGHDPV0C8KX.2 size=272592 2023-12-03T11:32:44.878 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.877+0000 7f4d50c67780 1 > prepared multipart upload key=ENMJS0KEVS2S upload=4MGHDPV0C8KX tag=UIG0O9KLSY9P type=write size=3418320 2023-12-03T11:32:44.879 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.879+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~12QZAVYUAZWZ.0 size=899094 2023-12-03T11:32:44.881 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.881+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=12QZAVYUAZWZ tag=5SFXJ59GSVB9 type=write size=1947670 2023-12-03T11:32:44.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.883+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~UPWVGB9ZWG8O.0 size=498719 2023-12-03T11:32:44.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.883+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=UPWVGB9ZWG8O tag=5FF86N08CS4X type=write size=1547295 2023-12-03T11:32:44.885 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.884+0000 7f4d50c67780 1 < canceled operation key=G0O8EC405LYM tag=L97WTQ36O27U type=write size=899022 2023-12-03T11:32:44.886 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.885+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=QTLSTFSG4TNE type=del size=1586284 2023-12-03T11:32:44.887 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.887+0000 7f4d50c67780 1 < completed delete operation key=EAP0BYZTTT2E tag=T55SXUZG7X79 type=del 2023-12-03T11:32:44.889 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.888+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=P8JEJ7YQZ7NS type=del size=1689498 2023-12-03T11:32:44.890 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.889+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~D90UOUT5SXT1.0 size=1048576 2023-12-03T11:32:44.891 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.890+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~D90UOUT5SXT1.1 size=1048576 2023-12-03T11:32:44.892 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.891+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~D90UOUT5SXT1.2 size=555650 2023-12-03T11:32:44.894 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.893+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=D90UOUT5SXT1 tag=V0SO0XOX4POU type=write size=3701378 2023-12-03T11:32:44.895 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.894+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=OSGCY1O37OON type=write size=777147 2023-12-03T11:32:44.897 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.896+0000 7f4d50c67780 1 < canceled operation key=CQPZ0X62207Z tag=ZY5OCICOCWBB type=del size=3443193 2023-12-03T11:32:44.898 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.897+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=HDICNY0433AS type=del size=1288566 2023-12-03T11:32:44.899 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.898+0000 7f4d50c67780 1 < completed part key=_multipart_CQPZ0X62207Z.2~S5IJSOYE9MDY.0 size=610312 2023-12-03T11:32:44.902 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.901+0000 7f4d50c67780 1 < completed multipart upload key=CQPZ0X62207Z upload=S5IJSOYE9MDY tag=3F7IEAN030MG type=write size=1658888 2023-12-03T11:32:44.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.902+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=BSQF36RR6NQ3 type=write size=217861 2023-12-03T11:32:44.905 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.905+0000 7f4d50c67780 1 < suggested remove operation key=EH4B2QP1C42H tag=4HLJ9QQZEB1F type=write 2023-12-03T11:32:44.907 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.906+0000 7f4d50c67780 1 > prepared operation key=CQPZ0X62207Z tag=IVLI2V5CSV4J type=del size=2380747 2023-12-03T11:32:44.909 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.909+0000 7f4d50c67780 1 < suggested remove operation key=ZE19S5UCCZ3C tag=GCYPEUTIGW4W type=del 2023-12-03T11:32:44.912 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.911+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~G7D2XM3Z1HUK.0 size=320884 2023-12-03T11:32:44.912 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.911+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=G7D2XM3Z1HUK tag=CM04UTIT0O1H type=write size=1369460 2023-12-03T11:32:44.913 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.912+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=DKRGN4JIB7ZX type=del 2023-12-03T11:32:44.914 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.913+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=X2YY3IJ4W4EN type=del size=559452 2023-12-03T11:32:44.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.915+0000 7f4d50c67780 1 < completed write operation key=RF2Q24GI24HJ tag=1OZ1SKK6C9D0 type=write size=810669 2023-12-03T11:32:44.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.916+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=2E4SOMY2L0Z3 type=del size=1200115 2023-12-03T11:32:44.918 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.917+0000 7f4d50c67780 1 < completed write operation key=EY1RBO15PCRR tag=5Z6SHEHQU3CN type=write size=904621 2023-12-03T11:32:44.920 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.919+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~NTW95N0D1CNI.0 size=890698 2023-12-03T11:32:44.920 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.919+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=NTW95N0D1CNI tag=0CE6C566G8DV type=write size=1939274 2023-12-03T11:32:44.921 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.921+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~RDDUO2C1HIWQ.0 size=984632 2023-12-03T11:32:44.923 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.923+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=RDDUO2C1HIWQ tag=2YJ291POR1ZH type=write size=2033208 2023-12-03T11:32:44.926 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.925+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~YQ4VKIPOIA1E.0 size=1048576 2023-12-03T11:32:44.927 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.926+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~YQ4VKIPOIA1E.1 size=882281 2023-12-03T11:32:44.927 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.926+0000 7f4d50c67780 1 > prepared multipart upload key=QQDBWLVSXIHP upload=YQ4VKIPOIA1E tag=ZZPRZD8N943E type=write size=2979433 2023-12-03T11:32:44.928 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.927+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~OF7K8YK65XMZ.0 size=1048576 2023-12-03T11:32:44.929 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.928+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~OF7K8YK65XMZ.1 size=1048576 2023-12-03T11:32:44.930 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.929+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~OF7K8YK65XMZ.2 size=61823 2023-12-03T11:32:44.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.931+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=OF7K8YK65XMZ tag=791YBKNCAXHP type=write size=3207551 2023-12-03T11:32:44.933 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.932+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=T019DNFSY38S type=write size=762806 2023-12-03T11:32:44.936 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.935+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=SNHFL2ZL4HRU type=del 2023-12-03T11:32:44.937 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.936+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=37QWBSIQXCZB type=del size=3833765 2023-12-03T11:32:44.939 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.938+0000 7f4d50c67780 1 < suggested remove operation key=V0ND3OBFJJUB tag=UW144XHELBUO type=del 2023-12-03T11:32:44.941 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.940+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=K1RLMI4CL2NS type=del size=3837065 2023-12-03T11:32:44.942 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.941+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~4MGHDPV0C8KX.0 size=1048576 2023-12-03T11:32:44.942 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.941+0000 7f4d50c67780 1 < canceled part key=_multipart_ENMJS0KEVS2S.2~4MGHDPV0C8KX.1 size=1048576 2023-12-03T11:32:44.943 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.942+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~4MGHDPV0C8KX.2 size=272592 2023-12-03T11:32:44.945 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.944+0000 7f4d50c67780 1 < canceled multipart upload key=ENMJS0KEVS2S upload=4MGHDPV0C8KX tag=UIG0O9KLSY9P type=write size=3418320 2023-12-03T11:32:44.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.946+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~G2T5QVKDVXTK.0 size=1048576 2023-12-03T11:32:44.948 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.947+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~G2T5QVKDVXTK.1 size=515786 2023-12-03T11:32:44.948 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.947+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=G2T5QVKDVXTK tag=9V27TN70IBHI type=write size=2612938 2023-12-03T11:32:44.950 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.949+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~UPWVGB9ZWG8O.0 size=498719 2023-12-03T11:32:44.952 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.951+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=UPWVGB9ZWG8O tag=5FF86N08CS4X type=write size=1547295 2023-12-03T11:32:44.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.953+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=GJR9TBIIFPNY type=write size=391508 2023-12-03T11:32:44.955 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.954+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=QTLSTFSG4TNE type=del 2023-12-03T11:32:44.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.957+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~ONLBRVSGJ3DL.0 size=229713 2023-12-03T11:32:44.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.957+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=ONLBRVSGJ3DL tag=XEG774GSZ711 type=write size=1278289 2023-12-03T11:32:44.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.959+0000 7f4d50c67780 1 < suggested remove operation key=U6R5Y9JXKT32 tag=P8JEJ7YQZ7NS type=del 2023-12-03T11:32:44.961 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.960+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=NKZG1ZFBDYZL type=del size=2007463 2023-12-03T11:32:44.962 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.961+0000 7f4d50c67780 1 < completed write operation key=83I1M5WIVKAA tag=OSGCY1O37OON type=write size=777147 2023-12-03T11:32:44.964 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.963+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~65K33GB78XRZ.0 size=204886 2023-12-03T11:32:44.965 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.963+0000 7f4d50c67780 1 > prepared multipart upload key=YDRAH5EE39R4 upload=65K33GB78XRZ tag=GHWWP857AKT2 type=write size=1253462 2023-12-03T11:32:44.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.965+0000 7f4d50c67780 1 < completed delete operation key=YDRAH5EE39R4 tag=HDICNY0433AS type=del 2023-12-03T11:32:44.967 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.966+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=65VMW7ELBEFZ type=del size=3470146 2023-12-03T11:32:44.968 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.967+0000 7f4d50c67780 1 < canceled operation key=ULLPV2G10BME tag=BSQF36RR6NQ3 type=write size=217861 2023-12-03T11:32:44.969 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.968+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=AGRWRF4NYH0G type=del size=535840 2023-12-03T11:32:44.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.969+0000 7f4d50c67780 1 < completed delete operation key=CQPZ0X62207Z tag=IVLI2V5CSV4J type=del 2023-12-03T11:32:44.971 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.971+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=UDG1ALM32TW6 type=del size=2764667 2023-12-03T11:32:44.973 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.972+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~G7D2XM3Z1HUK.0 size=320884 2023-12-03T11:32:44.975 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.974+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=G7D2XM3Z1HUK tag=CM04UTIT0O1H type=write size=1369460 2023-12-03T11:32:44.976 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.975+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=WG0V27ZKZQI1 type=del size=404197 2023-12-03T11:32:44.977 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.976+0000 7f4d50c67780 1 < completed delete operation key=02W4TX7ZCDI6 tag=X2YY3IJ4W4EN type=del 2023-12-03T11:32:44.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.977+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=0JX2LEVLQSCY type=del size=2271353 2023-12-03T11:32:44.981 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.979+0000 7f4d50c67780 1 < completed delete operation key=WUM939BATDG9 tag=2E4SOMY2L0Z3 type=del 2023-12-03T11:32:44.982 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.981+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~IJ1D1HO3WUFW.0 size=1048576 2023-12-03T11:32:44.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.982+0000 7f4d50c67780 1 > prepared part key=_multipart_TOGV2BZ99FRF.2~IJ1D1HO3WUFW.1 size=756500 2023-12-03T11:32:44.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.982+0000 7f4d50c67780 1 > prepared multipart upload key=TOGV2BZ99FRF upload=IJ1D1HO3WUFW tag=5VM7XEOHQSV0 type=write size=2853652 2023-12-03T11:32:44.984 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.983+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~NTW95N0D1CNI.0 size=890698 2023-12-03T11:32:44.986 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.985+0000 7f4d50c67780 1 < completed multipart upload key=EH4B2QP1C42H upload=NTW95N0D1CNI tag=0CE6C566G8DV type=write size=1939274 2023-12-03T11:32:44.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.986+0000 7f4d50c67780 1 > prepared operation key=QQDBWLVSXIHP tag=HJU0N44D7UXF type=del size=3311962 2023-12-03T11:32:44.989 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.988+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~YQ4VKIPOIA1E.0 size=1048576 2023-12-03T11:32:44.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.989+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~YQ4VKIPOIA1E.1 size=882281 2023-12-03T11:32:44.992 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.991+0000 7f4d50c67780 1 < completed multipart upload key=QQDBWLVSXIHP upload=YQ4VKIPOIA1E tag=ZZPRZD8N943E type=write size=2979433 2023-12-03T11:32:44.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.992+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=8M35PF1IX6GG type=del size=1427462 2023-12-03T11:32:44.994 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.993+0000 7f4d50c67780 1 < completed write operation key=EAP0BYZTTT2E tag=T019DNFSY38S type=write size=762806 2023-12-03T11:32:44.995 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.994+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=WK0G6907BNBF type=write size=138372 2023-12-03T11:32:44.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.996+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=37QWBSIQXCZB type=del 2023-12-03T11:32:44.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.997+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=BRM14L2IYUK5 type=del size=1961525 2023-12-03T11:32:44.999 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:44.998+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=K1RLMI4CL2NS type=del 2023-12-03T11:32:45.001 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.000+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~SP9YDX86G52S.0 size=1048576 2023-12-03T11:32:45.002 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.001+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~SP9YDX86G52S.1 size=1048576 2023-12-03T11:32:45.003 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.002+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~SP9YDX86G52S.2 size=87232 2023-12-03T11:32:45.003 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.002+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=SP9YDX86G52S tag=CF8DV94UQL8J type=write size=3232960 2023-12-03T11:32:45.004 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.003+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~G2T5QVKDVXTK.0 size=1048576 2023-12-03T11:32:45.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.004+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~G2T5QVKDVXTK.1 size=515786 2023-12-03T11:32:45.007 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.007+0000 7f4d50c67780 1 < completed multipart upload key=7C7UX0231SHV upload=G2T5QVKDVXTK tag=9V27TN70IBHI type=write size=2612938 2023-12-03T11:32:45.010 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.009+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~JDFH1Q2NDZMP.0 size=1048576 2023-12-03T11:32:45.011 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.010+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~JDFH1Q2NDZMP.1 size=546967 2023-12-03T11:32:45.011 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.010+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=JDFH1Q2NDZMP tag=FG8CAXAEJJ3N type=write size=2644119 2023-12-03T11:32:45.012 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.011+0000 7f4d50c67780 1 < completed write operation key=V0ND3OBFJJUB tag=GJR9TBIIFPNY type=write size=391508 2023-12-03T11:32:45.014 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.013+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~X0PSLIP0RGNE.0 size=1048576 2023-12-03T11:32:45.015 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.014+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~X0PSLIP0RGNE.1 size=112461 2023-12-03T11:32:45.015 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.014+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=X0PSLIP0RGNE tag=3K46149NRVDJ type=write size=2209613 2023-12-03T11:32:45.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.016+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~ONLBRVSGJ3DL.0 size=229713 2023-12-03T11:32:45.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.018+0000 7f4d50c67780 1 < completed multipart upload key=83I1M5WIVKAA upload=ONLBRVSGJ3DL tag=XEG774GSZ711 type=write size=1278289 2023-12-03T11:32:45.021 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.020+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~U718SZPTB48V.0 size=1048576 2023-12-03T11:32:45.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.021+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~U718SZPTB48V.1 size=420241 2023-12-03T11:32:45.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.021+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=U718SZPTB48V tag=ZNVXKUYDETAR type=write size=2517393 2023-12-03T11:32:45.023 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.022+0000 7f4d50c67780 1 < completed delete operation key=7C7UX0231SHV tag=NKZG1ZFBDYZL type=del 2023-12-03T11:32:45.025 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.024+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~KAU0J858UITR.0 size=1009986 2023-12-03T11:32:45.025 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.024+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=KAU0J858UITR tag=68K9TCR71INO type=write size=2058562 2023-12-03T11:32:45.026 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.025+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~65K33GB78XRZ.0 size=204886 2023-12-03T11:32:45.028 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.027+0000 7f4d50c67780 1 < completed multipart upload key=YDRAH5EE39R4 upload=65K33GB78XRZ tag=GHWWP857AKT2 type=write size=1253462 2023-12-03T11:32:45.030 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.030+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~5JUHQFTOY6KI.0 size=314838 2023-12-03T11:32:45.031 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.030+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=5JUHQFTOY6KI tag=2222SJ00EQBL type=write size=1363414 2023-12-03T11:32:45.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.031+0000 7f4d50c67780 1 < completed delete operation key=TEIYINZFFG76 tag=65VMW7ELBEFZ type=del 2023-12-03T11:32:45.034 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.033+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~DNKAC3DPRKGG.0 size=1048576 2023-12-03T11:32:45.035 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.034+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~DNKAC3DPRKGG.1 size=1048576 2023-12-03T11:32:45.035 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.035+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~DNKAC3DPRKGG.2 size=967621 2023-12-03T11:32:45.036 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.035+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=DNKAC3DPRKGG tag=Y16CELNIBHW8 type=write size=4113349 2023-12-03T11:32:45.037 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.036+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=AGRWRF4NYH0G type=del 2023-12-03T11:32:45.038 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.037+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=USLMKS1XTQ49 type=del size=1053393 2023-12-03T11:32:45.039 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.038+0000 7f4d50c67780 1 < completed delete operation key=TEIYINZFFG76 tag=UDG1ALM32TW6 type=del 2023-12-03T11:32:45.040 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.039+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=Y46D260L8LLL type=del size=989257 2023-12-03T11:32:45.041 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.041+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=WG0V27ZKZQI1 type=del 2023-12-03T11:32:45.043 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.042+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=QDN0H3ZX46PA type=del size=2690185 2023-12-03T11:32:45.044 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.043+0000 7f4d50c67780 1 < completed delete operation key=02W4TX7ZCDI6 tag=0JX2LEVLQSCY type=del 2023-12-03T11:32:45.046 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.045+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~QTTGB0E0CMJ5.0 size=1048576 2023-12-03T11:32:45.047 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.046+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~QTTGB0E0CMJ5.1 size=841341 2023-12-03T11:32:45.047 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.046+0000 7f4d50c67780 1 > prepared multipart upload key=U6R5Y9JXKT32 upload=QTTGB0E0CMJ5 tag=50HH4M17AFO0 type=write size=2938493 2023-12-03T11:32:45.048 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.047+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~IJ1D1HO3WUFW.0 size=1048576 2023-12-03T11:32:45.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.050+0000 7f4d50c67780 1 < completed part key=_multipart_TOGV2BZ99FRF.2~IJ1D1HO3WUFW.1 size=756500 2023-12-03T11:32:45.053 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.052+0000 7f4d50c67780 1 < completed multipart upload key=TOGV2BZ99FRF upload=IJ1D1HO3WUFW tag=5VM7XEOHQSV0 type=write size=2853652 2023-12-03T11:32:45.055 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.054+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~IJW8TACRIGK3.0 size=1048576 2023-12-03T11:32:45.056 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.055+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~IJW8TACRIGK3.1 size=85843 2023-12-03T11:32:45.056 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.055+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=IJW8TACRIGK3 tag=KC67DHA5EIPQ type=write size=2182995 2023-12-03T11:32:45.057 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.056+0000 7f4d50c67780 1 < completed delete operation key=QQDBWLVSXIHP tag=HJU0N44D7UXF type=del 2023-12-03T11:32:45.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.057+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=Q3VR5GF3MDA4 type=del size=4081980 2023-12-03T11:32:45.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.059+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=8M35PF1IX6GG type=del 2023-12-03T11:32:45.061 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.060+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=9QCY2UOPPNNR type=del size=3663007 2023-12-03T11:32:45.062 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.061+0000 7f4d50c67780 1 < completed write operation key=TOGV2BZ99FRF tag=WK0G6907BNBF type=write size=138372 2023-12-03T11:32:45.063 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.063+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=3506Z6F3PF9Q type=del size=3779516 2023-12-03T11:32:45.065 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.064+0000 7f4d50c67780 1 < completed delete operation key=EX93BYX10WJB tag=BRM14L2IYUK5 type=del 2023-12-03T11:32:45.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.065+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=2U5J7NUF0BLN type=del size=2696622 2023-12-03T11:32:45.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.066+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~SP9YDX86G52S.0 size=1048576 2023-12-03T11:32:45.068 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.067+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~SP9YDX86G52S.1 size=1048576 2023-12-03T11:32:45.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.068+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~SP9YDX86G52S.2 size=87232 2023-12-03T11:32:45.071 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.071+0000 7f4d50c67780 1 < completed multipart upload key=83I1M5WIVKAA upload=SP9YDX86G52S tag=CF8DV94UQL8J type=write size=3232960 2023-12-03T11:32:45.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.072+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=1SXQ764UF0MH type=del size=1873279 2023-12-03T11:32:45.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.073+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~JDFH1Q2NDZMP.0 size=1048576 2023-12-03T11:32:45.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.073+0000 7f4d50c67780 1 < canceled part key=_multipart_0M6ZAD39I852.2~JDFH1Q2NDZMP.1 size=546967 2023-12-03T11:32:45.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.075+0000 7f4d50c67780 1 < canceled multipart upload key=0M6ZAD39I852 upload=JDFH1Q2NDZMP tag=FG8CAXAEJJ3N type=write size=2644119 2023-12-03T11:32:45.077 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.076+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=PY52N86Y2708 type=del size=2629786 2023-12-03T11:32:45.079 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.078+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~X0PSLIP0RGNE.0 size=1048576 2023-12-03T11:32:45.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.079+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~X0PSLIP0RGNE.1 size=112461 2023-12-03T11:32:45.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.081+0000 7f4d50c67780 1 < completed multipart upload key=02W4TX7ZCDI6 upload=X0PSLIP0RGNE tag=3K46149NRVDJ type=write size=2209613 2023-12-03T11:32:45.084 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.083+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~PBCKB67W7Z78.0 size=593393 2023-12-03T11:32:45.084 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.083+0000 7f4d50c67780 1 > prepared multipart upload key=ENMJS0KEVS2S upload=PBCKB67W7Z78 tag=93H5IRPUO3SB type=write size=1641969 2023-12-03T11:32:45.085 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.084+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~U718SZPTB48V.0 size=1048576 2023-12-03T11:32:45.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.085+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~U718SZPTB48V.1 size=420241 2023-12-03T11:32:45.088 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.088+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=U718SZPTB48V tag=ZNVXKUYDETAR type=write size=2517393 2023-12-03T11:32:45.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.090+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~6XILBPF979RT.0 size=1048576 2023-12-03T11:32:45.092 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.091+0000 7f4d50c67780 1 > prepared part key=_multipart_WUM939BATDG9.2~6XILBPF979RT.1 size=743483 2023-12-03T11:32:45.092 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.091+0000 7f4d50c67780 1 > prepared multipart upload key=WUM939BATDG9 upload=6XILBPF979RT tag=C92VHH9L4F6X type=write size=2840635 2023-12-03T11:32:45.093 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.092+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~KAU0J858UITR.0 size=1009986 2023-12-03T11:32:45.095 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.094+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=KAU0J858UITR tag=68K9TCR71INO type=write size=2058562 2023-12-03T11:32:45.096 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.095+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=KCT4DJHJ2W20 type=write size=342615 2023-12-03T11:32:45.097 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.096+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~5JUHQFTOY6KI.0 size=314838 2023-12-03T11:32:45.099 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.099+0000 7f4d50c67780 1 < completed multipart upload key=K7YVVH7SAKMC upload=5JUHQFTOY6KI tag=2222SJ00EQBL type=write size=1363414 2023-12-03T11:32:45.101 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.100+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=E53DRV7W38OI type=del size=662989 2023-12-03T11:32:45.102 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.101+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~DNKAC3DPRKGG.0 size=1048576 2023-12-03T11:32:45.103 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.102+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~DNKAC3DPRKGG.1 size=1048576 2023-12-03T11:32:45.104 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.103+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~DNKAC3DPRKGG.2 size=967621 2023-12-03T11:32:45.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.105+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=DNKAC3DPRKGG tag=Y16CELNIBHW8 type=write size=4113349 2023-12-03T11:32:45.107 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.107+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=PZKNRI8WTULQ type=write size=758532 2023-12-03T11:32:45.109 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.108+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=USLMKS1XTQ49 type=del 2023-12-03T11:32:45.111 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.110+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~018GPD1FIBT7.0 size=1048576 2023-12-03T11:32:45.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.111+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~018GPD1FIBT7.1 size=724673 2023-12-03T11:32:45.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.111+0000 7f4d50c67780 1 > prepared multipart upload key=U6R5Y9JXKT32 upload=018GPD1FIBT7 tag=183MG970SV3W type=write size=2821825 2023-12-03T11:32:45.115 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.114+0000 7f4d50c67780 1 < suggested remove operation key=U6R5Y9JXKT32 tag=Y46D260L8LLL type=del 2023-12-03T11:32:45.116 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.115+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=U4QCHD057EL3 type=del size=2109969 2023-12-03T11:32:45.118 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.117+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=QDN0H3ZX46PA type=del 2023-12-03T11:32:45.119 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.118+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=UIQH1GFS7WW5 type=write size=252538 2023-12-03T11:32:45.120 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.119+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~QTTGB0E0CMJ5.0 size=1048576 2023-12-03T11:32:45.121 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.120+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~QTTGB0E0CMJ5.1 size=841341 2023-12-03T11:32:45.123 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.122+0000 7f4d50c67780 1 < completed multipart upload key=U6R5Y9JXKT32 upload=QTTGB0E0CMJ5 tag=50HH4M17AFO0 type=write size=2938493 2023-12-03T11:32:45.125 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.125+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~QKSNFI0MTEYK.0 size=1048576 2023-12-03T11:32:45.127 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.126+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~QKSNFI0MTEYK.1 size=52441 2023-12-03T11:32:45.127 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.126+0000 7f4d50c67780 1 > prepared multipart upload key=YDRAH5EE39R4 upload=QKSNFI0MTEYK tag=TTVXAQ2AR5YC type=write size=2149593 2023-12-03T11:32:45.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.127+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~IJW8TACRIGK3.0 size=1048576 2023-12-03T11:32:45.129 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.128+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~IJW8TACRIGK3.1 size=85843 2023-12-03T11:32:45.131 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.130+0000 7f4d50c67780 1 < completed multipart upload key=V0ND3OBFJJUB upload=IJW8TACRIGK3 tag=KC67DHA5EIPQ type=write size=2182995 2023-12-03T11:32:45.134 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.133+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~2A6JXDR2XJLT.0 size=752054 2023-12-03T11:32:45.134 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.133+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=2A6JXDR2XJLT tag=CZSSS8UQYK3T type=write size=1800630 2023-12-03T11:32:45.136 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.135+0000 7f4d50c67780 1 < suggested remove operation key=JBL6IOJC4TT0 tag=Q3VR5GF3MDA4 type=del 2023-12-03T11:32:45.139 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.138+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~Z4BMJXN0RWR3.0 size=914192 2023-12-03T11:32:45.139 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.138+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=Z4BMJXN0RWR3 tag=F7LL7NBV6IR2 type=write size=1962768 2023-12-03T11:32:45.140 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.139+0000 7f4d50c67780 1 < completed delete operation key=MLKGLDFFDC3W tag=9QCY2UOPPNNR type=del 2023-12-03T11:32:45.141 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.140+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=EL8JQCM5OGFM type=del size=2859801 2023-12-03T11:32:45.144 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.143+0000 7f4d50c67780 1 < suggested update operation key=ZE19S5UCCZ3C tag=3506Z6F3PF9Q type=del size=3779516 2023-12-03T11:32:45.145 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.144+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=RHJ93Y002A0S type=del size=3847928 2023-12-03T11:32:45.147 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.146+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=2U5J7NUF0BLN type=del 2023-12-03T11:32:45.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.147+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=MZIFSN62GICP type=del size=1769698 2023-12-03T11:32:45.149 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.148+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=1SXQ764UF0MH type=del 2023-12-03T11:32:45.150 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.149+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=H7WWW3KRXSD1 type=del size=1294066 2023-12-03T11:32:45.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.151+0000 7f4d50c67780 1 < completed delete operation key=JR8CIONID4QC tag=PY52N86Y2708 type=del 2023-12-03T11:32:45.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.152+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=BLKLFT8C788R type=del size=3405582 2023-12-03T11:32:45.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.153+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~PBCKB67W7Z78.0 size=593393 2023-12-03T11:32:45.156 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.155+0000 7f4d50c67780 1 < completed multipart upload key=ENMJS0KEVS2S upload=PBCKB67W7Z78 tag=93H5IRPUO3SB type=write size=1641969 2023-12-03T11:32:45.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.156+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=U25EWPJNTD3F type=write size=780142 2023-12-03T11:32:45.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.157+0000 7f4d50c67780 1 < canceled part key=_multipart_WUM939BATDG9.2~6XILBPF979RT.0 size=1048576 2023-12-03T11:32:45.158 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.158+0000 7f4d50c67780 1 < completed part key=_multipart_WUM939BATDG9.2~6XILBPF979RT.1 size=743483 2023-12-03T11:32:45.160 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.159+0000 7f4d50c67780 1 < canceled multipart upload key=WUM939BATDG9 upload=6XILBPF979RT tag=C92VHH9L4F6X type=write size=2840635 2023-12-03T11:32:45.162 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.161+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=FYBMN84L9IEY type=del size=1655675 2023-12-03T11:32:45.163 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.162+0000 7f4d50c67780 1 < completed write operation key=TEIYINZFFG76 tag=KCT4DJHJ2W20 type=write size=342615 2023-12-03T11:32:45.164 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.163+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=QP4UWIFDFNU0 type=del size=2559740 2023-12-03T11:32:45.166 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.165+0000 7f4d50c67780 1 < suggested update operation key=ULLPV2G10BME tag=E53DRV7W38OI type=del size=662989 2023-12-03T11:32:45.170 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.169+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~ROD38P4HTWB3.0 size=1048576 2023-12-03T11:32:45.171 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.170+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~ROD38P4HTWB3.1 size=1048576 2023-12-03T11:32:45.172 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.171+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~ROD38P4HTWB3.2 size=981349 2023-12-03T11:32:45.172 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.171+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=ROD38P4HTWB3 tag=HDX34BXJYTD5 type=write size=4127077 2023-12-03T11:32:45.173 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.173+0000 7f4d50c67780 -1 < failed to complete operation key=JBL6IOJC4TT0 tag=PZKNRI8WTULQ type=write size=758532: (22) Invalid argument 2023-12-03T11:32:45.175 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.174+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=AM0KH4C5JEVL type=write size=799913 2023-12-03T11:32:45.175 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.174+0000 7f4d50c67780 1 < canceled part key=_multipart_U6R5Y9JXKT32.2~018GPD1FIBT7.0 size=1048576 2023-12-03T11:32:45.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.175+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~018GPD1FIBT7.1 size=724673 2023-12-03T11:32:45.178 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.177+0000 7f4d50c67780 1 < canceled multipart upload key=U6R5Y9JXKT32 upload=018GPD1FIBT7 tag=183MG970SV3W type=write size=2821825 2023-12-03T11:32:45.180 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.179+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~QO5WAAFPR403.0 size=1048576 2023-12-03T11:32:45.181 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.180+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~QO5WAAFPR403.1 size=1048576 2023-12-03T11:32:45.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.181+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~QO5WAAFPR403.2 size=296223 2023-12-03T11:32:45.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.181+0000 7f4d50c67780 1 > prepared multipart upload key=YDRAH5EE39R4 upload=QO5WAAFPR403 tag=E8D0PIGEHJZF type=write size=3441951 2023-12-03T11:32:45.185 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.183+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=U4QCHD057EL3 type=del 2023-12-03T11:32:45.186 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.185+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~P49PYPWTNY7N.0 size=1048576 2023-12-03T11:32:45.187 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.186+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~P49PYPWTNY7N.1 size=545920 2023-12-03T11:32:45.187 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.186+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=P49PYPWTNY7N tag=1GE143WHS5HX type=write size=2643072 2023-12-03T11:32:45.188 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.187+0000 7f4d50c67780 1 < completed write operation key=K7YVVH7SAKMC tag=UIQH1GFS7WW5 type=write size=252538 2023-12-03T11:32:45.189 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.188+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=ZCKECMAH29KW type=del size=2018814 2023-12-03T11:32:45.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.190+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~QKSNFI0MTEYK.0 size=1048576 2023-12-03T11:32:45.191 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.191+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~QKSNFI0MTEYK.1 size=52441 2023-12-03T11:32:45.194 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.193+0000 7f4d50c67780 1 < completed multipart upload key=YDRAH5EE39R4 upload=QKSNFI0MTEYK tag=TTVXAQ2AR5YC type=write size=2149593 2023-12-03T11:32:45.196 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.195+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~VLQROXX29F67.0 size=1047946 2023-12-03T11:32:45.196 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.195+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=VLQROXX29F67 tag=3M6QSECB34D6 type=write size=2096522 2023-12-03T11:32:45.197 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.196+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~2A6JXDR2XJLT.0 size=752054 2023-12-03T11:32:45.199 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.198+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=2A6JXDR2XJLT tag=CZSSS8UQYK3T type=write size=1800630 2023-12-03T11:32:45.201 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.200+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~BVJNDY204IV8.0 size=1048576 2023-12-03T11:32:45.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.201+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~BVJNDY204IV8.1 size=538782 2023-12-03T11:32:45.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.201+0000 7f4d50c67780 1 > prepared multipart upload key=QQDBWLVSXIHP upload=BVJNDY204IV8 tag=TZEYMWJT286S type=write size=2635934 2023-12-03T11:32:45.203 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.203+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~Z4BMJXN0RWR3.0 size=914192 2023-12-03T11:32:45.205 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.205+0000 7f4d50c67780 1 < completed multipart upload key=EAP0BYZTTT2E upload=Z4BMJXN0RWR3 tag=F7LL7NBV6IR2 type=write size=1962768 2023-12-03T11:32:45.208 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.207+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~1TXCGQSA08VL.0 size=452077 2023-12-03T11:32:45.208 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.207+0000 7f4d50c67780 1 > prepared multipart upload key=RF2Q24GI24HJ upload=1TXCGQSA08VL tag=0D490U55PNIE type=write size=1500653 2023-12-03T11:32:45.209 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.208+0000 7f4d50c67780 1 < completed delete operation key=52E31L45TN7V tag=EL8JQCM5OGFM type=del 2023-12-03T11:32:45.212 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.210+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~ISE362OHEANH.0 size=1048576 2023-12-03T11:32:45.212 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.211+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~ISE362OHEANH.1 size=14526 2023-12-03T11:32:45.212 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.211+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=ISE362OHEANH tag=T233319O0YVI type=write size=2111678 2023-12-03T11:32:45.215 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.214+0000 7f4d50c67780 1 < suggested update operation key=ZE19S5UCCZ3C tag=RHJ93Y002A0S type=del size=3847928 2023-12-03T11:32:45.216 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.215+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=8N2PSDJ546N2 type=write size=260712 2023-12-03T11:32:45.217 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.216+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=MZIFSN62GICP type=del 2023-12-03T11:32:45.218 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.218+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=EQEVWKNVOQU2 type=del size=1801761 2023-12-03T11:32:45.220 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.219+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=H7WWW3KRXSD1 type=del 2023-12-03T11:32:45.221 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.220+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=3VXPCX5MG203 type=del size=3423338 2023-12-03T11:32:45.222 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.221+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=BLKLFT8C788R type=del 2023-12-03T11:32:45.223 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.222+0000 7f4d50c67780 1 > prepared operation key=K7YVVH7SAKMC tag=FPWPZEVOKO8C type=del size=2899685 2023-12-03T11:32:45.225 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.224+0000 7f4d50c67780 1 < completed write operation key=0M6ZAD39I852 tag=U25EWPJNTD3F type=write size=780142 2023-12-03T11:32:45.227 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.226+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~F8NPKAH83OF3.0 size=1048576 2023-12-03T11:32:45.228 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.227+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~F8NPKAH83OF3.1 size=1048576 2023-12-03T11:32:45.229 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.228+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~F8NPKAH83OF3.2 size=387991 2023-12-03T11:32:45.229 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.228+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=F8NPKAH83OF3 tag=NBHMTI1MVKH9 type=write size=3533719 2023-12-03T11:32:45.230 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.229+0000 7f4d50c67780 1 < completed delete operation key=WUM939BATDG9 tag=FYBMN84L9IEY type=del 2023-12-03T11:32:45.231 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.230+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=NFMTMQGU38VA type=del size=17841 2023-12-03T11:32:45.232 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.232+0000 7f4d50c67780 1 < completed delete operation key=TEIYINZFFG76 tag=QP4UWIFDFNU0 type=del 2023-12-03T11:32:45.235 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.234+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~HQLA6RXAIQLU.0 size=1048576 2023-12-03T11:32:45.236 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.235+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~HQLA6RXAIQLU.1 size=345379 2023-12-03T11:32:45.236 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.235+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=HQLA6RXAIQLU tag=RCR058CLJN2Z type=write size=2442531 2023-12-03T11:32:45.237 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.236+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~ROD38P4HTWB3.0 size=1048576 2023-12-03T11:32:45.238 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.237+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~ROD38P4HTWB3.1 size=1048576 2023-12-03T11:32:45.239 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.238+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~ROD38P4HTWB3.2 size=981349 2023-12-03T11:32:45.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.240+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=ROD38P4HTWB3 tag=HDX34BXJYTD5 type=write size=4127077 2023-12-03T11:32:45.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.242+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=3UUNZM9F74ZL type=write size=352900 2023-12-03T11:32:45.244 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.243+0000 7f4d50c67780 1 < completed write operation key=RF2Q24GI24HJ tag=AM0KH4C5JEVL type=write size=799913 2023-12-03T11:32:45.245 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.244+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=LH0ZMPRMXYTJ type=del size=2793194 2023-12-03T11:32:45.246 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.246+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~QO5WAAFPR403.0 size=1048576 2023-12-03T11:32:45.247 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.247+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~QO5WAAFPR403.1 size=1048576 2023-12-03T11:32:45.248 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.248+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~QO5WAAFPR403.2 size=296223 2023-12-03T11:32:45.250 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.250+0000 7f4d50c67780 1 < completed multipart upload key=YDRAH5EE39R4 upload=QO5WAAFPR403 tag=E8D0PIGEHJZF type=write size=3441951 2023-12-03T11:32:45.252 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.252+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~CCH9PKQNI079.0 size=1048576 2023-12-03T11:32:45.253 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.253+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~CCH9PKQNI079.1 size=822043 2023-12-03T11:32:45.254 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.253+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=CCH9PKQNI079 tag=BN25KHAGYVS3 type=write size=2919195 2023-12-03T11:32:45.255 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.254+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~P49PYPWTNY7N.0 size=1048576 2023-12-03T11:32:45.256 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.255+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~P49PYPWTNY7N.1 size=545920 2023-12-03T11:32:45.257 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.257+0000 7f4d50c67780 1 < completed multipart upload key=GTLP2WZUX7U8 upload=P49PYPWTNY7N tag=1GE143WHS5HX type=write size=2643072 2023-12-03T11:32:45.259 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.258+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=YE1OUWJ0EKRZ type=write size=296065 2023-12-03T11:32:45.260 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.259+0000 7f4d50c67780 1 < canceled operation key=JR8CIONID4QC tag=ZCKECMAH29KW type=del size=2018814 2023-12-03T11:32:45.261 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.260+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=TXL8NQSUCW2T type=write size=709566 2023-12-03T11:32:45.262 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.261+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~VLQROXX29F67.0 size=1047946 2023-12-03T11:32:45.264 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.263+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=VLQROXX29F67 tag=3M6QSECB34D6 type=write size=2096522 2023-12-03T11:32:45.266 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.265+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=8HR9VB7BT9F8 type=del size=1312745 2023-12-03T11:32:45.266 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.265+0000 7f4d50c67780 1 < canceled part key=_multipart_QQDBWLVSXIHP.2~BVJNDY204IV8.0 size=1048576 2023-12-03T11:32:45.267 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.266+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~BVJNDY204IV8.1 size=538782 2023-12-03T11:32:45.268 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.268+0000 7f4d50c67780 1 < canceled multipart upload key=QQDBWLVSXIHP upload=BVJNDY204IV8 tag=TZEYMWJT286S type=write size=2635934 2023-12-03T11:32:45.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.270+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~5W0NNLGJ1VQV.0 size=364150 2023-12-03T11:32:45.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.270+0000 7f4d50c67780 1 > prepared multipart upload key=52E31L45TN7V upload=5W0NNLGJ1VQV tag=2VRCAM63TRWI type=write size=1412726 2023-12-03T11:32:45.272 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.271+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~1TXCGQSA08VL.0 size=452077 2023-12-03T11:32:45.274 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.273+0000 7f4d50c67780 1 < completed multipart upload key=RF2Q24GI24HJ upload=1TXCGQSA08VL tag=0D490U55PNIE type=write size=1500653 2023-12-03T11:32:45.276 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.275+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~T2Q6SZYHTR85.0 size=1048576 2023-12-03T11:32:45.277 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.276+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~T2Q6SZYHTR85.1 size=857515 2023-12-03T11:32:45.277 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.276+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=T2Q6SZYHTR85 tag=200HLTRSCAZ2 type=write size=2954667 2023-12-03T11:32:45.278 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.277+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~ISE362OHEANH.0 size=1048576 2023-12-03T11:32:45.279 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.278+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~ISE362OHEANH.1 size=14526 2023-12-03T11:32:45.283 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.282+0000 7f4d50c67780 1 < completed multipart upload key=MLKGLDFFDC3W upload=ISE362OHEANH tag=T233319O0YVI type=write size=2111678 2023-12-03T11:32:45.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.284+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~SEGDLWH82IND.0 size=1048576 2023-12-03T11:32:45.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.285+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~SEGDLWH82IND.1 size=570453 2023-12-03T11:32:45.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.285+0000 7f4d50c67780 1 > prepared multipart upload key=U6R5Y9JXKT32 upload=SEGDLWH82IND tag=SCMYI7RKLHE9 type=write size=2667605 2023-12-03T11:32:45.287 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.286+0000 7f4d50c67780 1 < completed write operation key=RF2Q24GI24HJ tag=8N2PSDJ546N2 type=write size=260712 2023-12-03T11:32:45.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.287+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=QQLOQCNI7ZZI type=write size=163527 2023-12-03T11:32:45.289 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.288+0000 7f4d50c67780 1 < completed delete operation key=EX93BYX10WJB tag=EQEVWKNVOQU2 type=del 2023-12-03T11:32:45.290 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.290+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=JCZII1J6UM9E type=del size=130296 2023-12-03T11:32:45.292 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.291+0000 7f4d50c67780 1 < canceled operation key=83I1M5WIVKAA tag=3VXPCX5MG203 type=del size=3423338 2023-12-03T11:32:45.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.293+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~PW2H4NM2TVYY.0 size=488007 2023-12-03T11:32:45.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.293+0000 7f4d50c67780 1 > prepared multipart upload key=52E31L45TN7V upload=PW2H4NM2TVYY tag=W516WBFPBDGC type=write size=1536583 2023-12-03T11:32:45.296 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.295+0000 7f4d50c67780 1 < suggested remove operation key=K7YVVH7SAKMC tag=FPWPZEVOKO8C type=del 2023-12-03T11:32:45.297 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.297+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=U1SU4P78IOBC type=del size=1546685 2023-12-03T11:32:45.299 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.298+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~F8NPKAH83OF3.0 size=1048576 2023-12-03T11:32:45.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.299+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~F8NPKAH83OF3.1 size=1048576 2023-12-03T11:32:45.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.300+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~F8NPKAH83OF3.2 size=387991 2023-12-03T11:32:45.303 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.302+0000 7f4d50c67780 1 < completed multipart upload key=7C7UX0231SHV upload=F8NPKAH83OF3 tag=NBHMTI1MVKH9 type=write size=3533719 2023-12-03T11:32:45.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.303+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=FEGF1WOH335C type=del size=3452548 2023-12-03T11:32:45.305 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.304+0000 7f4d50c67780 1 < completed delete operation key=EX93BYX10WJB tag=NFMTMQGU38VA type=del 2023-12-03T11:32:45.307 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.306+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~LZJT2T223O4A.0 size=200306 2023-12-03T11:32:45.307 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.306+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=LZJT2T223O4A tag=KS08SSUCGG15 type=write size=1248882 2023-12-03T11:32:45.308 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.307+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~HQLA6RXAIQLU.0 size=1048576 2023-12-03T11:32:45.309 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.308+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~HQLA6RXAIQLU.1 size=345379 2023-12-03T11:32:45.311 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.310+0000 7f4d50c67780 1 < completed multipart upload key=7C7UX0231SHV upload=HQLA6RXAIQLU tag=RCR058CLJN2Z type=write size=2442531 2023-12-03T11:32:45.312 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.311+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=HFTW7CO0HJ2G type=del size=4088999 2023-12-03T11:32:45.314 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.313+0000 7f4d50c67780 1 < canceled operation key=GTLP2WZUX7U8 tag=3UUNZM9F74ZL type=write size=352900 2023-12-03T11:32:45.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.315+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~VANC07RO1B2Q.0 size=1048576 2023-12-03T11:32:45.316 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.316+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~VANC07RO1B2Q.1 size=1048576 2023-12-03T11:32:45.317 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.316+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~VANC07RO1B2Q.2 size=41639 2023-12-03T11:32:45.318 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.316+0000 7f4d50c67780 1 > prepared multipart upload key=ZE19S5UCCZ3C upload=VANC07RO1B2Q tag=SR5P8KS1CZ24 type=write size=3187367 2023-12-03T11:32:45.320 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.319+0000 7f4d50c67780 1 < suggested update operation key=7C7UX0231SHV tag=LH0ZMPRMXYTJ type=del size=2793194 2023-12-03T11:32:45.321 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.320+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=PCDISJX6ODUN type=del size=2766107 2023-12-03T11:32:45.322 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.321+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~CCH9PKQNI079.0 size=1048576 2023-12-03T11:32:45.323 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.322+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~CCH9PKQNI079.1 size=822043 2023-12-03T11:32:45.325 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.325+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=CCH9PKQNI079 tag=BN25KHAGYVS3 type=write size=2919195 2023-12-03T11:32:45.327 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.326+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=D1NDOTSVVEA9 type=del size=3221329 2023-12-03T11:32:45.328 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.327+0000 7f4d50c67780 1 < completed write operation key=XM5E3D99MXVA tag=YE1OUWJ0EKRZ type=write size=296065 2023-12-03T11:32:45.329 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.328+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=6VHKWTLM1GEH type=del size=2994178 2023-12-03T11:32:45.330 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.330+0000 7f4d50c67780 1 < completed write operation key=JBL6IOJC4TT0 tag=TXL8NQSUCW2T type=write size=709566 2023-12-03T11:32:45.333 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.332+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~3HA1PMKW0UK1.0 size=298456 2023-12-03T11:32:45.333 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.332+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=3HA1PMKW0UK1 tag=QL3RL4IA8WJ3 type=write size=1347032 2023-12-03T11:32:45.335 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.334+0000 7f4d50c67780 1 < suggested update operation key=U6R5Y9JXKT32 tag=8HR9VB7BT9F8 type=del size=1312745 2023-12-03T11:32:45.337 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.336+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=VYJFDWOICR3W type=del size=3769600 2023-12-03T11:32:45.338 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.337+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~5W0NNLGJ1VQV.0 size=364150 2023-12-03T11:32:45.340 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.339+0000 7f4d50c67780 1 < completed multipart upload key=52E31L45TN7V upload=5W0NNLGJ1VQV tag=2VRCAM63TRWI type=write size=1412726 2023-12-03T11:32:45.342 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.341+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~Y4PKDNNF7AVU.0 size=1048576 2023-12-03T11:32:45.343 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.342+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~Y4PKDNNF7AVU.1 size=1048576 2023-12-03T11:32:45.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.343+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~Y4PKDNNF7AVU.2 size=1031738 2023-12-03T11:32:45.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.343+0000 7f4d50c67780 1 > prepared multipart upload key=QQDBWLVSXIHP upload=Y4PKDNNF7AVU tag=1PAPUKZ19POG type=write size=4177466 2023-12-03T11:32:45.345 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.345+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~T2Q6SZYHTR85.0 size=1048576 2023-12-03T11:32:45.346 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.346+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~T2Q6SZYHTR85.1 size=857515 2023-12-03T11:32:45.349 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.348+0000 7f4d50c67780 1 < completed multipart upload key=MLKGLDFFDC3W upload=T2Q6SZYHTR85 tag=200HLTRSCAZ2 type=write size=2954667 2023-12-03T11:32:45.351 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.350+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~6FVE2T1EQCGN.0 size=1041731 2023-12-03T11:32:45.351 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.350+0000 7f4d50c67780 1 > prepared multipart upload key=RF2Q24GI24HJ upload=6FVE2T1EQCGN tag=W4DYN43N5L2D type=write size=2090307 2023-12-03T11:32:45.352 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.351+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~SEGDLWH82IND.0 size=1048576 2023-12-03T11:32:45.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.352+0000 7f4d50c67780 1 < completed part key=_multipart_U6R5Y9JXKT32.2~SEGDLWH82IND.1 size=570453 2023-12-03T11:32:45.355 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.354+0000 7f4d50c67780 1 < completed multipart upload key=U6R5Y9JXKT32 upload=SEGDLWH82IND tag=SCMYI7RKLHE9 type=write size=2667605 2023-12-03T11:32:45.357 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.356+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~H7DHADJIKA02.0 size=1048576 2023-12-03T11:32:45.358 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.357+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~H7DHADJIKA02.1 size=1048576 2023-12-03T11:32:45.359 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.358+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~H7DHADJIKA02.2 size=970864 2023-12-03T11:32:45.359 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.358+0000 7f4d50c67780 1 > prepared multipart upload key=YDRAH5EE39R4 upload=H7DHADJIKA02 tag=L343184Y47A2 type=write size=4116592 2023-12-03T11:32:45.360 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.360+0000 7f4d50c67780 1 < completed write operation key=BX5POXMMYLB7 tag=QQLOQCNI7ZZI type=write size=163527 2023-12-03T11:32:45.362 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.361+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=HFDN6H432TMI type=del size=2785342 2023-12-03T11:32:45.363 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.362+0000 7f4d50c67780 -1 < failed to complete operation key=7C7UX0231SHV tag=JCZII1J6UM9E type=del size=130296: (22) Invalid argument 2023-12-03T11:32:45.364 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.363+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=NPKGO5YCS6VB type=del size=233423 2023-12-03T11:32:45.365 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.364+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~PW2H4NM2TVYY.0 size=488007 2023-12-03T11:32:45.367 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.366+0000 7f4d50c67780 1 < completed multipart upload key=52E31L45TN7V upload=PW2H4NM2TVYY tag=W516WBFPBDGC type=write size=1536583 2023-12-03T11:32:45.369 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.369+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~TXAWF6S5MIWH.0 size=34684 2023-12-03T11:32:45.369 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.369+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=TXAWF6S5MIWH tag=TFU0CHOAW25V type=write size=1083260 2023-12-03T11:32:45.372 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.371+0000 7f4d50c67780 1 < suggested remove operation key=EY1RBO15PCRR tag=U1SU4P78IOBC type=del 2023-12-03T11:32:45.374 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.373+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~MSC4A9A6QUTE.0 size=1048576 2023-12-03T11:32:45.375 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.374+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~MSC4A9A6QUTE.1 size=267248 2023-12-03T11:32:45.375 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.374+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=MSC4A9A6QUTE tag=V65KVEAUAPZN type=write size=2364400 2023-12-03T11:32:45.376 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.375+0000 7f4d50c67780 -1 < failed to complete operation key=U6R5Y9JXKT32 tag=FEGF1WOH335C type=del size=3452548: (22) Invalid argument 2023-12-03T11:32:45.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.376+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=MRX9JKDJW7KB type=del size=2805034 2023-12-03T11:32:45.378 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.378+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~LZJT2T223O4A.0 size=200306 2023-12-03T11:32:45.380 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.380+0000 7f4d50c67780 1 < completed multipart upload key=K7YVVH7SAKMC upload=LZJT2T223O4A tag=KS08SSUCGG15 type=write size=1248882 2023-12-03T11:32:45.382 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.381+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=N0SBI7RHIF9N type=write size=229362 2023-12-03T11:32:45.384 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.383+0000 7f4d50c67780 1 < suggested remove operation key=JBL6IOJC4TT0 tag=HFTW7CO0HJ2G type=del 2023-12-03T11:32:45.386 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.385+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~4K1OKW50LNOZ.0 size=1048576 2023-12-03T11:32:45.387 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.386+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~4K1OKW50LNOZ.1 size=1048576 2023-12-03T11:32:45.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.388+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~4K1OKW50LNOZ.2 size=240598 2023-12-03T11:32:45.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.388+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=4K1OKW50LNOZ tag=90AWNI77HFBG type=write size=3386326 2023-12-03T11:32:45.390 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.389+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~VANC07RO1B2Q.0 size=1048576 2023-12-03T11:32:45.391 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.390+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~VANC07RO1B2Q.1 size=1048576 2023-12-03T11:32:45.391 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.390+0000 7f4d50c67780 1 < canceled part key=_multipart_ZE19S5UCCZ3C.2~VANC07RO1B2Q.2 size=41639 2023-12-03T11:32:45.394 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.393+0000 7f4d50c67780 1 < canceled multipart upload key=ZE19S5UCCZ3C upload=VANC07RO1B2Q tag=SR5P8KS1CZ24 type=write size=3187367 2023-12-03T11:32:45.395 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.394+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=H2G1V7SIO7KZ type=write size=156424 2023-12-03T11:32:45.396 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.396+0000 7f4d50c67780 1 < completed delete operation key=73SL3ZBBDA6Q tag=PCDISJX6ODUN type=del 2023-12-03T11:32:45.398 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.397+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=57I2QQOZAQGI type=del size=1772922 2023-12-03T11:32:45.399 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.398+0000 7f4d50c67780 1 < completed delete operation key=EH4B2QP1C42H tag=D1NDOTSVVEA9 type=del 2023-12-03T11:32:45.400 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.399+0000 7f4d50c67780 1 > prepared operation key=7C7UX0231SHV tag=PM4ASQE6P6XJ type=write size=228051 2023-12-03T11:32:45.401 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.400+0000 7f4d50c67780 1 < canceled operation key=MLKGLDFFDC3W tag=6VHKWTLM1GEH type=del size=2994178 2023-12-03T11:32:45.403 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.403+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~433AUNEUS8RL.0 size=114764 2023-12-03T11:32:45.404 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.403+0000 7f4d50c67780 1 > prepared multipart upload key=ZE19S5UCCZ3C upload=433AUNEUS8RL tag=1FCQWYERBVDI type=write size=1163340 2023-12-03T11:32:45.405 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.404+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~3HA1PMKW0UK1.0 size=298456 2023-12-03T11:32:45.407 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.406+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=3HA1PMKW0UK1 tag=QL3RL4IA8WJ3 type=write size=1347032 2023-12-03T11:32:45.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.408+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~PCX93087CPSZ.0 size=1048576 2023-12-03T11:32:45.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.409+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~PCX93087CPSZ.1 size=1048576 2023-12-03T11:32:45.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.410+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~PCX93087CPSZ.2 size=560737 2023-12-03T11:32:45.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.410+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=PCX93087CPSZ tag=F517N4VYW2OS type=write size=3706465 2023-12-03T11:32:45.413 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.412+0000 7f4d50c67780 1 < suggested update operation key=GTLP2WZUX7U8 tag=VYJFDWOICR3W type=del size=3769600 2023-12-03T11:32:45.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.414+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=5XTNGY2WSPTD type=del size=2317710 2023-12-03T11:32:45.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.415+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~Y4PKDNNF7AVU.0 size=1048576 2023-12-03T11:32:45.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.416+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~Y4PKDNNF7AVU.1 size=1048576 2023-12-03T11:32:45.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.416+0000 7f4d50c67780 1 < canceled part key=_multipart_QQDBWLVSXIHP.2~Y4PKDNNF7AVU.2 size=1031738 2023-12-03T11:32:45.419 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.418+0000 7f4d50c67780 1 < canceled multipart upload key=QQDBWLVSXIHP upload=Y4PKDNNF7AVU tag=1PAPUKZ19POG type=write size=4177466 2023-12-03T11:32:45.421 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.420+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~3SHEMHT8X26M.0 size=1048576 2023-12-03T11:32:45.422 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.421+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~3SHEMHT8X26M.1 size=743659 2023-12-03T11:32:45.422 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.421+0000 7f4d50c67780 1 > prepared multipart upload key=ENMJS0KEVS2S upload=3SHEMHT8X26M tag=7824A7DI3WLC type=write size=2840811 2023-12-03T11:32:45.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.422+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~6FVE2T1EQCGN.0 size=1041731 2023-12-03T11:32:45.425 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.424+0000 7f4d50c67780 1 < completed multipart upload key=RF2Q24GI24HJ upload=6FVE2T1EQCGN tag=W4DYN43N5L2D type=write size=2090307 2023-12-03T11:32:45.427 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.426+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~QUISUQ83R3DT.0 size=622289 2023-12-03T11:32:45.427 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.426+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=QUISUQ83R3DT tag=2O24I5RTV4JK type=write size=1670865 2023-12-03T11:32:45.428 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.427+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~H7DHADJIKA02.0 size=1048576 2023-12-03T11:32:45.429 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.428+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~H7DHADJIKA02.1 size=1048576 2023-12-03T11:32:45.430 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.430+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~H7DHADJIKA02.2 size=970864 2023-12-03T11:32:45.432 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.432+0000 7f4d50c67780 1 < completed multipart upload key=YDRAH5EE39R4 upload=H7DHADJIKA02 tag=L343184Y47A2 type=write size=4116592 2023-12-03T11:32:45.434 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.433+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=URRCKRL8UL01 type=del size=1048722 2023-12-03T11:32:45.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.435+0000 7f4d50c67780 1 < suggested update operation key=RF2Q24GI24HJ tag=HFDN6H432TMI type=del size=2785342 2023-12-03T11:32:45.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.437+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=ZD3YIL22MO77 type=del size=2058425 2023-12-03T11:32:45.440 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.439+0000 7f4d50c67780 1 < suggested remove operation key=8J1EO2JDQUQH tag=NPKGO5YCS6VB type=del 2023-12-03T11:32:45.441 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.441+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=CAJ0JC2KHQLI type=del size=3361957 2023-12-03T11:32:45.443 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.442+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~TXAWF6S5MIWH.0 size=34684 2023-12-03T11:32:45.445 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.444+0000 7f4d50c67780 1 < completed multipart upload key=7C7UX0231SHV upload=TXAWF6S5MIWH tag=TFU0CHOAW25V type=write size=1083260 2023-12-03T11:32:45.446 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.446+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=SN9N12Y1G9D8 type=del size=3627172 2023-12-03T11:32:45.447 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.446+0000 7f4d50c67780 1 < canceled part key=_multipart_02W4TX7ZCDI6.2~MSC4A9A6QUTE.0 size=1048576 2023-12-03T11:32:45.448 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.447+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~MSC4A9A6QUTE.1 size=267248 2023-12-03T11:32:45.450 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.449+0000 7f4d50c67780 1 < canceled multipart upload key=02W4TX7ZCDI6 upload=MSC4A9A6QUTE tag=V65KVEAUAPZN type=write size=2364400 2023-12-03T11:32:45.452 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.452+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~V56MLFX0R8Q9.0 size=408354 2023-12-03T11:32:45.452 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.452+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=V56MLFX0R8Q9 tag=RKVWMA506WX4 type=write size=1456930 2023-12-03T11:32:45.454 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.453+0000 7f4d50c67780 -1 < failed to complete operation key=JBL6IOJC4TT0 tag=MRX9JKDJW7KB type=del size=2805034: (22) Invalid argument 2023-12-03T11:32:45.455 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.454+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=INPIZQWA0K9S type=del size=2675863 2023-12-03T11:32:45.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.456+0000 7f4d50c67780 1 < completed write operation key=0M6ZAD39I852 tag=N0SBI7RHIF9N type=write size=229362 2023-12-03T11:32:45.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.458+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~AMNZGNGEVRRY.0 size=1048576 2023-12-03T11:32:45.460 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.459+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~AMNZGNGEVRRY.1 size=975233 2023-12-03T11:32:45.460 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.459+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=AMNZGNGEVRRY tag=6DHLW0PL4R60 type=write size=3072385 2023-12-03T11:32:45.461 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.460+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~4K1OKW50LNOZ.0 size=1048576 2023-12-03T11:32:45.462 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.462+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~4K1OKW50LNOZ.1 size=1048576 2023-12-03T11:32:45.464 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.463+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~4K1OKW50LNOZ.2 size=240598 2023-12-03T11:32:45.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.465+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=4K1OKW50LNOZ tag=90AWNI77HFBG type=write size=3386326 2023-12-03T11:32:45.468 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.467+0000 7f4d50c67780 1 > prepared part key=_multipart_52E31L45TN7V.2~N3CI08TA9KQE.0 size=718411 2023-12-03T11:32:45.468 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.467+0000 7f4d50c67780 1 > prepared multipart upload key=52E31L45TN7V upload=N3CI08TA9KQE tag=WEHEZODNFLKL type=write size=1766987 2023-12-03T11:32:45.469 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.468+0000 7f4d50c67780 -1 < failed to complete operation key=RF2Q24GI24HJ tag=H2G1V7SIO7KZ type=write size=156424: (22) Invalid argument 2023-12-03T11:32:45.471 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.471+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~A48KAGJF8J67.0 size=1048576 2023-12-03T11:32:45.472 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.471+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~A48KAGJF8J67.1 size=1048576 2023-12-03T11:32:45.473 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.473+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~A48KAGJF8J67.2 size=462565 2023-12-03T11:32:45.473 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.473+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=A48KAGJF8J67 tag=Y6YZ6O3NIRM0 type=write size=3608293 2023-12-03T11:32:45.475 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.474+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=57I2QQOZAQGI type=del 2023-12-03T11:32:45.477 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.476+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~21MUKE8IKKZE.0 size=1048576 2023-12-03T11:32:45.478 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.477+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~21MUKE8IKKZE.1 size=949573 2023-12-03T11:32:45.478 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.477+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=21MUKE8IKKZE tag=2KHKUV4MIZWD type=write size=3046725 2023-12-03T11:32:45.479 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.478+0000 7f4d50c67780 1 < completed write operation key=7C7UX0231SHV tag=PM4ASQE6P6XJ type=write size=228051 2023-12-03T11:32:45.481 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.481+0000 7f4d50c67780 1 > prepared part key=_multipart_MLKGLDFFDC3W.2~351DEFCKP960.0 size=343316 2023-12-03T11:32:45.481 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.481+0000 7f4d50c67780 1 > prepared multipart upload key=MLKGLDFFDC3W upload=351DEFCKP960 tag=CBJXDWO8HGT4 type=write size=1391892 2023-12-03T11:32:45.482 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.482+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~433AUNEUS8RL.0 size=114764 2023-12-03T11:32:45.485 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.484+0000 7f4d50c67780 1 < completed multipart upload key=ZE19S5UCCZ3C upload=433AUNEUS8RL tag=1FCQWYERBVDI type=write size=1163340 2023-12-03T11:32:45.486 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.485+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=BMB1PONDIFNV type=del size=534721 2023-12-03T11:32:45.487 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.486+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~PCX93087CPSZ.0 size=1048576 2023-12-03T11:32:45.487 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.486+0000 7f4d50c67780 1 < canceled part key=_multipart_EY1RBO15PCRR.2~PCX93087CPSZ.1 size=1048576 2023-12-03T11:32:45.487 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.486+0000 7f4d50c67780 1 < canceled part key=_multipart_EY1RBO15PCRR.2~PCX93087CPSZ.2 size=560737 2023-12-03T11:32:45.489 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.488+0000 7f4d50c67780 1 < canceled multipart upload key=EY1RBO15PCRR upload=PCX93087CPSZ tag=F517N4VYW2OS type=write size=3706465 2023-12-03T11:32:45.490 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.489+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=H52N6B7KD1GV type=del size=3821143 2023-12-03T11:32:45.491 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.491+0000 7f4d50c67780 -1 < failed to complete operation key=8J1EO2JDQUQH tag=5XTNGY2WSPTD type=del size=2317710: (22) Invalid argument 2023-12-03T11:32:45.492 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.492+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=BE4EDTW2HAB0 type=del size=1763141 2023-12-03T11:32:45.494 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.493+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~3SHEMHT8X26M.0 size=1048576 2023-12-03T11:32:45.495 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.494+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~3SHEMHT8X26M.1 size=743659 2023-12-03T11:32:45.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.496+0000 7f4d50c67780 1 < completed multipart upload key=ENMJS0KEVS2S upload=3SHEMHT8X26M tag=7824A7DI3WLC type=write size=2840811 2023-12-03T11:32:45.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.497+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=N3SKS6D6QEF1 type=del size=996301 2023-12-03T11:32:45.499 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.498+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~QUISUQ83R3DT.0 size=622289 2023-12-03T11:32:45.501 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.501+0000 7f4d50c67780 1 < completed multipart upload key=V0ND3OBFJJUB upload=QUISUQ83R3DT tag=2O24I5RTV4JK type=write size=1670865 2023-12-03T11:32:45.504 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.503+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~X0KKIYU7K1JU.0 size=1048576 2023-12-03T11:32:45.505 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.504+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~X0KKIYU7K1JU.1 size=1048576 2023-12-03T11:32:45.505 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.505+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~X0KKIYU7K1JU.2 size=489834 2023-12-03T11:32:45.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.505+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=X0KKIYU7K1JU tag=R53DFKFZ1M55 type=write size=3635562 2023-12-03T11:32:45.507 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.506+0000 7f4d50c67780 1 < completed delete operation key=ZE19S5UCCZ3C tag=URRCKRL8UL01 type=del 2023-12-03T11:32:45.509 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.508+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=C8025YJ425OE type=del size=2509353 2023-12-03T11:32:45.510 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.509+0000 7f4d50c67780 1 < completed delete operation key=ENMJS0KEVS2S tag=ZD3YIL22MO77 type=del 2023-12-03T11:32:45.511 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.510+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=FMFROK0SNIEQ type=write size=446751 2023-12-03T11:32:45.512 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.512+0000 7f4d50c67780 1 < completed delete operation key=73SL3ZBBDA6Q tag=CAJ0JC2KHQLI type=del 2023-12-03T11:32:45.514 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.513+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=0YQW7QUOU2HH type=del size=309239 2023-12-03T11:32:45.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.514+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=SN9N12Y1G9D8 type=del 2023-12-03T11:32:45.517 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.516+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~SM1K1MJ1SXTT.0 size=1048576 2023-12-03T11:32:45.518 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.517+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~SM1K1MJ1SXTT.1 size=998855 2023-12-03T11:32:45.518 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.517+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=SM1K1MJ1SXTT tag=4A7QESJ2OZ24 type=write size=3096007 2023-12-03T11:32:45.519 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.518+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~V56MLFX0R8Q9.0 size=408354 2023-12-03T11:32:45.521 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.520+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=V56MLFX0R8Q9 tag=RKVWMA506WX4 type=write size=1456930 2023-12-03T11:32:45.522 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.521+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=DCXT7W7UPAWZ type=del size=3232992 2023-12-03T11:32:45.523 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.522+0000 7f4d50c67780 1 < completed delete operation key=G0O8EC405LYM tag=INPIZQWA0K9S type=del 2023-12-03T11:32:45.525 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.524+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~MOX51RX02PDC.0 size=1048576 2023-12-03T11:32:45.526 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.525+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~MOX51RX02PDC.1 size=1048576 2023-12-03T11:32:45.527 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.526+0000 7f4d50c67780 1 > prepared part key=_multipart_RF2Q24GI24HJ.2~MOX51RX02PDC.2 size=492310 2023-12-03T11:32:45.527 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.526+0000 7f4d50c67780 1 > prepared multipart upload key=RF2Q24GI24HJ upload=MOX51RX02PDC tag=V63DTWNKZJNV type=write size=3638038 2023-12-03T11:32:45.528 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.527+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~AMNZGNGEVRRY.0 size=1048576 2023-12-03T11:32:45.529 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.528+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~AMNZGNGEVRRY.1 size=975233 2023-12-03T11:32:45.531 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.530+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=AMNZGNGEVRRY tag=6DHLW0PL4R60 type=write size=3072385 2023-12-03T11:32:45.532 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.531+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=E27V3WW1JE0W type=del size=1781531 2023-12-03T11:32:45.533 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.532+0000 7f4d50c67780 1 < completed part key=_multipart_52E31L45TN7V.2~N3CI08TA9KQE.0 size=718411 2023-12-03T11:32:45.535 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.534+0000 7f4d50c67780 1 < completed multipart upload key=52E31L45TN7V upload=N3CI08TA9KQE tag=WEHEZODNFLKL type=write size=1766987 2023-12-03T11:32:45.536 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.535+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=UB5H8EEPXD2N type=write size=502551 2023-12-03T11:32:45.537 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.537+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~A48KAGJF8J67.0 size=1048576 2023-12-03T11:32:45.538 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.537+0000 7f4d50c67780 1 < canceled part key=_multipart_K7YVVH7SAKMC.2~A48KAGJF8J67.1 size=1048576 2023-12-03T11:32:45.538 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.538+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~A48KAGJF8J67.2 size=462565 2023-12-03T11:32:45.540 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.539+0000 7f4d50c67780 1 < canceled multipart upload key=K7YVVH7SAKMC upload=A48KAGJF8J67 tag=Y6YZ6O3NIRM0 type=write size=3608293 2023-12-03T11:32:45.541 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.541+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=4JLOG928CS4R type=write size=50948 2023-12-03T11:32:45.543 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.542+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~21MUKE8IKKZE.0 size=1048576 2023-12-03T11:32:45.544 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.543+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~21MUKE8IKKZE.1 size=949573 2023-12-03T11:32:45.546 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.545+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=21MUKE8IKKZE tag=2KHKUV4MIZWD type=write size=3046725 2023-12-03T11:32:45.547 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.546+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=70OMDXS3097J type=del size=802079 2023-12-03T11:32:45.548 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.547+0000 7f4d50c67780 1 < completed part key=_multipart_MLKGLDFFDC3W.2~351DEFCKP960.0 size=343316 2023-12-03T11:32:45.550 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.549+0000 7f4d50c67780 1 < completed multipart upload key=MLKGLDFFDC3W upload=351DEFCKP960 tag=CBJXDWO8HGT4 type=write size=1391892 2023-12-03T11:32:45.551 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.550+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=G3JQYUO0T2R3 type=del size=609865 2023-12-03T11:32:45.552 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.552+0000 7f4d50c67780 1 < canceled operation key=8J1EO2JDQUQH tag=BMB1PONDIFNV type=del size=534721 2023-12-03T11:32:45.555 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.554+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~KC0SMCGDSBCZ.0 size=1048576 2023-12-03T11:32:45.556 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.555+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~KC0SMCGDSBCZ.1 size=157626 2023-12-03T11:32:45.556 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.555+0000 7f4d50c67780 1 > prepared multipart upload key=G0O8EC405LYM upload=KC0SMCGDSBCZ tag=GG17K06OWWHX type=write size=2254778 2023-12-03T11:32:45.557 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.556+0000 7f4d50c67780 1 < completed delete operation key=EY1RBO15PCRR tag=H52N6B7KD1GV type=del 2023-12-03T11:32:45.559 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.558+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~WJHBILRU5JVJ.0 size=1048576 2023-12-03T11:32:45.560 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.559+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~WJHBILRU5JVJ.1 size=436934 2023-12-03T11:32:45.560 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.559+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=WJHBILRU5JVJ tag=UMS6M53JMFFN type=write size=2534086 2023-12-03T11:32:45.561 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.560+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=BE4EDTW2HAB0 type=del 2023-12-03T11:32:45.562 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.562+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=J8L7KWHDT1SX type=del size=4023282 2023-12-03T11:32:45.565 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.564+0000 7f4d50c67780 1 < suggested remove operation key=EAP0BYZTTT2E tag=N3SKS6D6QEF1 type=del 2023-12-03T11:32:45.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.566+0000 7f4d50c67780 1 > prepared part key=_multipart_K7YVVH7SAKMC.2~9WSS48IS8ST4.0 size=495961 2023-12-03T11:32:45.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.566+0000 7f4d50c67780 1 > prepared multipart upload key=K7YVVH7SAKMC upload=9WSS48IS8ST4 tag=L3ZIGUPFU8F2 type=write size=1544537 2023-12-03T11:32:45.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.566+0000 7f4d50c67780 1 < canceled part key=_multipart_K7YVVH7SAKMC.2~X0KKIYU7K1JU.0 size=1048576 2023-12-03T11:32:45.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.566+0000 7f4d50c67780 1 < canceled part key=_multipart_K7YVVH7SAKMC.2~X0KKIYU7K1JU.1 size=1048576 2023-12-03T11:32:45.568 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.567+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~X0KKIYU7K1JU.2 size=489834 2023-12-03T11:32:45.570 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.569+0000 7f4d50c67780 1 < canceled multipart upload key=K7YVVH7SAKMC upload=X0KKIYU7K1JU tag=R53DFKFZ1M55 type=write size=3635562 2023-12-03T11:32:45.572 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.571+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~VI4N8HXWLVOA.0 size=1048576 2023-12-03T11:32:45.573 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.572+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~VI4N8HXWLVOA.1 size=1010469 2023-12-03T11:32:45.573 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.572+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=VI4N8HXWLVOA tag=FRE2RRFZIX2N type=write size=3107621 2023-12-03T11:32:45.576 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.575+0000 7f4d50c67780 1 < suggested remove operation key=0M6ZAD39I852 tag=C8025YJ425OE type=del 2023-12-03T11:32:45.577 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.576+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=TF2RUAPCYWGP type=del size=475394 2023-12-03T11:32:45.579 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.578+0000 7f4d50c67780 1 < suggested remove operation key=EY1RBO15PCRR tag=FMFROK0SNIEQ type=write 2023-12-03T11:32:45.580 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.580+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=2XWVU0UQ5BOV type=write size=922366 2023-12-03T11:32:45.582 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.581+0000 7f4d50c67780 1 < completed delete operation key=MLKGLDFFDC3W tag=0YQW7QUOU2HH type=del 2023-12-03T11:32:45.584 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.583+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~XNA0PTXCZ3ET.0 size=1048576 2023-12-03T11:32:45.585 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.584+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~XNA0PTXCZ3ET.1 size=395103 2023-12-03T11:32:45.585 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.584+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=XNA0PTXCZ3ET tag=GKQV130RMQP1 type=write size=2492255 2023-12-03T11:32:45.586 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.585+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~SM1K1MJ1SXTT.0 size=1048576 2023-12-03T11:32:45.587 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.586+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~SM1K1MJ1SXTT.1 size=998855 2023-12-03T11:32:45.589 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.588+0000 7f4d50c67780 1 < completed multipart upload key=V0ND3OBFJJUB upload=SM1K1MJ1SXTT tag=4A7QESJ2OZ24 type=write size=3096007 2023-12-03T11:32:45.593 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.590+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~G7J5QVET4N58.0 size=1048576 2023-12-03T11:32:45.594 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.591+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~G7J5QVET4N58.1 size=215018 2023-12-03T11:32:45.594 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.591+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=G7J5QVET4N58 tag=X3EY50K1V5LK type=write size=2312170 2023-12-03T11:32:45.594 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.593+0000 7f4d50c67780 1 < completed delete operation key=WUM939BATDG9 tag=DCXT7W7UPAWZ type=del 2023-12-03T11:32:45.595 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.594+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=HACJ6NOVVNC7 type=write size=411610 2023-12-03T11:32:45.596 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.595+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~MOX51RX02PDC.0 size=1048576 2023-12-03T11:32:45.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.596+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~MOX51RX02PDC.1 size=1048576 2023-12-03T11:32:45.598 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.597+0000 7f4d50c67780 1 < completed part key=_multipart_RF2Q24GI24HJ.2~MOX51RX02PDC.2 size=492310 2023-12-03T11:32:45.600 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.599+0000 7f4d50c67780 1 < completed multipart upload key=RF2Q24GI24HJ upload=MOX51RX02PDC tag=V63DTWNKZJNV type=write size=3638038 2023-12-03T11:32:45.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.600+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=VN6VDE27WUSK type=del size=2029324 2023-12-03T11:32:45.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.601+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=E27V3WW1JE0W type=del 2023-12-03T11:32:45.605 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.604+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~32OE2P1ULPUS.0 size=1048576 2023-12-03T11:32:45.605 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.605+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~32OE2P1ULPUS.1 size=359278 2023-12-03T11:32:45.606 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.605+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=32OE2P1ULPUS tag=K017GBUJB9J5 type=write size=2456430 2023-12-03T11:32:45.607 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.606+0000 7f4d50c67780 1 < completed write operation key=2H6AFQ362OGP tag=UB5H8EEPXD2N type=write size=502551 2023-12-03T11:32:45.609 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.608+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~E47WL4LKJGXQ.0 size=187158 2023-12-03T11:32:45.609 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.608+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=E47WL4LKJGXQ tag=DIM8UYKFCIQ7 type=write size=1235734 2023-12-03T11:32:45.610 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.609+0000 7f4d50c67780 -1 < failed to complete operation key=0M6ZAD39I852 tag=4JLOG928CS4R type=write size=50948: (22) Invalid argument 2023-12-03T11:32:45.612 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.612+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~MO32IZNV4DRY.0 size=102781 2023-12-03T11:32:45.612 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.612+0000 7f4d50c67780 1 > prepared multipart upload key=TEIYINZFFG76 upload=MO32IZNV4DRY tag=T20WN8AB28BL type=write size=1151357 2023-12-03T11:32:45.614 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.613+0000 7f4d50c67780 1 < completed delete operation key=73SL3ZBBDA6Q tag=70OMDXS3097J type=del 2023-12-03T11:32:45.615 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.614+0000 7f4d50c67780 1 > prepared operation key=RF2Q24GI24HJ tag=O44FJ2H4BVSZ type=del size=3961523 2023-12-03T11:32:45.617 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.616+0000 7f4d50c67780 1 < suggested remove operation key=EX93BYX10WJB tag=G3JQYUO0T2R3 type=del 2023-12-03T11:32:45.620 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.619+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~3S0HMTGAYOH3.0 size=809182 2023-12-03T11:32:45.620 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.619+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=3S0HMTGAYOH3 tag=9CWG5Q0HOXRW type=write size=1857758 2023-12-03T11:32:45.621 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.620+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~KC0SMCGDSBCZ.0 size=1048576 2023-12-03T11:32:45.622 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.621+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~KC0SMCGDSBCZ.1 size=157626 2023-12-03T11:32:45.624 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.623+0000 7f4d50c67780 1 < completed multipart upload key=G0O8EC405LYM upload=KC0SMCGDSBCZ tag=GG17K06OWWHX type=write size=2254778 2023-12-03T11:32:45.626 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.625+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~SLDJFVH61SHO.0 size=1048576 2023-12-03T11:32:45.627 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.627+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~SLDJFVH61SHO.1 size=588567 2023-12-03T11:32:45.627 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.627+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=SLDJFVH61SHO tag=3FAB5ZQP1HI2 type=write size=2685719 2023-12-03T11:32:45.629 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.628+0000 7f4d50c67780 1 < completed part key=_multipart_K7YVVH7SAKMC.2~WJHBILRU5JVJ.0 size=1048576 2023-12-03T11:32:45.629 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.628+0000 7f4d50c67780 1 < canceled part key=_multipart_K7YVVH7SAKMC.2~WJHBILRU5JVJ.1 size=436934 2023-12-03T11:32:45.631 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.630+0000 7f4d50c67780 1 < canceled multipart upload key=K7YVVH7SAKMC upload=WJHBILRU5JVJ tag=UMS6M53JMFFN type=write size=2534086 2023-12-03T11:32:45.632 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.631+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=3O8DLBOJS3NZ type=write size=71353 2023-12-03T11:32:45.634 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.633+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=J8L7KWHDT1SX type=del 2023-12-03T11:32:45.636 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.635+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~6443EPIT04R1.0 size=251683 2023-12-03T11:32:45.636 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.635+0000 7f4d50c67780 1 > prepared multipart upload key=73SL3ZBBDA6Q upload=6443EPIT04R1 tag=347VNENE322W type=write size=1300259 2023-12-03T11:32:45.636 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.635+0000 7f4d50c67780 1 < canceled part key=_multipart_K7YVVH7SAKMC.2~9WSS48IS8ST4.0 size=495961 2023-12-03T11:32:45.638 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.637+0000 7f4d50c67780 1 < canceled multipart upload key=K7YVVH7SAKMC upload=9WSS48IS8ST4 tag=L3ZIGUPFU8F2 type=write size=1544537 2023-12-03T11:32:45.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.639+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=N5A3TSVX5W8U type=del size=1906654 2023-12-03T11:32:45.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.640+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~VI4N8HXWLVOA.0 size=1048576 2023-12-03T11:32:45.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.641+0000 7f4d50c67780 1 < completed part key=_multipart_EX93BYX10WJB.2~VI4N8HXWLVOA.1 size=1010469 2023-12-03T11:32:45.644 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.643+0000 7f4d50c67780 1 < completed multipart upload key=EX93BYX10WJB upload=VI4N8HXWLVOA tag=FRE2RRFZIX2N type=write size=3107621 2023-12-03T11:32:45.645 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.644+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=U3E03R7MMVYC type=write size=741365 2023-12-03T11:32:45.646 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.646+0000 7f4d50c67780 1 < completed delete operation key=GTLP2WZUX7U8 tag=TF2RUAPCYWGP type=del 2023-12-03T11:32:45.648 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.647+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=RH3WD5UPY34Q type=del size=1385738 2023-12-03T11:32:45.649 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.648+0000 7f4d50c67780 1 < completed write operation key=V0ND3OBFJJUB tag=2XWVU0UQ5BOV type=write size=922366 2023-12-03T11:32:45.651 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.650+0000 7f4d50c67780 1 > prepared part key=_multipart_83I1M5WIVKAA.2~UME6FIOHLP8X.0 size=205211 2023-12-03T11:32:45.651 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.650+0000 7f4d50c67780 1 > prepared multipart upload key=83I1M5WIVKAA upload=UME6FIOHLP8X tag=UDMK1W9G3S52 type=write size=1253787 2023-12-03T11:32:45.652 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.652+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~XNA0PTXCZ3ET.0 size=1048576 2023-12-03T11:32:45.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.653+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~XNA0PTXCZ3ET.1 size=395103 2023-12-03T11:32:45.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.655+0000 7f4d50c67780 1 < completed multipart upload key=83I1M5WIVKAA upload=XNA0PTXCZ3ET tag=GKQV130RMQP1 type=write size=2492255 2023-12-03T11:32:45.658 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.657+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~NHBQZGVC9JPG.0 size=961647 2023-12-03T11:32:45.658 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.657+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=NHBQZGVC9JPG tag=Z5V00GFDJG9I type=write size=2010223 2023-12-03T11:32:45.659 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.658+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~G7J5QVET4N58.0 size=1048576 2023-12-03T11:32:45.660 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.659+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~G7J5QVET4N58.1 size=215018 2023-12-03T11:32:45.662 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.661+0000 7f4d50c67780 1 < completed multipart upload key=83I1M5WIVKAA upload=G7J5QVET4N58 tag=X3EY50K1V5LK type=write size=2312170 2023-12-03T11:32:45.663 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.662+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=F0WS8EV94N8R type=write size=271046 2023-12-03T11:32:45.664 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.664+0000 7f4d50c67780 1 < completed write operation key=WUM939BATDG9 tag=HACJ6NOVVNC7 type=write size=411610 2023-12-03T11:32:45.666 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.665+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=IYNRY8BVW8NI type=del size=4081624 2023-12-03T11:32:45.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.666+0000 7f4d50c67780 1 < completed delete operation key=EY1RBO15PCRR tag=VN6VDE27WUSK type=del 2023-12-03T11:32:45.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.669+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~UUIBEE7FUQVA.0 size=1048576 2023-12-03T11:32:45.670 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.669+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~UUIBEE7FUQVA.1 size=1048576 2023-12-03T11:32:45.671 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.671+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~UUIBEE7FUQVA.2 size=384083 2023-12-03T11:32:45.671 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.671+0000 7f4d50c67780 1 > prepared multipart upload key=QQDBWLVSXIHP upload=UUIBEE7FUQVA tag=LGN6E1KYQR2H type=write size=3529811 2023-12-03T11:32:45.672 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.672+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~32OE2P1ULPUS.0 size=1048576 2023-12-03T11:32:45.673 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.673+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~32OE2P1ULPUS.1 size=359278 2023-12-03T11:32:45.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.675+0000 7f4d50c67780 1 < completed multipart upload key=83I1M5WIVKAA upload=32OE2P1ULPUS tag=K017GBUJB9J5 type=write size=2456430 2023-12-03T11:32:45.677 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.676+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=DG3I7M6C51H4 type=write size=325805 2023-12-03T11:32:45.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.677+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~E47WL4LKJGXQ.0 size=187158 2023-12-03T11:32:45.680 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.679+0000 7f4d50c67780 1 < completed multipart upload key=EH4B2QP1C42H upload=E47WL4LKJGXQ tag=DIM8UYKFCIQ7 type=write size=1235734 2023-12-03T11:32:45.682 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.681+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~GPQFE2UPC1HF.0 size=1048576 2023-12-03T11:32:45.683 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.682+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~GPQFE2UPC1HF.1 size=1048576 2023-12-03T11:32:45.684 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.683+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~GPQFE2UPC1HF.2 size=862251 2023-12-03T11:32:45.684 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.683+0000 7f4d50c67780 1 > prepared multipart upload key=TEIYINZFFG76 upload=GPQFE2UPC1HF tag=TMQAUT3ZY89U type=write size=4007979 2023-12-03T11:32:45.684 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.683+0000 7f4d50c67780 1 < canceled part key=_multipart_TEIYINZFFG76.2~MO32IZNV4DRY.0 size=102781 2023-12-03T11:32:45.686 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.685+0000 7f4d50c67780 1 < canceled multipart upload key=TEIYINZFFG76 upload=MO32IZNV4DRY tag=T20WN8AB28BL type=write size=1151357 2023-12-03T11:32:45.687 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.686+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=COANJTVZ53B8 type=write size=788235 2023-12-03T11:32:45.689 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.688+0000 7f4d50c67780 1 < completed delete operation key=RF2Q24GI24HJ tag=O44FJ2H4BVSZ type=del 2023-12-03T11:32:45.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.690+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~QFZRWEQ075LI.0 size=1048576 2023-12-03T11:32:45.692 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.691+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~QFZRWEQ075LI.1 size=202739 2023-12-03T11:32:45.692 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.691+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=QFZRWEQ075LI tag=AOZV328DS9QI type=write size=2299891 2023-12-03T11:32:45.693 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.692+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~3S0HMTGAYOH3.0 size=809182 2023-12-03T11:32:45.694 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.694+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=3S0HMTGAYOH3 tag=9CWG5Q0HOXRW type=write size=1857758 2023-12-03T11:32:45.696 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.695+0000 7f4d50c67780 1 > prepared operation key=EAP0BYZTTT2E tag=H8ZMN59BKKZZ type=del size=172312 2023-12-03T11:32:45.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.696+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~SLDJFVH61SHO.0 size=1048576 2023-12-03T11:32:45.698 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.697+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~SLDJFVH61SHO.1 size=588567 2023-12-03T11:32:45.700 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.699+0000 7f4d50c67780 1 < completed multipart upload key=02W4TX7ZCDI6 upload=SLDJFVH61SHO tag=3FAB5ZQP1HI2 type=write size=2685719 2023-12-03T11:32:45.701 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.700+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=8RIT5M6HQXBD type=write size=539073 2023-12-03T11:32:45.702 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.701+0000 7f4d50c67780 1 < completed write operation key=WUM939BATDG9 tag=3O8DLBOJS3NZ type=write size=71353 2023-12-03T11:32:45.703 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.702+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=KVTAA7FBSKGP type=del size=2306683 2023-12-03T11:32:45.703 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.702+0000 7f4d50c67780 1 < canceled part key=_multipart_73SL3ZBBDA6Q.2~6443EPIT04R1.0 size=251683 2023-12-03T11:32:45.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.704+0000 7f4d50c67780 1 < canceled multipart upload key=73SL3ZBBDA6Q upload=6443EPIT04R1 tag=347VNENE322W type=write size=1300259 2023-12-03T11:32:45.706 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.705+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=2QGLKOEA52FP type=del size=322242 2023-12-03T11:32:45.707 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.707+0000 7f4d50c67780 1 < completed delete operation key=EX93BYX10WJB tag=N5A3TSVX5W8U type=del 2023-12-03T11:32:45.708 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.708+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=ALM1QPJCO0QD type=del size=3686187 2023-12-03T11:32:45.710 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.709+0000 7f4d50c67780 1 < canceled operation key=EX93BYX10WJB tag=U3E03R7MMVYC type=write size=741365 2023-12-03T11:32:45.711 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.710+0000 7f4d50c67780 1 > prepared operation key=TOGV2BZ99FRF tag=YHNL769FJDZ9 type=del size=2233107 2023-12-03T11:32:45.712 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.711+0000 7f4d50c67780 1 < completed delete operation key=U6R5Y9JXKT32 tag=RH3WD5UPY34Q type=del 2023-12-03T11:32:45.713 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.712+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=I64I1P4R1X0K type=del size=1441154 2023-12-03T11:32:45.714 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.714+0000 7f4d50c67780 1 < completed part key=_multipart_83I1M5WIVKAA.2~UME6FIOHLP8X.0 size=205211 2023-12-03T11:32:45.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.716+0000 7f4d50c67780 1 < completed multipart upload key=83I1M5WIVKAA upload=UME6FIOHLP8X tag=UDMK1W9G3S52 type=write size=1253787 2023-12-03T11:32:45.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.718+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~VPU3Z25KP6HE.0 size=1048576 2023-12-03T11:32:45.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.718+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~VPU3Z25KP6HE.1 size=1048576 2023-12-03T11:32:45.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.719+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~VPU3Z25KP6HE.2 size=89486 2023-12-03T11:32:45.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.719+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=VPU3Z25KP6HE tag=H0O3BJRKD35T type=write size=3235214 2023-12-03T11:32:45.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.721+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~NHBQZGVC9JPG.0 size=961647 2023-12-03T11:32:45.723 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.723+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=NHBQZGVC9JPG tag=Z5V00GFDJG9I type=write size=2010223 2023-12-03T11:32:45.726 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.725+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~SMKPY7Z81UTL.0 size=1048576 2023-12-03T11:32:45.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.726+0000 7f4d50c67780 1 > prepared part key=_multipart_QQDBWLVSXIHP.2~SMKPY7Z81UTL.1 size=114720 2023-12-03T11:32:45.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.726+0000 7f4d50c67780 1 > prepared multipart upload key=QQDBWLVSXIHP upload=SMKPY7Z81UTL tag=1IJPGULFAZYK type=write size=2211872 2023-12-03T11:32:45.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.727+0000 7f4d50c67780 1 < completed write operation key=EH4B2QP1C42H tag=F0WS8EV94N8R type=write size=271046 2023-12-03T11:32:45.731 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.731+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~U27CD40SYTBC.0 size=1048576 2023-12-03T11:32:45.732 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.732+0000 7f4d50c67780 1 > prepared part key=_multipart_YDRAH5EE39R4.2~U27CD40SYTBC.1 size=409619 2023-12-03T11:32:45.732 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.732+0000 7f4d50c67780 1 > prepared multipart upload key=YDRAH5EE39R4 upload=U27CD40SYTBC tag=IL3Y28ZEA7V4 type=write size=2506771 2023-12-03T11:32:45.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.734+0000 7f4d50c67780 1 < suggested remove operation key=8J1EO2JDQUQH tag=IYNRY8BVW8NI type=del 2023-12-03T11:32:45.737 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.737+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~821RHC0BRKT4.0 size=1048576 2023-12-03T11:32:45.738 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.737+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~821RHC0BRKT4.1 size=977224 2023-12-03T11:32:45.739 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.737+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=821RHC0BRKT4 tag=L0XF4VOBAQBF type=write size=3074376 2023-12-03T11:32:45.740 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.739+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~UUIBEE7FUQVA.0 size=1048576 2023-12-03T11:32:45.740 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.739+0000 7f4d50c67780 1 < canceled part key=_multipart_QQDBWLVSXIHP.2~UUIBEE7FUQVA.1 size=1048576 2023-12-03T11:32:45.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.740+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~UUIBEE7FUQVA.2 size=384083 2023-12-03T11:32:45.743 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.742+0000 7f4d50c67780 1 < canceled multipart upload key=QQDBWLVSXIHP upload=UUIBEE7FUQVA tag=LGN6E1KYQR2H type=write size=3529811 2023-12-03T11:32:45.744 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.743+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=W8D6CTPJZTQ1 type=del size=913731 2023-12-03T11:32:45.746 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.746+0000 7f4d50c67780 1 < suggested remove operation key=V0ND3OBFJJUB tag=DG3I7M6C51H4 type=write 2023-12-03T11:32:45.749 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.748+0000 7f4d50c67780 1 > prepared part key=_multipart_U6R5Y9JXKT32.2~UL0U74BMD9DI.0 size=147825 2023-12-03T11:32:45.749 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.748+0000 7f4d50c67780 1 > prepared multipart upload key=U6R5Y9JXKT32 upload=UL0U74BMD9DI tag=5EFCLDH8NY17 type=write size=1196401 2023-12-03T11:32:45.750 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.749+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~GPQFE2UPC1HF.0 size=1048576 2023-12-03T11:32:45.751 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.750+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~GPQFE2UPC1HF.1 size=1048576 2023-12-03T11:32:45.752 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.751+0000 7f4d50c67780 1 < completed part key=_multipart_TEIYINZFFG76.2~GPQFE2UPC1HF.2 size=862251 2023-12-03T11:32:45.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.753+0000 7f4d50c67780 1 < completed multipart upload key=TEIYINZFFG76 upload=GPQFE2UPC1HF tag=TMQAUT3ZY89U type=write size=4007979 2023-12-03T11:32:45.756 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.755+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~V0P70ACXCNY2.0 size=1048576 2023-12-03T11:32:45.757 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.756+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~V0P70ACXCNY2.1 size=838568 2023-12-03T11:32:45.757 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.756+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=V0P70ACXCNY2 tag=TLN74413YBOM type=write size=2935720 2023-12-03T11:32:45.758 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.757+0000 7f4d50c67780 1 < completed write operation key=02W4TX7ZCDI6 tag=COANJTVZ53B8 type=write size=788235 2023-12-03T11:32:45.759 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.759+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=N1MX8ADVH9SE type=del size=1237779 2023-12-03T11:32:45.761 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.760+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~QFZRWEQ075LI.0 size=1048576 2023-12-03T11:32:45.762 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.761+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~QFZRWEQ075LI.1 size=202739 2023-12-03T11:32:45.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.763+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=QFZRWEQ075LI tag=AOZV328DS9QI type=write size=2299891 2023-12-03T11:32:45.766 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.765+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~MK2U8949A5N7.0 size=1048576 2023-12-03T11:32:45.767 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.766+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~MK2U8949A5N7.1 size=760983 2023-12-03T11:32:45.767 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.766+0000 7f4d50c67780 1 > prepared multipart upload key=G0O8EC405LYM upload=MK2U8949A5N7 tag=9I1NK8F3H0HD type=write size=2858135 2023-12-03T11:32:45.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.768+0000 7f4d50c67780 1 < completed delete operation key=EAP0BYZTTT2E tag=H8ZMN59BKKZZ type=del 2023-12-03T11:32:45.771 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.770+0000 7f4d50c67780 1 > prepared part key=_multipart_EY1RBO15PCRR.2~F1F7DQSSBATE.0 size=301091 2023-12-03T11:32:45.771 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.770+0000 7f4d50c67780 1 > prepared multipart upload key=EY1RBO15PCRR upload=F1F7DQSSBATE tag=EAMGVFZ9W3OM type=write size=1349667 2023-12-03T11:32:45.772 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.771+0000 7f4d50c67780 1 < completed write operation key=YDRAH5EE39R4 tag=8RIT5M6HQXBD type=write size=539073 2023-12-03T11:32:45.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.772+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=IF9ERDTKAIZW type=write size=466250 2023-12-03T11:32:45.775 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.774+0000 7f4d50c67780 -1 < failed to complete operation key=8J1EO2JDQUQH tag=KVTAA7FBSKGP type=del size=2306683: (22) Invalid argument 2023-12-03T11:32:45.777 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.776+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~QAX9AXI9BH93.0 size=1048576 2023-12-03T11:32:45.779 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.777+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~QAX9AXI9BH93.1 size=1048576 2023-12-03T11:32:45.779 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.779+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~QAX9AXI9BH93.2 size=567172 2023-12-03T11:32:45.780 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.779+0000 7f4d50c67780 1 > prepared multipart upload key=G0O8EC405LYM upload=QAX9AXI9BH93 tag=R04CMII4WW94 type=write size=3712900 2023-12-03T11:32:45.781 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.780+0000 7f4d50c67780 1 < completed delete operation key=TOGV2BZ99FRF tag=2QGLKOEA52FP type=del 2023-12-03T11:32:45.783 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.782+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~PV6QKM9VLLFK.0 size=1048576 2023-12-03T11:32:45.784 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.783+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~PV6QKM9VLLFK.1 size=1048576 2023-12-03T11:32:45.785 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.784+0000 7f4d50c67780 1 > prepared part key=_multipart_73SL3ZBBDA6Q.2~PV6QKM9VLLFK.2 size=355235 2023-12-03T11:32:45.785 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.784+0000 7f4d50c67780 1 > prepared multipart upload key=73SL3ZBBDA6Q upload=PV6QKM9VLLFK tag=GOMQFXXD5377 type=write size=3500963 2023-12-03T11:32:45.786 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.785+0000 7f4d50c67780 1 < completed delete operation key=MLKGLDFFDC3W tag=ALM1QPJCO0QD type=del 2023-12-03T11:32:45.789 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.788+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~85KAE2UDQL72.0 size=238208 2023-12-03T11:32:45.789 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.788+0000 7f4d50c67780 1 > prepared multipart upload key=G0O8EC405LYM upload=85KAE2UDQL72 tag=R80DNZXC36GD type=write size=1286784 2023-12-03T11:32:45.791 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.790+0000 7f4d50c67780 1 < suggested update operation key=TOGV2BZ99FRF tag=YHNL769FJDZ9 type=del size=2233107 2023-12-03T11:32:45.794 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.793+0000 7f4d50c67780 1 > prepared part key=_multipart_2H6AFQ362OGP.2~54RAHYFJ9U52.0 size=688369 2023-12-03T11:32:45.794 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.793+0000 7f4d50c67780 1 > prepared multipart upload key=2H6AFQ362OGP upload=54RAHYFJ9U52 tag=F6576XCNGE63 type=write size=1736945 2023-12-03T11:32:45.795 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.794+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=I64I1P4R1X0K type=del 2023-12-03T11:32:45.796 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.795+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=CHFW4PAVXXNF type=write size=275676 2023-12-03T11:32:45.797 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.796+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~VPU3Z25KP6HE.0 size=1048576 2023-12-03T11:32:45.798 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.797+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~VPU3Z25KP6HE.1 size=1048576 2023-12-03T11:32:45.799 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.798+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~VPU3Z25KP6HE.2 size=89486 2023-12-03T11:32:45.801 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.800+0000 7f4d50c67780 1 < completed multipart upload key=V0ND3OBFJJUB upload=VPU3Z25KP6HE tag=H0O3BJRKD35T type=write size=3235214 2023-12-03T11:32:45.802 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.802+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=MDHCR8OHI93F type=del size=1907415 2023-12-03T11:32:45.804 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.803+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~SMKPY7Z81UTL.0 size=1048576 2023-12-03T11:32:45.805 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.804+0000 7f4d50c67780 1 < completed part key=_multipart_QQDBWLVSXIHP.2~SMKPY7Z81UTL.1 size=114720 2023-12-03T11:32:45.807 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.806+0000 7f4d50c67780 1 < completed multipart upload key=QQDBWLVSXIHP upload=SMKPY7Z81UTL tag=1IJPGULFAZYK type=write size=2211872 2023-12-03T11:32:45.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.807+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=AVQ7B73LYQWP type=del size=798498 2023-12-03T11:32:45.809 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.808+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~U27CD40SYTBC.0 size=1048576 2023-12-03T11:32:45.810 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.809+0000 7f4d50c67780 1 < completed part key=_multipart_YDRAH5EE39R4.2~U27CD40SYTBC.1 size=409619 2023-12-03T11:32:45.812 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.811+0000 7f4d50c67780 1 < completed multipart upload key=YDRAH5EE39R4 upload=U27CD40SYTBC tag=IL3Y28ZEA7V4 type=write size=2506771 2023-12-03T11:32:45.813 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.813+0000 7f4d50c67780 1 > prepared operation key=U6R5Y9JXKT32 tag=ZHE5VFL7BCRO type=del size=1487375 2023-12-03T11:32:45.815 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.814+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~821RHC0BRKT4.0 size=1048576 2023-12-03T11:32:45.816 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.815+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~821RHC0BRKT4.1 size=977224 2023-12-03T11:32:45.818 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.817+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=821RHC0BRKT4 tag=L0XF4VOBAQBF type=write size=3074376 2023-12-03T11:32:45.820 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.819+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~YLJNMBRLS2VN.0 size=1048576 2023-12-03T11:32:45.821 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.820+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~YLJNMBRLS2VN.1 size=1048576 2023-12-03T11:32:45.822 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.821+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~YLJNMBRLS2VN.2 size=602136 2023-12-03T11:32:45.822 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.821+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=YLJNMBRLS2VN tag=QS3GEUGSJH53 type=write size=3747864 2023-12-03T11:32:45.823 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.822+0000 7f4d50c67780 1 < completed delete operation key=73SL3ZBBDA6Q tag=W8D6CTPJZTQ1 type=del 2023-12-03T11:32:45.824 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.823+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=WK24X2DO0HPE type=del size=1053193 2023-12-03T11:32:45.824 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.824+0000 7f4d50c67780 1 < canceled part key=_multipart_U6R5Y9JXKT32.2~UL0U74BMD9DI.0 size=147825 2023-12-03T11:32:45.826 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.825+0000 7f4d50c67780 1 < canceled multipart upload key=U6R5Y9JXKT32 upload=UL0U74BMD9DI tag=5EFCLDH8NY17 type=write size=1196401 2023-12-03T11:32:45.827 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.827+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=TNWPWM6T5JOG type=del size=267260 2023-12-03T11:32:45.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.828+0000 7f4d50c67780 1 < completed part key=_multipart_V0ND3OBFJJUB.2~V0P70ACXCNY2.0 size=1048576 2023-12-03T11:32:45.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.828+0000 7f4d50c67780 1 < canceled part key=_multipart_V0ND3OBFJJUB.2~V0P70ACXCNY2.1 size=838568 2023-12-03T11:32:45.831 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.830+0000 7f4d50c67780 1 < canceled multipart upload key=V0ND3OBFJJUB upload=V0P70ACXCNY2 tag=TLN74413YBOM type=write size=2935720 2023-12-03T11:32:45.832 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.831+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=7CGQ342XXR3A type=write size=991187 2023-12-03T11:32:45.833 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.832+0000 7f4d50c67780 1 < canceled operation key=BX5POXMMYLB7 tag=N1MX8ADVH9SE type=del size=1237779 2023-12-03T11:32:45.834 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.833+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=Q7C0N4COTREK type=del size=763255 2023-12-03T11:32:45.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.835+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~MK2U8949A5N7.0 size=1048576 2023-12-03T11:32:45.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.835+0000 7f4d50c67780 1 < canceled part key=_multipart_G0O8EC405LYM.2~MK2U8949A5N7.1 size=760983 2023-12-03T11:32:45.838 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.837+0000 7f4d50c67780 1 < canceled multipart upload key=G0O8EC405LYM upload=MK2U8949A5N7 tag=9I1NK8F3H0HD type=write size=2858135 2023-12-03T11:32:45.839 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.839+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=V2QR0EMRKY7F type=del size=2302540 2023-12-03T11:32:45.841 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.840+0000 7f4d50c67780 1 < completed part key=_multipart_EY1RBO15PCRR.2~F1F7DQSSBATE.0 size=301091 2023-12-03T11:32:45.843 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.842+0000 7f4d50c67780 1 < completed multipart upload key=EY1RBO15PCRR upload=F1F7DQSSBATE tag=EAMGVFZ9W3OM type=write size=1349667 2023-12-03T11:32:45.845 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.844+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=MYKP6ZI6IOWE type=del size=1115638 2023-12-03T11:32:45.846 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.845+0000 7f4d50c67780 1 < completed write operation key=02W4TX7ZCDI6 tag=IF9ERDTKAIZW type=write size=466250 2023-12-03T11:32:45.848 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.847+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~E216V2POUAQX.0 size=739160 2023-12-03T11:32:45.848 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.847+0000 7f4d50c67780 1 > prepared multipart upload key=G0O8EC405LYM upload=E216V2POUAQX tag=U7TZH2R7UR63 type=write size=1787736 2023-12-03T11:32:45.849 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.849+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~QAX9AXI9BH93.0 size=1048576 2023-12-03T11:32:45.851 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.850+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~QAX9AXI9BH93.1 size=1048576 2023-12-03T11:32:45.851 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.851+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~QAX9AXI9BH93.2 size=567172 2023-12-03T11:32:45.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.853+0000 7f4d50c67780 1 < completed multipart upload key=G0O8EC405LYM upload=QAX9AXI9BH93 tag=R04CMII4WW94 type=write size=3712900 2023-12-03T11:32:45.855 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.854+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=4P1RTVWJZ1H8 type=del size=2903946 2023-12-03T11:32:45.856 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.855+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~PV6QKM9VLLFK.0 size=1048576 2023-12-03T11:32:45.857 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.856+0000 7f4d50c67780 1 < completed part key=_multipart_73SL3ZBBDA6Q.2~PV6QKM9VLLFK.1 size=1048576 2023-12-03T11:32:45.857 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.856+0000 7f4d50c67780 1 < canceled part key=_multipart_73SL3ZBBDA6Q.2~PV6QKM9VLLFK.2 size=355235 2023-12-03T11:32:45.859 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.858+0000 7f4d50c67780 1 < canceled multipart upload key=73SL3ZBBDA6Q upload=PV6QKM9VLLFK tag=GOMQFXXD5377 type=write size=3500963 2023-12-03T11:32:45.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.860+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~5KSBUXCIOE5I.0 size=1048576 2023-12-03T11:32:45.862 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.861+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~5KSBUXCIOE5I.1 size=1048576 2023-12-03T11:32:45.863 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.862+0000 7f4d50c67780 1 > prepared part key=_multipart_GTLP2WZUX7U8.2~5KSBUXCIOE5I.2 size=987446 2023-12-03T11:32:45.863 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.862+0000 7f4d50c67780 1 > prepared multipart upload key=GTLP2WZUX7U8 upload=5KSBUXCIOE5I tag=YBTMB4KRDN5S type=write size=4133174 2023-12-03T11:32:45.864 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.863+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~85KAE2UDQL72.0 size=238208 2023-12-03T11:32:45.866 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.865+0000 7f4d50c67780 1 < completed multipart upload key=G0O8EC405LYM upload=85KAE2UDQL72 tag=R80DNZXC36GD type=write size=1286784 2023-12-03T11:32:45.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.866+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=SEPQIN2CRKEY type=del size=3349674 2023-12-03T11:32:45.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.868+0000 7f4d50c67780 1 < completed part key=_multipart_2H6AFQ362OGP.2~54RAHYFJ9U52.0 size=688369 2023-12-03T11:32:45.870 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.870+0000 7f4d50c67780 1 < completed multipart upload key=2H6AFQ362OGP upload=54RAHYFJ9U52 tag=F6576XCNGE63 type=write size=1736945 2023-12-03T11:32:45.872 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.871+0000 7f4d50c67780 1 > prepared operation key=XM5E3D99MXVA tag=JGJ1NJNA98NU type=del size=1874322 2023-12-03T11:32:45.873 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.872+0000 7f4d50c67780 1 < completed write operation key=TEIYINZFFG76 tag=CHFW4PAVXXNF type=write size=275676 2023-12-03T11:32:45.874 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.873+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=4SNGZMI1X6JR type=del size=1969912 2023-12-03T11:32:45.877 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.876+0000 7f4d50c67780 1 < suggested remove operation key=02W4TX7ZCDI6 tag=MDHCR8OHI93F type=del 2023-12-03T11:32:45.878 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.877+0000 7f4d50c67780 1 > prepared operation key=EH4B2QP1C42H tag=BRLPLAV97D18 type=del size=672768 2023-12-03T11:32:45.879 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.878+0000 7f4d50c67780 1 < completed delete operation key=EY1RBO15PCRR tag=AVQ7B73LYQWP type=del 2023-12-03T11:32:45.880 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.879+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=9AMKRAM3HOI0 type=del size=596117 2023-12-03T11:32:45.882 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.881+0000 7f4d50c67780 1 < canceled operation key=U6R5Y9JXKT32 tag=ZHE5VFL7BCRO type=del size=1487375 2023-12-03T11:32:45.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.882+0000 7f4d50c67780 1 > prepared operation key=02W4TX7ZCDI6 tag=9AHPEPRDSDJC type=del size=1158491 2023-12-03T11:32:45.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.883+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~YLJNMBRLS2VN.0 size=1048576 2023-12-03T11:32:45.885 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.884+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~YLJNMBRLS2VN.1 size=1048576 2023-12-03T11:32:45.886 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.885+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~YLJNMBRLS2VN.2 size=602136 2023-12-03T11:32:45.888 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.887+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=YLJNMBRLS2VN tag=QS3GEUGSJH53 type=write size=3747864 2023-12-03T11:32:45.889 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.888+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=GM9ZHFTEEPDE type=del size=1658173 2023-12-03T11:32:45.890 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.890+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=WK24X2DO0HPE type=del 2023-12-03T11:32:45.893 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.891+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=3TSQ4JN6JI6O type=del size=3344143 2023-12-03T11:32:45.894 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.893+0000 7f4d50c67780 1 < suggested update operation key=ZE19S5UCCZ3C tag=TNWPWM6T5JOG type=del size=267260 2023-12-03T11:32:45.895 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.894+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=WB5NRXIE6ZFH type=write size=787786 2023-12-03T11:32:45.897 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.896+0000 7f4d50c67780 1 < completed write operation key=WUM939BATDG9 tag=7CGQ342XXR3A type=write size=991187 2023-12-03T11:32:45.899 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.898+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~PA0H5G82CG9R.0 size=1048576 2023-12-03T11:32:45.900 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.899+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~PA0H5G82CG9R.1 size=1048576 2023-12-03T11:32:45.901 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.900+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~PA0H5G82CG9R.2 size=158994 2023-12-03T11:32:45.901 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.900+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=PA0H5G82CG9R tag=EQ46931C2HKF type=write size=3304722 2023-12-03T11:32:45.902 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.901+0000 7f4d50c67780 1 < completed delete operation key=GTLP2WZUX7U8 tag=Q7C0N4COTREK type=del 2023-12-03T11:32:45.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.902+0000 7f4d50c67780 1 > prepared operation key=83I1M5WIVKAA tag=8GFHL589WETH type=del size=1092039 2023-12-03T11:32:45.904 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.903+0000 7f4d50c67780 1 < completed delete operation key=MLKGLDFFDC3W tag=V2QR0EMRKY7F type=del 2023-12-03T11:32:45.905 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.905+0000 7f4d50c67780 1 > prepared operation key=TEIYINZFFG76 tag=NKOMC44EHV88 type=del size=3869843 2023-12-03T11:32:45.907 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.906+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=MYKP6ZI6IOWE type=del 2023-12-03T11:32:45.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.907+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=R4CKKWXI9WMA type=del size=2272849 2023-12-03T11:32:45.909 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.908+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~E216V2POUAQX.0 size=739160 2023-12-03T11:32:45.911 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.910+0000 7f4d50c67780 1 < completed multipart upload key=G0O8EC405LYM upload=E216V2POUAQX tag=U7TZH2R7UR63 type=write size=1787736 2023-12-03T11:32:45.912 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.911+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=ADQ3SLP5945S type=del size=371687 2023-12-03T11:32:45.913 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.913+0000 7f4d50c67780 1 < completed delete operation key=TEIYINZFFG76 tag=4P1RTVWJZ1H8 type=del 2023-12-03T11:32:45.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.914+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=CR8C8KK6AI1Q type=del size=813120 2023-12-03T11:32:45.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.915+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~5KSBUXCIOE5I.0 size=1048576 2023-12-03T11:32:45.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.916+0000 7f4d50c67780 1 < completed part key=_multipart_GTLP2WZUX7U8.2~5KSBUXCIOE5I.1 size=1048576 2023-12-03T11:32:45.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.916+0000 7f4d50c67780 1 < canceled part key=_multipart_GTLP2WZUX7U8.2~5KSBUXCIOE5I.2 size=987446 2023-12-03T11:32:45.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.918+0000 7f4d50c67780 1 < canceled multipart upload key=GTLP2WZUX7U8 upload=5KSBUXCIOE5I tag=YBTMB4KRDN5S type=write size=4133174 2023-12-03T11:32:45.920 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.919+0000 7f4d50c67780 1 > prepared operation key=V0ND3OBFJJUB tag=ZF3H7RTYYFK9 type=del size=523020 2023-12-03T11:32:45.921 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.920+0000 7f4d50c67780 1 < completed delete operation key=0M6ZAD39I852 tag=SEPQIN2CRKEY type=del 2023-12-03T11:32:45.922 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.922+0000 7f4d50c67780 1 > prepared operation key=YDRAH5EE39R4 tag=LHB5QB0FEAUJ type=del size=3595600 2023-12-03T11:32:45.924 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.923+0000 7f4d50c67780 1 < completed delete operation key=XM5E3D99MXVA tag=JGJ1NJNA98NU type=del 2023-12-03T11:32:45.925 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.924+0000 7f4d50c67780 1 > prepared operation key=BX5POXMMYLB7 tag=ET1UD1LME7UL type=del size=4013611 2023-12-03T11:32:45.926 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.925+0000 7f4d50c67780 1 < completed delete operation key=8J1EO2JDQUQH tag=4SNGZMI1X6JR type=del 2023-12-03T11:32:45.928 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.928+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~IF2E4AR0O06P.0 size=1048576 2023-12-03T11:32:45.929 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.929+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~IF2E4AR0O06P.1 size=1048576 2023-12-03T11:32:45.930 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.930+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~IF2E4AR0O06P.2 size=90648 2023-12-03T11:32:45.930 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.930+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=IF2E4AR0O06P tag=JDV483ZVOSF4 type=write size=3236376 2023-12-03T11:32:45.933 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.932+0000 7f4d50c67780 1 < suggested update operation key=EH4B2QP1C42H tag=BRLPLAV97D18 type=del size=672768 2023-12-03T11:32:45.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.933+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=LVK17KHQSTIW type=del size=3239190 2023-12-03T11:32:45.935 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.935+0000 7f4d50c67780 1 < completed delete operation key=V0ND3OBFJJUB tag=9AMKRAM3HOI0 type=del 2023-12-03T11:32:45.937 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.936+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=IJ8L2K7WP2VF type=del size=1798908 2023-12-03T11:32:45.938 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.937+0000 7f4d50c67780 1 < completed delete operation key=02W4TX7ZCDI6 tag=9AHPEPRDSDJC type=del 2023-12-03T11:32:45.940 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.939+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~4OFKBU2M0GIC.0 size=1048576 2023-12-03T11:32:45.941 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.940+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~4OFKBU2M0GIC.1 size=1048576 2023-12-03T11:32:45.942 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.941+0000 7f4d50c67780 1 > prepared part key=_multipart_EAP0BYZTTT2E.2~4OFKBU2M0GIC.2 size=378557 2023-12-03T11:32:45.942 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.941+0000 7f4d50c67780 1 > prepared multipart upload key=EAP0BYZTTT2E upload=4OFKBU2M0GIC tag=YQ3Q7BPKAXZG type=write size=3524285 2023-12-03T11:32:45.943 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.943+0000 7f4d50c67780 1 < completed delete operation key=YDRAH5EE39R4 tag=GM9ZHFTEEPDE type=del 2023-12-03T11:32:45.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.945+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~E7P2XUX4FTGO.0 size=1048576 2023-12-03T11:32:45.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.946+0000 7f4d50c67780 1 > prepared part key=_multipart_8J1EO2JDQUQH.2~E7P2XUX4FTGO.1 size=897177 2023-12-03T11:32:45.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.946+0000 7f4d50c67780 1 > prepared multipart upload key=8J1EO2JDQUQH upload=E7P2XUX4FTGO tag=L2YUHFYTKY7F type=write size=2994329 2023-12-03T11:32:45.949 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.948+0000 7f4d50c67780 1 < suggested update operation key=GTLP2WZUX7U8 tag=3TSQ4JN6JI6O type=del size=3344143 2023-12-03T11:32:45.951 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.950+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~NL2FWIJEEXSO.0 size=1048576 2023-12-03T11:32:45.952 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.952+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~NL2FWIJEEXSO.1 size=611205 2023-12-03T11:32:45.953 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.952+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=NL2FWIJEEXSO tag=HTC3IIZQPCK8 type=write size=2708357 2023-12-03T11:32:45.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.953+0000 7f4d50c67780 1 < completed write operation key=ULLPV2G10BME tag=WB5NRXIE6ZFH type=write size=787786 2023-12-03T11:32:45.956 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.955+0000 7f4d50c67780 1 > prepared part key=_multipart_02W4TX7ZCDI6.2~K6DY71703LF1.0 size=134480 2023-12-03T11:32:45.956 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.955+0000 7f4d50c67780 1 > prepared multipart upload key=02W4TX7ZCDI6 upload=K6DY71703LF1 tag=JOTMGFJUXPER type=write size=1183056 2023-12-03T11:32:45.957 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.957+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~PA0H5G82CG9R.0 size=1048576 2023-12-03T11:32:45.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.959+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~PA0H5G82CG9R.1 size=1048576 2023-12-03T11:32:45.961 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.960+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~PA0H5G82CG9R.2 size=158994 2023-12-03T11:32:45.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.962+0000 7f4d50c67780 1 < completed multipart upload key=02W4TX7ZCDI6 upload=PA0H5G82CG9R tag=EQ46931C2HKF type=write size=3304722 2023-12-03T11:32:45.964 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.963+0000 7f4d50c67780 1 > prepared operation key=JR8CIONID4QC tag=X79AXGKEJXMU type=del size=2603890 2023-12-03T11:32:45.965 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.964+0000 7f4d50c67780 1 < completed delete operation key=83I1M5WIVKAA tag=8GFHL589WETH type=del 2023-12-03T11:32:45.967 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.967+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~EIYU10L9YC3Y.0 size=1048576 2023-12-03T11:32:45.968 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.968+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~EIYU10L9YC3Y.1 size=1048576 2023-12-03T11:32:45.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.969+0000 7f4d50c67780 1 > prepared part key=_multipart_ENMJS0KEVS2S.2~EIYU10L9YC3Y.2 size=287959 2023-12-03T11:32:45.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.969+0000 7f4d50c67780 1 > prepared multipart upload key=ENMJS0KEVS2S upload=EIYU10L9YC3Y tag=71PO3BPLWCV9 type=write size=3433687 2023-12-03T11:32:45.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.971+0000 7f4d50c67780 1 < suggested remove operation key=TEIYINZFFG76 tag=NKOMC44EHV88 type=del 2023-12-03T11:32:45.973 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.972+0000 7f4d50c67780 1 > prepared operation key=JBL6IOJC4TT0 tag=T4L9O54W1XWW type=del size=2788919 2023-12-03T11:32:45.974 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.974+0000 7f4d50c67780 1 < completed delete operation key=EX93BYX10WJB tag=R4CKKWXI9WMA type=del 2023-12-03T11:32:45.976 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.976+0000 7f4d50c67780 1 > prepared part key=_multipart_ULLPV2G10BME.2~50P8Y6WM5PMO.0 size=595407 2023-12-03T11:32:45.977 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.976+0000 7f4d50c67780 1 > prepared multipart upload key=ULLPV2G10BME upload=50P8Y6WM5PMO tag=SLCGUG4NI288 type=write size=1643983 2023-12-03T11:32:45.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.977+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=ADQ3SLP5945S type=del 2023-12-03T11:32:45.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.978+0000 7f4d50c67780 1 > prepared operation key=52E31L45TN7V tag=LCCY4GWDMCN2 type=del size=1847718 2023-12-03T11:32:45.980 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.979+0000 7f4d50c67780 1 < completed delete operation key=MLKGLDFFDC3W tag=CR8C8KK6AI1Q type=del 2023-12-03T11:32:45.982 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.981+0000 7f4d50c67780 1 > prepared part key=_multipart_G0O8EC405LYM.2~DK2WJT71UGCZ.0 size=345020 2023-12-03T11:32:45.982 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.981+0000 7f4d50c67780 1 > prepared multipart upload key=G0O8EC405LYM upload=DK2WJT71UGCZ tag=Y5U7TQVRZGVA type=write size=1393596 2023-12-03T11:32:45.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.983+0000 7f4d50c67780 1 < completed delete operation key=V0ND3OBFJJUB tag=ZF3H7RTYYFK9 type=del 2023-12-03T11:32:45.986 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.985+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~004WV0RQAEDW.0 size=1048576 2023-12-03T11:32:45.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.986+0000 7f4d50c67780 1 > prepared part key=_multipart_V0ND3OBFJJUB.2~004WV0RQAEDW.1 size=180060 2023-12-03T11:32:45.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.986+0000 7f4d50c67780 1 > prepared multipart upload key=V0ND3OBFJJUB upload=004WV0RQAEDW tag=UU6ZK4B8782N type=write size=2277212 2023-12-03T11:32:45.989 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.988+0000 7f4d50c67780 1 < suggested update operation key=YDRAH5EE39R4 tag=LHB5QB0FEAUJ type=del size=3595600 2023-12-03T11:32:45.991 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.990+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~IOQJCNAAFF9W.0 size=1048576 2023-12-03T11:32:45.992 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.991+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~IOQJCNAAFF9W.1 size=1048576 2023-12-03T11:32:45.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.992+0000 7f4d50c67780 1 > prepared part key=_multipart_JBL6IOJC4TT0.2~IOQJCNAAFF9W.2 size=997128 2023-12-03T11:32:45.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.992+0000 7f4d50c67780 1 > prepared multipart upload key=JBL6IOJC4TT0 upload=IOQJCNAAFF9W tag=03KV11VCM432 type=write size=4142856 2023-12-03T11:32:45.994 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.994+0000 7f4d50c67780 1 < completed delete operation key=BX5POXMMYLB7 tag=ET1UD1LME7UL type=del 2023-12-03T11:32:45.996 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.996+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~C8IWGCD57JJJ.0 size=1048576 2023-12-03T11:32:45.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.997+0000 7f4d50c67780 1 > prepared part key=_multipart_ZE19S5UCCZ3C.2~C8IWGCD57JJJ.1 size=372219 2023-12-03T11:32:45.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.997+0000 7f4d50c67780 1 > prepared multipart upload key=ZE19S5UCCZ3C upload=C8IWGCD57JJJ tag=ZAN5GH3YSX1M type=write size=2469371 2023-12-03T11:32:45.999 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.998+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~IF2E4AR0O06P.0 size=1048576 2023-12-03T11:32:46.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:45.999+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~IF2E4AR0O06P.1 size=1048576 2023-12-03T11:32:46.001 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.000+0000 7f4d50c67780 1 < completed part key=_multipart_0M6ZAD39I852.2~IF2E4AR0O06P.2 size=90648 2023-12-03T11:32:46.003 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.002+0000 7f4d50c67780 1 < completed multipart upload key=0M6ZAD39I852 upload=IF2E4AR0O06P tag=JDV483ZVOSF4 type=write size=3236376 2023-12-03T11:32:46.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.004+0000 7f4d50c67780 1 > prepared part key=_multipart_EH4B2QP1C42H.2~2D2K9INRWK0T.0 size=466533 2023-12-03T11:32:46.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.004+0000 7f4d50c67780 1 > prepared multipart upload key=EH4B2QP1C42H upload=2D2K9INRWK0T tag=G6VZBT8SE67G type=write size=1515109 2023-12-03T11:32:46.006 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.005+0000 7f4d50c67780 1 < completed delete operation key=JR8CIONID4QC tag=LVK17KHQSTIW type=del 2023-12-03T11:32:46.007 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.006+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=NEH7YJ2QX9S7 type=del size=968316 2023-12-03T11:32:46.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.007+0000 7f4d50c67780 1 < completed delete operation key=WUM939BATDG9 tag=IJ8L2K7WP2VF type=del 2023-12-03T11:32:46.010 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.009+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~XEZJPQIKYC6R.0 size=942786 2023-12-03T11:32:46.010 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.009+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=XEZJPQIKYC6R tag=T5XPB6DZL043 type=write size=1991362 2023-12-03T11:32:46.011 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.009+0000 7f4d50c67780 1 < canceled part key=_multipart_EAP0BYZTTT2E.2~4OFKBU2M0GIC.0 size=1048576 2023-12-03T11:32:46.011 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.009+0000 7f4d50c67780 1 < canceled part key=_multipart_EAP0BYZTTT2E.2~4OFKBU2M0GIC.1 size=1048576 2023-12-03T11:32:46.011 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.010+0000 7f4d50c67780 1 < completed part key=_multipart_EAP0BYZTTT2E.2~4OFKBU2M0GIC.2 size=378557 2023-12-03T11:32:46.013 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.012+0000 7f4d50c67780 1 < canceled multipart upload key=EAP0BYZTTT2E upload=4OFKBU2M0GIC tag=YQ3Q7BPKAXZG type=write size=3524285 2023-12-03T11:32:46.014 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.014+0000 7f4d50c67780 1 > prepared operation key=EY1RBO15PCRR tag=3QDQDBK67ZFA type=write size=687578 2023-12-03T11:32:46.016 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.015+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~E7P2XUX4FTGO.0 size=1048576 2023-12-03T11:32:46.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.016+0000 7f4d50c67780 1 < completed part key=_multipart_8J1EO2JDQUQH.2~E7P2XUX4FTGO.1 size=897177 2023-12-03T11:32:46.019 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.018+0000 7f4d50c67780 1 < completed multipart upload key=8J1EO2JDQUQH upload=E7P2XUX4FTGO tag=L2YUHFYTKY7F type=write size=2994329 2023-12-03T11:32:46.021 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.020+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~P9M1NRUTBQLJ.0 size=1048576 2023-12-03T11:32:46.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.021+0000 7f4d50c67780 1 > prepared part key=_multipart_BX5POXMMYLB7.2~P9M1NRUTBQLJ.1 size=147018 2023-12-03T11:32:46.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.021+0000 7f4d50c67780 1 > prepared multipart upload key=BX5POXMMYLB7 upload=P9M1NRUTBQLJ tag=7FQ6BKLD6KMY type=write size=2244170 2023-12-03T11:32:46.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.021+0000 7f4d50c67780 1 < canceled part key=_multipart_7C7UX0231SHV.2~NL2FWIJEEXSO.0 size=1048576 2023-12-03T11:32:46.024 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.023+0000 7f4d50c67780 1 < completed part key=_multipart_7C7UX0231SHV.2~NL2FWIJEEXSO.1 size=611205 2023-12-03T11:32:46.026 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.025+0000 7f4d50c67780 1 < canceled multipart upload key=7C7UX0231SHV upload=NL2FWIJEEXSO tag=HTC3IIZQPCK8 type=write size=2708357 2023-12-03T11:32:46.027 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.026+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=Z8BRD0GNJ8K5 type=write size=664192 2023-12-03T11:32:46.028 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.028+0000 7f4d50c67780 1 < completed part key=_multipart_02W4TX7ZCDI6.2~K6DY71703LF1.0 size=134480 2023-12-03T11:32:46.031 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.030+0000 7f4d50c67780 1 < completed multipart upload key=02W4TX7ZCDI6 upload=K6DY71703LF1 tag=JOTMGFJUXPER type=write size=1183056 2023-12-03T11:32:46.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.031+0000 7f4d50c67780 1 > prepared operation key=EX93BYX10WJB tag=AEYP7ZPCDMQR type=del size=980641 2023-12-03T11:32:46.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.033+0000 7f4d50c67780 1 < completed delete operation key=JR8CIONID4QC tag=X79AXGKEJXMU type=del 2023-12-03T11:32:46.035 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.034+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=J60JNQDVTJ0D type=del size=3846713 2023-12-03T11:32:46.035 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.034+0000 7f4d50c67780 1 < canceled part key=_multipart_ENMJS0KEVS2S.2~EIYU10L9YC3Y.0 size=1048576 2023-12-03T11:32:46.036 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.035+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~EIYU10L9YC3Y.1 size=1048576 2023-12-03T11:32:46.037 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.036+0000 7f4d50c67780 1 < completed part key=_multipart_ENMJS0KEVS2S.2~EIYU10L9YC3Y.2 size=287959 2023-12-03T11:32:46.039 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.038+0000 7f4d50c67780 1 < canceled multipart upload key=ENMJS0KEVS2S upload=EIYU10L9YC3Y tag=71PO3BPLWCV9 type=write size=3433687 2023-12-03T11:32:46.041 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.040+0000 7f4d50c67780 1 > prepared operation key=2H6AFQ362OGP tag=8GFESSRGMEG5 type=del size=366935 2023-12-03T11:32:46.042 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.041+0000 7f4d50c67780 1 < completed delete operation key=JBL6IOJC4TT0 tag=T4L9O54W1XWW type=del 2023-12-03T11:32:46.043 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.042+0000 7f4d50c67780 1 > prepared operation key=73SL3ZBBDA6Q tag=YSQOPEXFLHHQ type=del size=2541450 2023-12-03T11:32:46.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.044+0000 7f4d50c67780 1 < completed part key=_multipart_ULLPV2G10BME.2~50P8Y6WM5PMO.0 size=595407 2023-12-03T11:32:46.048 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.047+0000 7f4d50c67780 1 < completed multipart upload key=ULLPV2G10BME upload=50P8Y6WM5PMO tag=SLCGUG4NI288 type=write size=1643983 2023-12-03T11:32:46.049 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.048+0000 7f4d50c67780 1 > prepared operation key=G0O8EC405LYM tag=UVD7JL4SX491 type=del size=973772 2023-12-03T11:32:46.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.050+0000 7f4d50c67780 1 < completed delete operation key=52E31L45TN7V tag=LCCY4GWDMCN2 type=del 2023-12-03T11:32:46.052 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.051+0000 7f4d50c67780 1 > prepared operation key=WUM939BATDG9 tag=474PWNDXWI7N type=del size=1251605 2023-12-03T11:32:46.053 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.052+0000 7f4d50c67780 1 < completed part key=_multipart_G0O8EC405LYM.2~DK2WJT71UGCZ.0 size=345020 2023-12-03T11:32:46.056 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.055+0000 7f4d50c67780 1 < completed multipart upload key=G0O8EC405LYM upload=DK2WJT71UGCZ tag=Y5U7TQVRZGVA type=write size=1393596 2023-12-03T11:32:46.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.057+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~LNADAJCR2EOE.0 size=1048576 2023-12-03T11:32:46.059 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.058+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~LNADAJCR2EOE.1 size=1048576 2023-12-03T11:32:46.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.059+0000 7f4d50c67780 1 > prepared part key=_multipart_CQPZ0X62207Z.2~LNADAJCR2EOE.2 size=51126 2023-12-03T11:32:46.061 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.059+0000 7f4d50c67780 1 > prepared multipart upload key=CQPZ0X62207Z upload=LNADAJCR2EOE tag=Q065VFW6V9DE type=write size=3196854 2023-12-03T11:32:46.061 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.060+0000 7f4d50c67780 1 < canceled part key=_multipart_V0ND3OBFJJUB.2~004WV0RQAEDW.0 size=1048576 2023-12-03T11:32:46.061 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.060+0000 7f4d50c67780 1 < canceled part key=_multipart_V0ND3OBFJJUB.2~004WV0RQAEDW.1 size=180060 2023-12-03T11:32:46.063 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.062+0000 7f4d50c67780 1 < canceled multipart upload key=V0ND3OBFJJUB upload=004WV0RQAEDW tag=UU6ZK4B8782N type=write size=2277212 2023-12-03T11:32:46.064 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.063+0000 7f4d50c67780 1 > prepared operation key=ZE19S5UCCZ3C tag=H4P2SSBCICU6 type=del size=338882 2023-12-03T11:32:46.065 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.064+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~IOQJCNAAFF9W.0 size=1048576 2023-12-03T11:32:46.066 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.065+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~IOQJCNAAFF9W.1 size=1048576 2023-12-03T11:32:46.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.066+0000 7f4d50c67780 1 < completed part key=_multipart_JBL6IOJC4TT0.2~IOQJCNAAFF9W.2 size=997128 2023-12-03T11:32:46.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.068+0000 7f4d50c67780 1 < completed multipart upload key=JBL6IOJC4TT0 upload=IOQJCNAAFF9W tag=03KV11VCM432 type=write size=4142856 2023-12-03T11:32:46.071 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.070+0000 7f4d50c67780 1 > prepared operation key=MLKGLDFFDC3W tag=HVOB12LNTGVB type=del size=3318455 2023-12-03T11:32:46.072 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.071+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~C8IWGCD57JJJ.0 size=1048576 2023-12-03T11:32:46.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.072+0000 7f4d50c67780 1 < completed part key=_multipart_ZE19S5UCCZ3C.2~C8IWGCD57JJJ.1 size=372219 2023-12-03T11:32:46.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.076+0000 7f4d50c67780 1 < completed multipart upload key=ZE19S5UCCZ3C upload=C8IWGCD57JJJ tag=ZAN5GH3YSX1M type=write size=2469371 2023-12-03T11:32:46.078 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.077+0000 7f4d50c67780 1 > prepared operation key=ULLPV2G10BME tag=EJUWT28VGM30 type=del size=2843245 2023-12-03T11:32:46.079 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.078+0000 7f4d50c67780 1 < completed part key=_multipart_EH4B2QP1C42H.2~2D2K9INRWK0T.0 size=466533 2023-12-03T11:32:46.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.080+0000 7f4d50c67780 1 < completed multipart upload key=EH4B2QP1C42H upload=2D2K9INRWK0T tag=G6VZBT8SE67G type=write size=1515109 2023-12-03T11:32:46.083 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.082+0000 7f4d50c67780 1 > prepared operation key=GTLP2WZUX7U8 tag=RISS827DQ6DT type=del size=3042573 2023-12-03T11:32:46.084 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.083+0000 7f4d50c67780 1 < canceled operation key=ENMJS0KEVS2S tag=NEH7YJ2QX9S7 type=del size=968316 2023-12-03T11:32:46.087 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.086+0000 7f4d50c67780 1 > prepared part key=_multipart_XM5E3D99MXVA.2~X8C4VXECCGFI.0 size=119194 2023-12-03T11:32:46.087 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.086+0000 7f4d50c67780 1 > prepared multipart upload key=XM5E3D99MXVA upload=X8C4VXECCGFI tag=E7YF6JQOIC11 type=write size=1167770 2023-12-03T11:32:46.088 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.087+0000 7f4d50c67780 1 < completed part key=_multipart_XM5E3D99MXVA.2~XEZJPQIKYC6R.0 size=942786 2023-12-03T11:32:46.090 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.089+0000 7f4d50c67780 1 < completed multipart upload key=XM5E3D99MXVA upload=XEZJPQIKYC6R tag=T5XPB6DZL043 type=write size=1991362 2023-12-03T11:32:46.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.090+0000 7f4d50c67780 1 > prepared operation key=8J1EO2JDQUQH tag=O3VTXDF7IC7C type=del size=935815 2023-12-03T11:32:46.092 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.091+0000 7f4d50c67780 1 < completed write operation key=EY1RBO15PCRR tag=3QDQDBK67ZFA type=write size=687578 2023-12-03T11:32:46.094 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.093+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=4R5UOBQ0LXE4 type=del size=2087943 2023-12-03T11:32:46.095 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.094+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~P9M1NRUTBQLJ.0 size=1048576 2023-12-03T11:32:46.096 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.095+0000 7f4d50c67780 1 < completed part key=_multipart_BX5POXMMYLB7.2~P9M1NRUTBQLJ.1 size=147018 2023-12-03T11:32:46.098 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.097+0000 7f4d50c67780 1 < completed multipart upload key=BX5POXMMYLB7 upload=P9M1NRUTBQLJ tag=7FQ6BKLD6KMY type=write size=2244170 2023-12-03T11:32:46.099 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.098+0000 7f4d50c67780 1 > prepared operation key=ENMJS0KEVS2S tag=9H3UJOCMUVWV type=del size=4142130 2023-12-03T11:32:46.101 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.100+0000 7f4d50c67780 1 < completed write operation key=EX93BYX10WJB tag=Z8BRD0GNJ8K5 type=write size=664192 2023-12-03T11:32:46.103 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.102+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~EZMS6P6NUT2S.0 size=1048576 2023-12-03T11:32:46.104 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.103+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~EZMS6P6NUT2S.1 size=1048576 2023-12-03T11:32:46.105 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.104+0000 7f4d50c67780 1 > prepared part key=_multipart_7C7UX0231SHV.2~EZMS6P6NUT2S.2 size=890419 2023-12-03T11:32:46.105 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.104+0000 7f4d50c67780 1 > prepared multipart upload key=7C7UX0231SHV upload=EZMS6P6NUT2S tag=Y9ZYM5FQNC0J type=write size=4036147 2023-12-03T11:32:46.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.105+0000 7f4d50c67780 1 < completed delete operation key=EX93BYX10WJB tag=AEYP7ZPCDMQR type=del 2023-12-03T11:32:46.108 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.107+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~KO5Q9WN30MEP.0 size=1048576 2023-12-03T11:32:46.109 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.108+0000 7f4d50c67780 1 > prepared part key=_multipart_0M6ZAD39I852.2~KO5Q9WN30MEP.1 size=164670 2023-12-03T11:32:46.109 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.108+0000 7f4d50c67780 1 > prepared multipart upload key=0M6ZAD39I852 upload=KO5Q9WN30MEP tag=ZTZF7HZYCHJY type=write size=2261822 2023-12-03T11:32:46.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.109+0000 7f4d50c67780 1 < completed delete operation key=GTLP2WZUX7U8 tag=J60JNQDVTJ0D type=del 2023-12-03T11:32:46.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.111+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~DZT2KKILX416.0 size=1048576 2023-12-03T11:32:46.113 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.112+0000 7f4d50c67780 1 > prepared part key=_multipart_TEIYINZFFG76.2~DZT2KKILX416.1 size=311648 2023-12-03T11:32:46.113 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.112+0000 7f4d50c67780 1 > prepared multipart upload key=TEIYINZFFG76 upload=DZT2KKILX416 tag=C34YMLHHVQSP type=write size=2408800 2023-12-03T11:32:46.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.113+0000 7f4d50c67780 1 < completed delete operation key=2H6AFQ362OGP tag=8GFESSRGMEG5 type=del 2023-12-03T11:32:46.116 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.115+0000 7f4d50c67780 1 > prepared operation key=0M6ZAD39I852 tag=PCW0LL3CZARK type=write size=898019 2023-12-03T11:32:46.117 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.116+0000 7f4d50c67780 1 < completed delete operation key=73SL3ZBBDA6Q tag=YSQOPEXFLHHQ type=del 2023-12-03T11:32:46.119 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.118+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~W3SWCV4A7YKO.0 size=1048576 2023-12-03T11:32:46.120 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.119+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~W3SWCV4A7YKO.1 size=1048576 2023-12-03T11:32:46.121 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.120+0000 7f4d50c67780 1 > prepared part key=_multipart_EX93BYX10WJB.2~W3SWCV4A7YKO.2 size=675282 2023-12-03T11:32:46.121 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:32:46.120+0000 7f4d50c67780 1 > prepared multipart upload key=EX93BYX10WJB upload=W3SWCV4A7YKO tag=NB7JTOA6YARZ type=write size=3821010 2023-12-03T11:32:46.121 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw_stats.simulate (9182 ms) 2023-12-03T11:32:46.122 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 1 test from cls_rgw_stats (9182 ms total) 2023-12-03T11:32:46.122 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:32:46.122 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2023-12-03T11:32:46.961 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 1 test from 1 test suite ran. (11866 ms total) 2023-12-03T11:32:46.961 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 1 test. 2023-12-03T11:32:46.965 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:32:46.965 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:32:47.041 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2023-12-03T11:32:47.043 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2023-12-03T11:32:47.043 DEBUG:teuthology.orchestra.run.smithi044:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2023-12-03T11:32:47.115 INFO:tasks.workunit.client.0.smithi044.stdout:Running main() from gmock_main.cc 2023-12-03T11:32:47.115 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 31 tests from 1 test suite. 2023-12-03T11:32:47.115 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2023-12-03T11:32:48.979 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 31 tests from CmpOmap 2023-12-03T11:32:48.979 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2023-12-03T11:32:48.998 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (20 ms) 2023-12-03T11:32:48.998 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2023-12-03T11:32:49.002 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (4 ms) 2023-12-03T11:32:49.003 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2023-12-03T11:32:49.005 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2023-12-03T11:32:49.006 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2023-12-03T11:32:49.009 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (4 ms) 2023-12-03T11:32:49.009 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_str 2023-12-03T11:32:49.015 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_str (6 ms) 2023-12-03T11:32:49.015 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2023-12-03T11:32:49.021 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_u64 (6 ms) 2023-12-03T11:32:49.021 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2023-12-03T11:32:49.024 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2023-12-03T11:32:49.024 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2023-12-03T11:32:49.028 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (4 ms) 2023-12-03T11:32:49.028 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2023-12-03T11:32:49.032 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2023-12-03T11:32:49.032 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2023-12-03T11:32:49.037 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (4 ms) 2023-12-03T11:32:49.037 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2023-12-03T11:32:49.037 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2023-12-03T11:32:49.037 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2023-12-03T11:32:49.038 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2023-12-03T11:32:49.038 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2023-12-03T11:32:49.046 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (8 ms) 2023-12-03T11:32:49.046 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2023-12-03T11:32:49.053 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (7 ms) 2023-12-03T11:32:49.053 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2023-12-03T11:32:49.059 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (6 ms) 2023-12-03T11:32:49.059 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2023-12-03T11:32:49.066 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (7 ms) 2023-12-03T11:32:49.066 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2023-12-03T11:32:49.074 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_set_vals_str (8 ms) 2023-12-03T11:32:49.074 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2023-12-03T11:32:49.082 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (8 ms) 2023-12-03T11:32:49.083 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2023-12-03T11:32:49.085 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2023-12-03T11:32:49.086 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2023-12-03T11:32:49.088 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2023-12-03T11:32:49.088 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2023-12-03T11:32:49.089 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2023-12-03T11:32:49.089 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2023-12-03T11:32:49.090 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2023-12-03T11:32:49.090 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2023-12-03T11:32:49.097 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2023-12-03T11:32:49.097 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2023-12-03T11:32:49.103 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (6 ms) 2023-12-03T11:32:49.103 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2023-12-03T11:32:49.110 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (7 ms) 2023-12-03T11:32:49.111 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2023-12-03T11:32:49.119 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (9 ms) 2023-12-03T11:32:49.119 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2023-12-03T11:32:49.121 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2023-12-03T11:32:49.121 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2023-12-03T11:32:49.124 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2023-12-03T11:32:49.124 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2023-12-03T11:32:49.125 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2023-12-03T11:32:49.125 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2023-12-03T11:32:49.126 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2023-12-03T11:32:49.126 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2023-12-03T11:32:49.133 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (7 ms) 2023-12-03T11:32:49.133 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 31 tests from CmpOmap (155 ms total) 2023-12-03T11:32:49.133 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:32:49.133 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2023-12-03T11:32:49.992 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 31 tests from 1 test suite ran. (2878 ms total) 2023-12-03T11:32:49.993 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 31 tests. 2023-12-03T11:32:49.995 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:32:49.995 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:32:50.073 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2023-12-03T11:32:50.074 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2023-12-03T11:32:50.075 DEBUG:teuthology.orchestra.run.smithi044:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2023-12-03T11:32:50.148 INFO:tasks.workunit.client.0.smithi044.stdout:Running main() from gmock_main.cc 2023-12-03T11:32:50.148 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 24 tests from 1 test suite. 2023-12-03T11:32:50.148 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2023-12-03T11:32:50.148 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 24 tests from TestCls2PCQueue 2023-12-03T11:32:50.148 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2023-12-03T11:32:53.001 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2853 ms) 2023-12-03T11:32:53.001 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2023-12-03T11:32:56.028 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3027 ms) 2023-12-03T11:32:56.028 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.Reserve 2023-12-03T11:32:59.045 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.Reserve (3018 ms) 2023-12-03T11:32:59.045 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2023-12-03T11:33:02.068 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3023 ms) 2023-12-03T11:33:02.068 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.Commit 2023-12-03T11:33:05.085 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.Commit (3016 ms) 2023-12-03T11:33:05.085 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.Stats 2023-12-03T11:33:08.111 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.Stats (3026 ms) 2023-12-03T11:33:08.111 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2023-12-03T11:33:12.149 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4039 ms) 2023-12-03T11:33:12.149 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.Abort 2023-12-03T11:33:15.169 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.Abort (3020 ms) 2023-12-03T11:33:15.169 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2023-12-03T11:33:18.187 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.ReserveError (3017 ms) 2023-12-03T11:33:18.187 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.CommitError 2023-12-03T11:33:21.210 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.CommitError (3021 ms) 2023-12-03T11:33:21.211 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.AbortError 2023-12-03T11:33:24.228 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.AbortError (3021 ms) 2023-12-03T11:33:24.228 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2023-12-03T11:33:27.246 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3017 ms) 2023-12-03T11:33:27.246 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2023-12-03T11:33:30.270 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3024 ms) 2023-12-03T11:33:30.270 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2023-12-03T11:33:33.276 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3007 ms) 2023-12-03T11:33:33.276 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2023-12-03T11:33:36.319 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3042 ms) 2023-12-03T11:33:36.319 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2023-12-03T11:33:39.340 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3021 ms) 2023-12-03T11:33:39.340 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2023-12-03T11:33:42.362 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3022 ms) 2023-12-03T11:33:42.362 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2023-12-03T11:33:45.370 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.Cleanup (3008 ms) 2023-12-03T11:33:45.370 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2023-12-03T11:33:55.871 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10500 ms) 2023-12-03T11:33:55.871 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2023-12-03T11:33:58.888 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3018 ms) 2023-12-03T11:33:58.888 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2023-12-03T11:34:11.867 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (12978 ms) 2023-12-03T11:34:11.867 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2023-12-03T11:34:15.893 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4027 ms) 2023-12-03T11:34:15.893 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2023-12-03T11:34:21.926 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6033 ms) 2023-12-03T11:34:21.926 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2023-12-03T11:34:27.877 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5950 ms) 2023-12-03T11:34:27.877 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 24 tests from TestCls2PCQueue (97729 ms total) 2023-12-03T11:34:27.877 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:34:27.877 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2023-12-03T11:34:27.877 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 24 tests from 1 test suite ran. (97729 ms total) 2023-12-03T11:34:27.877 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 24 tests. 2023-12-03T11:34:27.881 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:34:27.881 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:34:27.957 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2023-12-03T11:34:27.958 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2023-12-03T11:34:27.958 DEBUG:teuthology.orchestra.run.smithi044:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2023-12-03T11:34:28.039 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:28.039 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:28.040 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 6 tests from 1 test suite. 2023-12-03T11:34:28.040 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2023-12-03T11:34:29.885 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 6 tests from rgw_gc_log 2023-12-03T11:34:29.886 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2023-12-03T11:34:30.021 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] rgw_gc_log.init_existing_queue (135 ms) 2023-12-03T11:34:30.021 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2023-12-03T11:34:30.025 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] rgw_gc_log.init_existing_omap (4 ms) 2023-12-03T11:34:30.025 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2023-12-03T11:34:30.028 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (3 ms) 2023-12-03T11:34:30.028 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2023-12-03T11:34:30.030 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2023-12-03T11:34:30.030 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2023-12-03T11:34:30.033 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2023-12-03T11:34:30.033 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2023-12-03T11:34:30.034 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2023-12-03T11:34:30.034 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 6 tests from rgw_gc_log (149 ms total) 2023-12-03T11:34:30.034 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:34:30.034 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2023-12-03T11:34:30.887 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 6 tests from 1 test suite ran. (2848 ms total) 2023-12-03T11:34:30.888 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 6 tests. 2023-12-03T11:34:30.891 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:34:30.891 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:34:30.967 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2023-12-03T11:34:30.968 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2023-12-03T11:34:30.968 DEBUG:teuthology.orchestra.run.smithi044:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2023-12-03T11:34:31.053 INFO:tasks.workunit.client.0.smithi044.stdout:Running main() from gmock_main.cc 2023-12-03T11:34:31.053 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 4 tests from 1 test suite. 2023-12-03T11:34:31.053 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2023-12-03T11:34:31.053 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 4 tests from TestRGWObj 2023-12-03T11:34:31.053 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestRGWObj.underscore 2023-12-03T11:34:31.053 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2023-12-03T11:34:31.053 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2023-12-03T11:34:31.053 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns= i= 2023-12-03T11:34:31.053 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2023-12-03T11:34:31.053 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2023-12-03T11:34:31.053 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns= i= 2023-12-03T11:34:31.054 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2023-12-03T11:34:31.054 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2023-12-03T11:34:31.054 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns= i= 2023-12-03T11:34:31.054 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.054 INFO:tasks.workunit.client.0.smithi044.stdout: "obj1": { 2023-12-03T11:34:31.054 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.054 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.054 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.054 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.054 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.054 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.054 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.054 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.054 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.054 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.055 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.055 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.055 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2023-12-03T11:34:31.055 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.055 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.055 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.055 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.055 INFO:tasks.workunit.client.0.smithi044.stdout: "obj2": { 2023-12-03T11:34:31.055 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.055 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.055 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.055 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.055 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.055 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.055 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.055 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.055 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.056 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.056 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.056 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.056 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2023-12-03T11:34:31.056 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.056 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.056 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.056 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.056 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3": { 2023-12-03T11:34:31.056 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.056 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.056 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.056 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.056 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.057 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.057 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.057 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.057 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.057 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.057 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.057 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.057 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2023-12-03T11:34:31.057 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.057 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.057 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.057 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.057 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3-2": { 2023-12-03T11:34:31.057 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.057 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.057 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.057 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.058 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.058 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.058 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.058 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.058 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.058 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.058 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.058 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.058 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2023-12-03T11:34:31.058 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.058 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.058 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.058 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.058 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.058 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2023-12-03T11:34:31.058 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2023-12-03T11:34:31.059 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns=ns i= 2023-12-03T11:34:31.059 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2023-12-03T11:34:31.059 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2023-12-03T11:34:31.059 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns=ns i= 2023-12-03T11:34:31.059 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2023-12-03T11:34:31.059 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2023-12-03T11:34:31.059 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns=ns i= 2023-12-03T11:34:31.059 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.059 INFO:tasks.workunit.client.0.smithi044.stdout: "obj1": { 2023-12-03T11:34:31.059 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.059 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.059 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.059 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.059 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.059 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.059 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.060 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.060 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.060 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.060 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.060 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.060 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2023-12-03T11:34:31.060 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.060 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.060 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.060 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.060 INFO:tasks.workunit.client.0.smithi044.stdout: "obj2": { 2023-12-03T11:34:31.060 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.060 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.060 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.060 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.060 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.060 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.061 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.061 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.061 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.061 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.061 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.061 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.061 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2023-12-03T11:34:31.061 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.061 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.061 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.061 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.061 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3": { 2023-12-03T11:34:31.061 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.061 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.061 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.061 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.061 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.062 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.062 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.062 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.062 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.062 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.062 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.062 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.062 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2023-12-03T11:34:31.062 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.062 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.062 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.062 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.062 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3-2": { 2023-12-03T11:34:31.062 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.062 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.063 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.063 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.063 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.063 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.063 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.063 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.063 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.063 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.063 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.063 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.063 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2023-12-03T11:34:31.063 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.063 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.063 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.063 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.063 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.063 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2023-12-03T11:34:31.064 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2023-12-03T11:34:31.064 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns= i=v1 2023-12-03T11:34:31.064 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2023-12-03T11:34:31.064 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2023-12-03T11:34:31.064 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns= i=v1 2023-12-03T11:34:31.064 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2023-12-03T11:34:31.064 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2023-12-03T11:34:31.064 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns= i=v1 2023-12-03T11:34:31.064 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.064 INFO:tasks.workunit.client.0.smithi044.stdout: "obj1": { 2023-12-03T11:34:31.064 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.064 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.064 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.064 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.064 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.064 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.064 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.065 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.065 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.065 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.065 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.065 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.065 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2023-12-03T11:34:31.065 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2023-12-03T11:34:31.065 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.065 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.065 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.065 INFO:tasks.workunit.client.0.smithi044.stdout: "obj2": { 2023-12-03T11:34:31.065 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.065 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.065 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.065 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.065 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.065 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.066 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.066 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.066 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.066 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.066 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.066 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.066 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2023-12-03T11:34:31.066 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2023-12-03T11:34:31.066 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.066 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.066 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.066 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3": { 2023-12-03T11:34:31.066 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.066 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.066 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.066 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.066 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.067 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.067 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.067 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.067 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.067 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.067 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.067 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.067 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2023-12-03T11:34:31.067 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.067 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.067 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.067 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.067 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3-2": { 2023-12-03T11:34:31.067 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.067 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.067 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.067 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.068 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.068 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.068 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.068 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.068 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.068 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.068 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.068 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.068 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2023-12-03T11:34:31.068 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2023-12-03T11:34:31.068 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.068 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.068 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.068 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.068 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2023-12-03T11:34:31.068 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2023-12-03T11:34:31.069 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns=ns i=v1 2023-12-03T11:34:31.069 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2023-12-03T11:34:31.069 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2023-12-03T11:34:31.069 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns=ns i=v1 2023-12-03T11:34:31.069 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2023-12-03T11:34:31.069 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2023-12-03T11:34:31.069 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns=ns i=v1 2023-12-03T11:34:31.069 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.069 INFO:tasks.workunit.client.0.smithi044.stdout: "obj1": { 2023-12-03T11:34:31.069 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.069 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.069 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.069 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.069 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.069 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.069 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.069 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.069 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.069 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.070 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.070 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.070 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2023-12-03T11:34:31.070 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2023-12-03T11:34:31.070 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.070 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.070 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.070 INFO:tasks.workunit.client.0.smithi044.stdout: "obj2": { 2023-12-03T11:34:31.070 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.070 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.070 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.070 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.070 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.070 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.070 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.070 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.070 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.071 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.071 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.071 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.071 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2023-12-03T11:34:31.071 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2023-12-03T11:34:31.071 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.071 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.071 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.071 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3": { 2023-12-03T11:34:31.071 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.071 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.071 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.071 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.071 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.071 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.071 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.071 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.071 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.072 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.072 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.072 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.072 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2023-12-03T11:34:31.072 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.072 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.072 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.072 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.072 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3-2": { 2023-12-03T11:34:31.072 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.072 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.072 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.072 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.072 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.072 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.072 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.072 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.072 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.073 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.073 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.073 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.073 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2023-12-03T11:34:31.073 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2023-12-03T11:34:31.073 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.073 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.073 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.073 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.073 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2023-12-03T11:34:31.073 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestRGWObj.no_underscore 2023-12-03T11:34:31.073 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2023-12-03T11:34:31.073 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2023-12-03T11:34:31.073 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns= i= 2023-12-03T11:34:31.073 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2023-12-03T11:34:31.073 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2023-12-03T11:34:31.073 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns= i= 2023-12-03T11:34:31.074 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2023-12-03T11:34:31.074 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2023-12-03T11:34:31.074 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns= i= 2023-12-03T11:34:31.074 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.074 INFO:tasks.workunit.client.0.smithi044.stdout: "obj1": { 2023-12-03T11:34:31.074 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.074 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.074 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.074 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.074 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.074 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.074 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.074 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.074 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.074 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.074 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.075 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.075 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2023-12-03T11:34:31.075 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.075 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.075 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.075 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.075 INFO:tasks.workunit.client.0.smithi044.stdout: "obj2": { 2023-12-03T11:34:31.075 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.075 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.075 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.075 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.075 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.075 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.075 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.075 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.075 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.076 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.076 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.076 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.076 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2023-12-03T11:34:31.076 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.076 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.076 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.076 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.076 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3": { 2023-12-03T11:34:31.076 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.076 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.076 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.076 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.076 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.076 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.076 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.076 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.077 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.077 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.077 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.077 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.077 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2023-12-03T11:34:31.077 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.077 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.077 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.077 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.077 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3-2": { 2023-12-03T11:34:31.077 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.077 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.077 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.077 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.077 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.077 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.078 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.078 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.078 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.078 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.078 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.078 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.078 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2023-12-03T11:34:31.078 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.078 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.078 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.078 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.078 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.078 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2023-12-03T11:34:31.078 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2023-12-03T11:34:31.078 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns=ns i= 2023-12-03T11:34:31.078 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2023-12-03T11:34:31.079 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2023-12-03T11:34:31.079 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns=ns i= 2023-12-03T11:34:31.079 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2023-12-03T11:34:31.079 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2023-12-03T11:34:31.079 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns=ns i= 2023-12-03T11:34:31.079 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.079 INFO:tasks.workunit.client.0.smithi044.stdout: "obj1": { 2023-12-03T11:34:31.079 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.079 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.079 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.079 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.079 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.079 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.079 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.079 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.079 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.079 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.080 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.080 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.080 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2023-12-03T11:34:31.080 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.080 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.080 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.080 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.080 INFO:tasks.workunit.client.0.smithi044.stdout: "obj2": { 2023-12-03T11:34:31.080 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.080 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.080 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.080 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.080 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.080 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.080 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.080 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.081 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.081 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.081 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.081 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.081 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2023-12-03T11:34:31.081 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.081 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.081 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.081 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.081 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3": { 2023-12-03T11:34:31.081 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.081 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.081 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.081 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.081 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.081 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.081 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.082 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.082 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.082 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.082 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.082 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.082 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2023-12-03T11:34:31.082 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.082 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.082 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.082 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.082 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3-2": { 2023-12-03T11:34:31.082 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.082 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.082 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.082 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.083 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.083 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.083 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.083 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.083 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.083 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.083 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.083 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.083 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2023-12-03T11:34:31.083 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.083 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.083 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.083 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.083 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.083 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2023-12-03T11:34:31.083 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2023-12-03T11:34:31.083 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns= i=v1 2023-12-03T11:34:31.084 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2023-12-03T11:34:31.084 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2023-12-03T11:34:31.084 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns= i=v1 2023-12-03T11:34:31.084 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2023-12-03T11:34:31.084 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2023-12-03T11:34:31.084 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns= i=v1 2023-12-03T11:34:31.084 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.084 INFO:tasks.workunit.client.0.smithi044.stdout: "obj1": { 2023-12-03T11:34:31.084 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.084 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.084 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.084 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.084 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.084 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.084 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.084 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.085 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.085 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.085 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.085 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.085 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2023-12-03T11:34:31.085 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2023-12-03T11:34:31.085 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.085 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.085 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.085 INFO:tasks.workunit.client.0.smithi044.stdout: "obj2": { 2023-12-03T11:34:31.085 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.085 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.085 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.085 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.085 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.085 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.086 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.086 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.086 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.086 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.086 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.086 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.086 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2023-12-03T11:34:31.086 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2023-12-03T11:34:31.086 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.086 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.086 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.087 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3": { 2023-12-03T11:34:31.087 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.087 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.087 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.087 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.087 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.087 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.087 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.087 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.087 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.087 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.087 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.087 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.087 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2023-12-03T11:34:31.087 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.087 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.087 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.088 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.088 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3-2": { 2023-12-03T11:34:31.088 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.088 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.088 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.088 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.088 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.088 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.088 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.088 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.088 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.088 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.088 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.088 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.088 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2023-12-03T11:34:31.088 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2023-12-03T11:34:31.089 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.089 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.089 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.089 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.089 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2023-12-03T11:34:31.089 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2023-12-03T11:34:31.089 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns=ns i=v1 2023-12-03T11:34:31.089 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2023-12-03T11:34:31.089 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2023-12-03T11:34:31.089 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns=ns i=v1 2023-12-03T11:34:31.089 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2023-12-03T11:34:31.089 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2023-12-03T11:34:31.089 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns=ns i=v1 2023-12-03T11:34:31.089 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.089 INFO:tasks.workunit.client.0.smithi044.stdout: "obj1": { 2023-12-03T11:34:31.089 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.089 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.090 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.090 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.090 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.090 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.090 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.090 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.090 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.090 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.090 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.090 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.090 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2023-12-03T11:34:31.090 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2023-12-03T11:34:31.090 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.090 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.090 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.090 INFO:tasks.workunit.client.0.smithi044.stdout: "obj2": { 2023-12-03T11:34:31.090 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.091 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.091 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.091 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.091 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.091 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.091 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.091 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.091 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.091 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.091 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.091 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.091 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2023-12-03T11:34:31.091 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2023-12-03T11:34:31.091 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.091 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.091 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.091 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3": { 2023-12-03T11:34:31.091 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.092 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.092 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.092 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.092 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.092 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.092 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.092 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.092 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.092 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.092 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.092 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.092 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2023-12-03T11:34:31.092 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.092 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.092 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.092 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.092 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3-2": { 2023-12-03T11:34:31.092 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.093 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.093 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.093 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.093 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.093 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.093 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.093 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.093 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.093 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.093 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.093 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.093 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2023-12-03T11:34:31.093 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2023-12-03T11:34:31.093 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.094 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.094 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.094 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.094 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2023-12-03T11:34:31.094 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestRGWObj.obj_to_raw 2023-12-03T11:34:31.094 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.094 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.094 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.094 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.094 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.094 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.094 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.094 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.094 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.094 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.095 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.095 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.095 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.095 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.095 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.095 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.095 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.095 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.095 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.095 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.095 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.095 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.095 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.095 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.095 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.096 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.096 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.096 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.096 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.096 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.096 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.096 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.096 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.096 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.096 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.096 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2023-12-03T11:34:31.096 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker_myobj", 2023-12-03T11:34:31.096 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.096 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.096 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.096 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.096 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.097 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.097 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.097 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.097 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.097 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.097 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.097 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.097 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.097 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.097 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.097 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.097 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.097 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.098 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.098 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.098 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.098 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.098 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.098 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.098 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.098 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.098 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.098 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.098 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.098 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.098 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.098 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.098 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.099 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.099 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.099 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.099 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.099 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.099 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.099 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.099 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.099 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.099 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.099 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.099 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.099 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.099 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.099 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.099 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.100 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.100 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.100 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.100 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.100 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.100 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.100 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.100 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.100 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.100 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.100 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker_myobj", 2023-12-03T11:34:31.100 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.100 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.100 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.100 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.100 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.100 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.101 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.101 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.101 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.101 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.101 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.101 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.101 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.101 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.101 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.101 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.101 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.101 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.101 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.101 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.101 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.102 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.102 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.102 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.102 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.102 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.102 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.102 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.102 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.102 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.102 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.102 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.102 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.102 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.102 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.102 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.102 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.103 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.103 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.103 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.103 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.103 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.103 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.103 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.103 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.103 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.103 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.103 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.103 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.103 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.103 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.103 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.103 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.103 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.104 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.104 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.104 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.104 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.104 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2023-12-03T11:34:31.104 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns_myobj", 2023-12-03T11:34:31.104 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.104 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.104 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.104 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.104 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.104 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.104 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.104 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.104 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.104 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.105 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.105 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.105 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.105 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.105 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.105 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.105 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.105 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.105 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.105 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.105 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.105 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.105 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.105 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.105 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.106 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.106 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.106 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.106 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.106 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.106 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.106 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.106 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.106 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.106 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.106 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.106 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.106 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.106 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.106 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.106 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.107 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.107 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.107 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.107 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.107 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.107 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.107 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.107 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.107 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.107 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.107 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.107 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.107 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.107 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.107 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.107 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.107 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.107 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.108 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns_myobj", 2023-12-03T11:34:31.108 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.108 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.108 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.108 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.108 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.108 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.108 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.108 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.108 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.108 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.109 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.109 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.109 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.109 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.109 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.109 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.109 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.109 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.109 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.109 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.109 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.109 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.109 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.109 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.109 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.109 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.109 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.110 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.110 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.110 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.110 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.110 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.110 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.110 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.110 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.110 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.110 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.110 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.110 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.110 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.110 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.110 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.110 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.111 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.111 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.111 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.111 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.111 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.111 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.111 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.111 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.111 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.111 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.111 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.111 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.111 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.111 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.111 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.111 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2023-12-03T11:34:31.111 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst_myobj", 2023-12-03T11:34:31.112 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.112 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.112 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.112 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.112 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.112 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.112 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.112 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.112 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.112 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.112 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.112 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.112 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.112 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.112 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.112 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.112 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.112 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.113 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.113 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.113 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.113 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.113 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.113 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.113 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.113 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.113 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.113 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.113 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.113 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.113 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.113 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.113 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.113 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.113 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.114 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.114 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.114 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.114 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.114 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.114 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.114 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.114 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.114 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.114 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.114 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.114 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.114 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.114 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.114 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.114 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.115 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.115 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.115 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.115 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.115 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.115 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.115 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.115 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.115 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst_myobj", 2023-12-03T11:34:31.115 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.115 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.115 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.115 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.115 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.115 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.115 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.115 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.115 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.116 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.116 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.116 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.116 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.116 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.116 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.116 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.116 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.116 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.116 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.116 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.116 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.116 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.116 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.116 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.116 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.116 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.117 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.117 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.117 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.117 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.117 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.117 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.117 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.117 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.117 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.117 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.117 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.117 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.117 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.117 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.117 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.117 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.117 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.118 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.118 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.118 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.118 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.118 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.118 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.118 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.118 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.118 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.118 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.118 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.118 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.118 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.118 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.118 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.118 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2023-12-03T11:34:31.119 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst_myobj", 2023-12-03T11:34:31.119 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.119 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.119 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.119 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.119 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.119 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.119 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.119 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.119 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.119 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.119 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.119 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.119 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.119 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.120 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.120 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.120 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.120 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.120 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.120 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.120 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.120 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.120 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.120 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.120 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.120 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.120 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.120 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.120 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.120 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.120 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.121 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.121 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.121 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.121 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.121 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.121 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.121 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.121 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.121 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.121 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.121 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.121 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.121 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.121 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.122 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.122 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.122 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.122 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.122 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.122 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.122 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.122 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.122 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.122 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.122 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.122 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.122 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.122 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.123 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst_myobj", 2023-12-03T11:34:31.123 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.123 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.123 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.123 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.123 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.123 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.123 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.123 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.123 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.123 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.123 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.123 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.123 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.124 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.124 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.124 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.124 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.124 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.124 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.124 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.124 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.124 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.124 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.124 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.124 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.124 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.124 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.124 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.124 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.125 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.125 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.125 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.125 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.125 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.125 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.125 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.125 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.125 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.125 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.125 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.125 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.125 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.125 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.125 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.125 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.126 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.126 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.126 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.126 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.126 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.126 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.126 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.126 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.126 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.126 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.126 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.126 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.126 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.126 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2023-12-03T11:34:31.126 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker___myobj", 2023-12-03T11:34:31.126 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj" 2023-12-03T11:34:31.127 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.127 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.127 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.127 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.127 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.127 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.127 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.127 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.127 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.127 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.127 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.127 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.127 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.127 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.127 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.128 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.128 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.128 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.128 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.128 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.128 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.128 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.128 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.128 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.128 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.128 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.128 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.128 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.128 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.128 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.128 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.129 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.129 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.129 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.129 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.129 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.129 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.129 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.129 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.129 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.129 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.129 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.129 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.129 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.129 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.129 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.129 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.129 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.130 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.130 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.130 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.130 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.130 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.130 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.130 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.130 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.130 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.130 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.130 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker___myobj", 2023-12-03T11:34:31.130 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj" 2023-12-03T11:34:31.130 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.130 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.130 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.131 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.131 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.131 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.131 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.131 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.131 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.131 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.131 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.131 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.131 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.131 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.131 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.131 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.131 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.131 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.131 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.131 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.132 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.132 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.132 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.132 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.132 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.132 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.132 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.132 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.132 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.132 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.132 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.132 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.132 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.132 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.132 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.132 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.133 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.133 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.133 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.133 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.133 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.133 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.133 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.133 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.133 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.133 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.133 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.133 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.133 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.133 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.133 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.133 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.134 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.134 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.134 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.134 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.134 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.134 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2023-12-03T11:34:31.134 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns__myobj", 2023-12-03T11:34:31.134 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.134 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.134 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.134 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.134 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.134 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.134 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.134 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.134 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.135 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.135 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.135 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.135 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.135 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.135 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.135 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.135 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.135 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.135 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.135 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.135 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.135 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.135 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.135 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.135 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.136 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.136 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.136 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.136 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.136 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.136 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.136 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.136 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.136 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.136 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.136 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.136 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.136 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.136 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.136 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.136 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.137 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.137 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.137 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.137 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.137 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.137 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.137 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.137 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.137 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.137 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.137 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.137 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.137 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.137 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.137 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.137 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.137 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.138 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.138 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns__myobj", 2023-12-03T11:34:31.138 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.138 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.138 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.138 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.138 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.138 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.138 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.138 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.138 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.138 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.138 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.138 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.139 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.139 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.139 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.139 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.139 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.139 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.139 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.139 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.139 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.139 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.139 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.139 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.139 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.139 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.139 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.139 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.139 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.140 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.140 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.140 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.140 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.140 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.140 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.140 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.140 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.140 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.140 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.140 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.140 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.140 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.140 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.140 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.140 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.141 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.141 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.141 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.141 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.141 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.141 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.141 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.141 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.141 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.141 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.141 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.141 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.141 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.141 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2023-12-03T11:34:31.141 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst__myobj", 2023-12-03T11:34:31.141 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj" 2023-12-03T11:34:31.141 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.142 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.142 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.142 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.142 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.142 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.142 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.142 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.142 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.142 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.142 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.142 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.142 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.142 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.142 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.142 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.143 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.143 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.143 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.143 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.143 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.143 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.143 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.143 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.143 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.143 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.143 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.143 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.143 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.143 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.143 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.144 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.144 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.144 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.144 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.144 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.144 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.144 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.144 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.144 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.144 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.144 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.144 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.144 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.144 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.144 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.144 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.144 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.144 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.145 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.145 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.145 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.145 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.145 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.145 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.145 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.145 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.145 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.145 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst__myobj", 2023-12-03T11:34:31.145 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj" 2023-12-03T11:34:31.145 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.145 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.146 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.146 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.146 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.146 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.146 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.146 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.146 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.146 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.146 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.146 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.146 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.146 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.146 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.147 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.147 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.147 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.147 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.147 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.147 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.147 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.147 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.147 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.147 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.147 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.147 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.147 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.147 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.147 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.147 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.148 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.148 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.148 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.148 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.148 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.148 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.148 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.148 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.148 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.148 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.148 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.148 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.148 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.148 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.148 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.148 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.149 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.149 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.149 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.149 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.149 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.149 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.149 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.149 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.149 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.149 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.149 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2023-12-03T11:34:31.149 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst__myobj", 2023-12-03T11:34:31.149 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.149 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.149 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.150 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.150 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.150 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.150 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.150 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.150 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.150 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.150 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.150 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.150 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.150 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.150 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.150 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.150 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.150 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.151 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.151 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.151 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.151 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.151 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.151 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.151 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.151 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.151 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.151 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.151 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.151 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.151 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.151 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.151 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.151 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.152 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.152 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.152 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.152 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.152 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.152 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.152 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.152 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.152 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.152 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.152 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.152 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.152 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.152 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.153 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.153 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.153 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.153 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.153 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.153 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.153 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.153 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.153 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.153 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.153 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.153 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst__myobj", 2023-12-03T11:34:31.153 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.153 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.153 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.154 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.154 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.154 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.154 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.154 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.154 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.154 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.154 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.154 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.154 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.154 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.154 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.154 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.154 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.154 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.155 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.155 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.155 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.155 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.155 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.155 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.155 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.155 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.155 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.155 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.155 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.155 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.155 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.155 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.155 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.155 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.155 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.156 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.156 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.156 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.156 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.156 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.156 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.156 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.156 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.156 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.156 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.156 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.156 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.156 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.156 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.156 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.156 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.156 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.157 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.157 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.157 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.157 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.157 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.157 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.157 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2023-12-03T11:34:31.157 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker___myobj_", 2023-12-03T11:34:31.157 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj_" 2023-12-03T11:34:31.157 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.157 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.157 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.157 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.157 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.157 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.157 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.157 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.158 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.158 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.158 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.158 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.158 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.158 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.158 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.158 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.158 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.158 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.158 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.158 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.158 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.158 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.158 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.159 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.159 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.159 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.159 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.159 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.159 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.159 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.159 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.159 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.159 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.159 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.159 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.159 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.159 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.159 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.159 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.160 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.160 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.160 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.160 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.160 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.160 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.160 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.160 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.160 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.160 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.160 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.160 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.160 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.160 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.160 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.160 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.160 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.161 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.161 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.161 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker___myobj_", 2023-12-03T11:34:31.161 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj_" 2023-12-03T11:34:31.161 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.161 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.161 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.161 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.161 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.161 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.161 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.161 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.161 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.161 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.161 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.161 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.161 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.161 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.162 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.162 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.162 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.162 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.162 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.162 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.162 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.162 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.162 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.162 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.162 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.162 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.162 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.162 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.162 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.162 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.163 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.163 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.163 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.163 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.163 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.163 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.163 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.163 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.163 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.163 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.163 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.163 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.163 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.163 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.163 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.163 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.163 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.164 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.164 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.164 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.164 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.164 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.164 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.164 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.164 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.164 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.164 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.164 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2023-12-03T11:34:31.164 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns__myobj_", 2023-12-03T11:34:31.164 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.164 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.164 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.164 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.165 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.165 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.165 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.165 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.165 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.165 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.165 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.165 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.165 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.165 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.165 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.165 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.165 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.165 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.165 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.165 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.165 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.166 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.166 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.166 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.166 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.166 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.166 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.166 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.166 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.166 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.166 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.166 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.166 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.166 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.166 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.166 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.166 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.167 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.167 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.167 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.167 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.167 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.167 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.167 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.167 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.167 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.167 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.167 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.167 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.167 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.167 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.167 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.167 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.167 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.167 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.168 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.168 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.168 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.168 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.168 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns__myobj_", 2023-12-03T11:34:31.168 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.168 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.168 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.168 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.168 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.168 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.168 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.168 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.168 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.168 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.168 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.169 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.169 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.169 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.169 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.169 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.169 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.169 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.169 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.169 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.169 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.169 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.169 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.169 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.169 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.169 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.169 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.170 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.170 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.170 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.170 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.170 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.170 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.170 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.170 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.170 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.170 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.170 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.170 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.170 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.170 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.171 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.171 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.171 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.171 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.171 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.171 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.171 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.171 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.171 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.171 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.171 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.171 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.171 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.171 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.171 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.171 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.172 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.172 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2023-12-03T11:34:31.172 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst__myobj_", 2023-12-03T11:34:31.172 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj_" 2023-12-03T11:34:31.172 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.172 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.172 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.172 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.172 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.172 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.172 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.172 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.172 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.172 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.172 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.172 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.172 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.173 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.173 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.173 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.173 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.173 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.173 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.173 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.173 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.173 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.173 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.173 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.173 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.173 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.173 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.173 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.173 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.174 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.174 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.174 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.174 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.174 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.174 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.174 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.174 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.174 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.174 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.174 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.174 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.174 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.174 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.174 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.174 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.175 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.175 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.175 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.175 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.175 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.175 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.175 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.175 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.175 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.175 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.175 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.175 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.175 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.175 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst__myobj_", 2023-12-03T11:34:31.175 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj_" 2023-12-03T11:34:31.176 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.176 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.176 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.176 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.176 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.176 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.176 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.176 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.176 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.176 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.176 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.176 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.176 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.176 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.176 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.176 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.176 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.177 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.177 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.177 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.177 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.177 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.177 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.177 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.177 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.177 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.177 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.177 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.177 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.177 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.177 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.177 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.177 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.177 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.178 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.178 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.178 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.178 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.178 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.178 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.178 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.178 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.178 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.178 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.178 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.178 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.178 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.178 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.178 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.179 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.179 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.179 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.179 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.179 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.179 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.179 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.179 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.179 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2023-12-03T11:34:31.179 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst__myobj_", 2023-12-03T11:34:31.179 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.179 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.179 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.179 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.179 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.179 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.179 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2023-12-03T11:34:31.179 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.180 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.180 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.180 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.180 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2023-12-03T11:34:31.180 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.180 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2023-12-03T11:34:31.180 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.180 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.180 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.180 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.180 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.180 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.180 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.180 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.180 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.181 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.181 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.181 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.181 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.181 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.181 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.181 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.181 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.181 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.181 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.181 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.181 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.181 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.182 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.182 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2023-12-03T11:34:31.182 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.182 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.182 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.182 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.182 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.182 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.182 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.182 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.182 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.182 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.182 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.182 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.182 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.183 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.183 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.183 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.183 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.183 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.183 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.183 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.183 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.183 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst__myobj_", 2023-12-03T11:34:31.183 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.183 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.183 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.183 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.183 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.183 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.183 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.183 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.184 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.184 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.184 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.184 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.184 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.184 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.184 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.184 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.184 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.184 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.184 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.184 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.184 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.184 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.184 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.185 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2023-12-03T11:34:31.185 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestRGWObj.old_to_raw 2023-12-03T11:34:31.185 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.185 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.185 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.185 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker_myobj", 2023-12-03T11:34:31.185 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.185 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.185 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.185 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.185 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.185 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.185 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.185 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.185 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.185 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.185 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.186 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.186 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.186 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.186 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.186 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.186 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.186 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.186 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.186 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.186 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.186 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.186 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.186 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker_myobj 2023-12-03T11:34:31.186 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.186 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2023-12-03T11:34:31.186 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.187 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker_myobj", 2023-12-03T11:34:31.187 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.187 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.187 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.187 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.187 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2023-12-03T11:34:31.187 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.187 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.187 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.187 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.187 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.187 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.187 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.187 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.187 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.187 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.187 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.188 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.188 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.188 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.188 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.188 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.188 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.188 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.188 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker_myobj 2023-12-03T11:34:31.188 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.188 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.188 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.188 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns_myobj", 2023-12-03T11:34:31.188 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.188 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.188 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.188 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.188 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.189 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.189 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.189 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.189 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.189 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.189 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.189 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.189 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.189 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.189 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.189 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.189 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.189 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.189 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.189 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.189 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.190 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.190 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.190 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker__ns_myobj 2023-12-03T11:34:31.190 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.190 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2023-12-03T11:34:31.190 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.190 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns_myobj", 2023-12-03T11:34:31.190 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.190 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.190 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.190 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.190 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2023-12-03T11:34:31.190 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.190 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.190 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.191 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.191 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.191 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.191 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.191 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.191 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.191 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.191 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.191 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.191 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.191 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.191 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.191 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.191 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.191 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.191 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker__ns_myobj 2023-12-03T11:34:31.191 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.192 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.192 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.192 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst_myobj", 2023-12-03T11:34:31.192 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.192 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.192 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.192 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.192 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.192 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.192 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.192 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.192 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.192 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.192 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.192 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.192 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.193 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.193 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.193 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.193 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.193 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.193 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.193 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.193 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.193 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.193 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.193 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker__:inst_myobj 2023-12-03T11:34:31.193 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.193 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2023-12-03T11:34:31.193 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.193 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst_myobj", 2023-12-03T11:34:31.193 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.193 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.194 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.194 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.194 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2023-12-03T11:34:31.194 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.194 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.194 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.194 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.194 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.194 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.194 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.194 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.194 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.194 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.194 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.194 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.194 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.195 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.195 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.195 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.195 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.195 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.195 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker__:inst_myobj 2023-12-03T11:34:31.195 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.195 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.195 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.195 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst_myobj", 2023-12-03T11:34:31.195 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.195 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.195 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.195 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.195 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.195 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.195 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.195 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.196 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.196 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.196 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.196 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.196 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.196 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.196 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.196 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.196 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.196 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.196 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.196 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.196 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.196 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.196 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.196 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker__ns:inst_myobj 2023-12-03T11:34:31.196 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.197 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2023-12-03T11:34:31.197 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.197 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst_myobj", 2023-12-03T11:34:31.197 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.197 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.197 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.197 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.197 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2023-12-03T11:34:31.197 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.197 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.197 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.197 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.197 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.197 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.197 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.197 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.198 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.198 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.198 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.198 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.198 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2023-12-03T11:34:31.198 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.198 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.198 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.198 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.198 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.198 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker__ns:inst_myobj 2023-12-03T11:34:31.198 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.198 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.198 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.199 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker___myobj", 2023-12-03T11:34:31.199 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj" 2023-12-03T11:34:31.199 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.199 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.199 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.199 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.199 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.199 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.199 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.199 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.199 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.199 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.199 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.199 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.199 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.199 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.199 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.200 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.200 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.200 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.200 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.200 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.200 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.200 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.200 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker___myobj 2023-12-03T11:34:31.200 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.200 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2023-12-03T11:34:31.200 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.200 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker___myobj", 2023-12-03T11:34:31.200 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj" 2023-12-03T11:34:31.200 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.200 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.200 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.200 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2023-12-03T11:34:31.201 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.201 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.201 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.201 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.201 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.201 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.201 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.201 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.201 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.201 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.201 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.201 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.201 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.201 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.201 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.202 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.202 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.202 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.202 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker___myobj 2023-12-03T11:34:31.202 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.202 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.202 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.202 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns__myobj", 2023-12-03T11:34:31.202 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.202 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.202 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.202 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.202 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.202 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.202 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.202 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.203 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.203 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.203 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.203 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.203 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.203 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.203 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.203 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.203 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.203 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.203 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.203 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.203 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.203 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.203 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.203 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker__ns__myobj 2023-12-03T11:34:31.203 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.203 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2023-12-03T11:34:31.204 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.204 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns__myobj", 2023-12-03T11:34:31.204 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.204 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.204 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.204 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.204 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2023-12-03T11:34:31.204 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.204 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.204 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.204 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.204 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.204 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.204 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.204 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.204 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.204 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.205 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.205 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.205 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.205 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.205 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.205 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.205 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.205 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.205 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker__ns__myobj 2023-12-03T11:34:31.205 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.205 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.205 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.205 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst__myobj", 2023-12-03T11:34:31.205 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj" 2023-12-03T11:34:31.206 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.206 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.206 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.206 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.206 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.206 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.206 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.206 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.206 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.206 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.206 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.206 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.206 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.206 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.206 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.206 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.207 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.207 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.207 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.207 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.207 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.207 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.207 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker__:inst__myobj 2023-12-03T11:34:31.207 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.207 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2023-12-03T11:34:31.207 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.207 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst__myobj", 2023-12-03T11:34:31.207 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj" 2023-12-03T11:34:31.207 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.207 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.207 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.207 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2023-12-03T11:34:31.207 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.207 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.208 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.208 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.208 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.208 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.208 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.208 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.208 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.208 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.208 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.208 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.208 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.208 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.208 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.208 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.208 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.208 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.209 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker__:inst__myobj 2023-12-03T11:34:31.209 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.209 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.209 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.209 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst__myobj", 2023-12-03T11:34:31.209 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.209 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.209 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.209 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.209 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.209 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.209 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.209 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.209 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.209 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.209 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.209 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.209 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.210 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.210 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.210 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.210 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.210 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.210 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.210 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.210 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.210 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.210 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.210 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker__ns:inst__myobj 2023-12-03T11:34:31.210 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.210 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2023-12-03T11:34:31.210 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.210 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst__myobj", 2023-12-03T11:34:31.210 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.210 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.211 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.211 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.211 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2023-12-03T11:34:31.211 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.211 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.211 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.211 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.211 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.211 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.211 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.211 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.211 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.211 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.211 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.211 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.211 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2023-12-03T11:34:31.211 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.211 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.212 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.212 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.212 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.212 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker__ns:inst__myobj 2023-12-03T11:34:31.212 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.212 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.212 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.212 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker___myobj_", 2023-12-03T11:34:31.212 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj_" 2023-12-03T11:34:31.212 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.212 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.212 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.212 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.212 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.212 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.212 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.212 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.212 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.213 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.213 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.213 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.213 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.213 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.213 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.213 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.213 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.213 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.213 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.213 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.213 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.213 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.213 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker___myobj_ 2023-12-03T11:34:31.213 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.213 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2023-12-03T11:34:31.214 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.214 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker___myobj_", 2023-12-03T11:34:31.214 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj_" 2023-12-03T11:34:31.214 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.214 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.214 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.214 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2023-12-03T11:34:31.214 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.214 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.214 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.214 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.214 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.214 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.214 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.214 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.214 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.215 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.215 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.215 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.215 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.215 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.215 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.215 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.215 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.215 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.215 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker___myobj_ 2023-12-03T11:34:31.215 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.215 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.215 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.215 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns__myobj_", 2023-12-03T11:34:31.215 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.215 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.215 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.215 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.216 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.216 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.216 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.216 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.216 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.216 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.216 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.216 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.216 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.216 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.216 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.216 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.216 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.216 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.216 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.216 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.216 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.216 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.217 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.217 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker__ns__myobj_ 2023-12-03T11:34:31.217 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.217 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2023-12-03T11:34:31.217 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.217 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns__myobj_", 2023-12-03T11:34:31.217 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.217 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.217 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.217 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.217 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2023-12-03T11:34:31.217 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.217 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.217 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.217 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.217 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.217 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.217 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.218 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.218 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.218 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.218 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.218 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.218 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.218 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2023-12-03T11:34:31.218 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.218 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.218 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.218 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.218 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker__ns__myobj_ 2023-12-03T11:34:31.218 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.218 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.218 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.218 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst__myobj_", 2023-12-03T11:34:31.219 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj_" 2023-12-03T11:34:31.219 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.219 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.219 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.219 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.219 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.219 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.219 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.219 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.219 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.219 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.219 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.219 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.219 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.219 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.220 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.220 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.220 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.220 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.220 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.220 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.220 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.220 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.220 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker__:inst__myobj_ 2023-12-03T11:34:31.220 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.220 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2023-12-03T11:34:31.220 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.220 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst__myobj_", 2023-12-03T11:34:31.220 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj_" 2023-12-03T11:34:31.220 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.220 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.221 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.221 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2023-12-03T11:34:31.221 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.221 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.221 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.221 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.221 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.221 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.221 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.221 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.221 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.221 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.221 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.221 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.221 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.221 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.222 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2023-12-03T11:34:31.222 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.222 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.222 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.222 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker__:inst__myobj_ 2023-12-03T11:34:31.222 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.222 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2023-12-03T11:34:31.222 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.222 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst__myobj_", 2023-12-03T11:34:31.222 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.222 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.222 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.222 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.222 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2023-12-03T11:34:31.222 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.223 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.223 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.223 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.223 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.223 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.223 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.223 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.223 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.223 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.223 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.223 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.223 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.223 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.223 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.223 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.223 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.224 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.224 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2023-12-03T11:34:31.224 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.224 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2023-12-03T11:34:31.224 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2023-12-03T11:34:31.224 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst__myobj_", 2023-12-03T11:34:31.224 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2023-12-03T11:34:31.224 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.224 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.224 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.224 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2023-12-03T11:34:31.224 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2023-12-03T11:34:31.224 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2023-12-03T11:34:31.224 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2023-12-03T11:34:31.224 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2023-12-03T11:34:31.224 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2023-12-03T11:34:31.225 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2023-12-03T11:34:31.225 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2023-12-03T11:34:31.225 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2023-12-03T11:34:31.225 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2023-12-03T11:34:31.225 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.225 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.225 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2023-12-03T11:34:31.225 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2023-12-03T11:34:31.225 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2023-12-03T11:34:31.225 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2023-12-03T11:34:31.225 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.225 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.225 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.225 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2023-12-03T11:34:31.225 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2023-12-03T11:34:31.225 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2023-12-03T11:34:31.225 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:34:31.226 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2023-12-03T11:34:31.226 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 4 tests from 1 test suite ran. (2 ms total) 2023-12-03T11:34:31.226 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 4 tests. 2023-12-03T11:34:31.226 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:34:31.226 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:34:31.262 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2023-12-03T11:34:31.263 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2023-12-03T11:34:31.263 DEBUG:teuthology.orchestra.run.smithi044:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2023-12-03T11:34:31.386 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:31.386 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:31.401 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.400+0000 7ffaa4a33800 20 rados->read ofs=0 len=0 2023-12-03T11:34:31.403 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.402+0000 7ffaa4a33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:31.404 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.402+0000 7ffaa4a33800 20 realm 2023-12-03T11:34:31.404 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.402+0000 7ffaa4a33800 20 rados->read ofs=0 len=0 2023-12-03T11:34:31.404 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.402+0000 7ffaa4a33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:31.404 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.402+0000 7ffaa4a33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:34:31.404 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.402+0000 7ffaa4a33800 20 rados->read ofs=0 len=0 2023-12-03T11:34:31.404 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.402+0000 7ffaa4a33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:31.404 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.402+0000 7ffaa4a33800 20 rados->read ofs=0 len=0 2023-12-03T11:34:31.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.408+0000 7ffaa4a33800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:31.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.408+0000 7ffaa4a33800 20 rados->read ofs=0 len=0 2023-12-03T11:34:31.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.409+0000 7ffaa4a33800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:34:31.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.409+0000 7ffaa4a33800 20 searching for the correct realm 2023-12-03T11:34:31.432 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.431+0000 7ffaa1d32640 0 -- 172.21.15.44:0/3824677672 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x55858a6fdff0 msgr2=0x55858a7003e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:31.435 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.434+0000 7ffaa4a33800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:34:31.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.434+0000 7ffaa4a33800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:34:31.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.434+0000 7ffaa4a33800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:34:31.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.434+0000 7ffaa4a33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:34:31.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.434+0000 7ffaa4a33800 20 rados->read ofs=0 len=0 2023-12-03T11:34:31.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.435+0000 7ffaa4a33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:31.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.435+0000 7ffaa4a33800 20 rados->read ofs=0 len=0 2023-12-03T11:34:31.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.435+0000 7ffaa4a33800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:31.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.435+0000 7ffaa4a33800 20 rados->read ofs=0 len=0 2023-12-03T11:34:31.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.435+0000 7ffaa4a33800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:34:31.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.435+0000 7ffaa4a33800 20 zone default found 2023-12-03T11:34:31.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.435+0000 7ffaa4a33800 4 Realm: () 2023-12-03T11:34:31.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.435+0000 7ffaa4a33800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:34:31.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.435+0000 7ffaa4a33800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:34:31.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.435+0000 7ffaa4a33800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:34:31.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.435+0000 7ffaa4a33800 20 zonegroup default 2023-12-03T11:34:31.438 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.435+0000 7ffaa4a33800 20 rados->read ofs=0 len=0 2023-12-03T11:34:31.438 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.436+0000 7ffaa4a33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:31.438 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.436+0000 7ffaa4a33800 20 rados->read ofs=0 len=0 2023-12-03T11:34:31.438 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.436+0000 7ffaa4a33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:31.438 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.436+0000 7ffaa4a33800 20 rados->read ofs=0 len=0 2023-12-03T11:34:31.438 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.436+0000 7ffaa4a33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:31.438 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.436+0000 7ffaa4a33800 20 started sync module instance, tier type = 2023-12-03T11:34:31.439 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.436+0000 7ffaa4a33800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:34:31.441 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.440+0000 7ffaa2533640 0 -- 172.21.15.44:0/3824677672 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55858a6fa9b0 msgr2=0x55858a6fcda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:31.448 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.447+0000 7ffaa4a33800 20 add_watcher() i=0 2023-12-03T11:34:31.448 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.447+0000 7ffaa4a33800 20 add_watcher() i=1 2023-12-03T11:34:31.448 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.447+0000 7ffaa4a33800 20 add_watcher() i=2 2023-12-03T11:34:31.448 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.447+0000 7ffaa4a33800 20 add_watcher() i=3 2023-12-03T11:34:31.448 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.447+0000 7ffaa4a33800 20 add_watcher() i=4 2023-12-03T11:34:31.448 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.447+0000 7ffaa4a33800 20 add_watcher() i=5 2023-12-03T11:34:31.448 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.447+0000 7ffaa4a33800 20 add_watcher() i=6 2023-12-03T11:34:31.449 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.448+0000 7ffaa4a33800 20 add_watcher() i=7 2023-12-03T11:34:31.449 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.448+0000 7ffaa4a33800 2 all 8 watchers are set, enabling cache 2023-12-03T11:34:31.450 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.450+0000 7ffa67fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:31.451 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.450+0000 7ffaa4a33800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:34:31.451 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.450+0000 7ffaa4a33800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:34:31.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.456+0000 7ffaa4a33800 5 note: GC not initialized 2023-12-03T11:34:31.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.456+0000 7ff9d6ffd640 20 reqs_thread_entry: start 2023-12-03T11:34:31.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.456+0000 7ffaa4a33800 20 init_complete bucket index max shards: 1 2023-12-03T11:34:31.458 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.457+0000 7ffaa4a33800 20 Filter name: none 2023-12-03T11:34:31.458 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.457+0000 7ff9d4ff9640 20 reqs_thread_entry: start 2023-12-03T11:34:31.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.457+0000 7ffaa4a33800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2023-12-03T11:34:31.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.457+0000 7ffaa4a33800 20 rados->read ofs=0 len=0 2023-12-03T11:34:31.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.457+0000 7ffaa4a33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:31.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.457+0000 7ffaa4a33800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2023-12-03T11:34:31.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.457+0000 7ffaa4a33800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2023-12-03T11:34:31.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.457+0000 7ffaa4a33800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2023-12-03T11:34:31.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.457+0000 7ffaa4a33800 20 rados->read ofs=0 len=0 2023-12-03T11:34:31.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.458+0000 7ffaa4a33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:31.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.458+0000 7ffaa4a33800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2023-12-03T11:34:31.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.458+0000 7ffaa4a33800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2023-12-03T11:34:31.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.458+0000 7ffaa4a33800 10 cache get: name=default.rgw.meta+users.keys+Y+wp144sZDrtzz3ryct4amFaY0M= : miss 2023-12-03T11:34:31.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.458+0000 7ffaa4a33800 20 rados->read ofs=0 len=0 2023-12-03T11:34:31.460 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.458+0000 7ffaa4a33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:31.460 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.458+0000 7ffaa4a33800 10 cache put: name=default.rgw.meta+users.keys+Y+wp144sZDrtzz3ryct4amFaY0M= info.flags=0x0 2023-12-03T11:34:31.460 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.458+0000 7ffaa4a33800 10 adding default.rgw.meta+users.keys+Y+wp144sZDrtzz3ryct4amFaY0M= to cache LRU end 2023-12-03T11:34:31.460 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.458+0000 7ffaa4a33800 10 cache get: name=default.rgw.meta+users.keys+Y+wp144sZDrtzz3ryct4amFaY0M= : hit (negative entry) 2023-12-03T11:34:31.460 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.458+0000 7ffaa4a33800 10 cache get: name=default.rgw.meta+users.keys+Y+wp144sZDrtzz3ryct4amFaY0M= : hit (negative entry) 2023-12-03T11:34:31.461 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.459+0000 7ffaa4a33800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2023-12-03T11:34:31.461 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.459+0000 7ffaa4a33800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2023-12-03T11:34:31.461 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.459+0000 7ffaa4a33800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2023-12-03T11:34:31.461 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.459+0000 7ffa90ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987521 cookie 94032041573728 notifier 5357 bl.length()=663 2023-12-03T11:34:31.461 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.459+0000 7ffa90ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2023-12-03T11:34:31.461 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.459+0000 7ffa90ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2023-12-03T11:34:31.462 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.461+0000 7ffaa4a33800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2023-12-03T11:34:31.462 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.461+0000 7ffaa4a33800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2023-12-03T11:34:31.462 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.461+0000 7ffaa4a33800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2023-12-03T11:34:31.463 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.462+0000 7ffa90ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987520 cookie 94032041607856 notifier 5357 bl.length()=194 2023-12-03T11:34:31.463 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.462+0000 7ffa90ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2023-12-03T11:34:31.463 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.462+0000 7ffa90ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2023-12-03T11:34:31.464 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.463+0000 7ffaa4a33800 10 cache put: name=default.rgw.meta+users.keys+Y+wp144sZDrtzz3ryct4amFaY0M= info.flags=0x7 2023-12-03T11:34:31.464 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.463+0000 7ffaa4a33800 10 moving default.rgw.meta+users.keys+Y+wp144sZDrtzz3ryct4amFaY0M= to cache LRU end 2023-12-03T11:34:31.464 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.463+0000 7ffaa4a33800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:Y+wp144sZDrtzz3ryct4amFaY0M=, ofs0, ns] 2023-12-03T11:34:31.465 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.463+0000 7ffa90ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987522 cookie 94032041605200 notifier 5357 bl.length()=203 2023-12-03T11:34:31.465 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.463+0000 7ffa90ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+Y+wp144sZDrtzz3ryct4amFaY0M= info.flags=0x7 2023-12-03T11:34:31.465 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.463+0000 7ffa90ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+Y+wp144sZDrtzz3ryct4amFaY0M= to cache LRU end 2023-12-03T11:34:31.465 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:34:31.465 INFO:tasks.workunit.client.0.smithi044.stdout: "user_id": "ceph-test-librgw-file", 2023-12-03T11:34:31.465 INFO:tasks.workunit.client.0.smithi044.stdout: "display_name": "librgw test user", 2023-12-03T11:34:31.465 INFO:tasks.workunit.client.0.smithi044.stdout: "email": "librgw@example.com", 2023-12-03T11:34:31.465 INFO:tasks.workunit.client.0.smithi044.stdout: "suspended": 0, 2023-12-03T11:34:31.465 INFO:tasks.workunit.client.0.smithi044.stdout: "max_buckets": 1000, 2023-12-03T11:34:31.465 INFO:tasks.workunit.client.0.smithi044.stdout: "subusers": [], 2023-12-03T11:34:31.465 INFO:tasks.workunit.client.0.smithi044.stdout: "keys": [ 2023-12-03T11:34:31.465 INFO:tasks.workunit.client.0.smithi044.stdout: { 2023-12-03T11:34:31.466 INFO:tasks.workunit.client.0.smithi044.stdout: "user": "ceph-test-librgw-file", 2023-12-03T11:34:31.466 INFO:tasks.workunit.client.0.smithi044.stdout: "access_key": "Y+wp144sZDrtzz3ryct4amFaY0M=", 2023-12-03T11:34:31.466 INFO:tasks.workunit.client.0.smithi044.stdout: "secret_key": "WQbMD4p0t4do7du0/UjcVN4RqzVTf+MmDR8wPVhigKTm37ufq06Q9A==" 2023-12-03T11:34:31.466 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:34:31.466 INFO:tasks.workunit.client.0.smithi044.stdout: ], 2023-12-03T11:34:31.466 INFO:tasks.workunit.client.0.smithi044.stdout: "swift_keys": [], 2023-12-03T11:34:31.466 INFO:tasks.workunit.client.0.smithi044.stdout: "caps": [], 2023-12-03T11:34:31.466 INFO:tasks.workunit.client.0.smithi044.stdout: "op_mask": "read, write, delete", 2023-12-03T11:34:31.466 INFO:tasks.workunit.client.0.smithi044.stdout: "default_placement": "", 2023-12-03T11:34:31.466 INFO:tasks.workunit.client.0.smithi044.stdout: "default_storage_class": "", 2023-12-03T11:34:31.466 INFO:tasks.workunit.client.0.smithi044.stdout: "placement_tags": [], 2023-12-03T11:34:31.466 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_quota": { 2023-12-03T11:34:31.466 INFO:tasks.workunit.client.0.smithi044.stdout: "enabled": false, 2023-12-03T11:34:31.466 INFO:tasks.workunit.client.0.smithi044.stdout: "check_on_raw": false, 2023-12-03T11:34:31.466 INFO:tasks.workunit.client.0.smithi044.stdout: "max_size": -1, 2023-12-03T11:34:31.466 INFO:tasks.workunit.client.0.smithi044.stdout: "max_size_kb": 0, 2023-12-03T11:34:31.466 INFO:tasks.workunit.client.0.smithi044.stdout: "max_objects": -1 2023-12-03T11:34:31.467 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.467 INFO:tasks.workunit.client.0.smithi044.stdout: "user_quota": { 2023-12-03T11:34:31.467 INFO:tasks.workunit.client.0.smithi044.stdout: "enabled": false, 2023-12-03T11:34:31.467 INFO:tasks.workunit.client.0.smithi044.stdout: "check_on_raw": false, 2023-12-03T11:34:31.467 INFO:tasks.workunit.client.0.smithi044.stdout: "max_size": -1, 2023-12-03T11:34:31.467 INFO:tasks.workunit.client.0.smithi044.stdout: "max_size_kb": 0, 2023-12-03T11:34:31.467 INFO:tasks.workunit.client.0.smithi044.stdout: "max_objects": -1 2023-12-03T11:34:31.467 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:34:31.467 INFO:tasks.workunit.client.0.smithi044.stdout: "temp_url_keys": [], 2023-12-03T11:34:31.467 INFO:tasks.workunit.client.0.smithi044.stdout: "type": "rgw", 2023-12-03T11:34:31.467 INFO:tasks.workunit.client.0.smithi044.stdout: "mfa_ids": [] 2023-12-03T11:34:31.467 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:34:31.467 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:34:31.468 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.465+0000 7ffa67fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:31.468 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.467+0000 7ffaa4a33800 20 remove_watcher() i=0 2023-12-03T11:34:31.468 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.467+0000 7ffaa4a33800 2 removed watcher, disabling cache 2023-12-03T11:34:31.469 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.468+0000 7ffaa4a33800 20 remove_watcher() i=1 2023-12-03T11:34:31.470 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.469+0000 7ffaa4a33800 20 remove_watcher() i=2 2023-12-03T11:34:31.472 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.471+0000 7ffaa4a33800 20 remove_watcher() i=3 2023-12-03T11:34:31.472 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.472+0000 7ffaa4a33800 20 remove_watcher() i=4 2023-12-03T11:34:31.474 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.473+0000 7ffaa4a33800 20 remove_watcher() i=5 2023-12-03T11:34:31.474 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.474+0000 7ffaa4a33800 20 remove_watcher() i=6 2023-12-03T11:34:31.475 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:31.475+0000 7ffaa4a33800 20 remove_watcher() i=7 2023-12-03T11:34:31.480 INFO:tasks.workunit.client.0.smithi044.stdout:phase 1.1 2023-12-03T11:34:31.501 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 24 tests from 1 test suite. 2023-12-03T11:34:31.501 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2023-12-03T11:34:31.501 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 24 tests from LibRGW 2023-12-03T11:34:31.501 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:34:31.511 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:31.511 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:31.892 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (392 ms) 2023-12-03T11:34:31.892 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2023-12-03T11:34:31.893 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2023-12-03T11:34:31.893 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:34:31.894 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2023-12-03T11:34:31.894 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SETUP_HIER1 2023-12-03T11:34:31.901 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/bar/baz/quux 2023-12-03T11:34:31.906 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/f1 2023-12-03T11:34:31.909 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/f2 2023-12-03T11:34:31.912 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/bar/f1 2023-12-03T11:34:31.915 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/bar/d1/ 2023-12-03T11:34:31.918 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/bar/baz/hungry 2023-12-03T11:34:31.921 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2023-12-03T11:34:31.925 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/bar/baz/momma 2023-12-03T11:34:31.927 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/bar/baz/bear/ 2023-12-03T11:34:31.931 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2023-12-03T11:34:31.934 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2023-12-03T11:34:31.937 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/bar/baz/frobozz 2023-12-03T11:34:31.940 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SETUP_HIER1 (46 ms) 2023-12-03T11:34:31.940 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2023-12-03T11:34:32.033 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SETUP_DIRS1 (93 ms) 2023-12-03T11:34:32.033 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SETATTR 2023-12-03T11:34:32.033 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2023-12-03T11:34:32.033 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2023-12-03T11:34:32.050 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (18 ms) 2023-12-03T11:34:32.050 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2023-12-03T11:34:32.087 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (36 ms) 2023-12-03T11:34:32.087 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2023-12-03T11:34:32.087 INFO:tasks.workunit.client.0.smithi044.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2023-12-03T11:34:32.097 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (10 ms) 2023-12-03T11:34:32.097 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2023-12-03T11:34:32.097 INFO:tasks.workunit.client.0.smithi044.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2023-12-03T11:34:32.105 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (8 ms) 2023-12-03T11:34:32.106 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2023-12-03T11:34:32.106 INFO:tasks.workunit.client.0.smithi044.stdout:scanning objects in /bdirs1/dir_0 2023-12-03T11:34:32.106 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-12-03T11:34:32.106 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-12-03T11:34:32.106 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-12-03T11:34:32.106 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-12-03T11:34:32.106 INFO:tasks.workunit.client.0.smithi044.stdout:scanning objects in /bdirs1/dir_1 2023-12-03T11:34:32.106 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-12-03T11:34:32.106 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-12-03T11:34:32.106 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-12-03T11:34:32.106 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-12-03T11:34:32.106 INFO:tasks.workunit.client.0.smithi044.stdout:scanning objects in /bdirs1/dir_2 2023-12-03T11:34:32.106 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-12-03T11:34:32.106 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-12-03T11:34:32.107 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-12-03T11:34:32.107 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-12-03T11:34:32.107 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2023-12-03T11:34:32.107 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READ_DIRS1 2023-12-03T11:34:32.107 INFO:tasks.workunit.client.0.smithi044.stdout:read back objects in /bdirs1/dir_0 2023-12-03T11:34:32.107 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_0/sfile_0 2023-12-03T11:34:32.107 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_0 : "data for sfile_0" 2023-12-03T11:34:32.107 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_0/sfile_1 2023-12-03T11:34:32.109 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_1 : "data for sfile_1" 2023-12-03T11:34:32.109 INFO:tasks.workunit.client.0.smithi044.stdout:read back objects in /bdirs1/dir_1 2023-12-03T11:34:32.109 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_1/sfile_0 2023-12-03T11:34:32.110 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_0 : "data for sfile_0" 2023-12-03T11:34:32.110 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_1/sfile_1 2023-12-03T11:34:32.112 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_1 : "data for sfile_1" 2023-12-03T11:34:32.112 INFO:tasks.workunit.client.0.smithi044.stdout:read back objects in /bdirs1/dir_2 2023-12-03T11:34:32.112 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_2/sfile_0 2023-12-03T11:34:32.113 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_0 : "data for sfile_0" 2023-12-03T11:34:32.113 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_2/sfile_1 2023-12-03T11:34:32.115 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_1 : "data for sfile_1" 2023-12-03T11:34:32.115 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READ_DIRS1 (10 ms) 2023-12-03T11:34:32.115 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READF_SETUP1 2023-12-03T11:34:32.296 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READF_SETUP1 (181 ms) 2023-12-03T11:34:32.296 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READF_DIRS1 2023-12-03T11:34:32.297 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2023-12-03T11:34:32.297 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2023-12-03T11:34:32.297 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2023-12-03T11:34:32.297 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2023-12-03T11:34:32.297 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_0 type: DIR refs: 2 2023-12-03T11:34:32.297 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_0 type: FILE refs: 2 2023-12-03T11:34:32.297 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_1 type: DIR refs: 2 2023-12-03T11:34:32.297 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_1 type: FILE refs: 2 2023-12-03T11:34:32.297 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_0 type: DIR refs: 2 2023-12-03T11:34:32.297 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_0 type: FILE refs: 2 2023-12-03T11:34:32.297 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_1 type: DIR refs: 2 2023-12-03T11:34:32.297 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_1 type: FILE refs: 2 2023-12-03T11:34:32.297 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_0 type: DIR refs: 2 2023-12-03T11:34:32.297 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_0 type: FILE refs: 2 2023-12-03T11:34:32.297 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_1 type: DIR refs: 2 2023-12-03T11:34:32.297 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_1 type: FILE refs: 2 2023-12-03T11:34:32.298 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2023-12-03T11:34:32.298 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.HIER1 2023-12-03T11:34:32.302 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/f2 (f2): FILE 2023-12-03T11:34:32.302 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/f1 (f1): FILE 2023-12-03T11:34:32.304 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2023-12-03T11:34:32.305 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2023-12-03T11:34:32.308 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2023-12-03T11:34:32.309 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2023-12-03T11:34:32.309 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2023-12-03T11:34:32.310 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2023-12-03T11:34:32.310 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2023-12-03T11:34:32.311 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2023-12-03T11:34:32.311 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2023-12-03T11:34:32.313 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2023-12-03T11:34:32.313 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz (baz): DIR 2023-12-03T11:34:32.313 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar (bar): DIR 2023-12-03T11:34:32.313 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo (foo): DIR 2023-12-03T11:34:32.313 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot (nfsroot): DIR 2023-12-03T11:34:32.313 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.HIER1 (16 ms) 2023-12-03T11:34:32.313 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2023-12-03T11:34:32.313 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (1 ms) 2023-12-03T11:34:32.313 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2023-12-03T11:34:32.314 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2023-12-03T11:34:32.314 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2023-12-03T11:34:32.314 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2023-12-03T11:34:32.314 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2023-12-03T11:34:32.314 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2023-12-03T11:34:32.314 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:34:32.314 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:34:32.314 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:34:32.314 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:34:32.314 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:34:32.314 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:32.312+0000 7f3ea883b8c0 -1 shutting down 2023-12-03T11:34:32.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:32.313+0000 7f3e7faac640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97313, si_uid : 1000, si_addr0x3e800017c21, si_status0 2023-12-03T11:34:32.342 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (29 ms) 2023-12-03T11:34:32.342 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 24 tests from LibRGW (842 ms total) 2023-12-03T11:34:32.342 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:34:32.342 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2023-12-03T11:34:32.342 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 24 tests from 1 test suite ran. (842 ms total) 2023-12-03T11:34:32.343 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 24 tests. 2023-12-03T11:34:32.348 INFO:tasks.workunit.client.0.smithi044.stdout:phase 1.2 2023-12-03T11:34:32.368 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 24 tests from 1 test suite. 2023-12-03T11:34:32.368 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2023-12-03T11:34:32.368 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 24 tests from LibRGW 2023-12-03T11:34:32.368 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:34:32.376 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:32.376 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:32.534 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (166 ms) 2023-12-03T11:34:32.535 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2023-12-03T11:34:32.536 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2023-12-03T11:34:32.536 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:34:32.536 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2023-12-03T11:34:32.536 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SETUP_HIER1 2023-12-03T11:34:32.536 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2023-12-03T11:34:32.536 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2023-12-03T11:34:32.536 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2023-12-03T11:34:32.537 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SETATTR 2023-12-03T11:34:32.537 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2023-12-03T11:34:32.537 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2023-12-03T11:34:32.537 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2023-12-03T11:34:32.537 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2023-12-03T11:34:32.537 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2023-12-03T11:34:32.537 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2023-12-03T11:34:32.537 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2023-12-03T11:34:32.537 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2023-12-03T11:34:32.537 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2023-12-03T11:34:32.537 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2023-12-03T11:34:32.537 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2023-12-03T11:34:32.537 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READ_DIRS1 2023-12-03T11:34:32.537 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2023-12-03T11:34:32.537 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READF_SETUP1 2023-12-03T11:34:32.538 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2023-12-03T11:34:32.538 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READF_DIRS1 2023-12-03T11:34:32.538 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2023-12-03T11:34:32.538 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2023-12-03T11:34:32.538 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2023-12-03T11:34:32.538 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2023-12-03T11:34:32.538 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2023-12-03T11:34:32.538 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.HIER1 2023-12-03T11:34:32.538 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2023-12-03T11:34:32.538 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2023-12-03T11:34:32.538 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2023-12-03T11:34:32.538 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2023-12-03T11:34:32.538 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2023-12-03T11:34:32.538 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2023-12-03T11:34:32.538 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2023-12-03T11:34:32.539 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2023-12-03T11:34:32.539 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2023-12-03T11:34:32.539 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:34:32.539 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:34:32.539 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:34:32.539 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:34:32.539 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:34:32.539 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:32.534+0000 7fe6761228c0 -1 shutting down 2023-12-03T11:34:32.539 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:32.536+0000 7fe64f152640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97423, si_uid : 1000, si_addr0x3e800017c8f, si_status0 2023-12-03T11:34:32.600 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (64 ms) 2023-12-03T11:34:32.600 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 24 tests from LibRGW (231 ms total) 2023-12-03T11:34:32.600 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:34:32.600 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2023-12-03T11:34:32.600 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 24 tests from 1 test suite ran. (231 ms total) 2023-12-03T11:34:32.600 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 24 tests. 2023-12-03T11:34:32.605 INFO:tasks.workunit.client.0.smithi044.stdout:phase 1.3 2023-12-03T11:34:32.625 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 24 tests from 1 test suite. 2023-12-03T11:34:32.625 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2023-12-03T11:34:32.625 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 24 tests from LibRGW 2023-12-03T11:34:32.625 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:34:32.634 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:32.635 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:33.202 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (577 ms) 2023-12-03T11:34:33.202 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2023-12-03T11:34:33.203 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2023-12-03T11:34:33.203 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:34:33.203 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-12-03T11:34:33.203 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SETUP_HIER1 2023-12-03T11:34:33.208 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SETUP_HIER1 (5 ms) 2023-12-03T11:34:33.208 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2023-12-03T11:34:33.270 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SETUP_DIRS1 (62 ms) 2023-12-03T11:34:33.270 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SETATTR 2023-12-03T11:34:33.270 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2023-12-03T11:34:33.271 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2023-12-03T11:34:33.271 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2023-12-03T11:34:33.271 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2023-12-03T11:34:33.271 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2023-12-03T11:34:33.271 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2023-12-03T11:34:33.271 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2023-12-03T11:34:33.271 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2023-12-03T11:34:33.271 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2023-12-03T11:34:33.271 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2023-12-03T11:34:33.271 INFO:tasks.workunit.client.0.smithi044.stdout:scanning objects in /bdirs1/dir_0 2023-12-03T11:34:33.271 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-12-03T11:34:33.271 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-12-03T11:34:33.271 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-12-03T11:34:33.271 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-12-03T11:34:33.271 INFO:tasks.workunit.client.0.smithi044.stdout:scanning objects in /bdirs1/dir_1 2023-12-03T11:34:33.271 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-12-03T11:34:33.271 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-12-03T11:34:33.272 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-12-03T11:34:33.272 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-12-03T11:34:33.272 INFO:tasks.workunit.client.0.smithi044.stdout:scanning objects in /bdirs1/dir_2 2023-12-03T11:34:33.272 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-12-03T11:34:33.272 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-12-03T11:34:33.272 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-12-03T11:34:33.272 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-12-03T11:34:33.272 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2023-12-03T11:34:33.272 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READ_DIRS1 2023-12-03T11:34:33.272 INFO:tasks.workunit.client.0.smithi044.stdout:read back objects in /bdirs1/dir_0 2023-12-03T11:34:33.272 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_0/sfile_0 2023-12-03T11:34:33.272 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_0 : "data for sfile_0" 2023-12-03T11:34:33.273 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_0/sfile_1 2023-12-03T11:34:33.274 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_1 : "data for sfile_1" 2023-12-03T11:34:33.274 INFO:tasks.workunit.client.0.smithi044.stdout:read back objects in /bdirs1/dir_1 2023-12-03T11:34:33.274 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_1/sfile_0 2023-12-03T11:34:33.276 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_0 : "data for sfile_0" 2023-12-03T11:34:33.276 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_1/sfile_1 2023-12-03T11:34:33.277 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_1 : "data for sfile_1" 2023-12-03T11:34:33.277 INFO:tasks.workunit.client.0.smithi044.stdout:read back objects in /bdirs1/dir_2 2023-12-03T11:34:33.277 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_2/sfile_0 2023-12-03T11:34:33.278 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_0 : "data for sfile_0" 2023-12-03T11:34:33.278 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_2/sfile_1 2023-12-03T11:34:33.280 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_1 : "data for sfile_1" 2023-12-03T11:34:33.280 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READ_DIRS1 (9 ms) 2023-12-03T11:34:33.280 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READF_SETUP1 2023-12-03T11:34:33.280 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2023-12-03T11:34:33.280 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READF_DIRS1 2023-12-03T11:34:33.280 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2023-12-03T11:34:33.280 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2023-12-03T11:34:33.280 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2023-12-03T11:34:33.280 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2023-12-03T11:34:33.280 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_0 type: DIR refs: 2 2023-12-03T11:34:33.280 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_0 type: FILE refs: 2 2023-12-03T11:34:33.281 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_1 type: DIR refs: 2 2023-12-03T11:34:33.281 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_1 type: FILE refs: 2 2023-12-03T11:34:33.281 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_0 type: DIR refs: 2 2023-12-03T11:34:33.281 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_0 type: FILE refs: 2 2023-12-03T11:34:33.281 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_1 type: DIR refs: 2 2023-12-03T11:34:33.281 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_1 type: FILE refs: 2 2023-12-03T11:34:33.281 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_0 type: DIR refs: 2 2023-12-03T11:34:33.281 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_0 type: FILE refs: 2 2023-12-03T11:34:33.281 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_1 type: DIR refs: 2 2023-12-03T11:34:33.281 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_1 type: FILE refs: 2 2023-12-03T11:34:33.281 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2023-12-03T11:34:33.281 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.HIER1 2023-12-03T11:34:33.285 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/f2 (f2): FILE 2023-12-03T11:34:33.285 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/f1 (f1): FILE 2023-12-03T11:34:33.287 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2023-12-03T11:34:33.288 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2023-12-03T11:34:33.291 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2023-12-03T11:34:33.291 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2023-12-03T11:34:33.291 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2023-12-03T11:34:33.292 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2023-12-03T11:34:33.292 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2023-12-03T11:34:33.293 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2023-12-03T11:34:33.293 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2023-12-03T11:34:33.295 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2023-12-03T11:34:33.295 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz (baz): DIR 2023-12-03T11:34:33.295 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar (bar): DIR 2023-12-03T11:34:33.295 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo (foo): DIR 2023-12-03T11:34:33.295 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot (nfsroot): DIR 2023-12-03T11:34:33.295 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.HIER1 (16 ms) 2023-12-03T11:34:33.295 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2023-12-03T11:34:33.296 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2023-12-03T11:34:33.296 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2023-12-03T11:34:33.296 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2023-12-03T11:34:33.296 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2023-12-03T11:34:33.296 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2023-12-03T11:34:33.296 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2023-12-03T11:34:33.296 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2023-12-03T11:34:33.296 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:34:33.296 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:34:33.296 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:34:33.296 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:34:33.296 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:34:33.297 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:33.294+0000 7fb2f11268c0 -1 shutting down 2023-12-03T11:34:33.297 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:33.295+0000 7fb2ca251640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97533, si_uid : 1000, si_addr0x3e800017cfd, si_status0 2023-12-03T11:34:33.367 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (72 ms) 2023-12-03T11:34:33.367 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 24 tests from LibRGW (743 ms total) 2023-12-03T11:34:33.367 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:34:33.367 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2023-12-03T11:34:33.367 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 24 tests from 1 test suite ran. (743 ms total) 2023-12-03T11:34:33.367 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 24 tests. 2023-12-03T11:34:33.372 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2.1 2023-12-03T11:34:33.393 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 9 tests from 1 test suite. 2023-12-03T11:34:33.393 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2023-12-03T11:34:33.393 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 9 tests from LibRGW 2023-12-03T11:34:33.394 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:34:33.402 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:33.402 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:33.711 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (318 ms) 2023-12-03T11:34:33.711 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:34:33.712 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-12-03T11:34:33.712 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-12-03T11:34:33.720 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2023-12-03T11:34:33.720 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-12-03T11:34:33.720 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2023-12-03T11:34:33.720 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2023-12-03T11:34:33.727 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave0 2023-12-03T11:34:33.733 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave1 2023-12-03T11:34:33.740 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave2 2023-12-03T11:34:33.746 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave3 2023-12-03T11:34:33.753 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave4 2023-12-03T11:34:33.760 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave5 2023-12-03T11:34:33.769 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave6 2023-12-03T11:34:33.773 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave7 2023-12-03T11:34:33.780 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave8 2023-12-03T11:34:33.787 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave9 2023-12-03T11:34:33.787 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (67 ms) 2023-12-03T11:34:33.787 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2023-12-03T11:34:33.931 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (144 ms) 2023-12-03T11:34:33.931 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:34:33.931 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:34:33.931 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:34:33.932 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:34:33.932 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:34:33.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:33.930+0000 7f828c8c58c0 -1 shutting down 2023-12-03T11:34:33.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:33.931+0000 7f82651ee640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97643, si_uid : 1000, si_addr0x3e800017d6b, si_status0 2023-12-03T11:34:34.029 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (97 ms) 2023-12-03T11:34:34.029 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 9 tests from LibRGW (635 ms total) 2023-12-03T11:34:34.029 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:34:34.029 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2023-12-03T11:34:34.029 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 9 tests from 1 test suite ran. (635 ms total) 2023-12-03T11:34:34.029 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 9 tests. 2023-12-03T11:34:34.034 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2.2 2023-12-03T11:34:34.056 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 9 tests from 1 test suite. 2023-12-03T11:34:34.056 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2023-12-03T11:34:34.056 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 9 tests from LibRGW 2023-12-03T11:34:34.056 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:34:34.065 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:34.065 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:34.216 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (159 ms) 2023-12-03T11:34:34.216 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:34:34.216 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-12-03T11:34:34.217 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-12-03T11:34:34.217 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2023-12-03T11:34:34.217 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-12-03T11:34:34.234 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_BUCKET (18 ms) 2023-12-03T11:34:34.234 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2023-12-03T11:34:34.241 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave0 2023-12-03T11:34:34.247 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave1 2023-12-03T11:34:34.254 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave2 2023-12-03T11:34:34.261 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave3 2023-12-03T11:34:34.267 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave4 2023-12-03T11:34:34.274 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave5 2023-12-03T11:34:34.281 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave6 2023-12-03T11:34:34.288 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave7 2023-12-03T11:34:34.294 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave8 2023-12-03T11:34:34.301 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave9 2023-12-03T11:34:34.301 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (67 ms) 2023-12-03T11:34:34.301 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2023-12-03T11:34:34.445 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (144 ms) 2023-12-03T11:34:34.446 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:34:34.446 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:34:34.446 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:34:34.446 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:34:34.446 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:34:34.446 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:34.444+0000 7f95811298c0 -1 shutting down 2023-12-03T11:34:34.447 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:34.445+0000 7f955a1d5640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97753, si_uid : 1000, si_addr0x3e800017dd9, si_status0 2023-12-03T11:34:34.480 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (35 ms) 2023-12-03T11:34:34.481 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 9 tests from LibRGW (424 ms total) 2023-12-03T11:34:34.481 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:34:34.481 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2023-12-03T11:34:34.481 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 9 tests from 1 test suite ran. (424 ms total) 2023-12-03T11:34:34.481 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 9 tests. 2023-12-03T11:34:34.486 INFO:tasks.workunit.client.0.smithi044.stdout:phase 3.1 2023-12-03T11:34:34.810 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 13 tests from 1 test suite. 2023-12-03T11:34:34.810 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2023-12-03T11:34:34.810 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 13 tests from LibRGW 2023-12-03T11:34:34.810 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:34:34.819 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:34.819 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:34.979 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (170 ms) 2023-12-03T11:34:34.979 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:34:34.980 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-12-03T11:34:34.980 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-12-03T11:34:34.987 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CREATE_BUCKET (7 ms) 2023-12-03T11:34:34.987 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2023-12-03T11:34:34.990 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2023-12-03T11:34:34.990 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2023-12-03T11:34:34.992 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2023-12-03T11:34:34.992 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LARGE1 2023-12-03T11:34:35.052 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LARGE1 (60 ms) 2023-12-03T11:34:35.052 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LARGE2 2023-12-03T11:34:35.090 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LARGE2 (38 ms) 2023-12-03T11:34:35.091 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.STAT_OBJECT 2023-12-03T11:34:35.091 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2023-12-03T11:34:35.091 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2023-12-03T11:34:35.091 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2023-12-03T11:34:35.091 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-12-03T11:34:35.091 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2023-12-03T11:34:35.091 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:34:35.091 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:34:35.091 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:34:35.091 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:34:35.091 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:34:35.092 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:35.089+0000 7f7fae3238c0 -1 shutting down 2023-12-03T11:34:35.092 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:35.091+0000 7f7f8743c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97863, si_uid : 1000, si_addr0x3e800017e47, si_status0 2023-12-03T11:34:35.144 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (53 ms) 2023-12-03T11:34:35.144 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 13 tests from LibRGW (334 ms total) 2023-12-03T11:34:35.144 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:34:35.144 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2023-12-03T11:34:35.144 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 13 tests from 1 test suite ran. (334 ms total) 2023-12-03T11:34:35.144 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 13 tests. 2023-12-03T11:34:35.150 INFO:tasks.workunit.client.0.smithi044.stdout:phase 3.2 2023-12-03T11:34:35.471 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 13 tests from 1 test suite. 2023-12-03T11:34:35.472 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2023-12-03T11:34:35.472 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 13 tests from LibRGW 2023-12-03T11:34:35.472 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:34:35.479 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:35.479 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:35.843 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (371 ms) 2023-12-03T11:34:35.843 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:34:35.843 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-12-03T11:34:35.844 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-12-03T11:34:35.844 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2023-12-03T11:34:35.844 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2023-12-03T11:34:35.848 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2023-12-03T11:34:35.848 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2023-12-03T11:34:35.852 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2023-12-03T11:34:35.852 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LARGE1 2023-12-03T11:34:35.926 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LARGE1 (73 ms) 2023-12-03T11:34:35.926 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LARGE2 2023-12-03T11:34:35.926 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2023-12-03T11:34:35.926 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.STAT_OBJECT 2023-12-03T11:34:35.926 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2023-12-03T11:34:35.926 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2023-12-03T11:34:35.930 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2023-12-03T11:34:35.930 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-12-03T11:34:35.945 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_BUCKET (15 ms) 2023-12-03T11:34:35.945 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:34:35.945 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:34:35.945 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:34:35.945 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:34:35.945 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:34:35.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:35.944+0000 7f542fc688c0 -1 shutting down 2023-12-03T11:34:35.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:35.945+0000 7f540ab47640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97973, si_uid : 1000, si_addr0x3e800017eb5, si_status0 2023-12-03T11:34:36.008 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (62 ms) 2023-12-03T11:34:36.008 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 13 tests from LibRGW (536 ms total) 2023-12-03T11:34:36.008 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:34:36.008 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2023-12-03T11:34:36.008 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 13 tests from 1 test suite ran. (536 ms total) 2023-12-03T11:34:36.008 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 13 tests. 2023-12-03T11:34:36.014 INFO:tasks.workunit.client.0.smithi044.stdout:phase 4.1 2023-12-03T11:34:36.033 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 11 tests from 1 test suite. 2023-12-03T11:34:36.034 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2023-12-03T11:34:36.034 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 11 tests from LibRGW 2023-12-03T11:34:36.034 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.TVAR 2023-12-03T11:34:36.034 INFO:tasks.workunit.client.0.smithi044.stdout:read i1: 64001 2023-12-03T11:34:36.034 INFO:tasks.workunit.client.0.smithi044.stdout:read s1: blunderbuss 2023-12-03T11:34:36.034 INFO:tasks.workunit.client.0.smithi044.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2023-12-03T11:34:36.034 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:34:36.044 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:36.044 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:36.211 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (178 ms) 2023-12-03T11:34:36.211 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:34:36.211 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2023-12-03T11:34:36.211 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2023-12-03T11:34:36.227 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (16 ms) 2023-12-03T11:34:36.227 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2023-12-03T11:34:36.661 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_0 2023-12-03T11:34:36.661 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_1 2023-12-03T11:34:36.661 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_2 2023-12-03T11:34:36.661 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_3 2023-12-03T11:34:36.661 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_4 2023-12-03T11:34:36.661 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_5 2023-12-03T11:34:36.661 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_6 2023-12-03T11:34:36.661 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_7 2023-12-03T11:34:36.661 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_8 2023-12-03T11:34:36.661 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_9 2023-12-03T11:34:36.661 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_10 2023-12-03T11:34:36.661 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_11 2023-12-03T11:34:36.661 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_12 2023-12-03T11:34:36.661 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_13 2023-12-03T11:34:36.661 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_14 2023-12-03T11:34:36.661 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_15 2023-12-03T11:34:36.662 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_16 2023-12-03T11:34:36.662 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_17 2023-12-03T11:34:36.662 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_18 2023-12-03T11:34:36.662 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_19 2023-12-03T11:34:36.662 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_20 2023-12-03T11:34:36.662 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_21 2023-12-03T11:34:36.662 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_22 2023-12-03T11:34:36.662 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_23 2023-12-03T11:34:36.662 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_24 2023-12-03T11:34:36.662 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_25 2023-12-03T11:34:36.662 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_26 2023-12-03T11:34:36.662 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_27 2023-12-03T11:34:36.662 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_28 2023-12-03T11:34:36.662 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_29 2023-12-03T11:34:36.662 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_30 2023-12-03T11:34:36.662 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_31 2023-12-03T11:34:36.662 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_32 2023-12-03T11:34:36.663 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_33 2023-12-03T11:34:36.663 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_34 2023-12-03T11:34:36.663 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_35 2023-12-03T11:34:36.663 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_36 2023-12-03T11:34:36.663 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_37 2023-12-03T11:34:36.663 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_38 2023-12-03T11:34:36.663 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_39 2023-12-03T11:34:36.663 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_40 2023-12-03T11:34:36.663 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_41 2023-12-03T11:34:36.663 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_42 2023-12-03T11:34:36.663 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_43 2023-12-03T11:34:36.663 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_44 2023-12-03T11:34:36.663 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_45 2023-12-03T11:34:36.663 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_46 2023-12-03T11:34:36.663 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_47 2023-12-03T11:34:36.663 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_48 2023-12-03T11:34:36.663 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_49 2023-12-03T11:34:36.664 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_50 2023-12-03T11:34:36.664 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_51 2023-12-03T11:34:36.664 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_52 2023-12-03T11:34:36.664 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_53 2023-12-03T11:34:36.664 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_54 2023-12-03T11:34:36.664 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_55 2023-12-03T11:34:36.664 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_56 2023-12-03T11:34:36.664 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_57 2023-12-03T11:34:36.664 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_58 2023-12-03T11:34:36.664 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_59 2023-12-03T11:34:36.664 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_60 2023-12-03T11:34:36.664 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_61 2023-12-03T11:34:36.664 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_62 2023-12-03T11:34:36.664 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_63 2023-12-03T11:34:36.664 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_64 2023-12-03T11:34:36.664 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_65 2023-12-03T11:34:36.665 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_66 2023-12-03T11:34:36.665 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_67 2023-12-03T11:34:36.665 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_68 2023-12-03T11:34:36.665 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_69 2023-12-03T11:34:36.665 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_70 2023-12-03T11:34:36.665 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_71 2023-12-03T11:34:36.665 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_72 2023-12-03T11:34:36.665 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_73 2023-12-03T11:34:36.665 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_74 2023-12-03T11:34:36.665 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_75 2023-12-03T11:34:36.665 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_76 2023-12-03T11:34:36.665 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_77 2023-12-03T11:34:36.665 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_78 2023-12-03T11:34:36.665 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_79 2023-12-03T11:34:36.665 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_80 2023-12-03T11:34:36.665 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_81 2023-12-03T11:34:36.665 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_82 2023-12-03T11:34:36.666 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_83 2023-12-03T11:34:36.666 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_84 2023-12-03T11:34:36.666 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_85 2023-12-03T11:34:36.666 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_86 2023-12-03T11:34:36.666 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_87 2023-12-03T11:34:36.666 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_88 2023-12-03T11:34:36.666 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_89 2023-12-03T11:34:36.666 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_90 2023-12-03T11:34:36.666 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_91 2023-12-03T11:34:36.666 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_92 2023-12-03T11:34:36.666 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_93 2023-12-03T11:34:36.666 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_94 2023-12-03T11:34:36.666 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_95 2023-12-03T11:34:36.666 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_96 2023-12-03T11:34:36.666 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_97 2023-12-03T11:34:36.667 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_98 2023-12-03T11:34:36.667 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_99 2023-12-03T11:34:36.667 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (433 ms) 2023-12-03T11:34:36.667 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2023-12-03T11:34:36.668 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2023-12-03T11:34:36.668 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2023-12-03T11:34:36.668 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2023-12-03T11:34:36.668 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2023-12-03T11:34:36.668 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2023-12-03T11:34:36.669 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2023-12-03T11:34:36.669 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2023-12-03T11:34:36.669 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2023-12-03T11:34:36.669 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2023-12-03T11:34:36.669 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2023-12-03T11:34:36.669 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2023-12-03T11:34:36.669 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2023-12-03T11:34:36.669 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2023-12-03T11:34:36.669 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2023-12-03T11:34:36.669 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2023-12-03T11:34:36.669 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2023-12-03T11:34:36.669 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2023-12-03T11:34:36.669 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2023-12-03T11:34:36.669 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2023-12-03T11:34:36.670 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2023-12-03T11:34:36.670 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2023-12-03T11:34:36.670 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2023-12-03T11:34:36.670 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2023-12-03T11:34:36.670 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2023-12-03T11:34:36.670 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2023-12-03T11:34:36.670 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2023-12-03T11:34:36.670 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2023-12-03T11:34:36.670 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2023-12-03T11:34:36.670 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2023-12-03T11:34:36.670 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2023-12-03T11:34:36.670 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2023-12-03T11:34:36.670 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2023-12-03T11:34:36.671 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2023-12-03T11:34:36.671 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2023-12-03T11:34:36.671 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2023-12-03T11:34:36.671 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2023-12-03T11:34:36.671 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2023-12-03T11:34:36.671 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2023-12-03T11:34:36.671 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2023-12-03T11:34:36.671 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2023-12-03T11:34:36.671 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2023-12-03T11:34:36.671 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2023-12-03T11:34:36.671 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2023-12-03T11:34:36.671 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2023-12-03T11:34:36.671 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2023-12-03T11:34:36.671 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2023-12-03T11:34:36.672 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2023-12-03T11:34:36.672 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2023-12-03T11:34:36.672 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2023-12-03T11:34:36.672 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2023-12-03T11:34:36.672 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2023-12-03T11:34:36.672 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2023-12-03T11:34:36.672 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2023-12-03T11:34:36.672 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2023-12-03T11:34:36.672 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2023-12-03T11:34:36.672 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2023-12-03T11:34:36.672 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2023-12-03T11:34:36.672 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2023-12-03T11:34:36.672 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2023-12-03T11:34:36.672 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2023-12-03T11:34:36.672 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2023-12-03T11:34:36.672 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2023-12-03T11:34:36.673 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2023-12-03T11:34:36.673 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2023-12-03T11:34:36.673 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2023-12-03T11:34:36.673 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2023-12-03T11:34:36.673 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2023-12-03T11:34:36.673 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2023-12-03T11:34:36.673 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2023-12-03T11:34:36.673 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2023-12-03T11:34:36.673 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2023-12-03T11:34:36.673 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2023-12-03T11:34:36.673 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2023-12-03T11:34:36.673 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2023-12-03T11:34:36.673 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2023-12-03T11:34:36.673 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2023-12-03T11:34:36.673 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2023-12-03T11:34:36.673 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2023-12-03T11:34:36.673 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2023-12-03T11:34:36.674 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2023-12-03T11:34:36.674 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2023-12-03T11:34:36.674 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2023-12-03T11:34:36.674 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2023-12-03T11:34:36.674 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2023-12-03T11:34:36.674 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2023-12-03T11:34:36.674 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2023-12-03T11:34:36.674 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2023-12-03T11:34:36.674 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2023-12-03T11:34:36.674 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2023-12-03T11:34:36.674 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2023-12-03T11:34:36.674 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2023-12-03T11:34:36.674 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2023-12-03T11:34:36.674 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2023-12-03T11:34:36.674 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2023-12-03T11:34:36.674 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2023-12-03T11:34:36.674 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2023-12-03T11:34:36.675 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2023-12-03T11:34:36.675 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2023-12-03T11:34:36.675 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2023-12-03T11:34:36.675 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2023-12-03T11:34:36.675 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2023-12-03T11:34:36.675 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2023-12-03T11:34:36.675 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_READDIR (4 ms) 2023-12-03T11:34:36.675 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2023-12-03T11:34:36.675 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2023-12-03T11:34:36.675 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2023-12-03T11:34:36.675 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2023-12-03T11:34:36.675 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2023-12-03T11:34:36.675 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2023-12-03T11:34:36.675 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2023-12-03T11:34:36.675 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2023-12-03T11:34:36.675 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2023-12-03T11:34:36.676 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2023-12-03T11:34:36.676 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2023-12-03T11:34:36.676 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2023-12-03T11:34:36.676 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2023-12-03T11:34:36.676 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2023-12-03T11:34:36.676 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2023-12-03T11:34:36.676 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2023-12-03T11:34:36.676 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2023-12-03T11:34:36.676 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2023-12-03T11:34:36.676 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2023-12-03T11:34:36.676 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2023-12-03T11:34:36.676 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2023-12-03T11:34:36.676 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2023-12-03T11:34:36.676 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2023-12-03T11:34:36.676 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2023-12-03T11:34:36.676 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2023-12-03T11:34:36.676 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2023-12-03T11:34:36.676 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2023-12-03T11:34:36.676 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2023-12-03T11:34:36.677 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2023-12-03T11:34:36.677 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2023-12-03T11:34:36.677 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2023-12-03T11:34:36.677 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2023-12-03T11:34:36.677 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2023-12-03T11:34:36.677 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2023-12-03T11:34:36.677 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2023-12-03T11:34:36.677 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2023-12-03T11:34:36.677 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2023-12-03T11:34:36.677 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2023-12-03T11:34:36.677 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2023-12-03T11:34:36.677 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2023-12-03T11:34:36.677 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2023-12-03T11:34:36.677 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2023-12-03T11:34:36.677 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2023-12-03T11:34:36.677 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2023-12-03T11:34:36.678 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2023-12-03T11:34:36.678 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2023-12-03T11:34:36.678 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2023-12-03T11:34:36.678 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2023-12-03T11:34:36.678 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2023-12-03T11:34:36.678 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2023-12-03T11:34:36.678 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2023-12-03T11:34:36.678 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2023-12-03T11:34:36.678 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2023-12-03T11:34:36.678 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2023-12-03T11:34:36.678 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2023-12-03T11:34:36.678 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2023-12-03T11:34:36.678 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2023-12-03T11:34:36.678 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2023-12-03T11:34:36.678 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2023-12-03T11:34:36.678 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2023-12-03T11:34:36.679 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2023-12-03T11:34:36.679 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2023-12-03T11:34:36.679 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2023-12-03T11:34:36.679 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2023-12-03T11:34:36.679 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2023-12-03T11:34:36.679 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2023-12-03T11:34:36.679 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2023-12-03T11:34:36.679 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2023-12-03T11:34:36.679 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2023-12-03T11:34:36.679 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2023-12-03T11:34:36.679 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2023-12-03T11:34:36.679 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2023-12-03T11:34:36.679 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2023-12-03T11:34:36.679 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2023-12-03T11:34:36.679 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2023-12-03T11:34:36.679 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2023-12-03T11:34:36.679 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2023-12-03T11:34:36.679 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2023-12-03T11:34:36.679 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2023-12-03T11:34:36.680 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2023-12-03T11:34:36.680 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2023-12-03T11:34:36.680 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2023-12-03T11:34:36.680 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2023-12-03T11:34:36.680 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2023-12-03T11:34:36.680 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2023-12-03T11:34:36.680 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2023-12-03T11:34:36.680 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2023-12-03T11:34:36.680 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2023-12-03T11:34:36.680 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2023-12-03T11:34:36.680 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2023-12-03T11:34:36.680 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2023-12-03T11:34:36.680 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2023-12-03T11:34:36.680 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2023-12-03T11:34:36.680 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2023-12-03T11:34:36.680 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2023-12-03T11:34:36.680 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2023-12-03T11:34:36.680 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2023-12-03T11:34:36.681 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2023-12-03T11:34:36.681 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2023-12-03T11:34:36.681 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2023-12-03T11:34:36.681 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2023-12-03T11:34:36.681 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2023-12-03T11:34:36.681 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2023-12-03T11:34:36.681 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (1 ms) 2023-12-03T11:34:36.681 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:34:36.681 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:34:36.681 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:34:36.681 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:34:36.681 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:34:36.681 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:36.666+0000 7fa351ac28c0 -1 shutting down 2023-12-03T11:34:36.681 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:36.667+0000 7fa32a6f2640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 98083, si_uid : 1000, si_addr0x3e800017f23, si_status0 2023-12-03T11:34:36.776 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (109 ms) 2023-12-03T11:34:36.777 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 11 tests from LibRGW (743 ms total) 2023-12-03T11:34:36.777 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:34:36.777 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2023-12-03T11:34:36.777 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 11 tests from 1 test suite ran. (743 ms total) 2023-12-03T11:34:36.777 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 11 tests. 2023-12-03T11:34:36.782 INFO:tasks.workunit.client.0.smithi044.stdout:phase 4.2 2023-12-03T11:34:36.802 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 11 tests from 1 test suite. 2023-12-03T11:34:36.802 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2023-12-03T11:34:36.802 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 11 tests from LibRGW 2023-12-03T11:34:36.802 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.TVAR 2023-12-03T11:34:36.802 INFO:tasks.workunit.client.0.smithi044.stdout:read i1: 64001 2023-12-03T11:34:36.803 INFO:tasks.workunit.client.0.smithi044.stdout:read s1: blunderbuss 2023-12-03T11:34:36.803 INFO:tasks.workunit.client.0.smithi044.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2023-12-03T11:34:36.803 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:34:36.810 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:36.810 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:36.973 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (170 ms) 2023-12-03T11:34:36.973 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:34:36.973 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2023-12-03T11:34:36.974 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2023-12-03T11:34:36.982 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (9 ms) 2023-12-03T11:34:36.982 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2023-12-03T11:34:36.982 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2023-12-03T11:34:36.982 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2023-12-03T11:34:36.982 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2023-12-03T11:34:36.982 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2023-12-03T11:34:36.985 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2023-12-03T11:34:36.985 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2023-12-03T11:34:36.986 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2023-12-03T11:34:36.986 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2023-12-03T11:34:36.986 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2023-12-03T11:34:36.986 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2023-12-03T11:34:36.986 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2023-12-03T11:34:36.986 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2023-12-03T11:34:36.986 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2023-12-03T11:34:36.986 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2023-12-03T11:34:36.986 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2023-12-03T11:34:36.986 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2023-12-03T11:34:36.986 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2023-12-03T11:34:36.986 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2023-12-03T11:34:36.986 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2023-12-03T11:34:36.986 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2023-12-03T11:34:36.986 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2023-12-03T11:34:36.987 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2023-12-03T11:34:36.987 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2023-12-03T11:34:36.987 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2023-12-03T11:34:36.987 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2023-12-03T11:34:36.987 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2023-12-03T11:34:36.987 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2023-12-03T11:34:36.987 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2023-12-03T11:34:36.987 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2023-12-03T11:34:36.987 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2023-12-03T11:34:36.987 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2023-12-03T11:34:36.987 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2023-12-03T11:34:36.987 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2023-12-03T11:34:36.987 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2023-12-03T11:34:36.987 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2023-12-03T11:34:36.987 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2023-12-03T11:34:36.987 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2023-12-03T11:34:36.987 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2023-12-03T11:34:36.988 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2023-12-03T11:34:36.988 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2023-12-03T11:34:36.988 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2023-12-03T11:34:36.988 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2023-12-03T11:34:36.988 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2023-12-03T11:34:36.988 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2023-12-03T11:34:36.988 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2023-12-03T11:34:36.988 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2023-12-03T11:34:36.988 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2023-12-03T11:34:36.988 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2023-12-03T11:34:36.988 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2023-12-03T11:34:36.988 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2023-12-03T11:34:36.988 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2023-12-03T11:34:36.988 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2023-12-03T11:34:36.988 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2023-12-03T11:34:36.989 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2023-12-03T11:34:36.989 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2023-12-03T11:34:36.989 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2023-12-03T11:34:36.989 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2023-12-03T11:34:36.989 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2023-12-03T11:34:36.989 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2023-12-03T11:34:36.989 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2023-12-03T11:34:36.989 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2023-12-03T11:34:36.989 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2023-12-03T11:34:36.989 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2023-12-03T11:34:36.989 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2023-12-03T11:34:36.989 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2023-12-03T11:34:36.989 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2023-12-03T11:34:36.989 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2023-12-03T11:34:36.990 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2023-12-03T11:34:36.990 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2023-12-03T11:34:36.990 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2023-12-03T11:34:36.990 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2023-12-03T11:34:36.990 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2023-12-03T11:34:36.990 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2023-12-03T11:34:36.990 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2023-12-03T11:34:36.990 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2023-12-03T11:34:36.990 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2023-12-03T11:34:36.990 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2023-12-03T11:34:36.990 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2023-12-03T11:34:36.990 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2023-12-03T11:34:36.990 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2023-12-03T11:34:36.990 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2023-12-03T11:34:36.991 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2023-12-03T11:34:36.991 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2023-12-03T11:34:36.991 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2023-12-03T11:34:36.991 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2023-12-03T11:34:36.991 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2023-12-03T11:34:36.991 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2023-12-03T11:34:36.991 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2023-12-03T11:34:36.991 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2023-12-03T11:34:36.991 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2023-12-03T11:34:36.991 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2023-12-03T11:34:36.991 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2023-12-03T11:34:36.991 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2023-12-03T11:34:36.991 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2023-12-03T11:34:36.991 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2023-12-03T11:34:36.991 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2023-12-03T11:34:36.991 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2023-12-03T11:34:36.991 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2023-12-03T11:34:36.992 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2023-12-03T11:34:36.992 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2023-12-03T11:34:36.992 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2023-12-03T11:34:36.992 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2023-12-03T11:34:36.992 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2023-12-03T11:34:36.992 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2023-12-03T11:34:36.992 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2023-12-03T11:34:36.992 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2023-12-03T11:34:36.992 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2023-12-03T11:34:36.992 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:34:36.992 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:34:36.992 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:34:36.992 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:34:36.992 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:34:36.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:36.984+0000 7f6b64f118c0 -1 shutting down 2023-12-03T11:34:36.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:36.985+0000 7f6b3fdf2640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 98193, si_uid : 1000, si_addr0x3e800017f91, si_status0 2023-12-03T11:34:37.038 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (53 ms) 2023-12-03T11:34:37.038 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 11 tests from LibRGW (236 ms total) 2023-12-03T11:34:37.038 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:34:37.038 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2023-12-03T11:34:37.038 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 11 tests from 1 test suite ran. (236 ms total) 2023-12-03T11:34:37.038 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 11 tests. 2023-12-03T11:34:37.043 INFO:tasks.workunit.client.0.smithi044.stdout:phase 5.1 2023-12-03T11:34:37.073 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 19 tests from 1 test suite. 2023-12-03T11:34:37.073 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2023-12-03T11:34:37.073 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 19 tests from LibRGW 2023-12-03T11:34:37.074 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:34:37.083 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:37.083 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:37.234 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (160 ms) 2023-12-03T11:34:37.234 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:34:37.234 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-12-03T11:34:37.234 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-12-03T11:34:37.242 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2023-12-03T11:34:37.242 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2023-12-03T11:34:37.245 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2023-12-03T11:34:37.245 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2023-12-03T11:34:37.245 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2023-12-03T11:34:37.245 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2023-12-03T11:34:37.246 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (1 ms) 2023-12-03T11:34:37.246 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.OBJ_OPEN 2023-12-03T11:34:37.246 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2023-12-03T11:34:37.246 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.PUT_OBJECT 2023-12-03T11:34:37.250 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.PUT_OBJECT (4 ms) 2023-12-03T11:34:37.250 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.GET_OBJECT 2023-12-03T11:34:37.254 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2023-12-03T11:34:37.254 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.STAT_OBJECT 2023-12-03T11:34:37.254 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2023-12-03T11:34:37.254 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2023-12-03T11:34:37.254 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2023-12-03T11:34:37.254 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.WRITEV 2023-12-03T11:34:37.254 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2023-12-03T11:34:37.254 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READV 2023-12-03T11:34:37.255 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READV (0 ms) 2023-12-03T11:34:37.255 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2023-12-03T11:34:37.255 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2023-12-03T11:34:37.255 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2023-12-03T11:34:37.255 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2023-12-03T11:34:37.255 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-12-03T11:34:37.255 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2023-12-03T11:34:37.255 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:34:37.255 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:34:37.255 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:34:37.255 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:34:37.255 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:34:37.256 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:37.251+0000 7f384041c8c0 -1 shutting down 2023-12-03T11:34:37.256 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:37.252+0000 7f3817cb5640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 98303, si_uid : 1000, si_addr0x3e800017fff, si_status0 2023-12-03T11:34:37.296 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (44 ms) 2023-12-03T11:34:37.297 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 19 tests from LibRGW (223 ms total) 2023-12-03T11:34:37.297 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:34:37.297 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2023-12-03T11:34:37.297 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 19 tests from 1 test suite ran. (223 ms total) 2023-12-03T11:34:37.297 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 19 tests. 2023-12-03T11:34:37.302 INFO:tasks.workunit.client.0.smithi044.stdout:phase 5.2 2023-12-03T11:34:37.331 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 19 tests from 1 test suite. 2023-12-03T11:34:37.332 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2023-12-03T11:34:37.332 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 19 tests from LibRGW 2023-12-03T11:34:37.332 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:34:37.339 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:37.339 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:37.491 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (159 ms) 2023-12-03T11:34:37.491 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:34:37.491 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-12-03T11:34:37.492 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-12-03T11:34:37.492 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2023-12-03T11:34:37.492 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2023-12-03T11:34:37.497 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2023-12-03T11:34:37.497 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2023-12-03T11:34:37.497 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2023-12-03T11:34:37.497 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2023-12-03T11:34:37.497 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2023-12-03T11:34:37.497 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.OBJ_OPEN 2023-12-03T11:34:37.497 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2023-12-03T11:34:37.497 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.PUT_OBJECT 2023-12-03T11:34:37.497 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2023-12-03T11:34:37.497 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.GET_OBJECT 2023-12-03T11:34:37.497 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2023-12-03T11:34:37.498 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.STAT_OBJECT 2023-12-03T11:34:37.498 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2023-12-03T11:34:37.498 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2023-12-03T11:34:37.498 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2023-12-03T11:34:37.498 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.WRITEV 2023-12-03T11:34:37.498 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2023-12-03T11:34:37.498 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READV 2023-12-03T11:34:37.498 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READV (0 ms) 2023-12-03T11:34:37.498 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2023-12-03T11:34:37.498 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2023-12-03T11:34:37.498 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2023-12-03T11:34:37.500 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_OBJECT (3 ms) 2023-12-03T11:34:37.500 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-12-03T11:34:37.516 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_BUCKET (15 ms) 2023-12-03T11:34:37.516 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:34:37.516 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:34:37.516 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:34:37.516 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:34:37.516 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:34:37.516 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:37.515+0000 7fabc6a1e8c0 -1 shutting down 2023-12-03T11:34:37.516 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:34:37.516+0000 7fab9e2c5640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 98413, si_uid : 1000, si_addr0x3e80001806d, si_status0 2023-12-03T11:34:37.554 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (39 ms) 2023-12-03T11:34:37.554 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 19 tests from LibRGW (223 ms total) 2023-12-03T11:34:37.554 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:34:37.554 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2023-12-03T11:34:37.554 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 19 tests from 1 test suite ran. (223 ms total) 2023-12-03T11:34:37.554 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 19 tests. 2023-12-03T11:34:37.560 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:34:37.560 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:34:37.591 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh'] on client.0... 2023-12-03T11:34:37.591 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-03T11:34:37.915 DEBUG:teuthology.parallel:result is None 2023-12-03T11:34:37.915 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:34:37.945 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:34:37.946 DEBUG:teuthology.orchestra.run.smithi044:> rmdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:34:38.001 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:34:38.001 INFO:teuthology.run_tasks:Running task workunit... 2023-12-03T11:34:38.010 INFO:tasks.workunit:Pulling workunits from ref bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:34:38.011 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-03T11:34:38.011 DEBUG:teuthology.orchestra.run.smithi044:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:34:38.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:34:38.057 INFO:teuthology.orchestra.run.smithi044.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-12-03T11:34:38.057 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:34:38.111 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-12-03T11:34:38.112 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-12-03T11:34:38.167 INFO:tasks.workunit:timeout=3h 2023-12-03T11:34:38.167 INFO:tasks.workunit:cleanup=True 2023-12-03T11:34:38.167 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:34:38.222 INFO:tasks.workunit.client.0.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-03T11:35:44.918 INFO:tasks.workunit.client.0.smithi044.stderr:Updating files: 94% (11468/12123) Updating files: 95% (11517/12123) Updating files: 96% (11639/12123) Updating files: 97% (11760/12123) Updating files: 98% (11881/12123) Updating files: 99% (12002/12123) Updating files: 100% (12123/12123) Updating files: 100% (12123/12123), done. 2023-12-03T11:35:45.591 INFO:tasks.workunit.client.0.smithi044.stderr:Note: switching to 'bcbf278cf395873c2a482f5a7b2345faf2160319'. 2023-12-03T11:35:45.591 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:35:45.591 INFO:tasks.workunit.client.0.smithi044.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-03T11:35:45.592 INFO:tasks.workunit.client.0.smithi044.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-03T11:35:45.592 INFO:tasks.workunit.client.0.smithi044.stderr:state without impacting any branches by switching back to a branch. 2023-12-03T11:35:45.592 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:35:45.592 INFO:tasks.workunit.client.0.smithi044.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-03T11:35:45.592 INFO:tasks.workunit.client.0.smithi044.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-03T11:35:45.592 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:35:45.592 INFO:tasks.workunit.client.0.smithi044.stderr: git switch -c 2023-12-03T11:35:45.592 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:35:45.592 INFO:tasks.workunit.client.0.smithi044.stderr:Or undo this operation with: 2023-12-03T11:35:45.592 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:35:45.592 INFO:tasks.workunit.client.0.smithi044.stderr: git switch - 2023-12-03T11:35:45.592 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:35:45.592 INFO:tasks.workunit.client.0.smithi044.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-03T11:35:45.592 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:35:45.592 INFO:tasks.workunit.client.0.smithi044.stderr:HEAD is now at bcbf278cf39 RGW:pubsub publish commit with etag populated 2023-12-03T11:35:45.594 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-03T11:35:45.650 INFO:tasks.workunit.client.0.smithi044.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-03T11:35:45.652 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:35:45.653 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-03T11:35:45.703 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-03T11:35:45.755 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-03T11:35:45.795 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:35:45.796 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:35:45.797 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-03T11:35:45.838 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:35:45.841 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:35:45.841 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-03T11:35:45.897 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2023-12-03T11:35:45.898 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2023-12-03T11:35:45.898 DEBUG:teuthology.orchestra.run.smithi044:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2023-12-03T11:35:45.958 INFO:tasks.workunit.client.0.smithi044.stdout:INFO: fully qualified domain name: smithi044.front.sepia.ceph.com 2023-12-03T11:35:45.958 INFO:tasks.workunit.client.0.smithi044.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2023-12-03T11:35:45.958 INFO:tasks.workunit.client.0.smithi044.stdout:== TESTING VERSIONED BUCKET == 2023-12-03T11:35:48.575 INFO:tasks.workunit.client.0.smithi044.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2023-12-03T11:35:48.787 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting pip 2023-12-03T11:35:48.794 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached pip-23.3.1-py3-none-any.whl (2.1 MB) 2023-12-03T11:35:48.842 INFO:tasks.workunit.client.0.smithi044.stdout:Installing collected packages: pip 2023-12-03T11:35:48.842 INFO:tasks.workunit.client.0.smithi044.stdout: Attempting uninstall: pip 2023-12-03T11:35:48.842 INFO:tasks.workunit.client.0.smithi044.stdout: Found existing installation: pip 21.2.3 2023-12-03T11:35:49.002 INFO:tasks.workunit.client.0.smithi044.stdout: Uninstalling pip-21.2.3: 2023-12-03T11:35:49.008 INFO:tasks.workunit.client.0.smithi044.stdout: Successfully uninstalled pip-21.2.3 2023-12-03T11:35:50.030 INFO:tasks.workunit.client.0.smithi044.stdout:Successfully installed pip-23.3.1 2023-12-03T11:35:50.900 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting boto3 2023-12-03T11:35:50.902 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached boto3-1.33.6-py3-none-any.whl.metadata (6.7 kB) 2023-12-03T11:35:51.427 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting botocore<1.34.0,>=1.33.6 (from boto3) 2023-12-03T11:35:51.428 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached botocore-1.33.6-py3-none-any.whl.metadata (6.1 kB) 2023-12-03T11:35:51.495 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2023-12-03T11:35:51.497 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2023-12-03T11:35:51.558 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting s3transfer<0.9.0,>=0.8.2 (from boto3) 2023-12-03T11:35:51.559 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached s3transfer-0.8.2-py3-none-any.whl.metadata (1.8 kB) 2023-12-03T11:35:51.626 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:35:51.627 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) 2023-12-03T11:35:51.709 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:35:51.710 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2023-12-03T11:35:51.873 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:35:51.875 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2023-12-03T11:35:51.899 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached boto3-1.33.6-py3-none-any.whl (139 kB) 2023-12-03T11:35:51.900 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached botocore-1.33.6-py3-none-any.whl (11.8 MB) 2023-12-03T11:35:51.921 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached s3transfer-0.8.2-py3-none-any.whl (82 kB) 2023-12-03T11:35:51.923 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2023-12-03T11:35:52.027 INFO:tasks.workunit.client.0.smithi044.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2023-12-03T11:35:53.124 INFO:tasks.workunit.client.0.smithi044.stdout:Successfully installed boto3-1.33.6 botocore-1.33.6 jmespath-1.0.1 python-dateutil-2.8.2 s3transfer-0.8.2 six-1.16.0 urllib3-1.26.18 2023-12-03T11:35:53.348 INFO:tasks.workunit.client.0.smithi044.stdout:INFO: creating user 2023-12-03T11:35:53.440 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2023-12-03T11:35:53.441 INFO:tasks.workunit.client.0.smithi044.stdout: "user_id": "testid", 2023-12-03T11:35:53.441 INFO:tasks.workunit.client.0.smithi044.stdout: "display_name": "M. Tester", 2023-12-03T11:35:53.441 INFO:tasks.workunit.client.0.smithi044.stdout: "email": "tester@ceph.com", 2023-12-03T11:35:53.441 INFO:tasks.workunit.client.0.smithi044.stdout: "suspended": 0, 2023-12-03T11:35:53.441 INFO:tasks.workunit.client.0.smithi044.stdout: "max_buckets": 1000, 2023-12-03T11:35:53.441 INFO:tasks.workunit.client.0.smithi044.stdout: "subusers": [], 2023-12-03T11:35:53.441 INFO:tasks.workunit.client.0.smithi044.stdout: "keys": [ 2023-12-03T11:35:53.441 INFO:tasks.workunit.client.0.smithi044.stdout: { 2023-12-03T11:35:53.441 INFO:tasks.workunit.client.0.smithi044.stdout: "user": "testid", 2023-12-03T11:35:53.441 INFO:tasks.workunit.client.0.smithi044.stdout: "access_key": "0555b35654ad1656d804", 2023-12-03T11:35:53.441 INFO:tasks.workunit.client.0.smithi044.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==" 2023-12-03T11:35:53.442 INFO:tasks.workunit.client.0.smithi044.stdout: } 2023-12-03T11:35:53.442 INFO:tasks.workunit.client.0.smithi044.stdout: ], 2023-12-03T11:35:53.442 INFO:tasks.workunit.client.0.smithi044.stdout: "swift_keys": [], 2023-12-03T11:35:53.442 INFO:tasks.workunit.client.0.smithi044.stdout: "caps": [], 2023-12-03T11:35:53.442 INFO:tasks.workunit.client.0.smithi044.stdout: "op_mask": "read, write, delete", 2023-12-03T11:35:53.442 INFO:tasks.workunit.client.0.smithi044.stdout: "default_placement": "", 2023-12-03T11:35:53.442 INFO:tasks.workunit.client.0.smithi044.stdout: "default_storage_class": "", 2023-12-03T11:35:53.442 INFO:tasks.workunit.client.0.smithi044.stdout: "placement_tags": [], 2023-12-03T11:35:53.442 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_quota": { 2023-12-03T11:35:53.442 INFO:tasks.workunit.client.0.smithi044.stdout: "enabled": false, 2023-12-03T11:35:53.442 INFO:tasks.workunit.client.0.smithi044.stdout: "check_on_raw": false, 2023-12-03T11:35:53.442 INFO:tasks.workunit.client.0.smithi044.stdout: "max_size": -1, 2023-12-03T11:35:53.442 INFO:tasks.workunit.client.0.smithi044.stdout: "max_size_kb": 0, 2023-12-03T11:35:53.442 INFO:tasks.workunit.client.0.smithi044.stdout: "max_objects": -1 2023-12-03T11:35:53.442 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:35:53.443 INFO:tasks.workunit.client.0.smithi044.stdout: "user_quota": { 2023-12-03T11:35:53.443 INFO:tasks.workunit.client.0.smithi044.stdout: "enabled": false, 2023-12-03T11:35:53.443 INFO:tasks.workunit.client.0.smithi044.stdout: "check_on_raw": false, 2023-12-03T11:35:53.443 INFO:tasks.workunit.client.0.smithi044.stdout: "max_size": -1, 2023-12-03T11:35:53.443 INFO:tasks.workunit.client.0.smithi044.stdout: "max_size_kb": 0, 2023-12-03T11:35:53.443 INFO:tasks.workunit.client.0.smithi044.stdout: "max_objects": -1 2023-12-03T11:35:53.443 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2023-12-03T11:35:53.443 INFO:tasks.workunit.client.0.smithi044.stdout: "temp_url_keys": [], 2023-12-03T11:35:53.443 INFO:tasks.workunit.client.0.smithi044.stdout: "type": "rgw", 2023-12-03T11:35:53.443 INFO:tasks.workunit.client.0.smithi044.stdout: "mfa_ids": [] 2023-12-03T11:35:53.443 INFO:tasks.workunit.client.0.smithi044.stdout:} 2023-12-03T11:35:53.443 INFO:tasks.workunit.client.0.smithi044.stdout: 2023-12-03T11:35:53.698 INFO:tasks.workunit.client.0.smithi044.stderr:5+0 records in 2023-12-03T11:35:53.698 INFO:tasks.workunit.client.0.smithi044.stderr:5+0 records out 2023-12-03T11:35:53.698 INFO:tasks.workunit.client.0.smithi044.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0144114 s, 364 MB/s 2023-12-03T11:35:56.170 INFO:tasks.workunit.client.0.smithi044.stdout:bucket nams is reupload-bkt-113207 2023-12-03T11:35:56.170 INFO:tasks.workunit.client.0.smithi044.stdout:endpoint is http://smithi044.front.sepia.ceph.com:80 2023-12-03T11:35:56.170 INFO:tasks.workunit.client.0.smithi044.stdout:start UploadId=2~L1GmpC6eTE89S_U_fP4qxTbhR_oyNW8 2023-12-03T11:35:56.170 INFO:tasks.workunit.client.0.smithi044.stdout:phase 1 uploaded part {'ETag': '"7995cbe873f7a62c84e190dce5a9caa1"', 'PartNumber': 1} 2023-12-03T11:35:56.170 INFO:tasks.workunit.client.0.smithi044.stdout:phase 1 uploaded part {'ETag': '"7995cbe873f7a62c84e190dce5a9caa1"', 'PartNumber': 2} 2023-12-03T11:35:56.170 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2 uploaded part {'ETag': '"7995cbe873f7a62c84e190dce5a9caa1"', 'PartNumber': 1} 2023-12-03T11:35:56.170 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2 uploaded part {'ETag': '"7995cbe873f7a62c84e190dce5a9caa1"', 'PartNumber': 1} 2023-12-03T11:35:56.170 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2 uploaded part {'ETag': '"7995cbe873f7a62c84e190dce5a9caa1"', 'PartNumber': 1} 2023-12-03T11:35:56.171 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2 uploaded part {'ETag': '"7995cbe873f7a62c84e190dce5a9caa1"', 'PartNumber': 1} 2023-12-03T11:35:56.171 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2 uploaded part {'ETag': '"7995cbe873f7a62c84e190dce5a9caa1"', 'PartNumber': 1} 2023-12-03T11:35:56.171 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2 uploaded part {'ETag': '"7995cbe873f7a62c84e190dce5a9caa1"', 'PartNumber': 1} 2023-12-03T11:35:56.171 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2 uploaded part {'ETag': '"7995cbe873f7a62c84e190dce5a9caa1"', 'PartNumber': 1} 2023-12-03T11:35:56.171 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2 uploaded part {'ETag': '"7995cbe873f7a62c84e190dce5a9caa1"', 'PartNumber': 1} 2023-12-03T11:35:56.171 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2 uploaded part {'ETag': '"7995cbe873f7a62c84e190dce5a9caa1"', 'PartNumber': 1} 2023-12-03T11:35:56.171 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2 uploaded part {'ETag': '"7995cbe873f7a62c84e190dce5a9caa1"', 'PartNumber': 1} 2023-12-03T11:35:56.171 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2 uploaded part {'ETag': '"7995cbe873f7a62c84e190dce5a9caa1"', 'PartNumber': 1} 2023-12-03T11:35:56.171 INFO:tasks.workunit.client.0.smithi044.stdout:completing multipart upload, parts=[{'ETag': '"7995cbe873f7a62c84e190dce5a9caa1"', 'PartNumber': 1}, {'ETag': '"7995cbe873f7a62c84e190dce5a9caa1"', 'PartNumber': 2}] 2023-12-03T11:35:56.858 INFO:tasks.workunit.client.0.smithi044.stdout:radosgw-admin bucket radoslist: 2023-12-03T11:35:57.038 INFO:tasks.workunit.client.0.smithi044.stdout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.2__:6eZHv7JveG1Y6axppOuvJrLh3W8Nkjr_mpu_test4 2023-12-03T11:35:57.038 INFO:tasks.workunit.client.0.smithi044.stdout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.2_mpu_test4 2023-12-03T11:35:57.038 INFO:tasks.workunit.client.0.smithi044.stdout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.2__multipart_mpu_test4.2~L1GmpC6eTE89S_U_fP4qxTbhR_oyNW8.2 2023-12-03T11:35:57.038 INFO:tasks.workunit.client.0.smithi044.stdout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.2__multipart_mpu_test4.vn5r-Bcsd-f-8MM0FRFXxE6Yal1mFExV.1 2023-12-03T11:35:57.038 INFO:tasks.workunit.client.0.smithi044.stdout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.2__shadow_mpu_test4.2~L1GmpC6eTE89S_U_fP4qxTbhR_oyNW8.2_1 2023-12-03T11:35:57.038 INFO:tasks.workunit.client.0.smithi044.stdout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.2__shadow_mpu_test4.vn5r-Bcsd-f-8MM0FRFXxE6Yal1mFExV.1_1 2023-12-03T11:35:57.038 INFO:tasks.workunit.client.0.smithi044.stdout:rados ls: 2023-12-03T11:35:57.038 INFO:tasks.workunit.client.0.smithi044.stdout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.2__:6eZHv7JveG1Y6axppOuvJrLh3W8Nkjr_mpu_test4 2023-12-03T11:35:57.038 INFO:tasks.workunit.client.0.smithi044.stdout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.2_mpu_test4 2023-12-03T11:35:57.038 INFO:tasks.workunit.client.0.smithi044.stdout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.2__multipart_mpu_test4.2~L1GmpC6eTE89S_U_fP4qxTbhR_oyNW8.2 2023-12-03T11:35:57.038 INFO:tasks.workunit.client.0.smithi044.stdout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.2__multipart_mpu_test4.vn5r-Bcsd-f-8MM0FRFXxE6Yal1mFExV.1 2023-12-03T11:35:57.038 INFO:tasks.workunit.client.0.smithi044.stdout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.2__shadow_mpu_test4.2~L1GmpC6eTE89S_U_fP4qxTbhR_oyNW8.2_1 2023-12-03T11:35:57.038 INFO:tasks.workunit.client.0.smithi044.stdout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.2__shadow_mpu_test4.vn5r-Bcsd-f-8MM0FRFXxE6Yal1mFExV.1_1 2023-12-03T11:35:57.039 INFO:tasks.workunit.client.0.smithi044.stdout:== PASSED == 2023-12-03T11:35:57.039 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:35:57.039 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:35:57.111 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2023-12-03T11:35:57.111 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-03T11:35:57.469 DEBUG:teuthology.parallel:result is None 2023-12-03T11:35:57.469 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:35:57.500 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:35:57.500 DEBUG:teuthology.orchestra.run.smithi044:> rmdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:35:57.555 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:35:57.555 INFO:teuthology.run_tasks:Running task ragweed... 2023-12-03T11:35:57.570 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2023-12-03T11:35:57.571 INFO:tasks.ragweed:Downloading ragweed... 2023-12-03T11:35:57.571 INFO:tasks.ragweed:Using branch 'wip-alimasa-multi-pubsub-etag' for ragweed 2023-12-03T11:35:57.571 DEBUG:teuthology.orchestra.run.smithi044:> git clone -b wip-alimasa-multi-pubsub-etag https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2023-12-03T11:35:57.611 INFO:teuthology.orchestra.run.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2023-12-03T11:35:57.657 INFO:teuthology.orchestra.run.smithi044.stderr:fatal: Remote branch wip-alimasa-multi-pubsub-etag not found in upstream origin 2023-12-03T11:35:57.658 DEBUG:teuthology.orchestra.run:got remote process result: 128 2023-12-03T11:35:57.659 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2023-12-03T11:35:57.659 DEBUG:teuthology.orchestra.run.smithi044:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2023-12-03T11:35:57.714 INFO:teuthology.orchestra.run.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2023-12-03T11:35:57.890 INFO:tasks.ragweed:Creating rgw users... 2023-12-03T11:35:57.890 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2023-12-03T11:35:57.890 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key DOBOWVTIWFGJVYIMXPSY --secret 0HWMrkSgqezw9LTAVg3qnrnKsZL5RKXf3YAxcu4puKkqJnaTgJtxIw== --email ragweed.client.0+test@test.test --system false 2023-12-03T11:35:57.982 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:57.982 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:57.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:57.992+0000 7f77a8920800 20 rados->read ofs=0 len=0 2023-12-03T11:35:57.995 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:57.994+0000 7f77a8920800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:57.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:57.994+0000 7f77a8920800 20 realm 2023-12-03T11:35:57.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:57.994+0000 7f77a8920800 20 rados->read ofs=0 len=0 2023-12-03T11:35:57.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:57.994+0000 7f77a8920800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:57.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:57.994+0000 7f77a8920800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:57.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:57.994+0000 7f77a8920800 20 rados->read ofs=0 len=0 2023-12-03T11:35:57.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:57.995+0000 7f77a8920800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:57.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:57.995+0000 7f77a8920800 20 rados->read ofs=0 len=0 2023-12-03T11:35:57.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:57.996+0000 7f77a8920800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:57.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:57.996+0000 7f77a8920800 20 rados->read ofs=0 len=0 2023-12-03T11:35:57.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:57.996+0000 7f77a8920800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:57.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:57.996+0000 7f77a8920800 20 searching for the correct realm 2023-12-03T11:35:58.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.008+0000 7f77a4da7640 0 -- 172.21.15.44:0/1747892759 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f779805cc20 msgr2=0x7f779805b020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:58.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.008+0000 7f77a8920800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:35:58.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.008+0000 7f77a8920800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:35:58.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.008+0000 7f77a8920800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:58.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.008+0000 7f77a8920800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:58.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.008+0000 7f77a8920800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.009+0000 7f77a8920800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:58.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.009+0000 7f77a8920800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.009+0000 7f77a8920800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:58.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.009+0000 7f77a8920800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.009+0000 7f77a8920800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:58.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.009+0000 7f77a8920800 20 zone default found 2023-12-03T11:35:58.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.009+0000 7f77a8920800 4 Realm: () 2023-12-03T11:35:58.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.009+0000 7f77a8920800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:35:58.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.009+0000 7f77a8920800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:35:58.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.009+0000 7f77a8920800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:58.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.009+0000 7f77a8920800 20 zonegroup default 2023-12-03T11:35:58.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.009+0000 7f77a8920800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.009+0000 7f77a8920800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:58.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.010+0000 7f77a8920800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.010+0000 7f77a8920800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:58.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.010+0000 7f77a8920800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.010+0000 7f77a8920800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:58.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.010+0000 7f77a8920800 20 started sync module instance, tier type = 2023-12-03T11:35:58.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.010+0000 7f77a8920800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:35:58.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.020+0000 7f77a45a6640 0 -- 172.21.15.44:0/1747892759 >> [v2:172.21.15.44:6800/4244511941,v1:172.21.15.44:6801/4244511941] conn(0x7f7798063280 msgr2=0x7f7798060090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:58.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.020+0000 7f77a8920800 20 add_watcher() i=0 2023-12-03T11:35:58.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.020+0000 7f77a8920800 20 add_watcher() i=1 2023-12-03T11:35:58.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.020+0000 7f77a8920800 20 add_watcher() i=2 2023-12-03T11:35:58.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.020+0000 7f77a8920800 20 add_watcher() i=3 2023-12-03T11:35:58.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.020+0000 7f77a8920800 20 add_watcher() i=4 2023-12-03T11:35:58.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.020+0000 7f77a8920800 20 add_watcher() i=5 2023-12-03T11:35:58.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.020+0000 7f77a8920800 20 add_watcher() i=6 2023-12-03T11:35:58.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.021+0000 7f77a8920800 20 add_watcher() i=7 2023-12-03T11:35:58.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.021+0000 7f77a8920800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:58.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.023+0000 7f776a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:58.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.023+0000 7f77a8920800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:58.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.023+0000 7f77a8920800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:58.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.028+0000 7f77a8920800 5 note: GC not initialized 2023-12-03T11:35:58.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.028+0000 7f76d97fa640 20 reqs_thread_entry: start 2023-12-03T11:35:58.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.028+0000 7f77a8920800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:58.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.028+0000 7f77a8920800 20 Filter name: none 2023-12-03T11:35:58.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.028+0000 7f76d2ffd640 20 reqs_thread_entry: start 2023-12-03T11:35:58.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.029+0000 7f77a8920800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2023-12-03T11:35:58.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.029+0000 7f77a8920800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.029+0000 7f77a8920800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:58.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.029+0000 7f77a8920800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2023-12-03T11:35:58.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.029+0000 7f77a8920800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2023-12-03T11:35:58.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.029+0000 7f77a8920800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2023-12-03T11:35:58.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.029+0000 7f77a8920800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.030+0000 7f77a8920800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:58.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.030+0000 7f77a8920800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2023-12-03T11:35:58.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.030+0000 7f77a8920800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2023-12-03T11:35:58.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.030+0000 7f77a8920800 10 cache get: name=default.rgw.meta+users.keys+DOBOWVTIWFGJVYIMXPSY : miss 2023-12-03T11:35:58.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.030+0000 7f77a8920800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.030+0000 7f77a8920800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:58.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.030+0000 7f77a8920800 10 cache put: name=default.rgw.meta+users.keys+DOBOWVTIWFGJVYIMXPSY info.flags=0x0 2023-12-03T11:35:58.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.030+0000 7f77a8920800 10 adding default.rgw.meta+users.keys+DOBOWVTIWFGJVYIMXPSY to cache LRU end 2023-12-03T11:35:58.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.030+0000 7f77a8920800 10 cache get: name=default.rgw.meta+users.keys+DOBOWVTIWFGJVYIMXPSY : hit (negative entry) 2023-12-03T11:35:58.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.030+0000 7f77a8920800 10 cache get: name=default.rgw.meta+users.keys+DOBOWVTIWFGJVYIMXPSY : hit (negative entry) 2023-12-03T11:35:58.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.031+0000 7f77a8920800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2023-12-03T11:35:58.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.031+0000 7f77a8920800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2023-12-03T11:35:58.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.031+0000 7f77a8920800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2023-12-03T11:35:58.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.032+0000 7f778affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889428 cookie 94462454927680 notifier 5705 bl.length()=641 2023-12-03T11:35:58.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.032+0000 7f778affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2023-12-03T11:35:58.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.032+0000 7f778affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2023-12-03T11:35:58.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.033+0000 7f77a8920800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2023-12-03T11:35:58.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.033+0000 7f77a8920800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2023-12-03T11:35:58.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.033+0000 7f77a8920800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2023-12-03T11:35:58.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.034+0000 7f778affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889415 cookie 94462454916096 notifier 5705 bl.length()=202 2023-12-03T11:35:58.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.034+0000 7f778affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2023-12-03T11:35:58.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.034+0000 7f778affd640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2023-12-03T11:35:58.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.035+0000 7f77a8920800 10 cache put: name=default.rgw.meta+users.keys+DOBOWVTIWFGJVYIMXPSY info.flags=0x7 2023-12-03T11:35:58.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.035+0000 7f77a8920800 10 moving default.rgw.meta+users.keys+DOBOWVTIWFGJVYIMXPSY to cache LRU end 2023-12-03T11:35:58.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.035+0000 7f77a8920800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:DOBOWVTIWFGJVYIMXPSY, ofs0, ns] 2023-12-03T11:35:58.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.036+0000 7f778affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889418 cookie 94462454935680 notifier 5705 bl.length()=190 2023-12-03T11:35:58.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.036+0000 7f778affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+DOBOWVTIWFGJVYIMXPSY info.flags=0x7 2023-12-03T11:35:58.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.036+0000 7f778affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+DOBOWVTIWFGJVYIMXPSY to cache LRU end 2023-12-03T11:35:58.037 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-12-03T11:35:58.038 INFO:teuthology.orchestra.run.smithi044.stdout: "user_id": "ragweed.client.0", 2023-12-03T11:35:58.038 INFO:teuthology.orchestra.run.smithi044.stdout: "display_name": "Mr. ragweed.client.0", 2023-12-03T11:35:58.038 INFO:teuthology.orchestra.run.smithi044.stdout: "email": "ragweed.client.0+test@test.test", 2023-12-03T11:35:58.038 INFO:teuthology.orchestra.run.smithi044.stdout: "suspended": 0, 2023-12-03T11:35:58.038 INFO:teuthology.orchestra.run.smithi044.stdout: "max_buckets": 1000, 2023-12-03T11:35:58.038 INFO:teuthology.orchestra.run.smithi044.stdout: "subusers": [], 2023-12-03T11:35:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: "keys": [ 2023-12-03T11:35:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-12-03T11:35:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: "user": "ragweed.client.0", 2023-12-03T11:35:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: "access_key": "DOBOWVTIWFGJVYIMXPSY", 2023-12-03T11:35:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: "secret_key": "0HWMrkSgqezw9LTAVg3qnrnKsZL5RKXf3YAxcu4puKkqJnaTgJtxIw==" 2023-12-03T11:35:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-12-03T11:35:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2023-12-03T11:35:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: "swift_keys": [], 2023-12-03T11:35:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": [], 2023-12-03T11:35:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: "op_mask": "read, write, delete", 2023-12-03T11:35:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: "default_placement": "", 2023-12-03T11:35:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: "default_storage_class": "", 2023-12-03T11:35:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: "placement_tags": [], 2023-12-03T11:35:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: "bucket_quota": { 2023-12-03T11:35:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2023-12-03T11:35:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2023-12-03T11:35:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2023-12-03T11:35:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2023-12-03T11:35:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2023-12-03T11:35:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-12-03T11:35:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "user_quota": { 2023-12-03T11:35:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2023-12-03T11:35:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2023-12-03T11:35:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2023-12-03T11:35:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2023-12-03T11:35:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2023-12-03T11:35:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-12-03T11:35:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "temp_url_keys": [], 2023-12-03T11:35:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "rgw", 2023-12-03T11:35:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "mfa_ids": [] 2023-12-03T11:35:58.040 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-12-03T11:35:58.041 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:35:58.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.037+0000 7f776a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:58.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.040+0000 7f77a8920800 20 remove_watcher() i=0 2023-12-03T11:35:58.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.040+0000 7f77a8920800 2 removed watcher, disabling cache 2023-12-03T11:35:58.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.041+0000 7f77a8920800 20 remove_watcher() i=1 2023-12-03T11:35:58.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.042+0000 7f77a8920800 20 remove_watcher() i=2 2023-12-03T11:35:58.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.043+0000 7f77a8920800 20 remove_watcher() i=3 2023-12-03T11:35:58.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.044+0000 7f77a8920800 20 remove_watcher() i=4 2023-12-03T11:35:58.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.045+0000 7f77a8920800 20 remove_watcher() i=5 2023-12-03T11:35:58.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.046+0000 7f77a8920800 20 remove_watcher() i=6 2023-12-03T11:35:58.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.047+0000 7f77a8920800 20 remove_watcher() i=7 2023-12-03T11:35:58.054 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2023-12-03T11:35:58.055 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key MXACUFQVLISLOZCOBOGV --secret H2gu+McmlgkDuAZtkdEaXTxT3muO1bcDkwUnPCFrH0FbLUXhH81IXg== --email sysuser.client.0+test@test.test --system true 2023-12-03T11:35:58.108 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:58.108 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:58.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.118+0000 7fc357b37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.120+0000 7fc357b37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:58.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.120+0000 7fc357b37800 20 realm 2023-12-03T11:35:58.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.120+0000 7fc357b37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.120+0000 7fc357b37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:58.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.120+0000 7fc357b37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:58.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.120+0000 7fc357b37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.120+0000 7fc357b37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:58.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.120+0000 7fc357b37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.121+0000 7fc357b37800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:58.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.121+0000 7fc357b37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.122+0000 7fc357b37800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:58.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.122+0000 7fc357b37800 20 searching for the correct realm 2023-12-03T11:35:58.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.132+0000 7fc3538cd640 0 -- 172.21.15.44:0/526065620 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55b3260dd200 msgr2=0x55b3260df650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:58.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.133+0000 7fc357b37800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:35:58.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.133+0000 7fc357b37800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:35:58.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.133+0000 7fc357b37800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:58.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.133+0000 7fc357b37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:58.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.133+0000 7fc357b37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.133+0000 7fc357b37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:58.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.133+0000 7fc357b37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.133+0000 7fc357b37800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:58.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.133+0000 7fc357b37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.134+0000 7fc357b37800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:58.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.134+0000 7fc357b37800 20 zone default found 2023-12-03T11:35:58.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.134+0000 7fc357b37800 4 Realm: () 2023-12-03T11:35:58.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.134+0000 7fc357b37800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:35:58.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.134+0000 7fc357b37800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:35:58.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.134+0000 7fc357b37800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:58.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.134+0000 7fc357b37800 20 zonegroup default 2023-12-03T11:35:58.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.134+0000 7fc357b37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.134+0000 7fc357b37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:58.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.134+0000 7fc357b37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.135+0000 7fc357b37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:58.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.135+0000 7fc357b37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.135+0000 7fc357b37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:58.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.135+0000 7fc357b37800 20 started sync module instance, tier type = 2023-12-03T11:35:58.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.135+0000 7fc357b37800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:35:58.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.141+0000 7fc3540ce640 0 -- 172.21.15.44:0/526065620 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7fc348064070 msgr2=0x7fc34807f000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:58.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.144+0000 7fc357b37800 20 add_watcher() i=0 2023-12-03T11:35:58.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.144+0000 7fc357b37800 20 add_watcher() i=1 2023-12-03T11:35:58.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.144+0000 7fc357b37800 20 add_watcher() i=2 2023-12-03T11:35:58.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.144+0000 7fc357b37800 20 add_watcher() i=3 2023-12-03T11:35:58.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.144+0000 7fc357b37800 20 add_watcher() i=4 2023-12-03T11:35:58.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.144+0000 7fc357b37800 20 add_watcher() i=5 2023-12-03T11:35:58.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.144+0000 7fc357b37800 20 add_watcher() i=6 2023-12-03T11:35:58.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.145+0000 7fc357b37800 20 add_watcher() i=7 2023-12-03T11:35:58.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.145+0000 7fc357b37800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:58.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.147+0000 7fc319fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:58.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.147+0000 7fc357b37800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:58.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.147+0000 7fc357b37800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:58.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.152+0000 7fc357b37800 5 note: GC not initialized 2023-12-03T11:35:58.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.152+0000 7fc290ff9640 20 reqs_thread_entry: start 2023-12-03T11:35:58.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.152+0000 7fc357b37800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:58.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.152+0000 7fc357b37800 20 Filter name: none 2023-12-03T11:35:58.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.152+0000 7fc2867fc640 20 reqs_thread_entry: start 2023-12-03T11:35:58.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.152+0000 7fc357b37800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2023-12-03T11:35:58.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.152+0000 7fc357b37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.153+0000 7fc357b37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:58.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.153+0000 7fc357b37800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2023-12-03T11:35:58.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.153+0000 7fc357b37800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2023-12-03T11:35:58.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.153+0000 7fc357b37800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2023-12-03T11:35:58.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.153+0000 7fc357b37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.153+0000 7fc357b37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:58.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.153+0000 7fc357b37800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2023-12-03T11:35:58.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.153+0000 7fc357b37800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2023-12-03T11:35:58.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.153+0000 7fc357b37800 10 cache get: name=default.rgw.meta+users.keys+MXACUFQVLISLOZCOBOGV : miss 2023-12-03T11:35:58.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.153+0000 7fc357b37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:58.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.153+0000 7fc357b37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:58.156 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.153+0000 7fc357b37800 10 cache put: name=default.rgw.meta+users.keys+MXACUFQVLISLOZCOBOGV info.flags=0x0 2023-12-03T11:35:58.156 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.153+0000 7fc357b37800 10 adding default.rgw.meta+users.keys+MXACUFQVLISLOZCOBOGV to cache LRU end 2023-12-03T11:35:58.156 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.153+0000 7fc357b37800 10 cache get: name=default.rgw.meta+users.keys+MXACUFQVLISLOZCOBOGV : hit (negative entry) 2023-12-03T11:35:58.156 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.153+0000 7fc357b37800 10 cache get: name=default.rgw.meta+users.keys+MXACUFQVLISLOZCOBOGV : hit (negative entry) 2023-12-03T11:35:58.156 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.155+0000 7fc357b37800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2023-12-03T11:35:58.156 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.155+0000 7fc357b37800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2023-12-03T11:35:58.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.155+0000 7fc357b37800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2023-12-03T11:35:58.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.155+0000 7fc33a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889416 cookie 94227925998512 notifier 5726 bl.length()=641 2023-12-03T11:35:58.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.155+0000 7fc33a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2023-12-03T11:35:58.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.155+0000 7fc33a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2023-12-03T11:35:58.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.157+0000 7fc357b37800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2023-12-03T11:35:58.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.157+0000 7fc357b37800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2023-12-03T11:35:58.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.157+0000 7fc357b37800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2023-12-03T11:35:58.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.157+0000 7fc33a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889429 cookie 94227926005344 notifier 5726 bl.length()=202 2023-12-03T11:35:58.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.157+0000 7fc33a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2023-12-03T11:35:58.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.157+0000 7fc33a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2023-12-03T11:35:58.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.159+0000 7fc357b37800 10 cache put: name=default.rgw.meta+users.keys+MXACUFQVLISLOZCOBOGV info.flags=0x7 2023-12-03T11:35:58.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.159+0000 7fc357b37800 10 moving default.rgw.meta+users.keys+MXACUFQVLISLOZCOBOGV to cache LRU end 2023-12-03T11:35:58.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.159+0000 7fc357b37800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:MXACUFQVLISLOZCOBOGV, ofs0, ns] 2023-12-03T11:35:58.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.159+0000 7fc33a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889430 cookie 94227926005344 notifier 5726 bl.length()=190 2023-12-03T11:35:58.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.159+0000 7fc33a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MXACUFQVLISLOZCOBOGV info.flags=0x7 2023-12-03T11:35:58.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.159+0000 7fc33a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MXACUFQVLISLOZCOBOGV to cache LRU end 2023-12-03T11:35:58.160 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-12-03T11:35:58.161 INFO:teuthology.orchestra.run.smithi044.stdout: "user_id": "sysuser.client.0", 2023-12-03T11:35:58.161 INFO:teuthology.orchestra.run.smithi044.stdout: "display_name": "Mr. sysuser.client.0", 2023-12-03T11:35:58.161 INFO:teuthology.orchestra.run.smithi044.stdout: "email": "sysuser.client.0+test@test.test", 2023-12-03T11:35:58.161 INFO:teuthology.orchestra.run.smithi044.stdout: "suspended": 0, 2023-12-03T11:35:58.161 INFO:teuthology.orchestra.run.smithi044.stdout: "max_buckets": 1000, 2023-12-03T11:35:58.161 INFO:teuthology.orchestra.run.smithi044.stdout: "subusers": [], 2023-12-03T11:35:58.161 INFO:teuthology.orchestra.run.smithi044.stdout: "keys": [ 2023-12-03T11:35:58.161 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-12-03T11:35:58.161 INFO:teuthology.orchestra.run.smithi044.stdout: "user": "sysuser.client.0", 2023-12-03T11:35:58.161 INFO:teuthology.orchestra.run.smithi044.stdout: "access_key": "MXACUFQVLISLOZCOBOGV", 2023-12-03T11:35:58.161 INFO:teuthology.orchestra.run.smithi044.stdout: "secret_key": "H2gu+McmlgkDuAZtkdEaXTxT3muO1bcDkwUnPCFrH0FbLUXhH81IXg==" 2023-12-03T11:35:58.161 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-12-03T11:35:58.161 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2023-12-03T11:35:58.161 INFO:teuthology.orchestra.run.smithi044.stdout: "swift_keys": [], 2023-12-03T11:35:58.161 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": [], 2023-12-03T11:35:58.162 INFO:teuthology.orchestra.run.smithi044.stdout: "op_mask": "read, write, delete", 2023-12-03T11:35:58.162 INFO:teuthology.orchestra.run.smithi044.stdout: "system": true, 2023-12-03T11:35:58.162 INFO:teuthology.orchestra.run.smithi044.stdout: "default_placement": "", 2023-12-03T11:35:58.162 INFO:teuthology.orchestra.run.smithi044.stdout: "default_storage_class": "", 2023-12-03T11:35:58.162 INFO:teuthology.orchestra.run.smithi044.stdout: "placement_tags": [], 2023-12-03T11:35:58.162 INFO:teuthology.orchestra.run.smithi044.stdout: "bucket_quota": { 2023-12-03T11:35:58.162 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2023-12-03T11:35:58.162 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2023-12-03T11:35:58.162 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2023-12-03T11:35:58.162 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2023-12-03T11:35:58.162 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2023-12-03T11:35:58.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-12-03T11:35:58.162 INFO:teuthology.orchestra.run.smithi044.stdout: "user_quota": { 2023-12-03T11:35:58.162 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2023-12-03T11:35:58.162 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2023-12-03T11:35:58.163 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2023-12-03T11:35:58.163 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2023-12-03T11:35:58.163 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2023-12-03T11:35:58.163 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-12-03T11:35:58.163 INFO:teuthology.orchestra.run.smithi044.stdout: "temp_url_keys": [], 2023-12-03T11:35:58.163 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "rgw", 2023-12-03T11:35:58.163 INFO:teuthology.orchestra.run.smithi044.stdout: "mfa_ids": [] 2023-12-03T11:35:58.163 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-12-03T11:35:58.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:35:58.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.160+0000 7fc319fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:58.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.162+0000 7fc357b37800 20 remove_watcher() i=0 2023-12-03T11:35:58.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.162+0000 7fc357b37800 2 removed watcher, disabling cache 2023-12-03T11:35:58.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.164+0000 7fc357b37800 20 remove_watcher() i=1 2023-12-03T11:35:58.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.165+0000 7fc357b37800 20 remove_watcher() i=2 2023-12-03T11:35:58.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.166+0000 7fc357b37800 20 remove_watcher() i=3 2023-12-03T11:35:58.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.167+0000 7fc357b37800 20 remove_watcher() i=4 2023-12-03T11:35:58.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.168+0000 7fc357b37800 20 remove_watcher() i=5 2023-12-03T11:35:58.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.169+0000 7fc357b37800 20 remove_watcher() i=6 2023-12-03T11:35:58.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:35:58.170+0000 7fc357b37800 20 remove_watcher() i=7 2023-12-03T11:35:58.176 INFO:tasks.ragweed:Configuring ragweed... 2023-12-03T11:35:58.176 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:35:58.176 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2023-12-03T11:35:58.191 INFO:tasks.ragweed:Configuring boto... 2023-12-03T11:35:58.192 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:35:58.192 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/boto.cfg 2023-12-03T11:35:58.247 DEBUG:teuthology.orchestra.run.smithi044:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2023-12-03T11:35:58.413 INFO:teuthology.orchestra.run.smithi044.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2023-12-03T11:35:58.592 INFO:teuthology.orchestra.run.smithi044.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2023-12-03T11:35:59.086 INFO:teuthology.orchestra.run.smithi044.stdout:py installdeps: -rrequirements.txt 2023-12-03T11:36:11.842 INFO:teuthology.orchestra.run.smithi044.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2023-12-03T11:36:14.934 INFO:teuthology.orchestra.run.smithi044.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2021.10.8,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-299/tmp/wheel/cockpit-299-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.0,execnet==2.0.2,file-magic==0.4.0,gevent==23.9.1,google-auth==2.23.4,gpg==1.15.1,greenlet==3.0.1,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==23.2,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.3.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,PyJWT==2.4.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==7.4.3,python-dateutil==2.8.1,python-linux-procfs==0.7.0,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=14dd06389ff7acb3c4e4765ee3fff888628f0f76bbeb89e210ce7193a8c47ff8,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.3.0,scipy==1.6.2,selinux==3.5,sepolicy==3.5,setools==4.4.3,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,sos==4.3,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.4.0,urllib3==1.26.5,WebOb==1.8.7,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==6.1 2023-12-03T11:36:14.934 INFO:teuthology.orchestra.run.smithi044.stdout:py run-test-pre: PYTHONHASHSEED='2810931368' 2023-12-03T11:36:14.934 INFO:teuthology.orchestra.run.smithi044.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2023-12-03T11:36:15.147 INFO:teuthology.orchestra.run.smithi044.stdout:============================= test session starts ============================== 2023-12-03T11:36:15.148 INFO:teuthology.orchestra.run.smithi044.stdout:platform linux -- Python 3.9.17, pytest-7.4.3, pluggy-1.3.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2023-12-03T11:36:15.148 INFO:teuthology.orchestra.run.smithi044.stdout:cachedir: .tox/py/.pytest_cache 2023-12-03T11:36:15.148 INFO:teuthology.orchestra.run.smithi044.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2023-12-03T11:36:15.148 INFO:teuthology.orchestra.run.smithi044.stdout:configfile: pytest.ini 2023-12-03T11:36:15.251 INFO:teuthology.orchestra.run.smithi044.stdout:collecting ... collected 9 items 2023-12-03T11:36:15.252 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:36:15.712 INFO:teuthology.orchestra.run.smithi044.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2023-12-03T11:36:16.303 INFO:teuthology.orchestra.run.smithi044.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2023-12-03T11:36:16.819 INFO:teuthology.orchestra.run.smithi044.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2023-12-03T11:36:17.364 INFO:teuthology.orchestra.run.smithi044.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2023-12-03T11:36:17.993 INFO:teuthology.orchestra.run.smithi044.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2023-12-03T11:36:23.548 INFO:teuthology.orchestra.run.smithi044.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2023-12-03T11:36:24.816 INFO:teuthology.orchestra.run.smithi044.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2023-12-03T11:36:26.066 INFO:teuthology.orchestra.run.smithi044.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2023-12-03T11:36:28.373 INFO:teuthology.orchestra.run.smithi044.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2023-12-03T11:36:28.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:36:28.373 INFO:teuthology.orchestra.run.smithi044.stdout:=============================== warnings summary =============================== 2023-12-03T11:36:28.373 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2023-12-03T11:36:28.374 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2023-12-03T11:36:28.374 INFO:teuthology.orchestra.run.smithi044.stdout: import imp 2023-12-03T11:36:28.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:36:28.374 INFO:teuthology.orchestra.run.smithi044.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2023-12-03T11:36:28.374 INFO:teuthology.orchestra.run.smithi044.stdout:======================== 9 passed, 1 warning in 13.23s ========================= 2023-12-03T11:36:28.406 INFO:teuthology.orchestra.run.smithi044.stdout:___________________________________ summary ____________________________________ 2023-12-03T11:36:28.407 INFO:teuthology.orchestra.run.smithi044.stdout: py: commands succeeded 2023-12-03T11:36:28.407 INFO:teuthology.orchestra.run.smithi044.stdout: congratulations :) 2023-12-03T11:36:28.421 INFO:tasks.ragweed:Cleaning up boto... 2023-12-03T11:36:28.422 DEBUG:teuthology.orchestra.run.smithi044:> rm -f /home/ubuntu/cephtest/boto.cfg 2023-12-03T11:36:28.437 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2023-12-03T11:36:28.522 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:36:28.522 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:36:28.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.533+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.535+0000 7fec4832a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:28.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.535+0000 7fec4832a800 20 realm 2023-12-03T11:36:28.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.535+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.535+0000 7fec4832a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:28.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.535+0000 7fec4832a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:36:28.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.535+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.535+0000 7fec4832a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:28.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.535+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.536+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:28.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.536+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.537+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:36:28.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.537+0000 7fec4832a800 20 searching for the correct realm 2023-12-03T11:36:28.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.545+0000 7fec44866640 0 -- 172.21.15.44:0/987422899 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55a07f0c11a0 msgr2=0x55a07f0c3630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:36:28.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.547+0000 7fec4832a800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:36:28.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.547+0000 7fec4832a800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:36:28.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.547+0000 7fec4832a800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:36:28.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.547+0000 7fec4832a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:36:28.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.547+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.548+0000 7fec4832a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:28.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.548+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.548+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:28.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.548+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.548+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:36:28.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.548+0000 7fec4832a800 20 zone default found 2023-12-03T11:36:28.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.548+0000 7fec4832a800 4 Realm: () 2023-12-03T11:36:28.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.548+0000 7fec4832a800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:36:28.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.548+0000 7fec4832a800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:36:28.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.548+0000 7fec4832a800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:36:28.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.548+0000 7fec4832a800 20 zonegroup default 2023-12-03T11:36:28.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.548+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.548+0000 7fec4832a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:28.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.548+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.549+0000 7fec4832a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:28.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.549+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.549+0000 7fec4832a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:28.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.549+0000 7fec4832a800 20 started sync module instance, tier type = 2023-12-03T11:36:28.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.549+0000 7fec4832a800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:36:28.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.553+0000 7fec43864640 0 -- 172.21.15.44:0/987422899 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x55a07f0bc8a0 msgr2=0x55a07f0bec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:28.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.558+0000 7fec4832a800 20 add_watcher() i=0 2023-12-03T11:36:28.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.558+0000 7fec4832a800 20 add_watcher() i=1 2023-12-03T11:36:28.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.558+0000 7fec4832a800 20 add_watcher() i=2 2023-12-03T11:36:28.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.558+0000 7fec4832a800 20 add_watcher() i=3 2023-12-03T11:36:28.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.558+0000 7fec4832a800 20 add_watcher() i=4 2023-12-03T11:36:28.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.558+0000 7fec4832a800 20 add_watcher() i=5 2023-12-03T11:36:28.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.558+0000 7fec4832a800 20 add_watcher() i=6 2023-12-03T11:36:28.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.559+0000 7fec4832a800 20 add_watcher() i=7 2023-12-03T11:36:28.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.559+0000 7fec4832a800 2 all 8 watchers are set, enabling cache 2023-12-03T11:36:28.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.560+0000 7fec0a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:28.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.560+0000 7fec4832a800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:36:28.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.560+0000 7fec4832a800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:36:28.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.601+0000 7feb797fa640 20 reqs_thread_entry: start 2023-12-03T11:36:28.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.601+0000 7fec4832a800 20 init_complete bucket index max shards: 1 2023-12-03T11:36:28.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.601+0000 7fec4832a800 20 Filter name: none 2023-12-03T11:36:28.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.601+0000 7feb72ffd640 20 reqs_thread_entry: start 2023-12-03T11:36:28.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.601+0000 7fec4832a800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2023-12-03T11:36:28.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.601+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.602+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=452 2023-12-03T11:36:28.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.602+0000 7fec4832a800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2023-12-03T11:36:28.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.602+0000 7fec4832a800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2023-12-03T11:36:28.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.602+0000 7fec4832a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:36:28.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.602+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.3 : miss 2023-12-03T11:36:28.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.602+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.603+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:36:28.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.603+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.3 info.flags=0x17 2023-12-03T11:36:28.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.603+0000 7fec4832a800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.3 to cache LRU end 2023-12-03T11:36:28.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.603+0000 7fec4832a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:36:28.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.603+0000 7fec4832a800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:36:28.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.603+0000 7fec4832a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.3 2023-12-03T11:36:28.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.603+0000 7fec4832a800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2023-12-03T11:36:28.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.603+0000 7fec4832a800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2023-12-03T11:36:28.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.603+0000 7fec4832a800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2023-12-03T11:36:28.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.603+0000 7fec4832a800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2023-12-03T11:36:28.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.603+0000 7fec4832a800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2023-12-03T11:36:28.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.603+0000 7fec4832a800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2023-12-03T11:36:28.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.603+0000 7fec4832a800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2023-12-03T11:36:28.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.603+0000 7fec4832a800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2023-12-03T11:36:28.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.603+0000 7fec4832a800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2023-12-03T11:36:28.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.604+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f1324b0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55a07f136388 s->prefetch_data=0 2023-12-03T11:36:28.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.604+0000 7fec4832a800 10 manifest: total_size = 5166 2023-12-03T11:36:28.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.604+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.632220731761220278 2023-12-03T11:36:28.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.604+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f1324b0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55a07f136388 s->prefetch_data=0 2023-12-03T11:36:28.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.604+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f136388 2023-12-03T11:36:28.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.604+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.3.0 2023-12-03T11:36:28.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.606+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f1324b0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55a07f136388 s->prefetch_data=0 2023-12-03T11:36:28.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.607+0000 7fec4832a800 10 manifest: total_size = 12883 2023-12-03T11:36:28.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.607+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.11463028829771824346 2023-12-03T11:36:28.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.607+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f1324b0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55a07f136388 s->prefetch_data=0 2023-12-03T11:36:28.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.607+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f136388 2023-12-03T11:36:28.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.607+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.3.0 2023-12-03T11:36:28.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.608+0000 7fec2affd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2023-12-03T11:36:28.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.609+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f1324b0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55a07f135ea8 s->prefetch_data=0 2023-12-03T11:36:28.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.610+0000 7fec4832a800 10 manifest: total_size = 5036 2023-12-03T11:36:28.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.610+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.5030812998960000642 2023-12-03T11:36:28.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.610+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f1324b0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55a07f135ea8 s->prefetch_data=0 2023-12-03T11:36:28.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.610+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f135ea8 2023-12-03T11:36:28.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.610+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.3.0 2023-12-03T11:36:28.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.610+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2023-12-03T11:36:28.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.612+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f1324b0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55a07f135ea8 s->prefetch_data=0 2023-12-03T11:36:28.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.612+0000 7fec4832a800 10 manifest: total_size = 7437 2023-12-03T11:36:28.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.612+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.4073643871793321147 2023-12-03T11:36:28.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.612+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f1324b0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55a07f135ea8 s->prefetch_data=0 2023-12-03T11:36:28.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.612+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f135ea8 2023-12-03T11:36:28.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.612+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.3.0 2023-12-03T11:36:28.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.613+0000 7fec2affd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2023-12-03T11:36:28.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.615+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f1324b0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55a07f135ea8 s->prefetch_data=0 2023-12-03T11:36:28.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.615+0000 7fec4832a800 10 manifest: total_size = 7471 2023-12-03T11:36:28.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.615+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.9787731041327012250 2023-12-03T11:36:28.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.615+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f1324b0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55a07f135ea8 s->prefetch_data=0 2023-12-03T11:36:28.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.615+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f135ea8 2023-12-03T11:36:28.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.615+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.3.0 2023-12-03T11:36:28.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.616+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2023-12-03T11:36:28.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.617+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f1324b0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55a07f135ea8 s->prefetch_data=0 2023-12-03T11:36:28.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.618+0000 7fec4832a800 10 manifest: total_size = 15705 2023-12-03T11:36:28.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.618+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.11176875871872357352 2023-12-03T11:36:28.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.618+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f1324b0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55a07f135ea8 s->prefetch_data=0 2023-12-03T11:36:28.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.618+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f135ea8 2023-12-03T11:36:28.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.618+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.3.0 2023-12-03T11:36:28.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.618+0000 7fec2affd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2023-12-03T11:36:28.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.620+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f1324b0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55a07f135ea8 s->prefetch_data=0 2023-12-03T11:36:28.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.621+0000 7fec4832a800 10 manifest: total_size = 5075 2023-12-03T11:36:28.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.621+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.264231612578970088 2023-12-03T11:36:28.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.621+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f1324b0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55a07f135ea8 s->prefetch_data=0 2023-12-03T11:36:28.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.621+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f135ea8 2023-12-03T11:36:28.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.621+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.3.0 2023-12-03T11:36:28.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.621+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2023-12-03T11:36:28.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.623+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f1324b0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55a07f135ea8 s->prefetch_data=0 2023-12-03T11:36:28.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.623+0000 7fec4832a800 10 manifest: total_size = 4987 2023-12-03T11:36:28.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.623+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.1064006907487389565 2023-12-03T11:36:28.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.623+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f1324b0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55a07f135ea8 s->prefetch_data=0 2023-12-03T11:36:28.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.623+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f135ea8 2023-12-03T11:36:28.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.623+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.3.0 2023-12-03T11:36:28.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.624+0000 7fec2affd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2023-12-03T11:36:28.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.626+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f1324b0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55a07f135ea8 s->prefetch_data=0 2023-12-03T11:36:28.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.626+0000 7fec4832a800 10 manifest: total_size = 8637 2023-12-03T11:36:28.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.626+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.7120293770919137808 2023-12-03T11:36:28.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.626+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f1324b0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55a07f135ea8 s->prefetch_data=0 2023-12-03T11:36:28.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.626+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f135ea8 2023-12-03T11:36:28.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.626+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.3.0 2023-12-03T11:36:28.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.627+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2023-12-03T11:36:28.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.629+0000 7fec4832a800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:36:28.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.629+0000 7fec4832a800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:36:28.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.630+0000 7fec2affd640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2023-12-03T11:36:28.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.630+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:36:28.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.630+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:36:28.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.630+0000 7fec4832a800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:36:28.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.630+0000 7fec4832a800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:36:28.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.630+0000 7fec4832a800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.3])"; uploads.size()=0; is_truncated=0 2023-12-03T11:36:28.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.632+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2023-12-03T11:36:28.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.632+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.632+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=204 2023-12-03T11:36:28.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.632+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2023-12-03T11:36:28.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.632+0000 7fec4832a800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2023-12-03T11:36:28.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.632+0000 7fec4832a800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2023-12-03T11:36:28.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.632+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2023-12-03T11:36:28.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.632+0000 7fec2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693213 cookie 140652529188864 notifier 5756 bl.length()=162 2023-12-03T11:36:28.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.634+0000 7fec4832a800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.3 from cache 2023-12-03T11:36:28.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.634+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.3, ofs0, ns] 2023-12-03T11:36:28.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.634+0000 7fec2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693262 cookie 94147814610688 notifier 5756 bl.length()=219 2023-12-03T11:36:28.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.637+0000 7fec4832a800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.3 : miss 2023-12-03T11:36:28.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.637+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.637+0000 7fec4832a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:28.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.637+0000 7fec4832a800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.3 info.flags=0x0 2023-12-03T11:36:28.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.637+0000 7fec4832a800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.3 to cache LRU end 2023-12-03T11:36:28.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.637+0000 7fec4832a800 10 removing default.rgw.log++pubsub..bucket.test-client.0-conf/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.3 from cache 2023-12-03T11:36:28.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.637+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-conf/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.3, ofs0, ns] 2023-12-03T11:36:28.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.637+0000 7fec2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693214 cookie 94147814647504 notifier 5756 bl.length()=216 2023-12-03T11:36:28.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.640+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.10 : miss 2023-12-03T11:36:28.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.640+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.641+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=409 2023-12-03T11:36:28.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.641+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.10 info.flags=0x17 2023-12-03T11:36:28.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.641+0000 7fec4832a800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.10 to cache LRU end 2023-12-03T11:36:28.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.641+0000 7fec4832a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:36:28.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.641+0000 7fec4832a800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:36:28.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.641+0000 7fec4832a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.10 2023-12-03T11:36:28.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.641+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo 2023-12-03T11:36:28.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.641+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f13e3f0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55a07f1378b8 s->prefetch_data=0 2023-12-03T11:36:28.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.642+0000 7fec4832a800 10 manifest: total_size = 1667 2023-12-03T11:36:28.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.642+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.9707469193298936919 2023-12-03T11:36:28.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.642+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f13e3f0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55a07f1378b8 s->prefetch_data=0 2023-12-03T11:36:28.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.642+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f1378b8 2023-12-03T11:36:28.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.642+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.10.0 2023-12-03T11:36:28.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2023-12-03T11:36:28.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2023-12-03T11:36:28.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2023-12-03T11:36:28.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2023-12-03T11:36:28.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2023-12-03T11:36:28.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2023-12-03T11:36:28.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2023-12-03T11:36:28.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=516 2023-12-03T11:36:28.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2023-12-03T11:36:28.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2023-12-03T11:36:28.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4195852 part_ofs=1548 rule->part_size=119 2023-12-03T11:36:28.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2023-12-03T11:36:28.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.9707469193298936919 2023-12-03T11:36:28.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.10__multipart_foo.2~NRwZnHg8Vzye7TVXkipMVT-TPXYJSxj.1 2023-12-03T11:36:28.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2023-12-03T11:36:28.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.10__multipart_foo.2~NRwZnHg8Vzye7TVXkipMVT-TPXYJSxj.2 2023-12-03T11:36:28.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2023-12-03T11:36:28.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.10__multipart_foo.2~NRwZnHg8Vzye7TVXkipMVT-TPXYJSxj.3 2023-12-03T11:36:28.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2023-12-03T11:36:28.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.10__multipart_foo.2~NRwZnHg8Vzye7TVXkipMVT-TPXYJSxj.4 2023-12-03T11:36:28.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2023-12-03T11:36:28.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.644+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.9707469193298936919 2023-12-03T11:36:28.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.645+0000 7fec2affd640 20 handle_completion(): completion ok for obj=foo 2023-12-03T11:36:28.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.646+0000 7fec4832a800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:36:28.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.646+0000 7fec4832a800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:36:28.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.646+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:36:28.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.646+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:36:28.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.646+0000 7fec4832a800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:36:28.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.646+0000 7fec4832a800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:36:28.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.646+0000 7fec4832a800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.10])"; uploads.size()=0; is_truncated=0 2023-12-03T11:36:28.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.647+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2023-12-03T11:36:28.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.647+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.648+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=235 2023-12-03T11:36:28.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.648+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2023-12-03T11:36:28.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.648+0000 7fec4832a800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2023-12-03T11:36:28.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.648+0000 7fec4832a800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2023-12-03T11:36:28.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.648+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2023-12-03T11:36:28.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.648+0000 7fec2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693237 cookie 94147812151120 notifier 5756 bl.length()=191 2023-12-03T11:36:28.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.650+0000 7fec4832a800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.10 from cache 2023-12-03T11:36:28.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.650+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.10, ofs0, ns] 2023-12-03T11:36:28.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.650+0000 7fec2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693238 cookie 94147812151120 notifier 5756 bl.length()=249 2023-12-03T11:36:28.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.653+0000 7fec4832a800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.10 : miss 2023-12-03T11:36:28.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.653+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.653+0000 7fec4832a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:28.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.653+0000 7fec4832a800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.10 info.flags=0x0 2023-12-03T11:36:28.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.653+0000 7fec4832a800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.10 to cache LRU end 2023-12-03T11:36:28.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.653+0000 7fec4832a800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.10 from cache 2023-12-03T11:36:28.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.653+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.10, ofs0, ns] 2023-12-03T11:36:28.655 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.653+0000 7fec2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693263 cookie 94147814608000 notifier 5756 bl.length()=246 2023-12-03T11:36:28.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.656+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.11 : miss 2023-12-03T11:36:28.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.656+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.656+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=416 2023-12-03T11:36:28.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.656+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.11 info.flags=0x17 2023-12-03T11:36:28.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.656+0000 7fec4832a800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.11 to cache LRU end 2023-12-03T11:36:28.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.656+0000 7fec4832a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:36:28.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.656+0000 7fec4832a800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:36:28.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.656+0000 7fec4832a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.11 2023-12-03T11:36:28.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.656+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo 2023-12-03T11:36:28.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.657+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3c076c90 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55a07f141b18 s->prefetch_data=0 2023-12-03T11:36:28.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.657+0000 7fec4832a800 10 manifest: total_size = 26079 2023-12-03T11:36:28.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.657+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.2147914547053907546 2023-12-03T11:36:28.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.657+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3c076c90 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55a07f141b18 s->prefetch_data=0 2023-12-03T11:36:28.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.657+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f141b18 2023-12-03T11:36:28.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.657+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.11.0 2023-12-03T11:36:28.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2023-12-03T11:36:28.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7670 2023-12-03T11:36:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7672 2023-12-03T11:36:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2023-12-03T11:36:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4201974 part_ofs=7670 rule->part_size=7672 2023-12-03T11:36:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=7670 2023-12-03T11:36:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2023-12-03T11:36:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4209646 part_ofs=15342 rule->part_size=7670 2023-12-03T11:36:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=23012 stripe_ofs=23012 part_ofs=23012 rule->part_size=3067 2023-12-03T11:36:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2023-12-03T11:36:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4217316 part_ofs=23012 rule->part_size=3067 2023-12-03T11:36:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=26079 stripe_ofs=26079 part_ofs=26079 rule->part_size=3067 2023-12-03T11:36:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.2147914547053907546 2023-12-03T11:36:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.11__multipart_foo.2~oKO_SIqogcy04MN8y0DHre0qGSmfLST.1 2023-12-03T11:36:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2023-12-03T11:36:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.11__multipart_foo.2~oKO_SIqogcy04MN8y0DHre0qGSmfLST.2 2023-12-03T11:36:28.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2023-12-03T11:36:28.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.11__multipart_foo.2~oKO_SIqogcy04MN8y0DHre0qGSmfLST.3 2023-12-03T11:36:28.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2023-12-03T11:36:28.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.11__multipart_foo.2~oKO_SIqogcy04MN8y0DHre0qGSmfLST.4 2023-12-03T11:36:28.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2023-12-03T11:36:28.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.659+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.2147914547053907546 2023-12-03T11:36:28.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.660+0000 7fec2affd640 20 handle_completion(): completion ok for obj=foo 2023-12-03T11:36:28.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.661+0000 7fec4832a800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:36:28.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.661+0000 7fec4832a800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:36:28.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.661+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:36:28.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.661+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:36:28.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.661+0000 7fec4832a800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:36:28.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.661+0000 7fec4832a800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:36:28.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.661+0000 7fec4832a800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.11])"; uploads.size()=0; is_truncated=0 2023-12-03T11:36:28.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.662+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2023-12-03T11:36:28.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.662+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.663+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=242 2023-12-03T11:36:28.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.663+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2023-12-03T11:36:28.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.663+0000 7fec4832a800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2023-12-03T11:36:28.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.663+0000 7fec4832a800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2023-12-03T11:36:28.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.663+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2023-12-03T11:36:28.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.663+0000 7fec2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693197 cookie 94147814641472 notifier 5756 bl.length()=198 2023-12-03T11:36:28.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.665+0000 7fec4832a800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.11 from cache 2023-12-03T11:36:28.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.665+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.11, ofs0, ns] 2023-12-03T11:36:28.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.665+0000 7fec2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693264 cookie 94147814608000 notifier 5756 bl.length()=256 2023-12-03T11:36:28.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.668+0000 7fec4832a800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.11 : miss 2023-12-03T11:36:28.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.668+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.668+0000 7fec4832a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:28.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.668+0000 7fec4832a800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.11 info.flags=0x0 2023-12-03T11:36:28.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.668+0000 7fec4832a800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.11 to cache LRU end 2023-12-03T11:36:28.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.668+0000 7fec4832a800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.11 from cache 2023-12-03T11:36:28.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.668+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.11, ofs0, ns] 2023-12-03T11:36:28.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.668+0000 7fec2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693205 cookie 94147814644928 notifier 5756 bl.length()=253 2023-12-03T11:36:28.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.671+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9 : miss 2023-12-03T11:36:28.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.671+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.672+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=409 2023-12-03T11:36:28.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.672+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9 info.flags=0x17 2023-12-03T11:36:28.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.672+0000 7fec4832a800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9 to cache LRU end 2023-12-03T11:36:28.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.672+0000 7fec4832a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:36:28.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.672+0000 7fec4832a800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:36:28.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.672+0000 7fec4832a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9 2023-12-03T11:36:28.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.672+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo[ngm764HNlYcaQPxGPNG0ydP6HCCzl1o] 2023-12-03T11:36:28.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.672+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9.0 2023-12-03T11:36:28.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.672+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34019910 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.673+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to j5rdx62ux4l4k1kbbn613wvpqhc1d6yu 2023-12-03T11:36:28.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.673+0000 7fec4832a800 20 get_obj_state_impl: setting s->olh_tag to 26m38uscg6zdhd5623p32ph3gdcnp0lg 2023-12-03T11:36:28.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.673+0000 7fec4832a800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=26m38uscg6zdhd5623p32ph3gdcnp0lg 2023-12-03T11:36:28.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.674+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9.0 2023-12-03T11:36:28.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.675+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9.0 2023-12-03T11:36:28.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.676+0000 7fec4832a800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2023-12-03T11:36:28.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.676+0000 7fec4832a800 20 olh_log_entry: epoch=3 op=3 key=foo[ngm764HNlYcaQPxGPNG0ydP6HCCzl1o] 2023-12-03T11:36:28.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.676+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34019910 obj=test-client.0-r-test-multipart-index-versioning.1:_:ngm764HNlYcaQPxGPNG0ydP6HCCzl1o_foo state=0x55a07f149008 s->prefetch_data=0 2023-12-03T11:36:28.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.676+0000 7fec4832a800 10 manifest: total_size = 26082 2023-12-03T11:36:28.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.676+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.17545548839326365404 2023-12-03T11:36:28.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.676+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34019910 obj=test-client.0-r-test-multipart-index-versioning.1:_:ngm764HNlYcaQPxGPNG0ydP6HCCzl1o_foo state=0x55a07f149008 s->prefetch_data=0 2023-12-03T11:36:28.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.676+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f149008 2023-12-03T11:36:28.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.676+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9.0 2023-12-03T11:36:28.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2023-12-03T11:36:28.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7672 2023-12-03T11:36:28.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7672 2023-12-03T11:36:28.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2023-12-03T11:36:28.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4201976 part_ofs=7672 rule->part_size=7672 2023-12-03T11:36:28.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=15344 stripe_ofs=15344 part_ofs=15344 rule->part_size=7671 2023-12-03T11:36:28.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2023-12-03T11:36:28.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4209648 part_ofs=15344 rule->part_size=7671 2023-12-03T11:36:28.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=23015 stripe_ofs=23015 part_ofs=23015 rule->part_size=3067 2023-12-03T11:36:28.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=3 2023-12-03T11:36:28.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4217319 part_ofs=23015 rule->part_size=3067 2023-12-03T11:36:28.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=26082 stripe_ofs=26082 part_ofs=26082 rule->part_size=3067 2023-12-03T11:36:28.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.17545548839326365404 2023-12-03T11:36:28.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9__multipart_foo.2~d_6Jp2MPaiBCGNRMBj2_k73oLR8_31x.1 2023-12-03T11:36:28.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2023-12-03T11:36:28.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9__multipart_foo.2~d_6Jp2MPaiBCGNRMBj2_k73oLR8_31x.2 2023-12-03T11:36:28.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 589 2023-12-03T11:36:28.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9__multipart_foo.2~d_6Jp2MPaiBCGNRMBj2_k73oLR8_31x.3 2023-12-03T11:36:28.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 833 2023-12-03T11:36:28.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9__multipart_foo.2~d_6Jp2MPaiBCGNRMBj2_k73oLR8_31x.4 2023-12-03T11:36:28.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1077 2023-12-03T11:36:28.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.679+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.17545548839326365404 2023-12-03T11:36:28.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.680+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=foo[ngm764HNlYcaQPxGPNG0ydP6HCCzl1o] 2023-12-03T11:36:28.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.681+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34019910 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.683+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9.0 2023-12-03T11:36:28.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.684+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9.0 2023-12-03T11:36:28.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.684+0000 7fec4832a800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:36:28.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.684+0000 7fec4832a800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:36:28.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.684+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:36:28.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.684+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:36:28.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.684+0000 7fec4832a800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:36:28.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.684+0000 7fec4832a800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:36:28.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.684+0000 7fec4832a800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9])"; uploads.size()=0; is_truncated=0 2023-12-03T11:36:28.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.685+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2023-12-03T11:36:28.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.685+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.686+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=235 2023-12-03T11:36:28.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.686+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2023-12-03T11:36:28.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.686+0000 7fec4832a800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2023-12-03T11:36:28.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.686+0000 7fec4832a800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2023-12-03T11:36:28.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.686+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2023-12-03T11:36:28.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.686+0000 7fec2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693198 cookie 94147814641472 notifier 5756 bl.length()=193 2023-12-03T11:36:28.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.687+0000 7fec4832a800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9 from cache 2023-12-03T11:36:28.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.687+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9, ofs0, ns] 2023-12-03T11:36:28.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.688+0000 7fec2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693239 cookie 94147812151120 notifier 5756 bl.length()=250 2023-12-03T11:36:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.691+0000 7fec4832a800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9 : miss 2023-12-03T11:36:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.691+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.691+0000 7fec4832a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.691+0000 7fec4832a800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9 info.flags=0x0 2023-12-03T11:36:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.691+0000 7fec4832a800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9 to cache LRU end 2023-12-03T11:36:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.691+0000 7fec4832a800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9 from cache 2023-12-03T11:36:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.691+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9, ofs0, ns] 2023-12-03T11:36:28.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.691+0000 7fec2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693215 cookie 140652529188864 notifier 5756 bl.length()=247 2023-12-03T11:36:28.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.694+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.8 : miss 2023-12-03T11:36:28.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.694+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.694+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=399 2023-12-03T11:36:28.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.694+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.8 info.flags=0x17 2023-12-03T11:36:28.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.694+0000 7fec4832a800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.8 to cache LRU end 2023-12-03T11:36:28.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.694+0000 7fec4832a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:36:28.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.694+0000 7fec4832a800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:36:28.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.694+0000 7fec4832a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.8 2023-12-03T11:36:28.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.695+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo 2023-12-03T11:36:28.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.695+0000 7fec4832a800 20 get_obj_state: octx=0x7fec380c7450 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.695+0000 7fec4832a800 10 manifest: total_size = 26080 2023-12-03T11:36:28.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.695+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.11555830209973298190 2023-12-03T11:36:28.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.695+0000 7fec4832a800 20 get_obj_state: octx=0x7fec380c7450 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.695+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f13d108 2023-12-03T11:36:28.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.695+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.8.0 2023-12-03T11:36:28.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.697+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2023-12-03T11:36:28.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.697+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7672 2023-12-03T11:36:28.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.697+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7670 2023-12-03T11:36:28.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.697+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2023-12-03T11:36:28.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.697+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4201976 part_ofs=7672 rule->part_size=7670 2023-12-03T11:36:28.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.697+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=7671 2023-12-03T11:36:28.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.697+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2023-12-03T11:36:28.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.697+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4209646 part_ofs=15342 rule->part_size=7671 2023-12-03T11:36:28.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.697+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=23013 stripe_ofs=23013 part_ofs=23013 rule->part_size=3067 2023-12-03T11:36:28.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.697+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2023-12-03T11:36:28.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.697+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4217317 part_ofs=23013 rule->part_size=3067 2023-12-03T11:36:28.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.697+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=26080 stripe_ofs=26080 part_ofs=26080 rule->part_size=3067 2023-12-03T11:36:28.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.697+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.11555830209973298190 2023-12-03T11:36:28.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.698+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.698+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.8__multipart_foo.2~kZLV1mMAsIx-ZJx2IFGENleK5tXGjEc.1 2023-12-03T11:36:28.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.698+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2023-12-03T11:36:28.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.698+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.8__multipart_foo.2~kZLV1mMAsIx-ZJx2IFGENleK5tXGjEc.2 2023-12-03T11:36:28.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.698+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 589 2023-12-03T11:36:28.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.698+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.8__multipart_foo.2~kZLV1mMAsIx-ZJx2IFGENleK5tXGjEc.3 2023-12-03T11:36:28.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.698+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 833 2023-12-03T11:36:28.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.698+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.8__multipart_foo.2~kZLV1mMAsIx-ZJx2IFGENleK5tXGjEc.4 2023-12-03T11:36:28.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.698+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1077 2023-12-03T11:36:28.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.698+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.698+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.11555830209973298190 2023-12-03T11:36:28.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.699+0000 7fec2affd640 20 handle_completion(): completion ok for obj=foo 2023-12-03T11:36:28.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.699+0000 7fec4832a800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:36:28.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.699+0000 7fec4832a800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:36:28.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.699+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:36:28.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.699+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:36:28.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.699+0000 7fec4832a800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:36:28.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.699+0000 7fec4832a800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:36:28.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.699+0000 7fec4832a800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.8])"; uploads.size()=0; is_truncated=0 2023-12-03T11:36:28.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.701+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2023-12-03T11:36:28.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.701+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.701+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=225 2023-12-03T11:36:28.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.701+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2023-12-03T11:36:28.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.701+0000 7fec4832a800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2023-12-03T11:36:28.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.701+0000 7fec4832a800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2023-12-03T11:36:28.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.701+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2023-12-03T11:36:28.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.701+0000 7fec2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693216 cookie 94147814647504 notifier 5756 bl.length()=183 2023-12-03T11:36:28.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.703+0000 7fec4832a800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.8 from cache 2023-12-03T11:36:28.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.703+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.8, ofs0, ns] 2023-12-03T11:36:28.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.703+0000 7fec2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693206 cookie 94147814644928 notifier 5756 bl.length()=240 2023-12-03T11:36:28.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.705+0000 7fec4832a800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.8 : miss 2023-12-03T11:36:28.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.705+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.706+0000 7fec4832a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:28.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.706+0000 7fec4832a800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.8 info.flags=0x0 2023-12-03T11:36:28.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.706+0000 7fec4832a800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.8 to cache LRU end 2023-12-03T11:36:28.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.706+0000 7fec4832a800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.8 from cache 2023-12-03T11:36:28.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.706+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-multipart-simple.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.8, ofs0, ns] 2023-12-03T11:36:28.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.706+0000 7fec2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693199 cookie 94147814641472 notifier 5756 bl.length()=237 2023-12-03T11:36:28.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.708+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14 : miss 2023-12-03T11:36:28.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.708+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.709+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=407 2023-12-03T11:36:28.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.709+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14 info.flags=0x17 2023-12-03T11:36:28.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.709+0000 7fec4832a800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14 to cache LRU end 2023-12-03T11:36:28.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.709+0000 7fec4832a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:36:28.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.709+0000 7fec4832a800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:36:28.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.709+0000 7fec4832a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14 2023-12-03T11:36:28.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.710+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-FROZEN 2023-12-03T11:36:28.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.710+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2023-12-03T11:36:28.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.710+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2023-12-03T11:36:28.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.710+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2023-12-03T11:36:28.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.710+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2023-12-03T11:36:28.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.710+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2023-12-03T11:36:28.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.710+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2023-12-03T11:36:28.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.710+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2023-12-03T11:36:28.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.710+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-STANDARD 2023-12-03T11:36:28.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.710+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2023-12-03T11:36:28.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.710+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2023-12-03T11:36:28.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.710+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2023-12-03T11:36:28.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.710+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34047e10 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.711+0000 7fec4832a800 10 manifest: total_size = 5242880 2023-12-03T11:36:28.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.711+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.7925414971850557585 2023-12-03T11:36:28.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.711+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34047e10 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.711+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f13d108 2023-12-03T11:36:28.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.711+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14.0 2023-12-03T11:36:28.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.713+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.713+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.713+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.713+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.713+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.7925414971850557585 2023-12-03T11:36:28.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.713+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.713+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.hE0IhaDifyj-uLSifn0qsr9WZTIxJRX_0 2023-12-03T11:36:28.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.713+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2023-12-03T11:36:28.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.713+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.hE0IhaDifyj-uLSifn0qsr9WZTIxJRX_1 2023-12-03T11:36:28.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.713+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2023-12-03T11:36:28.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.713+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.713+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.7925414971850557585 2023-12-03T11:36:28.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.714+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2023-12-03T11:36:28.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.715+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3402ce30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.715+0000 7fec4832a800 10 manifest: total_size = 5242880 2023-12-03T11:36:28.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.715+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.715+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.715+0000 7fec4832a800 10 generate_fake_tag new tag=ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.hE0IhaDifyj-uLSifn0qsr9WZTIxJRX_1_6a9dfe91a6fc057b73d0ea5d3b77be5c 2023-12-03T11:36:28.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.715+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.hE0IhaDifyj-uLSifn0qsr9WZTIxJRX_1_6a9dfe91a6fc057b73d0ea5d3b77be5c 2023-12-03T11:36:28.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.715+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3402ce30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.715+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f13d108 2023-12-03T11:36:28.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.715+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14.0 2023-12-03T11:36:28.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.717+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.717+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.717+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.717+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.717+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.hE0IhaDifyj-uLSifn0qsr9WZTIxJRX_1_6a9dfe91a6fc057b73d0ea5d3b77be5c 2023-12-03T11:36:28.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.717+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.717+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.hE0IhaDifyj-uLSifn0qsr9WZTIxJRX_0 2023-12-03T11:36:28.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.717+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 396 2023-12-03T11:36:28.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.717+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.hE0IhaDifyj-uLSifn0qsr9WZTIxJRX_1 2023-12-03T11:36:28.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.717+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2023-12-03T11:36:28.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.717+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.717+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.hE0IhaDifyj-uLSifn0qsr9WZTIxJRX_1_6a9dfe91a6fc057b73d0ea5d3b77be5c 2023-12-03T11:36:28.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.718+0000 7fec2affd640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2023-12-03T11:36:28.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.718+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3402ce30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.719+0000 7fec4832a800 10 manifest: total_size = 5242880 2023-12-03T11:36:28.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.719+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to _KFCdW6YJ6GiwbOqLOv--ZcxEoLX3h3D 2023-12-03T11:36:28.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.719+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3402ce30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.719+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f13d108 2023-12-03T11:36:28.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.719+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14.0 2023-12-03T11:36:28.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.721+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.721+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.721+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.721+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.721+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: _KFCdW6YJ6GiwbOqLOv--ZcxEoLX3h3D 2023-12-03T11:36:28.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.721+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.721+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.YcRVrY5kxZIYT3o38Zpl9Bc6WEDGH7X_0 2023-12-03T11:36:28.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.721+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2023-12-03T11:36:28.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.721+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.YcRVrY5kxZIYT3o38Zpl9Bc6WEDGH7X_1 2023-12-03T11:36:28.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.721+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2023-12-03T11:36:28.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.721+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.721+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _KFCdW6YJ6GiwbOqLOv--ZcxEoLX3h3D 2023-12-03T11:36:28.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.722+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2023-12-03T11:36:28.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.722+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3402ce30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.723+0000 7fec4832a800 10 manifest: total_size = 5242880 2023-12-03T11:36:28.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.723+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to _YXX_WEE5aPjjvsy7J6HF3MEpoX1_kB8 2023-12-03T11:36:28.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.723+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3402ce30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.723+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f13d108 2023-12-03T11:36:28.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.723+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14.0 2023-12-03T11:36:28.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.725+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.725+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.725+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: _YXX_WEE5aPjjvsy7J6HF3MEpoX1_kB8 2023-12-03T11:36:28.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.725+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.725+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.0tp963Q3nbsr3qmaVlMUAxrYhoq3aoV_1 2023-12-03T11:36:28.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.725+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2023-12-03T11:36:28.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.725+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.725+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _YXX_WEE5aPjjvsy7J6HF3MEpoX1_kB8 2023-12-03T11:36:28.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.726+0000 7fec2affd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2023-12-03T11:36:28.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.727+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34019910 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.727+0000 7fec4832a800 10 manifest: total_size = 5242880 2023-12-03T11:36:28.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.727+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.5310989475983401622 2023-12-03T11:36:28.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.727+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34019910 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.727+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f13d108 2023-12-03T11:36:28.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.727+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14.0 2023-12-03T11:36:28.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.729+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.729+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.729+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.729+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.729+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.5310989475983401622 2023-12-03T11:36:28.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.729+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.729+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.D9h1gFNBW9ggLc4wJgTSkVywSNQ5PDD_0 2023-12-03T11:36:28.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.729+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2023-12-03T11:36:28.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.729+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.D9h1gFNBW9ggLc4wJgTSkVywSNQ5PDD_1 2023-12-03T11:36:28.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.729+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2023-12-03T11:36:28.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.729+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.729+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.5310989475983401622 2023-12-03T11:36:28.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.730+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2023-12-03T11:36:28.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.731+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3402ce30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.731+0000 7fec4832a800 10 manifest: total_size = 5242880 2023-12-03T11:36:28.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.731+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to _HjPamC5MASxj3wahiikfnIh_sCXZ8hx 2023-12-03T11:36:28.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.731+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3402ce30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.731+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f13d108 2023-12-03T11:36:28.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.731+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14.0 2023-12-03T11:36:28.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.734+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.734+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.734+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.734+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.734+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: _HjPamC5MASxj3wahiikfnIh_sCXZ8hx 2023-12-03T11:36:28.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.734+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.734+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_._RaQBdhrhgcD7irJwM-MKGlCPdnDInv_0 2023-12-03T11:36:28.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.734+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2023-12-03T11:36:28.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.734+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_._RaQBdhrhgcD7irJwM-MKGlCPdnDInv_1 2023-12-03T11:36:28.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.734+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2023-12-03T11:36:28.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.734+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.734+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _HjPamC5MASxj3wahiikfnIh_sCXZ8hx 2023-12-03T11:36:28.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.735+0000 7fec2affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2023-12-03T11:36:28.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.735+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34019910 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.736+0000 7fec4832a800 10 manifest: total_size = 5242880 2023-12-03T11:36:28.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.736+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.736+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.736+0000 7fec4832a800 10 generate_fake_tag new tag=ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.D9h1gFNBW9ggLc4wJgTSkVywSNQ5PDD_1_1185a456eb67558dde9f6d5c640d5ec3 2023-12-03T11:36:28.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.736+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.D9h1gFNBW9ggLc4wJgTSkVywSNQ5PDD_1_1185a456eb67558dde9f6d5c640d5ec3 2023-12-03T11:36:28.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.736+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34019910 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.736+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f13d108 2023-12-03T11:36:28.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.736+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14.0 2023-12-03T11:36:28.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.738+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.738+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.738+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.738+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.738+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.D9h1gFNBW9ggLc4wJgTSkVywSNQ5PDD_1_1185a456eb67558dde9f6d5c640d5ec3 2023-12-03T11:36:28.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.738+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.738+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.D9h1gFNBW9ggLc4wJgTSkVywSNQ5PDD_0 2023-12-03T11:36:28.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.738+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 398 2023-12-03T11:36:28.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.738+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.D9h1gFNBW9ggLc4wJgTSkVywSNQ5PDD_1 2023-12-03T11:36:28.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.738+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 637 2023-12-03T11:36:28.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.738+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.738+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.D9h1gFNBW9ggLc4wJgTSkVywSNQ5PDD_1_1185a456eb67558dde9f6d5c640d5ec3 2023-12-03T11:36:28.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.739+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2023-12-03T11:36:28.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.739+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3402ce30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.740+0000 7fec4832a800 10 manifest: total_size = 5242880 2023-12-03T11:36:28.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.740+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to _PIc52q_4vk5oppIDy-ywaKx6Axeu5ti 2023-12-03T11:36:28.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.740+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3402ce30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.740+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f13d108 2023-12-03T11:36:28.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.740+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14.0 2023-12-03T11:36:28.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.742+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.742+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.742+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: _PIc52q_4vk5oppIDy-ywaKx6Axeu5ti 2023-12-03T11:36:28.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.742+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.742+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.2qw5DdKKvt3I1EIcC5sJDvP96DvJSqj_1 2023-12-03T11:36:28.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.742+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2023-12-03T11:36:28.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.742+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.742+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _PIc52q_4vk5oppIDy-ywaKx6Axeu5ti 2023-12-03T11:36:28.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.743+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3c001670 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.743+0000 7fec2affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2023-12-03T11:36:28.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.744+0000 7fec4832a800 10 manifest: total_size = 5242880 2023-12-03T11:36:28.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.744+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.6841886426244023594 2023-12-03T11:36:28.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.744+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3c001670 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.744+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f13d108 2023-12-03T11:36:28.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.744+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14.0 2023-12-03T11:36:28.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.746+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.746+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.746+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.6841886426244023594 2023-12-03T11:36:28.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.746+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.746+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.-wC8iZz0wOpq6d2qiYcX1FmUwyogqiX_1 2023-12-03T11:36:28.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.746+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2023-12-03T11:36:28.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.746+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.746+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.6841886426244023594 2023-12-03T11:36:28.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.747+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2023-12-03T11:36:28.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.747+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34019910 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.748+0000 7fec4832a800 10 manifest: total_size = 5242880 2023-12-03T11:36:28.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.748+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to _UMIXUt7fiOyWkbL5BW2WAWCqNNA8FJm 2023-12-03T11:36:28.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.748+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34019910 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.748+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f13d108 2023-12-03T11:36:28.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.748+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14.0 2023-12-03T11:36:28.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.750+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.750+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.750+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.750+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.750+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: _UMIXUt7fiOyWkbL5BW2WAWCqNNA8FJm 2023-12-03T11:36:28.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.750+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.750+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.9nsQAu1Hq-sZ28fa4p5r0fEb7rpP7FC_0 2023-12-03T11:36:28.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.750+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2023-12-03T11:36:28.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.750+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.9nsQAu1Hq-sZ28fa4p5r0fEb7rpP7FC_1 2023-12-03T11:36:28.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.750+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2023-12-03T11:36:28.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.750+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.750+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _UMIXUt7fiOyWkbL5BW2WAWCqNNA8FJm 2023-12-03T11:36:28.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.752+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3402ce30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.752+0000 7fec2affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2023-12-03T11:36:28.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.752+0000 7fec4832a800 10 manifest: total_size = 5242880 2023-12-03T11:36:28.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.752+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to _Pn7dPxXxIE_FKEnIADqmBTpwX81VwgS 2023-12-03T11:36:28.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.752+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3402ce30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.752+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f13d108 2023-12-03T11:36:28.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.752+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14.0 2023-12-03T11:36:28.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.754+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.754+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.754+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.754+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.754+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: _Pn7dPxXxIE_FKEnIADqmBTpwX81VwgS 2023-12-03T11:36:28.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.754+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.754+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.mcURseV0ZRIt1lYpZytbNuuRtLsmCtL_0 2023-12-03T11:36:28.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.754+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2023-12-03T11:36:28.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.754+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.mcURseV0ZRIt1lYpZytbNuuRtLsmCtL_1 2023-12-03T11:36:28.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.754+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2023-12-03T11:36:28.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.754+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.754+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _Pn7dPxXxIE_FKEnIADqmBTpwX81VwgS 2023-12-03T11:36:28.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.756+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2023-12-03T11:36:28.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.756+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3c001670 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.756+0000 7fec4832a800 10 manifest: total_size = 5242880 2023-12-03T11:36:28.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.756+0000 7fec4832a800 10 generate_fake_tag new tag=ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.-wC8iZz0wOpq6d2qiYcX1FmUwyogqiX_1_83e2abb05daa084ced31185e291951f2 2023-12-03T11:36:28.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.756+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.-wC8iZz0wOpq6d2qiYcX1FmUwyogqiX_1_83e2abb05daa084ced31185e291951f2 2023-12-03T11:36:28.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.756+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3c001670 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55a07f13d108 s->prefetch_data=0 2023-12-03T11:36:28.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.756+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f13d108 2023-12-03T11:36:28.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.756+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14.0 2023-12-03T11:36:28.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.759+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.759+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.759+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.-wC8iZz0wOpq6d2qiYcX1FmUwyogqiX_1_83e2abb05daa084ced31185e291951f2 2023-12-03T11:36:28.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.759+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.759+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.-wC8iZz0wOpq6d2qiYcX1FmUwyogqiX_1 2023-12-03T11:36:28.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.759+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 389 2023-12-03T11:36:28.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.759+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.759+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.-wC8iZz0wOpq6d2qiYcX1FmUwyogqiX_1_83e2abb05daa084ced31185e291951f2 2023-12-03T11:36:28.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.761+0000 7fec2affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2023-12-03T11:36:28.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.761+0000 7fec4832a800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:36:28.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.761+0000 7fec4832a800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:36:28.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.761+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:36:28.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.761+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:36:28.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.761+0000 7fec4832a800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:36:28.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.761+0000 7fec4832a800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:36:28.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.761+0000 7fec4832a800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14])"; uploads.size()=0; is_truncated=0 2023-12-03T11:36:28.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.763+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2023-12-03T11:36:28.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.763+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.763+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=233 2023-12-03T11:36:28.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.763+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2023-12-03T11:36:28.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.763+0000 7fec4832a800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2023-12-03T11:36:28.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.763+0000 7fec4832a800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2023-12-03T11:36:28.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.763+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2023-12-03T11:36:28.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.764+0000 7fec2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693200 cookie 94147814641472 notifier 5756 bl.length()=189 2023-12-03T11:36:28.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.765+0000 7fec4832a800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14 from cache 2023-12-03T11:36:28.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.765+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14, ofs0, ns] 2023-12-03T11:36:28.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.766+0000 7fec2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693217 cookie 94147814647504 notifier 5756 bl.length()=247 2023-12-03T11:36:28.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.768+0000 7fec4832a800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14 : miss 2023-12-03T11:36:28.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.768+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.768+0000 7fec4832a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:28.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.768+0000 7fec4832a800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14 info.flags=0x0 2023-12-03T11:36:28.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.768+0000 7fec4832a800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14 to cache LRU end 2023-12-03T11:36:28.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.768+0000 7fec4832a800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14 from cache 2023-12-03T11:36:28.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.769+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14, ofs0, ns] 2023-12-03T11:36:28.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.769+0000 7fec2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693240 cookie 94147812151120 notifier 5756 bl.length()=244 2023-12-03T11:36:28.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.771+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15 : miss 2023-12-03T11:36:28.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.771+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.772+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=417 2023-12-03T11:36:28.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.772+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15 info.flags=0x17 2023-12-03T11:36:28.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.772+0000 7fec4832a800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15 to cache LRU end 2023-12-03T11:36:28.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.772+0000 7fec4832a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:36:28.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.772+0000 7fec4832a800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:36:28.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.772+0000 7fec4832a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15 2023-12-03T11:36:28.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.773+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-FROZEN 2023-12-03T11:36:28.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.773+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2023-12-03T11:36:28.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.773+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2023-12-03T11:36:28.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.773+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2023-12-03T11:36:28.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.773+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2023-12-03T11:36:28.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.773+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2023-12-03T11:36:28.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.773+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2023-12-03T11:36:28.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.773+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2023-12-03T11:36:28.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.773+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-STANDARD 2023-12-03T11:36:28.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.773+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2023-12-03T11:36:28.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.773+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2023-12-03T11:36:28.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.773+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2023-12-03T11:36:28.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.773+0000 7fec4832a800 20 get_obj_state: octx=0x7fec380c7450 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.773+0000 7fec4832a800 10 manifest: total_size = 11534336 2023-12-03T11:36:28.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.773+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.16687783434326797147 2023-12-03T11:36:28.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.773+0000 7fec4832a800 20 get_obj_state: octx=0x7fec380c7450 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.773+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07efde148 2023-12-03T11:36:28.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.773+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15.0 2023-12-03T11:36:28.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.775+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.775+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.775+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.775+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.775+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.775+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.775+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.775+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.775+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.775+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.775+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.775+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:36:28.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.775+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-12-03T11:36:28.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.775+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:36:28.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.775+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-12-03T11:36:28.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.776+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.16687783434326797147 2023-12-03T11:36:28.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.776+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.776+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.1 2023-12-03T11:36:28.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.776+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2023-12-03T11:36:28.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.776+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.1_1 2023-12-03T11:36:28.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.776+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2023-12-03T11:36:28.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.776+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.2 2023-12-03T11:36:28.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.776+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2023-12-03T11:36:28.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.776+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.2_1 2023-12-03T11:36:28.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.776+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2023-12-03T11:36:28.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.776+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.3 2023-12-03T11:36:28.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.776+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2023-12-03T11:36:28.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.776+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.776+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.16687783434326797147 2023-12-03T11:36:28.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.777+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2023-12-03T11:36:28.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.777+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34047e10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.777+0000 7fec4832a800 10 manifest: total_size = 11534336 2023-12-03T11:36:28.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.777+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.777+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.777+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.777+0000 7fec4832a800 10 generate_fake_tag new tag=ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.1_1_f2da08f3fe9c9c50c2c0d5487b397353 2023-12-03T11:36:28.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.777+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.1_1_f2da08f3fe9c9c50c2c0d5487b397353 2023-12-03T11:36:28.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.777+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34047e10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.777+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07efde148 2023-12-03T11:36:28.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.777+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15.0 2023-12-03T11:36:28.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:36:28.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-12-03T11:36:28.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:36:28.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-12-03T11:36:28.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.1_1_f2da08f3fe9c9c50c2c0d5487b397353 2023-12-03T11:36:28.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.1 2023-12-03T11:36:28.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 440 2023-12-03T11:36:28.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.1_1 2023-12-03T11:36:28.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 705 2023-12-03T11:36:28.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.2 2023-12-03T11:36:28.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 972 2023-12-03T11:36:28.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.2_1 2023-12-03T11:36:28.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1237 2023-12-03T11:36:28.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.3 2023-12-03T11:36:28.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1504 2023-12-03T11:36:28.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.780+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.1_1_f2da08f3fe9c9c50c2c0d5487b397353 2023-12-03T11:36:28.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.782+0000 7fec2affd640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2023-12-03T11:36:28.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.782+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f136f30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.782+0000 7fec4832a800 10 manifest: total_size = 11534336 2023-12-03T11:36:28.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.782+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to _YXJjSvwaiyk53eDbxerAB6p_XNItzu7 2023-12-03T11:36:28.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.782+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f136f30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.782+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07efde148 2023-12-03T11:36:28.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.782+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15.0 2023-12-03T11:36:28.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.785+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.785+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.785+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.785+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.785+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.785+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.785+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: _YXJjSvwaiyk53eDbxerAB6p_XNItzu7 2023-12-03T11:36:28.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.785+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.785+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.SHL6isXdOybGySHPd0pcFNWemDAQKqE_0 2023-12-03T11:36:28.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.785+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2023-12-03T11:36:28.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.785+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.SHL6isXdOybGySHPd0pcFNWemDAQKqE_1 2023-12-03T11:36:28.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.785+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2023-12-03T11:36:28.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.785+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.SHL6isXdOybGySHPd0pcFNWemDAQKqE_2 2023-12-03T11:36:28.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.785+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2023-12-03T11:36:28.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.785+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.785+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _YXJjSvwaiyk53eDbxerAB6p_XNItzu7 2023-12-03T11:36:28.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.786+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2023-12-03T11:36:28.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.786+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34047e10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.786+0000 7fec4832a800 10 manifest: total_size = 11534336 2023-12-03T11:36:28.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.786+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to _JV--RqO2Rs6kgfJf3nWdAvkAM7nxQl3 2023-12-03T11:36:28.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.786+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34047e10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.786+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07efde148 2023-12-03T11:36:28.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.786+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15.0 2023-12-03T11:36:28.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.789+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.789+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.789+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.789+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.789+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: _JV--RqO2Rs6kgfJf3nWdAvkAM7nxQl3 2023-12-03T11:36:28.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.789+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.789+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.1_btFogcO5neU067WRPa-8fIWOLbOsQ_1 2023-12-03T11:36:28.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.789+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2023-12-03T11:36:28.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.789+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.1_btFogcO5neU067WRPa-8fIWOLbOsQ_2 2023-12-03T11:36:28.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.789+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2023-12-03T11:36:28.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.789+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.789+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _JV--RqO2Rs6kgfJf3nWdAvkAM7nxQl3 2023-12-03T11:36:28.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.790+0000 7fec2affd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2023-12-03T11:36:28.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.790+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3c001670 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.791+0000 7fec4832a800 10 manifest: total_size = 11534336 2023-12-03T11:36:28.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.791+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.631626898493404941 2023-12-03T11:36:28.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.791+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3c001670 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.791+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07efde148 2023-12-03T11:36:28.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.791+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15.0 2023-12-03T11:36:28.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:36:28.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-12-03T11:36:28.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:36:28.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-12-03T11:36:28.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.631626898493404941 2023-12-03T11:36:28.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.1 2023-12-03T11:36:28.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 372 2023-12-03T11:36:28.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.1_1 2023-12-03T11:36:28.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 643 2023-12-03T11:36:28.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.2 2023-12-03T11:36:28.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 916 2023-12-03T11:36:28.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.2_1 2023-12-03T11:36:28.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1187 2023-12-03T11:36:28.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.3 2023-12-03T11:36:28.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1460 2023-12-03T11:36:28.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.793+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.631626898493404941 2023-12-03T11:36:28.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.794+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2023-12-03T11:36:28.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.794+0000 7fec4832a800 20 get_obj_state: octx=0x7fec380c7450 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.795+0000 7fec4832a800 10 manifest: total_size = 11534336 2023-12-03T11:36:28.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.795+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to _5QxsiQY1m02WFCxmDlMLvbgWChfHCHP 2023-12-03T11:36:28.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.795+0000 7fec4832a800 20 get_obj_state: octx=0x7fec380c7450 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.795+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07efde148 2023-12-03T11:36:28.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.795+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15.0 2023-12-03T11:36:28.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.797+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.797+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.797+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.797+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.797+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.797+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.797+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: _5QxsiQY1m02WFCxmDlMLvbgWChfHCHP 2023-12-03T11:36:28.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.797+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.797+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.aQ2SLiEhhLd4qw6j3lM77wgW0KDTdbl_0 2023-12-03T11:36:28.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.797+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2023-12-03T11:36:28.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.797+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.aQ2SLiEhhLd4qw6j3lM77wgW0KDTdbl_1 2023-12-03T11:36:28.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.797+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2023-12-03T11:36:28.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.797+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.aQ2SLiEhhLd4qw6j3lM77wgW0KDTdbl_2 2023-12-03T11:36:28.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.797+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2023-12-03T11:36:28.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.797+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.797+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _5QxsiQY1m02WFCxmDlMLvbgWChfHCHP 2023-12-03T11:36:28.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.798+0000 7fec2affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2023-12-03T11:36:28.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.798+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34047e10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.798+0000 7fec4832a800 10 manifest: total_size = 11534336 2023-12-03T11:36:28.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.798+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.798+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.798+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.798+0000 7fec4832a800 10 generate_fake_tag new tag=ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.1_1_0f9ee03b3f24bf3d677231b0d4755470 2023-12-03T11:36:28.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.798+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.1_1_0f9ee03b3f24bf3d677231b0d4755470 2023-12-03T11:36:28.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.798+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34047e10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.798+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07efde148 2023-12-03T11:36:28.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.798+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15.0 2023-12-03T11:36:28.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:36:28.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-12-03T11:36:28.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:36:28.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-12-03T11:36:28.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.1_1_0f9ee03b3f24bf3d677231b0d4755470 2023-12-03T11:36:28.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.1 2023-12-03T11:36:28.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 448 2023-12-03T11:36:28.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.1_1 2023-12-03T11:36:28.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 719 2023-12-03T11:36:28.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.2 2023-12-03T11:36:28.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 992 2023-12-03T11:36:28.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.2_1 2023-12-03T11:36:28.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1263 2023-12-03T11:36:28.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.3 2023-12-03T11:36:28.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1536 2023-12-03T11:36:28.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.801+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.1_1_0f9ee03b3f24bf3d677231b0d4755470 2023-12-03T11:36:28.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.802+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2023-12-03T11:36:28.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.802+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34019910 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.803+0000 7fec4832a800 10 manifest: total_size = 11534336 2023-12-03T11:36:28.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.803+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to _ZEeYsa3VP2RPdRmSJ9T6ENDqad0L-GC 2023-12-03T11:36:28.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.803+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34019910 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.803+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07efde148 2023-12-03T11:36:28.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.803+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15.0 2023-12-03T11:36:28.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.805+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.805+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.805+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.805+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.805+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: _ZEeYsa3VP2RPdRmSJ9T6ENDqad0L-GC 2023-12-03T11:36:28.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.805+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.805+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.-hu2PS74923_mtosF0XkjUS-pA6EAC7_1 2023-12-03T11:36:28.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.805+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2023-12-03T11:36:28.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.805+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.-hu2PS74923_mtosF0XkjUS-pA6EAC7_2 2023-12-03T11:36:28.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.805+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2023-12-03T11:36:28.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.805+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.805+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _ZEeYsa3VP2RPdRmSJ9T6ENDqad0L-GC 2023-12-03T11:36:28.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.806+0000 7fec2affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2023-12-03T11:36:28.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.806+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34047e10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.807+0000 7fec4832a800 10 manifest: total_size = 11534336 2023-12-03T11:36:28.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.807+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.14694426577960200789 2023-12-03T11:36:28.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.807+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34047e10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.807+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07efde148 2023-12-03T11:36:28.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.807+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15.0 2023-12-03T11:36:28.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:36:28.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-12-03T11:36:28.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:36:28.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-12-03T11:36:28.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.14694426577960200789 2023-12-03T11:36:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.1 2023-12-03T11:36:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2023-12-03T11:36:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.1_1 2023-12-03T11:36:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 627 2023-12-03T11:36:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.2 2023-12-03T11:36:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 891 2023-12-03T11:36:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.2_1 2023-12-03T11:36:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1153 2023-12-03T11:36:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.3 2023-12-03T11:36:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1417 2023-12-03T11:36:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.810+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.14694426577960200789 2023-12-03T11:36:28.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.811+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2023-12-03T11:36:28.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.812+0000 7fec4832a800 20 get_obj_state: octx=0x7fec380c7450 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.812+0000 7fec4832a800 10 manifest: total_size = 11534336 2023-12-03T11:36:28.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.812+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to _wBZXE3JQs4n2RL_tom_m4D8KCSVrBw0 2023-12-03T11:36:28.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.812+0000 7fec4832a800 20 get_obj_state: octx=0x7fec380c7450 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.812+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07efde148 2023-12-03T11:36:28.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.812+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15.0 2023-12-03T11:36:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.815+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.815+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.815+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.815+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.815+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.815+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.815+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: _wBZXE3JQs4n2RL_tom_m4D8KCSVrBw0 2023-12-03T11:36:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.815+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.815+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.ELCejSM4f68kSELjiJnOXJuFI-P6m3r_0 2023-12-03T11:36:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.815+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2023-12-03T11:36:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.815+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.ELCejSM4f68kSELjiJnOXJuFI-P6m3r_1 2023-12-03T11:36:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.815+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2023-12-03T11:36:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.815+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.ELCejSM4f68kSELjiJnOXJuFI-P6m3r_2 2023-12-03T11:36:28.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.815+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2023-12-03T11:36:28.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.815+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.815+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _wBZXE3JQs4n2RL_tom_m4D8KCSVrBw0 2023-12-03T11:36:28.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.816+0000 7fec2affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2023-12-03T11:36:28.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.817+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3c06beb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.817+0000 7fec4832a800 10 manifest: total_size = 11534336 2023-12-03T11:36:28.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.817+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to _nI3qJ0fL-r_TjDRtPbtpriSjDJfvT1R 2023-12-03T11:36:28.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.817+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3c06beb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.817+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07efde148 2023-12-03T11:36:28.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.817+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15.0 2023-12-03T11:36:28.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.820+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.820+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.820+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.820+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.820+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.820+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.820+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: _nI3qJ0fL-r_TjDRtPbtpriSjDJfvT1R 2023-12-03T11:36:28.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.820+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.820+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.bIZndDBQPRKgNz3MoLkR4cxyN1B0JJo_0 2023-12-03T11:36:28.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.820+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2023-12-03T11:36:28.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.820+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.bIZndDBQPRKgNz3MoLkR4cxyN1B0JJo_1 2023-12-03T11:36:28.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.820+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2023-12-03T11:36:28.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.820+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.bIZndDBQPRKgNz3MoLkR4cxyN1B0JJo_2 2023-12-03T11:36:28.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.820+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2023-12-03T11:36:28.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.820+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.820+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _nI3qJ0fL-r_TjDRtPbtpriSjDJfvT1R 2023-12-03T11:36:28.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.821+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2023-12-03T11:36:28.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.821+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3c001670 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.821+0000 7fec4832a800 10 manifest: total_size = 11534336 2023-12-03T11:36:28.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.821+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.821+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.821+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.821+0000 7fec4832a800 10 generate_fake_tag new tag=ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.1_1_1a4ee8236fadd2d2055d61a226b899ea 2023-12-03T11:36:28.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.821+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.1_1_1a4ee8236fadd2d2055d61a226b899ea 2023-12-03T11:36:28.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.821+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3c001670 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55a07efde148 s->prefetch_data=0 2023-12-03T11:36:28.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.821+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07efde148 2023-12-03T11:36:28.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.821+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15.0 2023-12-03T11:36:28.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:36:28.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-12-03T11:36:28.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:36:28.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-12-03T11:36:28.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.1_1_1a4ee8236fadd2d2055d61a226b899ea 2023-12-03T11:36:28.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.1 2023-12-03T11:36:28.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 439 2023-12-03T11:36:28.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.1_1 2023-12-03T11:36:28.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 701 2023-12-03T11:36:28.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.2 2023-12-03T11:36:28.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 965 2023-12-03T11:36:28.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.2_1 2023-12-03T11:36:28.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1227 2023-12-03T11:36:28.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.3 2023-12-03T11:36:28.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1491 2023-12-03T11:36:28.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.825+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.1_1_1a4ee8236fadd2d2055d61a226b899ea 2023-12-03T11:36:28.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.826+0000 7fec2affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2023-12-03T11:36:28.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.826+0000 7fec4832a800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:36:28.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.826+0000 7fec4832a800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:36:28.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.826+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:36:28.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.826+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:36:28.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.826+0000 7fec4832a800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:36:28.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.826+0000 7fec4832a800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:36:28.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.826+0000 7fec4832a800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15])"; uploads.size()=0; is_truncated=0 2023-12-03T11:36:28.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.828+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2023-12-03T11:36:28.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.828+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.828+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=243 2023-12-03T11:36:28.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.828+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2023-12-03T11:36:28.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.828+0000 7fec4832a800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2023-12-03T11:36:28.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.828+0000 7fec4832a800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2023-12-03T11:36:28.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.828+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2023-12-03T11:36:28.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.829+0000 7fec2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693207 cookie 94147814644928 notifier 5756 bl.length()=199 2023-12-03T11:36:28.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.830+0000 7fec4832a800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15 from cache 2023-12-03T11:36:28.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.830+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15, ofs0, ns] 2023-12-03T11:36:28.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.831+0000 7fec2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693197 cookie 94147814614784 notifier 5756 bl.length()=257 2023-12-03T11:36:28.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.833+0000 7fec4832a800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15 : miss 2023-12-03T11:36:28.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.833+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.833+0000 7fec4832a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:28.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.833+0000 7fec4832a800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15 info.flags=0x0 2023-12-03T11:36:28.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.833+0000 7fec4832a800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15 to cache LRU end 2023-12-03T11:36:28.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.833+0000 7fec4832a800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15 from cache 2023-12-03T11:36:28.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.833+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15, ofs0, ns] 2023-12-03T11:36:28.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.834+0000 7fec2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693218 cookie 94147814647504 notifier 5756 bl.length()=254 2023-12-03T11:36:28.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.836+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13 : miss 2023-12-03T11:36:28.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.836+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.837+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=412 2023-12-03T11:36:28.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.837+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13 info.flags=0x17 2023-12-03T11:36:28.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.837+0000 7fec4832a800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13 to cache LRU end 2023-12-03T11:36:28.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.837+0000 7fec4832a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:36:28.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.837+0000 7fec4832a800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:36:28.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.837+0000 7fec4832a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13 2023-12-03T11:36:28.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.837+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-FROZEN 2023-12-03T11:36:28.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.837+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2023-12-03T11:36:28.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.837+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-STANDARD 2023-12-03T11:36:28.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.837+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f138180 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55a07f135378 s->prefetch_data=0 2023-12-03T11:36:28.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.838+0000 7fec4832a800 10 manifest: total_size = 11534336 2023-12-03T11:36:28.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.838+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.14005413547435585571 2023-12-03T11:36:28.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.838+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f138180 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55a07f135378 s->prefetch_data=0 2023-12-03T11:36:28.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.838+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f135378 2023-12-03T11:36:28.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.838+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13.0 2023-12-03T11:36:28.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:36:28.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-12-03T11:36:28.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:36:28.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-12-03T11:36:28.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.14005413547435585571 2023-12-03T11:36:28.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__multipart_foo-FROZEN.2~ObSIJA9XRIM-juNj5LpIJ0SJU8eyq1-.1 2023-12-03T11:36:28.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2023-12-03T11:36:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__shadow_foo-FROZEN.2~ObSIJA9XRIM-juNj5LpIJ0SJU8eyq1-.1_1 2023-12-03T11:36:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2023-12-03T11:36:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__multipart_foo-FROZEN.2~ObSIJA9XRIM-juNj5LpIJ0SJU8eyq1-.2 2023-12-03T11:36:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2023-12-03T11:36:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__shadow_foo-FROZEN.2~ObSIJA9XRIM-juNj5LpIJ0SJU8eyq1-.2_1 2023-12-03T11:36:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2023-12-03T11:36:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__multipart_foo-FROZEN.2~ObSIJA9XRIM-juNj5LpIJ0SJU8eyq1-.3 2023-12-03T11:36:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2023-12-03T11:36:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.840+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.14005413547435585571 2023-12-03T11:36:28.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.841+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2023-12-03T11:36:28.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.842+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3c06beb0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55a07f135378 s->prefetch_data=0 2023-12-03T11:36:28.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.842+0000 7fec4832a800 10 manifest: total_size = 11534336 2023-12-03T11:36:28.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.842+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.15165498622313365685 2023-12-03T11:36:28.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.842+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3c06beb0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55a07f135378 s->prefetch_data=0 2023-12-03T11:36:28.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.842+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f135378 2023-12-03T11:36:28.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.842+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13.0 2023-12-03T11:36:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.844+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.844+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.844+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.844+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.844+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2023-12-03T11:36:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.844+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.844+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.844+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.844+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.844+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:36:28.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.844+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:36:28.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.844+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:36:28.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.844+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-12-03T11:36:28.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.844+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:36:28.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.844+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-12-03T11:36:28.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.845+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.15165498622313365685 2023-12-03T11:36:28.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.845+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.845+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__multipart_foo-LUKEWARM.2~Dz3nutPJQF3BSu1zhU5a4RqfoECZEQi.1 2023-12-03T11:36:28.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.845+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2023-12-03T11:36:28.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.845+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__shadow_foo-LUKEWARM.2~Dz3nutPJQF3BSu1zhU5a4RqfoECZEQi.1_1 2023-12-03T11:36:28.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.845+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2023-12-03T11:36:28.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.845+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__multipart_foo-LUKEWARM.2~Dz3nutPJQF3BSu1zhU5a4RqfoECZEQi.2 2023-12-03T11:36:28.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.845+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2023-12-03T11:36:28.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.845+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__shadow_foo-LUKEWARM.2~Dz3nutPJQF3BSu1zhU5a4RqfoECZEQi.2_1 2023-12-03T11:36:28.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.845+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2023-12-03T11:36:28.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.845+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__multipart_foo-LUKEWARM.2~Dz3nutPJQF3BSu1zhU5a4RqfoECZEQi.3 2023-12-03T11:36:28.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.845+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2023-12-03T11:36:28.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.845+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.845+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.15165498622313365685 2023-12-03T11:36:28.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.847+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34059130 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55a07f147108 s->prefetch_data=0 2023-12-03T11:36:28.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.847+0000 7fec2affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2023-12-03T11:36:28.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.847+0000 7fec4832a800 10 manifest: total_size = 1087 2023-12-03T11:36:28.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.847+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.17939752204479921556 2023-12-03T11:36:28.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.847+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34059130 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55a07f147108 s->prefetch_data=0 2023-12-03T11:36:28.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.847+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f147108 2023-12-03T11:36:28.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.847+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13.0 2023-12-03T11:36:28.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.850+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2023-12-03T11:36:28.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.850+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2023-12-03T11:36:28.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.850+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2023-12-03T11:36:28.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.850+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2023-12-03T11:36:28.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.850+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2023-12-03T11:36:28.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.850+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2023-12-03T11:36:28.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.850+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2023-12-03T11:36:28.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.850+0000 7fec4832a800 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=55 2023-12-03T11:36:28.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.850+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2023-12-03T11:36:28.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.850+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.17939752204479921556 2023-12-03T11:36:28.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.850+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.850+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__multipart_foo-STANDARD.2~jrO2GEYLA0xH9IyTGBsOE-pJKpdd7r7.1 2023-12-03T11:36:28.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.850+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2023-12-03T11:36:28.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.850+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__multipart_foo-STANDARD.2~jrO2GEYLA0xH9IyTGBsOE-pJKpdd7r7.2 2023-12-03T11:36:28.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.850+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2023-12-03T11:36:28.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.850+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__multipart_foo-STANDARD.2~jrO2GEYLA0xH9IyTGBsOE-pJKpdd7r7.3 2023-12-03T11:36:28.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.850+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2023-12-03T11:36:28.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.850+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.850+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.17939752204479921556 2023-12-03T11:36:28.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.851+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2023-12-03T11:36:28.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.851+0000 7fec4832a800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:36:28.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.851+0000 7fec4832a800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:36:28.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.852+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:36:28.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.852+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:36:28.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.852+0000 7fec4832a800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:36:28.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.852+0000 7fec4832a800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:36:28.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.852+0000 7fec4832a800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13])"; uploads.size()=0; is_truncated=0 2023-12-03T11:36:28.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.854+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2023-12-03T11:36:28.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.854+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.854+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=238 2023-12-03T11:36:28.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.854+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2023-12-03T11:36:28.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.854+0000 7fec4832a800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2023-12-03T11:36:28.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.854+0000 7fec4832a800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2023-12-03T11:36:28.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.854+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2023-12-03T11:36:28.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.854+0000 7fec2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693265 cookie 94147814610688 notifier 5756 bl.length()=194 2023-12-03T11:36:28.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.856+0000 7fec4832a800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13 from cache 2023-12-03T11:36:28.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.856+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13, ofs0, ns] 2023-12-03T11:36:28.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.856+0000 7fec2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693198 cookie 94147814614784 notifier 5756 bl.length()=252 2023-12-03T11:36:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.859+0000 7fec4832a800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13 : miss 2023-12-03T11:36:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.859+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.859+0000 7fec4832a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.859+0000 7fec4832a800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13 info.flags=0x0 2023-12-03T11:36:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.859+0000 7fec4832a800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13 to cache LRU end 2023-12-03T11:36:28.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.859+0000 7fec4832a800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13 from cache 2023-12-03T11:36:28.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.859+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13, ofs0, ns] 2023-12-03T11:36:28.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.860+0000 7fec2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693219 cookie 94147814647504 notifier 5756 bl.length()=249 2023-12-03T11:36:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.862+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12 : miss 2023-12-03T11:36:28.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.862+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.863+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=402 2023-12-03T11:36:28.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.863+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12 info.flags=0x17 2023-12-03T11:36:28.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.863+0000 7fec4832a800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12 to cache LRU end 2023-12-03T11:36:28.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.863+0000 7fec4832a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:36:28.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.863+0000 7fec4832a800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:36:28.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.863+0000 7fec4832a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12 2023-12-03T11:36:28.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.864+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-FROZEN 2023-12-03T11:36:28.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.864+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2023-12-03T11:36:28.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.864+0000 7fec4832a800 10 cls_bucket_list_unordered: got foo-STANDARD 2023-12-03T11:36:28.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.864+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f140e70 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55a07f134e98 s->prefetch_data=0 2023-12-03T11:36:28.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.864+0000 7fec4832a800 10 manifest: total_size = 10485760 2023-12-03T11:36:28.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.864+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.7272626509401976650 2023-12-03T11:36:28.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.864+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f140e70 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55a07f134e98 s->prefetch_data=0 2023-12-03T11:36:28.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.864+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f134e98 2023-12-03T11:36:28.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.864+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12.0 2023-12-03T11:36:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.866+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.867+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.867+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.867+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.867+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.867+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.867+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.7272626509401976650 2023-12-03T11:36:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.867+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.867+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12__shadow_.7CVv4E6Qj0yRiYuN5fxdgxO1BQbfwjE_0 2023-12-03T11:36:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.867+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2023-12-03T11:36:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.867+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12__shadow_.7CVv4E6Qj0yRiYuN5fxdgxO1BQbfwjE_1 2023-12-03T11:36:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.867+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2023-12-03T11:36:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.867+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12__shadow_.7CVv4E6Qj0yRiYuN5fxdgxO1BQbfwjE_2 2023-12-03T11:36:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.867+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 811 2023-12-03T11:36:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.867+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.867+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.7272626509401976650 2023-12-03T11:36:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.868+0000 7fec2affd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2023-12-03T11:36:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.868+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f140e70 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55a07f134e98 s->prefetch_data=0 2023-12-03T11:36:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.868+0000 7fec4832a800 10 manifest: total_size = 10485760 2023-12-03T11:36:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.868+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.11144776869064333912 2023-12-03T11:36:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.868+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f140e70 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55a07f134e98 s->prefetch_data=0 2023-12-03T11:36:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.868+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f134e98 2023-12-03T11:36:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.868+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12.0 2023-12-03T11:36:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.871+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.871+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.871+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.871+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.871+0000 7fec4832a800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:36:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.871+0000 7fec4832a800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2023-12-03T11:36:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.871+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.11144776869064333912 2023-12-03T11:36:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.871+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:36:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.871+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12__shadow_.0cJqm4SmH6fyd-sd4TZ-G_huWc9OQmH_0 2023-12-03T11:36:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.871+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2023-12-03T11:36:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.871+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12__shadow_.0cJqm4SmH6fyd-sd4TZ-G_huWc9OQmH_1 2023-12-03T11:36:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.871+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2023-12-03T11:36:28.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.871+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12__shadow_.0cJqm4SmH6fyd-sd4TZ-G_huWc9OQmH_2 2023-12-03T11:36:28.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.871+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 818 2023-12-03T11:36:28.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.871+0000 7fec4832a800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:36:28.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.871+0000 7fec4832a800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: ff414afd-0753-48a7-8bb4-762be6d38c82.4641.11144776869064333912 2023-12-03T11:36:28.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.872+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2023-12-03T11:36:28.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.872+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3c070f80 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55a07f140048 s->prefetch_data=0 2023-12-03T11:36:28.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.872+0000 7fec4832a800 10 manifest: total_size = 44258 2023-12-03T11:36:28.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.872+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.3519616912911329569 2023-12-03T11:36:28.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.872+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3c070f80 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55a07f140048 s->prefetch_data=0 2023-12-03T11:36:28.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.872+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f140048 2023-12-03T11:36:28.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.872+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12.0 2023-12-03T11:36:28.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.875+0000 7fec4832a800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:36:28.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.875+0000 7fec4832a800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:36:28.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.876+0000 7fec2affd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2023-12-03T11:36:28.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.876+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:36:28.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.876+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:36:28.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.876+0000 7fec4832a800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:36:28.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.876+0000 7fec4832a800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:36:28.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.876+0000 7fec4832a800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12])"; uploads.size()=0; is_truncated=0 2023-12-03T11:36:28.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.877+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2023-12-03T11:36:28.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.877+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.878+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=228 2023-12-03T11:36:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.878+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2023-12-03T11:36:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.878+0000 7fec4832a800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2023-12-03T11:36:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.878+0000 7fec4832a800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2023-12-03T11:36:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.878+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2023-12-03T11:36:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.878+0000 7fec2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693201 cookie 94147814641472 notifier 5756 bl.length()=184 2023-12-03T11:36:28.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.880+0000 7fec4832a800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12 from cache 2023-12-03T11:36:28.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.880+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12, ofs0, ns] 2023-12-03T11:36:28.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.880+0000 7fec2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693266 cookie 94147814608000 notifier 5756 bl.length()=242 2023-12-03T11:36:28.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.882+0000 7fec4832a800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12 : miss 2023-12-03T11:36:28.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.883+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.883+0000 7fec4832a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:28.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.883+0000 7fec4832a800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12 info.flags=0x0 2023-12-03T11:36:28.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.883+0000 7fec4832a800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12 to cache LRU end 2023-12-03T11:36:28.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.883+0000 7fec4832a800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12 from cache 2023-12-03T11:36:28.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.883+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-obj-storage-class.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12, ofs0, ns] 2023-12-03T11:36:28.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.883+0000 7fec2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693208 cookie 94147814644928 notifier 5756 bl.length()=239 2023-12-03T11:36:28.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.888+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.5 : miss 2023-12-03T11:36:28.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.888+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.888+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=397 2023-12-03T11:36:28.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.888+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.5 info.flags=0x17 2023-12-03T11:36:28.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.888+0000 7fec4832a800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.5 to cache LRU end 2023-12-03T11:36:28.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.888+0000 7fec4832a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:36:28.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.888+0000 7fec4832a800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:36:28.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.888+0000 7fec4832a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.5 2023-12-03T11:36:28.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.889+0000 7fec4832a800 10 cls_bucket_list_unordered: got __ 2023-12-03T11:36:28.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.889+0000 7fec4832a800 10 cls_bucket_list_unordered: got __ _ 2023-12-03T11:36:28.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.889+0000 7fec4832a800 10 cls_bucket_list_unordered: got ___ 2023-12-03T11:36:28.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.889+0000 7fec4832a800 10 cls_bucket_list_unordered: got obj 2023-12-03T11:36:28.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.889+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f136460 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55a07f140048 s->prefetch_data=0 2023-12-03T11:36:28.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.889+0000 7fec4832a800 10 manifest: total_size = 0 2023-12-03T11:36:28.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.889+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.13031781945937755435 2023-12-03T11:36:28.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.889+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f136460 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55a07f140048 s->prefetch_data=0 2023-12-03T11:36:28.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.889+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f140048 2023-12-03T11:36:28.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.889+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.5.0 2023-12-03T11:36:28.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.892+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f136460 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55a07f144e78 s->prefetch_data=0 2023-12-03T11:36:28.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.892+0000 7fec4832a800 10 manifest: total_size = 0 2023-12-03T11:36:28.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.892+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.2966537884351847592 2023-12-03T11:36:28.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.892+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f136460 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55a07f144e78 s->prefetch_data=0 2023-12-03T11:36:28.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.892+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f144e78 2023-12-03T11:36:28.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.892+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.5.0 2023-12-03T11:36:28.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.893+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=__ 2023-12-03T11:36:28.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.894+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f136460 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55a07f144e78 s->prefetch_data=0 2023-12-03T11:36:28.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.895+0000 7fec4832a800 10 manifest: total_size = 0 2023-12-03T11:36:28.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.895+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.15488362763301548562 2023-12-03T11:36:28.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.895+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f136460 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55a07f144e78 s->prefetch_data=0 2023-12-03T11:36:28.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.895+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f144e78 2023-12-03T11:36:28.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.895+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.5.0 2023-12-03T11:36:28.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.896+0000 7fec2affd640 20 handle_completion(): completion ok for obj=__ _ 2023-12-03T11:36:28.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.897+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f136460 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55a07f144e78 s->prefetch_data=0 2023-12-03T11:36:28.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.898+0000 7fec4832a800 10 manifest: total_size = 0 2023-12-03T11:36:28.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.898+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.7839972579629363860 2023-12-03T11:36:28.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.898+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f136460 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55a07f144e78 s->prefetch_data=0 2023-12-03T11:36:28.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.898+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f144e78 2023-12-03T11:36:28.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.898+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.5.0 2023-12-03T11:36:28.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.898+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=___ 2023-12-03T11:36:28.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.900+0000 7fec4832a800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:36:28.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.900+0000 7fec4832a800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:36:28.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.901+0000 7fec2affd640 20 handle_completion(): completion ok for obj=obj 2023-12-03T11:36:28.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.901+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:36:28.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.901+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:36:28.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.901+0000 7fec4832a800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:36:28.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.901+0000 7fec4832a800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:36:28.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.901+0000 7fec4832a800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.5])"; uploads.size()=0; is_truncated=0 2023-12-03T11:36:28.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.903+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2023-12-03T11:36:28.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.903+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.904+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=223 2023-12-03T11:36:28.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.904+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2023-12-03T11:36:28.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.904+0000 7fec4832a800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2023-12-03T11:36:28.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.904+0000 7fec4832a800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2023-12-03T11:36:28.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.904+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2023-12-03T11:36:28.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.904+0000 7fec2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693241 cookie 94147812151120 notifier 5756 bl.length()=181 2023-12-03T11:36:28.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.906+0000 7fec4832a800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.5 from cache 2023-12-03T11:36:28.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.906+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.5, ofs0, ns] 2023-12-03T11:36:28.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.906+0000 7fec2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693220 cookie 140652529188864 notifier 5756 bl.length()=238 2023-12-03T11:36:28.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.908+0000 7fec4832a800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.5 : miss 2023-12-03T11:36:28.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.908+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.908+0000 7fec4832a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:28.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.908+0000 7fec4832a800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.5 info.flags=0x0 2023-12-03T11:36:28.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.908+0000 7fec4832a800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.5 to cache LRU end 2023-12-03T11:36:28.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.908+0000 7fec4832a800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.5 from cache 2023-12-03T11:36:28.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.908+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-small-obj-data.1/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.5, ofs0, ns] 2023-12-03T11:36:28.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.909+0000 7fec2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693199 cookie 94147814614784 notifier 5756 bl.length()=235 2023-12-03T11:36:28.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.911+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.6 : miss 2023-12-03T11:36:28.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.911+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.912+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=397 2023-12-03T11:36:28.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.912+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.6 info.flags=0x17 2023-12-03T11:36:28.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.912+0000 7fec4832a800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.6 to cache LRU end 2023-12-03T11:36:28.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.912+0000 7fec4832a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:36:28.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.912+0000 7fec4832a800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:36:28.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.912+0000 7fec4832a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.6 2023-12-03T11:36:28.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.912+0000 7fec4832a800 10 cls_bucket_list_unordered: got __ 2023-12-03T11:36:28.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.912+0000 7fec4832a800 10 cls_bucket_list_unordered: got __ _ 2023-12-03T11:36:28.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.912+0000 7fec4832a800 10 cls_bucket_list_unordered: got ___ 2023-12-03T11:36:28.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.912+0000 7fec4832a800 10 cls_bucket_list_unordered: got obj 2023-12-03T11:36:28.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.912+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f130340 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55a07f135378 s->prefetch_data=0 2023-12-03T11:36:28.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.913+0000 7fec4832a800 10 manifest: total_size = 38 2023-12-03T11:36:28.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.913+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.1038049998642883852 2023-12-03T11:36:28.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.913+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f130340 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55a07f135378 s->prefetch_data=0 2023-12-03T11:36:28.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.913+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f135378 2023-12-03T11:36:28.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.913+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.6.0 2023-12-03T11:36:28.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.916+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f130340 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55a07f147108 s->prefetch_data=0 2023-12-03T11:36:28.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.916+0000 7fec4832a800 10 manifest: total_size = 524288 2023-12-03T11:36:28.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.916+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.9227865894155643305 2023-12-03T11:36:28.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.916+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f130340 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55a07f147108 s->prefetch_data=0 2023-12-03T11:36:28.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.916+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f147108 2023-12-03T11:36:28.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.916+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.6.0 2023-12-03T11:36:28.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.917+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=__ 2023-12-03T11:36:28.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.918+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f130340 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55a07f143e68 s->prefetch_data=0 2023-12-03T11:36:28.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.919+0000 7fec4832a800 10 manifest: total_size = 2078 2023-12-03T11:36:28.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.919+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.3938141107246671189 2023-12-03T11:36:28.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.919+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f130340 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55a07f143e68 s->prefetch_data=0 2023-12-03T11:36:28.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.919+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f143e68 2023-12-03T11:36:28.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.919+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.6.0 2023-12-03T11:36:28.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.920+0000 7fec2affd640 20 handle_completion(): completion ok for obj=__ _ 2023-12-03T11:36:28.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.921+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f13f9c0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55a07f143e68 s->prefetch_data=0 2023-12-03T11:36:28.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.922+0000 7fec4832a800 10 manifest: total_size = 2078 2023-12-03T11:36:28.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.922+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.3984648895342499674 2023-12-03T11:36:28.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.922+0000 7fec4832a800 20 get_obj_state: octx=0x55a07f13f9c0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55a07f143e68 s->prefetch_data=0 2023-12-03T11:36:28.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.922+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f143e68 2023-12-03T11:36:28.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.922+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.6.0 2023-12-03T11:36:28.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.924+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=___ 2023-12-03T11:36:28.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.925+0000 7fec4832a800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:36:28.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.925+0000 7fec4832a800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:36:28.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.926+0000 7fec2affd640 20 handle_completion(): completion ok for obj=obj 2023-12-03T11:36:28.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.927+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:36:28.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.927+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:36:28.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.927+0000 7fec4832a800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:36:28.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.927+0000 7fec4832a800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:36:28.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.927+0000 7fec4832a800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.6])"; uploads.size()=0; is_truncated=0 2023-12-03T11:36:28.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.928+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2023-12-03T11:36:28.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.928+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.929+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=223 2023-12-03T11:36:28.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.929+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2023-12-03T11:36:28.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.929+0000 7fec4832a800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2023-12-03T11:36:28.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.929+0000 7fec4832a800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2023-12-03T11:36:28.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.929+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2023-12-03T11:36:28.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.929+0000 7fec2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693242 cookie 94147812151120 notifier 5756 bl.length()=181 2023-12-03T11:36:28.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.930+0000 7fec4832a800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.6 from cache 2023-12-03T11:36:28.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.930+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.6, ofs0, ns] 2023-12-03T11:36:28.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.931+0000 7fec2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693221 cookie 140652529188864 notifier 5756 bl.length()=238 2023-12-03T11:36:28.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.933+0000 7fec4832a800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.6 : miss 2023-12-03T11:36:28.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.933+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.934+0000 7fec4832a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:28.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.934+0000 7fec4832a800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.6 info.flags=0x0 2023-12-03T11:36:28.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.934+0000 7fec4832a800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.6 to cache LRU end 2023-12-03T11:36:28.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.934+0000 7fec4832a800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.6 from cache 2023-12-03T11:36:28.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.934+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-small-obj-data.2/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.6, ofs0, ns] 2023-12-03T11:36:28.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.934+0000 7fec2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693200 cookie 94147814614784 notifier 5756 bl.length()=235 2023-12-03T11:36:28.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.936+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.7 : miss 2023-12-03T11:36:28.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.936+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.937+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=397 2023-12-03T11:36:28.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.937+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.7 info.flags=0x17 2023-12-03T11:36:28.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.937+0000 7fec4832a800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.7 to cache LRU end 2023-12-03T11:36:28.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.937+0000 7fec4832a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:36:28.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.937+0000 7fec4832a800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:36:28.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.937+0000 7fec4832a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.7 2023-12-03T11:36:28.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.937+0000 7fec4832a800 10 cls_bucket_list_unordered: got __ 2023-12-03T11:36:28.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.937+0000 7fec4832a800 10 cls_bucket_list_unordered: got __ _ 2023-12-03T11:36:28.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.937+0000 7fec4832a800 10 cls_bucket_list_unordered: got ___ 2023-12-03T11:36:28.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.937+0000 7fec4832a800 10 cls_bucket_list_unordered: got obj 2023-12-03T11:36:28.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.937+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34019dc0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55a07f134e98 s->prefetch_data=0 2023-12-03T11:36:28.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.937+0000 7fec4832a800 10 manifest: total_size = 1035 2023-12-03T11:36:28.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.937+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.16461217008290333627 2023-12-03T11:36:28.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.937+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34019dc0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55a07f134e98 s->prefetch_data=0 2023-12-03T11:36:28.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.937+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f134e98 2023-12-03T11:36:28.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.937+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.7.0 2023-12-03T11:36:28.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.940+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3c009970 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55a07f134e98 s->prefetch_data=0 2023-12-03T11:36:28.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.940+0000 7fec4832a800 10 manifest: total_size = 49187 2023-12-03T11:36:28.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.940+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.7911254061802556871 2023-12-03T11:36:28.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.940+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3c009970 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55a07f134e98 s->prefetch_data=0 2023-12-03T11:36:28.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.940+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f134e98 2023-12-03T11:36:28.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.940+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.7.0 2023-12-03T11:36:28.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.941+0000 7fec2affd640 20 handle_completion(): completion ok for obj=__ 2023-12-03T11:36:28.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.943+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34059260 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55a07f134e98 s->prefetch_data=0 2023-12-03T11:36:28.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.944+0000 7fec4832a800 10 manifest: total_size = 49187 2023-12-03T11:36:28.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.944+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.21025949301569044 2023-12-03T11:36:28.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.944+0000 7fec4832a800 20 get_obj_state: octx=0x7fec34059260 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55a07f134e98 s->prefetch_data=0 2023-12-03T11:36:28.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.944+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f134e98 2023-12-03T11:36:28.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.944+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.7.0 2023-12-03T11:36:28.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.945+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=__ _ 2023-12-03T11:36:28.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.946+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3c076f80 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55a07f134e98 s->prefetch_data=0 2023-12-03T11:36:28.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.947+0000 7fec4832a800 10 manifest: total_size = 55 2023-12-03T11:36:28.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.947+0000 7fec4832a800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.8733419310252839643 2023-12-03T11:36:28.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.947+0000 7fec4832a800 20 get_obj_state: octx=0x7fec3c076f80 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55a07f134e98 s->prefetch_data=0 2023-12-03T11:36:28.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.947+0000 7fec4832a800 20 prepare_atomic_modification: state is not atomic. state=0x55a07f134e98 2023-12-03T11:36:28.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.947+0000 7fec4832a800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.7.0 2023-12-03T11:36:28.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.948+0000 7fec2affd640 20 handle_completion(): completion ok for obj=___ 2023-12-03T11:36:28.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.950+0000 7fec4832a800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:36:28.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.950+0000 7fec4832a800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:36:28.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.951+0000 7fec2a7fc640 20 handle_completion(): completion ok for obj=obj 2023-12-03T11:36:28.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.951+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:36:28.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.951+0000 7fec4832a800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:36:28.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.951+0000 7fec4832a800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:36:28.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.951+0000 7fec4832a800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:36:28.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.951+0000 7fec4832a800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.7])"; uploads.size()=0; is_truncated=0 2023-12-03T11:36:28.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.952+0000 7fec4832a800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2023-12-03T11:36:28.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.952+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.953+0000 7fec4832a800 20 rados_obj.operate() r=0 bl.length=223 2023-12-03T11:36:28.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.953+0000 7fec4832a800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2023-12-03T11:36:28.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.953+0000 7fec4832a800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2023-12-03T11:36:28.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.953+0000 7fec4832a800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2023-12-03T11:36:28.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.953+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2023-12-03T11:36:28.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.953+0000 7fec2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693243 cookie 94147812151120 notifier 5756 bl.length()=181 2023-12-03T11:36:28.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.954+0000 7fec4832a800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.7 from cache 2023-12-03T11:36:28.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.954+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.7, ofs0, ns] 2023-12-03T11:36:28.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.955+0000 7fec2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693222 cookie 140652529188864 notifier 5756 bl.length()=238 2023-12-03T11:36:28.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.957+0000 7fec4832a800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.7 : miss 2023-12-03T11:36:28.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.957+0000 7fec4832a800 20 rados->read ofs=0 len=0 2023-12-03T11:36:28.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.957+0000 7fec4832a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:28.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.957+0000 7fec4832a800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.7 info.flags=0x0 2023-12-03T11:36:28.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.957+0000 7fec4832a800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.7 to cache LRU end 2023-12-03T11:36:28.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.957+0000 7fec4832a800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.7 from cache 2023-12-03T11:36:28.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.957+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-small-obj-data.3/ff414afd-0753-48a7-8bb4-762be6d38c82.4647.7, ofs0, ns] 2023-12-03T11:36:28.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.958+0000 7fec2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693201 cookie 94147814614784 notifier 5756 bl.length()=235 2023-12-03T11:36:28.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.960+0000 7fec4832a800 10 removing key index: DOBOWVTIWFGJVYIMXPSY 2023-12-03T11:36:28.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.960+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.keys:DOBOWVTIWFGJVYIMXPSY, ofs0, ns] 2023-12-03T11:36:28.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.961+0000 7fec2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693202 cookie 94147814614784 notifier 5756 bl.length()=170 2023-12-03T11:36:28.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.962+0000 7fec4832a800 10 removing email index: ragweed.client.0+test@test.test 2023-12-03T11:36:28.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.962+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2023-12-03T11:36:28.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.962+0000 7fec2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693202 cookie 94147814641472 notifier 5756 bl.length()=182 2023-12-03T11:36:28.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.963+0000 7fec4832a800 10 removing user buckets index 2023-12-03T11:36:28.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.963+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2023-12-03T11:36:28.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.964+0000 7fec2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693267 cookie 94147814610688 notifier 5756 bl.length()=173 2023-12-03T11:36:28.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.965+0000 7fec4832a800 10 removing user index: ragweed.client.0 2023-12-03T11:36:28.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.965+0000 7fec4832a800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2023-12-03T11:36:28.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.965+0000 7fec4832a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2023-12-03T11:36:28.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.965+0000 7fec2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693223 cookie 94147814647504 notifier 5756 bl.length()=165 2023-12-03T11:36:28.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.968+0000 7fec0a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:28.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.970+0000 7fec4832a800 20 remove_watcher() i=0 2023-12-03T11:36:28.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.970+0000 7fec4832a800 2 removed watcher, disabling cache 2023-12-03T11:36:28.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.971+0000 7fec4832a800 20 remove_watcher() i=1 2023-12-03T11:36:28.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.972+0000 7fec4832a800 20 remove_watcher() i=2 2023-12-03T11:36:28.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.973+0000 7fec4832a800 20 remove_watcher() i=3 2023-12-03T11:36:28.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.974+0000 7fec4832a800 20 remove_watcher() i=4 2023-12-03T11:36:28.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.975+0000 7fec4832a800 20 remove_watcher() i=5 2023-12-03T11:36:28.976 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.976+0000 7fec4832a800 20 remove_watcher() i=6 2023-12-03T11:36:28.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:28.976+0000 7fec4832a800 20 remove_watcher() i=7 2023-12-03T11:36:28.983 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2023-12-03T11:36:29.066 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:36:29.066 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:36:29.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.076+0000 7f9311529800 20 rados->read ofs=0 len=0 2023-12-03T11:36:29.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.078+0000 7f9311529800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:29.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.078+0000 7f9311529800 20 realm 2023-12-03T11:36:29.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.078+0000 7f9311529800 20 rados->read ofs=0 len=0 2023-12-03T11:36:29.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.078+0000 7f9311529800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:29.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.078+0000 7f9311529800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:36:29.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.078+0000 7f9311529800 20 rados->read ofs=0 len=0 2023-12-03T11:36:29.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.078+0000 7f9311529800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:29.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.078+0000 7f9311529800 20 rados->read ofs=0 len=0 2023-12-03T11:36:29.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.079+0000 7f9311529800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:29.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.079+0000 7f9311529800 20 rados->read ofs=0 len=0 2023-12-03T11:36:29.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.080+0000 7f9311529800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:36:29.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.080+0000 7f9311529800 20 searching for the correct realm 2023-12-03T11:36:29.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.089+0000 7f930d2bf640 0 -- 172.21.15.44:0/2697650410 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55e9c57732b0 msgr2=0x55e9c57756e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:29.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.090+0000 7f9311529800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:36:29.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.090+0000 7f9311529800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:36:29.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.090+0000 7f9311529800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:36:29.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.090+0000 7f9311529800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:36:29.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.090+0000 7f9311529800 20 rados->read ofs=0 len=0 2023-12-03T11:36:29.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.091+0000 7f9311529800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:29.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.091+0000 7f9311529800 20 rados->read ofs=0 len=0 2023-12-03T11:36:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.091+0000 7f9311529800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.091+0000 7f9311529800 20 rados->read ofs=0 len=0 2023-12-03T11:36:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.091+0000 7f9311529800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:36:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.091+0000 7f9311529800 20 zone default found 2023-12-03T11:36:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.091+0000 7f9311529800 4 Realm: () 2023-12-03T11:36:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.091+0000 7f9311529800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:36:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.091+0000 7f9311529800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:36:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.091+0000 7f9311529800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:36:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.091+0000 7f9311529800 20 zonegroup default 2023-12-03T11:36:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.091+0000 7f9311529800 20 rados->read ofs=0 len=0 2023-12-03T11:36:29.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.091+0000 7f9311529800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:29.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.091+0000 7f9311529800 20 rados->read ofs=0 len=0 2023-12-03T11:36:29.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.092+0000 7f9311529800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:29.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.092+0000 7f9311529800 20 rados->read ofs=0 len=0 2023-12-03T11:36:29.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.092+0000 7f9311529800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:29.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.092+0000 7f9311529800 20 started sync module instance, tier type = 2023-12-03T11:36:29.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.092+0000 7f9311529800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:36:29.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.099+0000 7f930dac0640 0 -- 172.21.15.44:0/2697650410 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f930409a350 msgr2=0x7f9304098750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:29.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.101+0000 7f9311529800 20 add_watcher() i=0 2023-12-03T11:36:29.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.101+0000 7f9311529800 20 add_watcher() i=1 2023-12-03T11:36:29.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.101+0000 7f9311529800 20 add_watcher() i=2 2023-12-03T11:36:29.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.101+0000 7f9311529800 20 add_watcher() i=3 2023-12-03T11:36:29.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.101+0000 7f9311529800 20 add_watcher() i=4 2023-12-03T11:36:29.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.101+0000 7f9311529800 20 add_watcher() i=5 2023-12-03T11:36:29.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.101+0000 7f9311529800 20 add_watcher() i=6 2023-12-03T11:36:29.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.102+0000 7f9311529800 20 add_watcher() i=7 2023-12-03T11:36:29.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.102+0000 7f9311529800 2 all 8 watchers are set, enabling cache 2023-12-03T11:36:29.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.104+0000 7f92d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:29.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.104+0000 7f9311529800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:36:29.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.104+0000 7f9311529800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:36:29.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.145+0000 7f9241ffb640 20 reqs_thread_entry: start 2023-12-03T11:36:29.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.145+0000 7f9311529800 20 init_complete bucket index max shards: 1 2023-12-03T11:36:29.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.145+0000 7f9311529800 20 Filter name: none 2023-12-03T11:36:29.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.145+0000 7f92337fe640 20 reqs_thread_entry: start 2023-12-03T11:36:29.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.145+0000 7f9311529800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2023-12-03T11:36:29.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.145+0000 7f9311529800 20 rados->read ofs=0 len=0 2023-12-03T11:36:29.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.146+0000 7f9311529800 20 rados_obj.operate() r=0 bl.length=452 2023-12-03T11:36:29.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.146+0000 7f9311529800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2023-12-03T11:36:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.146+0000 7f9311529800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2023-12-03T11:36:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.146+0000 7f9311529800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:36:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.146+0000 7f9311529800 10 removing key index: MXACUFQVLISLOZCOBOGV 2023-12-03T11:36:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.146+0000 7f9311529800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:MXACUFQVLISLOZCOBOGV, ofs0, ns] 2023-12-03T11:36:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.146+0000 7f92ef7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693224 cookie 94462528721120 notifier 5774 bl.length()=170 2023-12-03T11:36:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.148+0000 7f9311529800 10 removing email index: sysuser.client.0+test@test.test 2023-12-03T11:36:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.148+0000 7f9311529800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2023-12-03T11:36:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.148+0000 7f92ef7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693225 cookie 94462528721120 notifier 5774 bl.length()=182 2023-12-03T11:36:29.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.149+0000 7f9311529800 10 removing user buckets index 2023-12-03T11:36:29.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.149+0000 7f9311529800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0.buckets, ofs0, ns] 2023-12-03T11:36:29.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.149+0000 7f92ef7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693209 cookie 94462528718928 notifier 5774 bl.length()=173 2023-12-03T11:36:29.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.151+0000 7f9311529800 10 removing user index: sysuser.client.0 2023-12-03T11:36:29.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.151+0000 7f9311529800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2023-12-03T11:36:29.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.151+0000 7f9311529800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2023-12-03T11:36:29.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.151+0000 7f92ef7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693203 cookie 94462528715472 notifier 5774 bl.length()=165 2023-12-03T11:36:29.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.154+0000 7f92d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:29.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.156+0000 7f9311529800 20 remove_watcher() i=0 2023-12-03T11:36:29.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.156+0000 7f9311529800 2 removed watcher, disabling cache 2023-12-03T11:36:29.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.157+0000 7f9311529800 20 remove_watcher() i=1 2023-12-03T11:36:29.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.158+0000 7f9311529800 20 remove_watcher() i=2 2023-12-03T11:36:29.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.159+0000 7f9311529800 20 remove_watcher() i=3 2023-12-03T11:36:29.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.160+0000 7f9311529800 20 remove_watcher() i=4 2023-12-03T11:36:29.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.161+0000 7f9311529800 20 remove_watcher() i=5 2023-12-03T11:36:29.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.166+0000 7f9311529800 20 remove_watcher() i=6 2023-12-03T11:36:29.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:36:29.167+0000 7f9311529800 20 remove_watcher() i=7 2023-12-03T11:36:29.173 INFO:tasks.ragweed:Removing ragweed... 2023-12-03T11:36:29.174 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2023-12-03T11:36:29.276 INFO:teuthology.run_tasks:Running task workunit... 2023-12-03T11:36:29.287 INFO:tasks.workunit:Pulling workunits from ref bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:36:29.287 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-03T11:36:29.287 DEBUG:teuthology.orchestra.run.smithi044:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:36:29.303 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:36:29.303 INFO:teuthology.orchestra.run.smithi044.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-12-03T11:36:29.303 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:36:29.359 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-12-03T11:36:29.359 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-12-03T11:36:29.414 INFO:tasks.workunit:timeout=3h 2023-12-03T11:36:29.414 INFO:tasks.workunit:cleanup=True 2023-12-03T11:36:29.415 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:36:29.470 INFO:tasks.workunit.client.0.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-03T11:37:34.729 INFO:tasks.workunit.client.0.smithi044.stderr:Updating files: 96% (11676/12123) Updating files: 97% (11760/12123) Updating files: 98% (11881/12123) Updating files: 99% (12002/12123) Updating files: 100% (12123/12123) Updating files: 100% (12123/12123), done. 2023-12-03T11:37:35.330 INFO:tasks.workunit.client.0.smithi044.stderr:Note: switching to 'bcbf278cf395873c2a482f5a7b2345faf2160319'. 2023-12-03T11:37:35.330 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:35.330 INFO:tasks.workunit.client.0.smithi044.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-03T11:37:35.331 INFO:tasks.workunit.client.0.smithi044.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-03T11:37:35.331 INFO:tasks.workunit.client.0.smithi044.stderr:state without impacting any branches by switching back to a branch. 2023-12-03T11:37:35.331 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:35.331 INFO:tasks.workunit.client.0.smithi044.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-03T11:37:35.331 INFO:tasks.workunit.client.0.smithi044.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-03T11:37:35.331 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:35.331 INFO:tasks.workunit.client.0.smithi044.stderr: git switch -c 2023-12-03T11:37:35.332 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:35.332 INFO:tasks.workunit.client.0.smithi044.stderr:Or undo this operation with: 2023-12-03T11:37:35.332 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:35.332 INFO:tasks.workunit.client.0.smithi044.stderr: git switch - 2023-12-03T11:37:35.332 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:35.332 INFO:tasks.workunit.client.0.smithi044.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-03T11:37:35.332 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:35.332 INFO:tasks.workunit.client.0.smithi044.stderr:HEAD is now at bcbf278cf39 RGW:pubsub publish commit with etag populated 2023-12-03T11:37:35.333 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-03T11:37:35.388 INFO:tasks.workunit.client.0.smithi044.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-03T11:37:35.390 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:37:35.390 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-03T11:37:35.441 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-03T11:37:35.493 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-03T11:37:35.532 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:37:35.533 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:37:35.533 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-03T11:37:35.573 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:37:35.576 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:37:35.576 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-03T11:37:35.632 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2023-12-03T11:37:35.633 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2023-12-03T11:37:35.633 DEBUG:teuthology.orchestra.run.smithi044:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2023-12-03T11:37:35.691 INFO:tasks.workunit.client.0.smithi044.stderr:+ ulimit -c 0 2023-12-03T11:37:35.691 INFO:tasks.workunit.client.0.smithi044.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2023-12-03T11:37:35.692 INFO:tasks.workunit.client.0.smithi044.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-12-03T11:37:35.692 INFO:tasks.workunit.client.0.smithi044.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-12-03T11:37:38.134 INFO:tasks.workunit.client.0.smithi044.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2023-12-03T11:37:38.134 INFO:tasks.workunit.client.0.smithi044.stderr:++ deactivate nondestructive 2023-12-03T11:37:38.134 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2023-12-03T11:37:38.134 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2023-12-03T11:37:38.134 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2023-12-03T11:37:38.134 INFO:tasks.workunit.client.0.smithi044.stderr:++ hash -r 2023-12-03T11:37:38.134 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2023-12-03T11:37:38.134 INFO:tasks.workunit.client.0.smithi044.stderr:++ unset VIRTUAL_ENV 2023-12-03T11:37:38.134 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' '!' nondestructive = nondestructive ']' 2023-12-03T11:37:38.135 INFO:tasks.workunit.client.0.smithi044.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-12-03T11:37:38.135 INFO:tasks.workunit.client.0.smithi044.stderr:++ export VIRTUAL_ENV 2023-12-03T11:37:38.135 INFO:tasks.workunit.client.0.smithi044.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-12-03T11:37:38.135 INFO:tasks.workunit.client.0.smithi044.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-12-03T11:37:38.135 INFO:tasks.workunit.client.0.smithi044.stderr:++ export PATH 2023-12-03T11:37:38.135 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2023-12-03T11:37:38.135 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -z '' ']' 2023-12-03T11:37:38.135 INFO:tasks.workunit.client.0.smithi044.stderr:++ _OLD_VIRTUAL_PS1= 2023-12-03T11:37:38.135 INFO:tasks.workunit.client.0.smithi044.stderr:++ PS1='(rgw) ' 2023-12-03T11:37:38.135 INFO:tasks.workunit.client.0.smithi044.stderr:++ export PS1 2023-12-03T11:37:38.135 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2023-12-03T11:37:38.135 INFO:tasks.workunit.client.0.smithi044.stderr:++ hash -r 2023-12-03T11:37:38.135 INFO:tasks.workunit.client.0.smithi044.stderr:+ pip install pip --upgrade 2023-12-03T11:37:38.374 INFO:tasks.workunit.client.0.smithi044.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2023-12-03T11:37:39.003 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting pip 2023-12-03T11:37:39.009 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached pip-23.3.1-py3-none-any.whl (2.1 MB) 2023-12-03T11:37:39.059 INFO:tasks.workunit.client.0.smithi044.stdout:Installing collected packages: pip 2023-12-03T11:37:39.060 INFO:tasks.workunit.client.0.smithi044.stdout: Attempting uninstall: pip 2023-12-03T11:37:39.060 INFO:tasks.workunit.client.0.smithi044.stdout: Found existing installation: pip 21.2.3 2023-12-03T11:37:39.227 INFO:tasks.workunit.client.0.smithi044.stdout: Uninstalling pip-21.2.3: 2023-12-03T11:37:39.233 INFO:tasks.workunit.client.0.smithi044.stdout: Successfully uninstalled pip-21.2.3 2023-12-03T11:37:40.244 INFO:tasks.workunit.client.0.smithi044.stdout:Successfully installed pip-23.3.1 2023-12-03T11:37:40.294 INFO:tasks.workunit.client.0.smithi044.stderr:+ pip install boto3 2023-12-03T11:37:41.142 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting boto3 2023-12-03T11:37:41.144 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached boto3-1.33.6-py3-none-any.whl.metadata (6.7 kB) 2023-12-03T11:37:41.671 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting botocore<1.34.0,>=1.33.6 (from boto3) 2023-12-03T11:37:41.672 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached botocore-1.33.6-py3-none-any.whl.metadata (6.1 kB) 2023-12-03T11:37:41.718 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2023-12-03T11:37:41.719 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2023-12-03T11:37:41.772 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting s3transfer<0.9.0,>=0.8.2 (from boto3) 2023-12-03T11:37:41.773 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached s3transfer-0.8.2-py3-none-any.whl.metadata (1.8 kB) 2023-12-03T11:37:41.839 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:37:41.841 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) 2023-12-03T11:37:41.924 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:37:41.925 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2023-12-03T11:37:42.155 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:37:42.156 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2023-12-03T11:37:42.180 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached boto3-1.33.6-py3-none-any.whl (139 kB) 2023-12-03T11:37:42.182 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached botocore-1.33.6-py3-none-any.whl (11.8 MB) 2023-12-03T11:37:42.205 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached s3transfer-0.8.2-py3-none-any.whl (82 kB) 2023-12-03T11:37:42.206 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2023-12-03T11:37:42.310 INFO:tasks.workunit.client.0.smithi044.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2023-12-03T11:37:43.395 INFO:tasks.workunit.client.0.smithi044.stdout:Successfully installed boto3-1.33.6 botocore-1.33.6 jmespath-1.0.1 python-dateutil-2.8.2 s3transfer-0.8.2 six-1.16.0 urllib3-1.26.18 2023-12-03T11:37:43.522 INFO:tasks.workunit.client.0.smithi044.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2023-12-03T11:37:43.654 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2023-12-03T11:37:43.688 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:43.688 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:43.703 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.702+0000 7f2f41d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:43.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.703+0000 7f2f41d3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:43.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.703+0000 7f2f41d3a800 20 realm 2023-12-03T11:37:43.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.703+0000 7f2f41d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:43.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.704+0000 7f2f41d3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:43.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.704+0000 7f2f41d3a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:43.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.704+0000 7f2f41d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:43.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.704+0000 7f2f41d3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:43.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.704+0000 7f2f41d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:43.706 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.705+0000 7f2f41d3a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:43.706 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.705+0000 7f2f41d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:43.707 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.705+0000 7f2f41d3a800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:43.707 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.706+0000 7f2f41d3a800 20 searching for the correct realm 2023-12-03T11:37:43.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.717+0000 7f2f3da06640 0 -- 172.21.15.44:0/2166562821 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x561d723d38e0 msgr2=0x561d723d5cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:37:43.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.718+0000 7f2f41d3a800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:43.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.718+0000 7f2f41d3a800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:43.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.718+0000 7f2f41d3a800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:43.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.718+0000 7f2f41d3a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:43.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.718+0000 7f2f41d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:43.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.719+0000 7f2f41d3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:43.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.719+0000 7f2f41d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:43.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.719+0000 7f2f41d3a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:43.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.719+0000 7f2f41d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:43.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.719+0000 7f2f41d3a800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:43.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.719+0000 7f2f41d3a800 20 zone default found 2023-12-03T11:37:43.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.719+0000 7f2f41d3a800 4 Realm: () 2023-12-03T11:37:43.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.719+0000 7f2f41d3a800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:43.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.719+0000 7f2f41d3a800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:43.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.719+0000 7f2f41d3a800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:43.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.719+0000 7f2f41d3a800 20 zonegroup default 2023-12-03T11:37:43.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.719+0000 7f2f41d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:43.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.720+0000 7f2f41d3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:43.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.720+0000 7f2f41d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:43.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.720+0000 7f2f41d3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:43.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.720+0000 7f2f41d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:43.723 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.720+0000 7f2f41d3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:43.723 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.720+0000 7f2f41d3a800 20 started sync module instance, tier type = 2023-12-03T11:37:43.723 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.720+0000 7f2f41d3a800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:43.729 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.728+0000 7f2f3e207640 0 -- 172.21.15.44:0/2166562821 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x561d723db980 msgr2=0x561d723dde40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:43.731 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.730+0000 7f2f41d3a800 20 add_watcher() i=0 2023-12-03T11:37:43.731 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.730+0000 7f2f41d3a800 20 add_watcher() i=1 2023-12-03T11:37:43.731 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.730+0000 7f2f41d3a800 20 add_watcher() i=2 2023-12-03T11:37:43.731 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.730+0000 7f2f41d3a800 20 add_watcher() i=3 2023-12-03T11:37:43.731 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.730+0000 7f2f41d3a800 20 add_watcher() i=4 2023-12-03T11:37:43.731 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.730+0000 7f2f41d3a800 20 add_watcher() i=5 2023-12-03T11:37:43.732 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.730+0000 7f2f41d3a800 20 add_watcher() i=6 2023-12-03T11:37:43.732 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.731+0000 7f2f41d3a800 20 add_watcher() i=7 2023-12-03T11:37:43.732 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.731+0000 7f2f41d3a800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:43.734 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.733+0000 7f2f037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:43.734 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.733+0000 7f2f41d3a800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:43.734 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.733+0000 7f2f41d3a800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:43.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.739+0000 7f2f41d3a800 5 note: GC not initialized 2023-12-03T11:37:43.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.739+0000 7f2e727fc640 20 reqs_thread_entry: start 2023-12-03T11:37:43.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.739+0000 7f2f41d3a800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:43.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.739+0000 7f2f41d3a800 20 Filter name: none 2023-12-03T11:37:43.742 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.739+0000 7f2e63fff640 20 reqs_thread_entry: start 2023-12-03T11:37:43.742 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.739+0000 7f2f41d3a800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2023-12-03T11:37:43.742 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.739+0000 7f2f41d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:43.742 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.740+0000 7f2f41d3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:43.742 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.740+0000 7f2f41d3a800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2023-12-03T11:37:43.742 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.740+0000 7f2f41d3a800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2023-12-03T11:37:43.742 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.740+0000 7f2f41d3a800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2023-12-03T11:37:43.742 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.740+0000 7f2f41d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:43.742 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.740+0000 7f2f41d3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:43.742 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.740+0000 7f2f41d3a800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2023-12-03T11:37:43.742 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.740+0000 7f2f41d3a800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-12-03T11:37:43.742 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.740+0000 7f2f41d3a800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2023-12-03T11:37:43.742 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.740+0000 7f2f41d3a800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2023-12-03T11:37:43.743 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.742+0000 7f2f41d3a800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2023-12-03T11:37:43.743 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.742+0000 7f2f41d3a800 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2023-12-03T11:37:43.743 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.742+0000 7f2f41d3a800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2023-12-03T11:37:43.743 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.742+0000 7f2f1ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693268 cookie 94684470707264 notifier 5795 bl.length()=535 2023-12-03T11:37:43.743 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.742+0000 7f2f1ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2023-12-03T11:37:43.743 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.742+0000 7f2f1ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2023-12-03T11:37:43.745 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.743+0000 7f2f41d3a800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2023-12-03T11:37:43.745 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.743+0000 7f2f41d3a800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-12-03T11:37:43.745 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.743+0000 7f2f41d3a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2023-12-03T11:37:43.745 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.744+0000 7f2f1ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693269 cookie 94684470717072 notifier 5795 bl.length()=180 2023-12-03T11:37:43.745 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.744+0000 7f2f1ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2023-12-03T11:37:43.745 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.744+0000 7f2f1ffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-12-03T11:37:43.746 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.745+0000 7f2f037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:43.748 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.747+0000 7f2f41d3a800 20 remove_watcher() i=0 2023-12-03T11:37:43.748 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.747+0000 7f2f41d3a800 2 removed watcher, disabling cache 2023-12-03T11:37:43.749 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.748+0000 7f2f41d3a800 20 remove_watcher() i=1 2023-12-03T11:37:43.750 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.749+0000 7f2f41d3a800 20 remove_watcher() i=2 2023-12-03T11:37:43.751 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.750+0000 7f2f41d3a800 20 remove_watcher() i=3 2023-12-03T11:37:43.752 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.752+0000 7f2f41d3a800 20 remove_watcher() i=4 2023-12-03T11:37:43.753 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.752+0000 7f2f41d3a800 20 remove_watcher() i=5 2023-12-03T11:37:43.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.753+0000 7f2f41d3a800 20 remove_watcher() i=6 2023-12-03T11:37:43.755 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:43.755+0000 7f2f41d3a800 20 remove_watcher() i=7 2023-12-03T11:37:43.985 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard add 2023-12-03T11:37:43.986 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:43.987 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket a-bucket 2023-12-03T11:37:44.015 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:44.015 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:44.030 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.029+0000 7f6dc1b33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.030+0000 7f6dc1b33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.030+0000 7f6dc1b33800 20 realm 2023-12-03T11:37:44.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.030+0000 7f6dc1b33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.031+0000 7f6dc1b33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.031+0000 7f6dc1b33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:44.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.031+0000 7f6dc1b33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.031+0000 7f6dc1b33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.031+0000 7f6dc1b33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.032+0000 7f6dc1b33800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:44.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.032+0000 7f6dc1b33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.034 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.033+0000 7f6dc1b33800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:44.034 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.033+0000 7f6dc1b33800 20 searching for the correct realm 2023-12-03T11:37:44.042 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.041+0000 7f6dbd7fb640 0 -- 172.21.15.44:0/497799725 >> [v2:172.21.15.91:6808/776869758,v1:172.21.15.91:6809/776869758] conn(0x5579ef1f5220 msgr2=0x7f6db8062440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:44.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.044+0000 7f6dc1b33800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:44.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.044+0000 7f6dc1b33800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:44.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.044+0000 7f6dc1b33800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:44.046 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.044+0000 7f6dc1b33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:44.046 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.044+0000 7f6dc1b33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.046 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.044+0000 7f6dc1b33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.046 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.044+0000 7f6dc1b33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.047 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.045+0000 7f6dc1b33800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:44.047 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.045+0000 7f6dc1b33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.047 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.045+0000 7f6dc1b33800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:44.047 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.045+0000 7f6dc1b33800 20 zone default found 2023-12-03T11:37:44.047 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.045+0000 7f6dc1b33800 4 Realm: () 2023-12-03T11:37:44.047 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.045+0000 7f6dc1b33800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:44.047 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.045+0000 7f6dc1b33800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:44.047 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.045+0000 7f6dc1b33800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:44.047 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.045+0000 7f6dc1b33800 20 zonegroup default 2023-12-03T11:37:44.048 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.045+0000 7f6dc1b33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.048 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.045+0000 7f6dc1b33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.048 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.045+0000 7f6dc1b33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.048 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.046+0000 7f6dbcffa640 0 -- 172.21.15.44:0/497799725 >> [v2:172.21.15.91:6800/3513356836,v1:172.21.15.91:6801/3513356836] conn(0x7f6db4018070 msgr2=0x7f6db4018450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:44.048 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.046+0000 7f6dc1b33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.048 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.046+0000 7f6dc1b33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.048 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.046+0000 7f6dc1b33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.048 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.046+0000 7f6dc1b33800 20 started sync module instance, tier type = 2023-12-03T11:37:44.048 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.046+0000 7f6dc1b33800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:44.056 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.055+0000 7f6dc1b33800 20 add_watcher() i=0 2023-12-03T11:37:44.056 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.055+0000 7f6dc1b33800 20 add_watcher() i=1 2023-12-03T11:37:44.056 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.055+0000 7f6dc1b33800 20 add_watcher() i=2 2023-12-03T11:37:44.056 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.055+0000 7f6dc1b33800 20 add_watcher() i=3 2023-12-03T11:37:44.057 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.055+0000 7f6dc1b33800 20 add_watcher() i=4 2023-12-03T11:37:44.057 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.055+0000 7f6dc1b33800 20 add_watcher() i=5 2023-12-03T11:37:44.057 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.055+0000 7f6dc1b33800 20 add_watcher() i=6 2023-12-03T11:37:44.057 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.056+0000 7f6dc1b33800 20 add_watcher() i=7 2023-12-03T11:37:44.057 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.056+0000 7f6dc1b33800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:44.059 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.058+0000 7f6d82fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:44.059 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.059+0000 7f6dc1b33800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:44.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.059+0000 7f6dc1b33800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:44.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.066+0000 7f6dc1b33800 5 note: GC not initialized 2023-12-03T11:37:44.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.066+0000 7f6cf1ffb640 20 reqs_thread_entry: start 2023-12-03T11:37:44.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.066+0000 7f6dc1b33800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:44.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.066+0000 7f6dc1b33800 20 Filter name: none 2023-12-03T11:37:44.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.066+0000 7f6ce37fe640 20 reqs_thread_entry: start 2023-12-03T11:37:44.068 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.066+0000 7f6dc1b33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.068 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.067+0000 7f6dc1b33800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:37:44.068 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.067+0000 7f6dc1b33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.068+0000 7f6dc1b33800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:37:44.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.068+0000 7f6dc1b33800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:44.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.068+0000 7f6dc1b33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.068+0000 7f6dc1b33800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:37:44.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.068+0000 7f6dc1b33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.068+0000 7f6dc1b33800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:37:44.070 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.069+0000 7f6dc1b33800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:44.070 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.069+0000 7f6dc1b33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.070 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.069+0000 7f6dc1b33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.071 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.070+0000 7f6d82fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:44.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.072+0000 7f6dc1b33800 20 remove_watcher() i=0 2023-12-03T11:37:44.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.072+0000 7f6dc1b33800 2 removed watcher, disabling cache 2023-12-03T11:37:44.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.073+0000 7f6dc1b33800 20 remove_watcher() i=1 2023-12-03T11:37:44.075 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.074+0000 7f6dc1b33800 20 remove_watcher() i=2 2023-12-03T11:37:44.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.075+0000 7f6dc1b33800 20 remove_watcher() i=3 2023-12-03T11:37:44.077 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.076+0000 7f6dc1b33800 20 remove_watcher() i=4 2023-12-03T11:37:44.078 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.077+0000 7f6dc1b33800 20 remove_watcher() i=5 2023-12-03T11:37:44.079 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.079+0000 7f6dc1b33800 20 remove_watcher() i=6 2023-12-03T11:37:44.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.079+0000 7f6dc1b33800 20 remove_watcher() i=7 2023-12-03T11:37:44.085 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:44.085 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:37:44.085 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: a-bucket id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 num_objects: 0 size_kb: 0 num_shards: 1 2023-12-03T11:37:44.085 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:44.087 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 2 2023-12-03T11:37:44.117 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:44.117 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:44.132 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.131+0000 7f9390d24800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.134 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.133+0000 7f9390d24800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.134 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.133+0000 7f9390d24800 20 realm 2023-12-03T11:37:44.135 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.133+0000 7f9390d24800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.135 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.133+0000 7f9390d24800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.135 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.133+0000 7f9390d24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:44.135 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.133+0000 7f9390d24800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.135 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.133+0000 7f9390d24800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.135 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.133+0000 7f9390d24800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.135 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.134+0000 7f9390d24800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:44.135 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.134+0000 7f9390d24800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.136 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.135+0000 7f9390d24800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:44.136 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.135+0000 7f9390d24800 20 searching for the correct realm 2023-12-03T11:37:44.145 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.144+0000 7f938c995640 0 -- 172.21.15.44:0/1651923984 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x561a794a0930 msgr2=0x561a794a2d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:44.147 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.146+0000 7f9390d24800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:44.147 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.146+0000 7f9390d24800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:44.147 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.146+0000 7f9390d24800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:44.147 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.146+0000 7f9390d24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:44.147 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.146+0000 7f9390d24800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.147 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.146+0000 7f9390d24800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.147 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.146+0000 7f9390d24800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.149 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.146+0000 7f9390d24800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:44.149 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.146+0000 7f9390d24800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.149 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.147+0000 7f9390d24800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:44.149 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.147+0000 7f9390d24800 20 zone default found 2023-12-03T11:37:44.149 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.147+0000 7f9390d24800 4 Realm: () 2023-12-03T11:37:44.149 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.147+0000 7f9390d24800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:44.149 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.147+0000 7f9390d24800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:44.149 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.147+0000 7f9390d24800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:44.149 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.147+0000 7f9390d24800 20 zonegroup default 2023-12-03T11:37:44.149 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.147+0000 7f9390d24800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.149 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.147+0000 7f9390d24800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.149 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.147+0000 7f9390d24800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.149 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.147+0000 7f9390d24800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.149 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.147+0000 7f9390d24800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.150 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.148+0000 7f9390d24800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.150 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.148+0000 7f9390d24800 20 started sync module instance, tier type = 2023-12-03T11:37:44.150 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.148+0000 7f9390d24800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:44.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.153+0000 7f938d196640 0 -- 172.21.15.44:0/1651923984 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f9380027c10 msgr2=0x7f9380025580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:44.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.156+0000 7f9390d24800 20 add_watcher() i=0 2023-12-03T11:37:44.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.156+0000 7f9390d24800 20 add_watcher() i=1 2023-12-03T11:37:44.158 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.156+0000 7f9390d24800 20 add_watcher() i=2 2023-12-03T11:37:44.158 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.156+0000 7f9390d24800 20 add_watcher() i=3 2023-12-03T11:37:44.158 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.156+0000 7f9390d24800 20 add_watcher() i=4 2023-12-03T11:37:44.158 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.156+0000 7f9390d24800 20 add_watcher() i=5 2023-12-03T11:37:44.158 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.156+0000 7f9390d24800 20 add_watcher() i=6 2023-12-03T11:37:44.158 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.157+0000 7f9390d24800 20 add_watcher() i=7 2023-12-03T11:37:44.158 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.157+0000 7f9390d24800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:44.160 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.159+0000 7f9352fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:44.160 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.159+0000 7f9390d24800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:44.160 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.159+0000 7f9390d24800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:44.167 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.165+0000 7f9390d24800 5 note: GC not initialized 2023-12-03T11:37:44.167 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.165+0000 7f92c1ffb640 20 reqs_thread_entry: start 2023-12-03T11:37:44.167 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.166+0000 7f9390d24800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:44.167 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.166+0000 7f9390d24800 20 Filter name: none 2023-12-03T11:37:44.167 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.166+0000 7f92b37fe640 20 reqs_thread_entry: start 2023-12-03T11:37:44.167 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.166+0000 7f9390d24800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2023-12-03T11:37:44.167 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.166+0000 7f9390d24800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.166+0000 7f9390d24800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:37:44.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.166+0000 7f9390d24800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2023-12-03T11:37:44.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.166+0000 7f9390d24800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2023-12-03T11:37:44.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.166+0000 7f9390d24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 : miss 2023-12-03T11:37:44.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.166+0000 7f9390d24800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.167+0000 7f9390d24800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:37:44.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.167+0000 7f9390d24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 info.flags=0x17 2023-12-03T11:37:44.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.167+0000 7f9390d24800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 to cache LRU end 2023-12-03T11:37:44.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.167+0000 7f9390d24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:37:44.169 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.167+0000 7f9390d24800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:37:44.169 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.167+0000 7f9390d24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 2023-12-03T11:37:44.170 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.169+0000 7f9352fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:44.173 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.172+0000 7f9390d24800 20 remove_watcher() i=0 2023-12-03T11:37:44.173 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.172+0000 7f9390d24800 2 removed watcher, disabling cache 2023-12-03T11:37:44.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.173+0000 7f9390d24800 20 remove_watcher() i=1 2023-12-03T11:37:44.175 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.174+0000 7f9390d24800 20 remove_watcher() i=2 2023-12-03T11:37:44.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.175+0000 7f9390d24800 20 remove_watcher() i=3 2023-12-03T11:37:44.177 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.176+0000 7f9390d24800 20 remove_watcher() i=4 2023-12-03T11:37:44.178 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.177+0000 7f9390d24800 20 remove_watcher() i=5 2023-12-03T11:37:44.179 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.178+0000 7f9390d24800 20 remove_watcher() i=6 2023-12-03T11:37:44.180 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.179+0000 7f9390d24800 20 remove_watcher() i=7 2023-12-03T11:37:44.186 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin reshard list 2023-12-03T11:37:44.212 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:44.212 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:44.227 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.226+0000 7fb5c4111800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.229 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.228+0000 7fb5c4111800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.229 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.228+0000 7fb5c4111800 20 realm 2023-12-03T11:37:44.229 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.228+0000 7fb5c4111800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.229 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.228+0000 7fb5c4111800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.229 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.228+0000 7fb5c4111800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:44.230 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.228+0000 7fb5c4111800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.230 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.228+0000 7fb5c4111800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.230 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.228+0000 7fb5c4111800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.230 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.229+0000 7fb5c4111800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:44.230 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.229+0000 7fb5c4111800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.231 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.229+0000 7fb5c4111800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:44.231 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.229+0000 7fb5c4111800 20 searching for the correct realm 2023-12-03T11:37:44.240 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.239+0000 7fb5c1c11640 0 -- 172.21.15.44:0/637429288 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x555a21711830 msgr2=0x555a21713c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:44.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.240+0000 7fb5c4111800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:44.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.240+0000 7fb5c4111800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:44.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.240+0000 7fb5c4111800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:44.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.240+0000 7fb5c4111800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:44.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.240+0000 7fb5c4111800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.240+0000 7fb5c4111800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.240+0000 7fb5c4111800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.241+0000 7fb5c4111800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:44.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.241+0000 7fb5c4111800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.241+0000 7fb5c4111800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:44.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.241+0000 7fb5c4111800 20 zone default found 2023-12-03T11:37:44.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.241+0000 7fb5c4111800 4 Realm: () 2023-12-03T11:37:44.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.241+0000 7fb5c4111800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:44.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.241+0000 7fb5c4111800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:44.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.241+0000 7fb5c4111800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:44.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.241+0000 7fb5c4111800 20 zonegroup default 2023-12-03T11:37:44.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.241+0000 7fb5c4111800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.244 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.241+0000 7fb5c4111800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.244 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.242+0000 7fb5c4111800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.244 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.242+0000 7fb5c4111800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.244 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.242+0000 7fb5c4111800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.244 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.242+0000 7fb5c4111800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.244 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.242+0000 7fb5c4111800 20 started sync module instance, tier type = 2023-12-03T11:37:44.244 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.242+0000 7fb5c4111800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:44.246 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.245+0000 7fb5c1c11640 0 -- 172.21.15.44:0/637429288 >> [v2:172.21.15.91:6808/776869758,v1:172.21.15.91:6809/776869758] conn(0x7fb5bc058660 msgr2=0x7fb5bc081ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:44.252 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.251+0000 7fb5c4111800 20 add_watcher() i=0 2023-12-03T11:37:44.252 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.251+0000 7fb5c4111800 20 add_watcher() i=1 2023-12-03T11:37:44.252 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.251+0000 7fb5c4111800 20 add_watcher() i=2 2023-12-03T11:37:44.252 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.251+0000 7fb5c4111800 20 add_watcher() i=3 2023-12-03T11:37:44.252 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.251+0000 7fb5c4111800 20 add_watcher() i=4 2023-12-03T11:37:44.253 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.251+0000 7fb5c4111800 20 add_watcher() i=5 2023-12-03T11:37:44.253 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.251+0000 7fb5c4111800 20 add_watcher() i=6 2023-12-03T11:37:44.253 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.252+0000 7fb5c4111800 20 add_watcher() i=7 2023-12-03T11:37:44.253 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.252+0000 7fb5c4111800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:44.255 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.254+0000 7fb5877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:44.255 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.254+0000 7fb5c4111800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:44.255 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.254+0000 7fb5c4111800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:44.261 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.260+0000 7fb5c4111800 5 note: GC not initialized 2023-12-03T11:37:44.262 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.260+0000 7fb4f67fc640 20 reqs_thread_entry: start 2023-12-03T11:37:44.262 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.260+0000 7fb5c4111800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:44.262 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.261+0000 7fb5c4111800 20 Filter name: none 2023-12-03T11:37:44.262 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.261+0000 7fb4e7fff640 20 reqs_thread_entry: start 2023-12-03T11:37:44.270 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.269+0000 7fb5877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:44.273 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.272+0000 7fb5c4111800 20 remove_watcher() i=0 2023-12-03T11:37:44.273 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.272+0000 7fb5c4111800 2 removed watcher, disabling cache 2023-12-03T11:37:44.274 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.273+0000 7fb5c4111800 20 remove_watcher() i=1 2023-12-03T11:37:44.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.274+0000 7fb5c4111800 20 remove_watcher() i=2 2023-12-03T11:37:44.276 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.275+0000 7fb5c4111800 20 remove_watcher() i=3 2023-12-03T11:37:44.277 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.276+0000 7fb5c4111800 20 remove_watcher() i=4 2023-12-03T11:37:44.278 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.277+0000 7fb5c4111800 20 remove_watcher() i=5 2023-12-03T11:37:44.279 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.278+0000 7fb5c4111800 20 remove_watcher() i=6 2023-12-03T11:37:44.280 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.279+0000 7fb5c4111800 20 remove_watcher() i=7 2023-12-03T11:37:44.285 INFO:tasks.workunit.client.0.smithi044.stderr:bucket name a-bucket 2023-12-03T11:37:44.286 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard process 2023-12-03T11:37:44.286 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:44.287 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin reshard process 2023-12-03T11:37:44.312 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:44.312 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:44.327 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.326+0000 7f0c11523800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.329 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.328+0000 7f0c11523800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.329 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.328+0000 7f0c11523800 20 realm 2023-12-03T11:37:44.329 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.328+0000 7f0c11523800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.329 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.328+0000 7f0c11523800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.329 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.328+0000 7f0c11523800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:44.329 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.328+0000 7f0c11523800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.330 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.328+0000 7f0c11523800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.330 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.328+0000 7f0c11523800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.330 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.329+0000 7f0c11523800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:44.330 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.329+0000 7f0c11523800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.331 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.330+0000 7f0c11523800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:44.331 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.330+0000 7f0c11523800 20 searching for the correct realm 2023-12-03T11:37:44.340 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.339+0000 7f0c0d143640 0 -- 172.21.15.44:0/689401663 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x563ff8acfae0 msgr2=0x563ff8ad1ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:44.342 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.340+0000 7f0c11523800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:44.342 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.340+0000 7f0c11523800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:44.342 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.340+0000 7f0c11523800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:44.342 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.340+0000 7f0c11523800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:44.342 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.340+0000 7f0c11523800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.342 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.341+0000 7f0c11523800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.342 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.341+0000 7f0c11523800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.342 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.341+0000 7f0c11523800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:44.342 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.341+0000 7f0c11523800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.343 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.341+0000 7f0c11523800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:44.343 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.341+0000 7f0c11523800 20 zone default found 2023-12-03T11:37:44.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.341+0000 7f0c11523800 4 Realm: () 2023-12-03T11:37:44.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.341+0000 7f0c11523800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:44.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.341+0000 7f0c11523800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:44.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.341+0000 7f0c11523800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:44.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.341+0000 7f0c11523800 20 zonegroup default 2023-12-03T11:37:44.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.341+0000 7f0c11523800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.341+0000 7f0c11523800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.341+0000 7f0c11523800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.342+0000 7f0c11523800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.342+0000 7f0c11523800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.342+0000 7f0c11523800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:44.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.342+0000 7f0c11523800 20 started sync module instance, tier type = 2023-12-03T11:37:44.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.342+0000 7f0c11523800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:44.349 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.348+0000 7f0c0d944640 0 -- 172.21.15.44:0/689401663 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x563ff8ad7ae0 msgr2=0x563ff8ad9fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:44.352 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.351+0000 7f0c11523800 20 add_watcher() i=0 2023-12-03T11:37:44.352 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.351+0000 7f0c11523800 20 add_watcher() i=1 2023-12-03T11:37:44.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.351+0000 7f0c11523800 20 add_watcher() i=2 2023-12-03T11:37:44.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.351+0000 7f0c11523800 20 add_watcher() i=3 2023-12-03T11:37:44.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.351+0000 7f0c11523800 20 add_watcher() i=4 2023-12-03T11:37:44.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.351+0000 7f0c11523800 20 add_watcher() i=5 2023-12-03T11:37:44.353 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.351+0000 7f0c11523800 20 add_watcher() i=6 2023-12-03T11:37:44.355 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.354+0000 7f0c11523800 20 add_watcher() i=7 2023-12-03T11:37:44.355 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.354+0000 7f0c11523800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:44.356 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.355+0000 7f0bd2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:44.357 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.356+0000 7f0c11523800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:44.357 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.356+0000 7f0c11523800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:44.363 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.362+0000 7f0c11523800 5 note: GC not initialized 2023-12-03T11:37:44.363 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.362+0000 7f0b41ffb640 20 reqs_thread_entry: start 2023-12-03T11:37:44.364 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.362+0000 7f0c11523800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:44.364 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.362+0000 7f0c11523800 20 Filter name: none 2023-12-03T11:37:44.364 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.362+0000 7f0b337fe640 20 reqs_thread_entry: start 2023-12-03T11:37:44.364 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.362+0000 7f0c11523800 20 processing logshard = reshard.0000000000 2023-12-03T11:37:44.366 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.366+0000 7f0c11523800 20 finish processing logshard = reshard.0000000000 , ret = 0 2023-12-03T11:37:44.367 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.366+0000 7f0c11523800 20 processing logshard = reshard.0000000001 2023-12-03T11:37:44.369 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.368+0000 7f0c11523800 20 finish processing logshard = reshard.0000000001 , ret = 0 2023-12-03T11:37:44.369 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.368+0000 7f0c11523800 20 processing logshard = reshard.0000000002 2023-12-03T11:37:44.371 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.371+0000 7f0c11523800 20 finish processing logshard = reshard.0000000002 , ret = 0 2023-12-03T11:37:44.372 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.371+0000 7f0c11523800 20 processing logshard = reshard.0000000003 2023-12-03T11:37:44.374 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.373+0000 7f0c11523800 20 finish processing logshard = reshard.0000000003 , ret = 0 2023-12-03T11:37:44.374 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.373+0000 7f0c11523800 20 processing logshard = reshard.0000000004 2023-12-03T11:37:44.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.376+0000 7f0c11523800 20 finish processing logshard = reshard.0000000004 , ret = 0 2023-12-03T11:37:44.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.376+0000 7f0c11523800 20 processing logshard = reshard.0000000005 2023-12-03T11:37:44.379 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.378+0000 7f0c11523800 20 finish processing logshard = reshard.0000000005 , ret = 0 2023-12-03T11:37:44.379 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.378+0000 7f0c11523800 20 processing logshard = reshard.0000000006 2023-12-03T11:37:44.381 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.380+0000 7f0c11523800 20 process_entry resharding a-bucket 2023-12-03T11:37:44.381 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.380+0000 7f0c11523800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2023-12-03T11:37:44.381 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.380+0000 7f0c11523800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.382 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.380+0000 7f0c11523800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:37:44.382 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.380+0000 7f0c11523800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2023-12-03T11:37:44.382 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.380+0000 7f0c11523800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2023-12-03T11:37:44.382 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.380+0000 7f0c11523800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 : miss 2023-12-03T11:37:44.382 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.380+0000 7f0c11523800 20 rados->read ofs=0 len=0 2023-12-03T11:37:44.382 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.381+0000 7f0c11523800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:37:44.382 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.381+0000 7f0c11523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 info.flags=0x17 2023-12-03T11:37:44.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.381+0000 7f0c11523800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 to cache LRU end 2023-12-03T11:37:44.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.381+0000 7f0c11523800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:37:44.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.381+0000 7f0c11523800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:37:44.383 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.381+0000 7f0c11523800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 2023-12-03T11:37:44.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.386+0000 7f0c11523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 info.flags=0x17 2023-12-03T11:37:44.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.386+0000 7f0c11523800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 to cache LRU end 2023-12-03T11:37:44.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.386+0000 7f0c11523800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:37:44.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.386+0000 7f0c11523800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16, ofs0, ns] 2023-12-03T11:37:44.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.387+0000 7f0bef7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693245 cookie 94832755020416 notifier 6168 bl.length()=789 2023-12-03T11:37:44.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.387+0000 7f0bef7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 info.flags=0x17 2023-12-03T11:37:44.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.387+0000 7f0bef7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 to cache LRU end 2023-12-03T11:37:44.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.387+0000 7f0bef7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:37:44.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.387+0000 7f0c11523800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): orig_sources= new_sources= 2023-12-03T11:37:44.389 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.387+0000 7f0c11523800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): potential sources added=[] removed=[] 2023-12-03T11:37:44.389 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.387+0000 7f0c11523800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): orig_dests= new_dests= 2023-12-03T11:37:44.389 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.387+0000 7f0c11523800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): potential dests added=[] removed=[] 2023-12-03T11:37:44.389 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.388+0000 7f0c11523800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.1.0 2023-12-03T11:37:44.389 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.388+0000 7f0c11523800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.1.0 2023-12-03T11:37:44.389 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.388+0000 7f0c11523800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.1.1 2023-12-03T11:37:44.389 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.388+0000 7f0c11523800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.1.1 2023-12-03T11:37:44.389 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.388+0000 7f0c11523800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.0 2023-12-03T11:37:44.390 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.389+0000 7f0c11523800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 : hit (requested=0x17, cached=0x17) 2023-12-03T11:37:44.390 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.389+0000 7f0c11523800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 2023-12-03T11:37:44.391 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.390+0000 7f0c11523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 info.flags=0x17 2023-12-03T11:37:44.391 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.390+0000 7f0c11523800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 to cache LRU end 2023-12-03T11:37:44.392 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.390+0000 7f0c11523800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:37:44.392 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.390+0000 7f0c11523800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16, ofs0, ns] 2023-12-03T11:37:44.392 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.390+0000 7f0beeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693246 cookie 94832755020416 notifier 6168 bl.length()=757 2023-12-03T11:37:44.392 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.390+0000 7f0beeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 info.flags=0x17 2023-12-03T11:37:44.392 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.390+0000 7f0beeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 to cache LRU end 2023-12-03T11:37:44.392 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.390+0000 7f0beeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:37:44.392 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.391+0000 7f0c11523800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): orig_sources= new_sources= 2023-12-03T11:37:44.392 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.391+0000 7f0c11523800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): potential sources added=[] removed=[] 2023-12-03T11:37:44.392 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.391+0000 7f0c11523800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): orig_dests= new_dests= 2023-12-03T11:37:44.392 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.391+0000 7f0c11523800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): potential dests added=[] removed=[] 2023-12-03T11:37:44.393 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.392+0000 7f0c11523800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2023-12-03T11:37:44.394 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.393+0000 7f0c11523800 20 process_entry removing reshard queue entry for bucket a-bucket 2023-12-03T11:37:44.395 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.395+0000 7f0c11523800 20 finish processing logshard = reshard.0000000006 , ret = 0 2023-12-03T11:37:44.396 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.395+0000 7f0c11523800 20 processing logshard = reshard.0000000007 2023-12-03T11:37:44.397 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.397+0000 7f0c11523800 20 finish processing logshard = reshard.0000000007 , ret = 0 2023-12-03T11:37:44.398 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.397+0000 7f0c11523800 20 processing logshard = reshard.0000000008 2023-12-03T11:37:44.400 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.399+0000 7f0c11523800 20 finish processing logshard = reshard.0000000008 , ret = 0 2023-12-03T11:37:44.400 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.399+0000 7f0c11523800 20 processing logshard = reshard.0000000009 2023-12-03T11:37:44.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.402+0000 7f0c11523800 20 finish processing logshard = reshard.0000000009 , ret = 0 2023-12-03T11:37:44.403 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.402+0000 7f0c11523800 20 processing logshard = reshard.0000000010 2023-12-03T11:37:44.405 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.404+0000 7f0c11523800 20 finish processing logshard = reshard.0000000010 , ret = 0 2023-12-03T11:37:44.405 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.404+0000 7f0c11523800 20 processing logshard = reshard.0000000011 2023-12-03T11:37:44.407 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.406+0000 7f0c11523800 20 finish processing logshard = reshard.0000000011 , ret = 0 2023-12-03T11:37:44.407 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.406+0000 7f0c11523800 20 processing logshard = reshard.0000000012 2023-12-03T11:37:44.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.408+0000 7f0c11523800 20 finish processing logshard = reshard.0000000012 , ret = 0 2023-12-03T11:37:44.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.408+0000 7f0c11523800 20 processing logshard = reshard.0000000013 2023-12-03T11:37:44.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.411+0000 7f0c11523800 20 finish processing logshard = reshard.0000000013 , ret = 0 2023-12-03T11:37:44.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.411+0000 7f0c11523800 20 processing logshard = reshard.0000000014 2023-12-03T11:37:44.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.414+0000 7f0c11523800 20 finish processing logshard = reshard.0000000014 , ret = 0 2023-12-03T11:37:44.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.414+0000 7f0c11523800 20 processing logshard = reshard.0000000015 2023-12-03T11:37:44.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.416+0000 7f0c11523800 20 finish processing logshard = reshard.0000000015 , ret = 0 2023-12-03T11:37:44.418 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.417+0000 7f0bd2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:44.420 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.419+0000 7f0c11523800 20 remove_watcher() i=0 2023-12-03T11:37:44.420 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.419+0000 7f0c11523800 2 removed watcher, disabling cache 2023-12-03T11:37:44.421 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.421+0000 7f0c11523800 20 remove_watcher() i=1 2023-12-03T11:37:44.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.422+0000 7f0c11523800 20 remove_watcher() i=2 2023-12-03T11:37:44.424 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.423+0000 7f0c11523800 20 remove_watcher() i=3 2023-12-03T11:37:44.425 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.424+0000 7f0c11523800 20 remove_watcher() i=4 2023-12-03T11:37:44.426 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.425+0000 7f0c11523800 20 remove_watcher() i=5 2023-12-03T11:37:44.427 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.426+0000 7f0c11523800 20 remove_watcher() i=6 2023-12-03T11:37:44.427 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:44.427+0000 7f0c11523800 20 remove_watcher() i=7 2023-12-03T11:37:49.440 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket a-bucket 2023-12-03T11:37:49.472 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:49.472 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:49.490 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.488+0000 7f8bae32a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.492 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.490+0000 7f8bae32a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.492 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.490+0000 7f8bae32a800 20 realm 2023-12-03T11:37:49.492 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.490+0000 7f8bae32a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.492 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.490+0000 7f8bae32a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.492 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.490+0000 7f8bae32a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:49.492 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.491+0000 7f8bae32a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.492 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.491+0000 7f8bae32a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.492 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.491+0000 7f8bae32a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.492+0000 7f8bae32a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:49.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.492+0000 7f8bae32a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.494 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.493+0000 7f8bae32a800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:49.494 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.493+0000 7f8bae32a800 20 searching for the correct realm 2023-12-03T11:37:49.505 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.504+0000 7f8baa0f0640 0 -- 172.21.15.44:0/1220689783 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x556e3c370b30 msgr2=0x556e3c372f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:49.507 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.506+0000 7f8bae32a800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:49.507 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.506+0000 7f8bae32a800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:49.507 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.506+0000 7f8bae32a800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:49.507 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.506+0000 7f8bae32a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:49.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.506+0000 7f8bae32a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.506+0000 7f8bae32a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.506+0000 7f8bae32a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.506+0000 7f8bae32a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:49.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.506+0000 7f8bae32a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.510 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.507+0000 7f8bae32a800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:49.510 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.507+0000 7f8bae32a800 20 zone default found 2023-12-03T11:37:49.510 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.507+0000 7f8bae32a800 4 Realm: () 2023-12-03T11:37:49.511 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.507+0000 7f8bae32a800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:49.511 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.507+0000 7f8bae32a800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:49.511 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.507+0000 7f8bae32a800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:49.511 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.507+0000 7f8bae32a800 20 zonegroup default 2023-12-03T11:37:49.511 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.507+0000 7f8bae32a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.511 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.507+0000 7f8bae32a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.511 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.507+0000 7f8bae32a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.511 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.507+0000 7f8bae32a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.512 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.507+0000 7f8bae32a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.512 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.508+0000 7f8bae32a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.512 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.508+0000 7f8bae32a800 20 started sync module instance, tier type = 2023-12-03T11:37:49.512 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.508+0000 7f8bae32a800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:49.517 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.516+0000 7f8baa8f1640 0 -- 172.21.15.44:0/1220689783 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x556e3c378b80 msgr2=0x556e3c37b040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:49.520 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.518+0000 7f8bae32a800 20 add_watcher() i=0 2023-12-03T11:37:49.520 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.518+0000 7f8bae32a800 20 add_watcher() i=1 2023-12-03T11:37:49.520 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.518+0000 7f8bae32a800 20 add_watcher() i=2 2023-12-03T11:37:49.520 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.518+0000 7f8bae32a800 20 add_watcher() i=3 2023-12-03T11:37:49.520 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.518+0000 7f8bae32a800 20 add_watcher() i=4 2023-12-03T11:37:49.520 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.518+0000 7f8bae32a800 20 add_watcher() i=5 2023-12-03T11:37:49.520 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.518+0000 7f8bae32a800 20 add_watcher() i=6 2023-12-03T11:37:49.520 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.520+0000 7f8bae32a800 20 add_watcher() i=7 2023-12-03T11:37:49.521 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.520+0000 7f8bae32a800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:49.523 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.522+0000 7f8b6ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:49.523 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.522+0000 7f8bae32a800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:49.523 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.522+0000 7f8bae32a800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:49.529 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.529+0000 7f8bae32a800 5 note: GC not initialized 2023-12-03T11:37:49.530 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.529+0000 7f8adeffd640 20 reqs_thread_entry: start 2023-12-03T11:37:49.530 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.529+0000 7f8bae32a800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:49.530 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.529+0000 7f8bae32a800 20 Filter name: none 2023-12-03T11:37:49.531 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.529+0000 7f8adcff9640 20 reqs_thread_entry: start 2023-12-03T11:37:49.531 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.529+0000 7f8bae32a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.531 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.530+0000 7f8bae32a800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:37:49.531 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.530+0000 7f8bae32a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.532 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.530+0000 7f8bae32a800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:37:49.532 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.530+0000 7f8bae32a800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:49.532 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.530+0000 7f8bae32a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.532 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.531+0000 7f8bae32a800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:37:49.533 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.531+0000 7f8bae32a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.533 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.531+0000 7f8bae32a800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:37:49.533 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.531+0000 7f8bae32a800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:49.533 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.532+0000 7f8bae32a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.533 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.532+0000 7f8bae32a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.534 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.533+0000 7f8b6ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:49.536 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.536+0000 7f8bae32a800 20 remove_watcher() i=0 2023-12-03T11:37:49.537 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.536+0000 7f8bae32a800 2 removed watcher, disabling cache 2023-12-03T11:37:49.538 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.537+0000 7f8bae32a800 20 remove_watcher() i=1 2023-12-03T11:37:49.539 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.538+0000 7f8bae32a800 20 remove_watcher() i=2 2023-12-03T11:37:49.540 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.539+0000 7f8bae32a800 20 remove_watcher() i=3 2023-12-03T11:37:49.541 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.540+0000 7f8bae32a800 20 remove_watcher() i=4 2023-12-03T11:37:49.543 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.542+0000 7f8bae32a800 20 remove_watcher() i=5 2023-12-03T11:37:49.544 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.543+0000 7f8bae32a800 20 remove_watcher() i=6 2023-12-03T11:37:49.545 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.544+0000 7f8bae32a800 20 remove_watcher() i=7 2023-12-03T11:37:49.551 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:49.551 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:37:49.551 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: a-bucket id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 num_objects: 0 size_kb: 0 num_shards: 2 2023-12-03T11:37:49.551 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:49.551 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard add non empty bucket 2023-12-03T11:37:49.551 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:49.610 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket a-bucket 2023-12-03T11:37:49.637 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:49.638 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:49.652 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.651+0000 7f6ca7a12800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.652+0000 7f6ca7a12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.652+0000 7f6ca7a12800 20 realm 2023-12-03T11:37:49.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.652+0000 7f6ca7a12800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.653+0000 7f6ca7a12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.653+0000 7f6ca7a12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:49.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.653+0000 7f6ca7a12800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.653+0000 7f6ca7a12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.653+0000 7f6ca7a12800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.655 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.654+0000 7f6ca7a12800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:49.655 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.654+0000 7f6ca7a12800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.655 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.654+0000 7f6ca7a12800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:49.655 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.654+0000 7f6ca7a12800 20 searching for the correct realm 2023-12-03T11:37:49.666 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.665+0000 7f6ca3057640 0 -- 172.21.15.44:0/4248943490 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55b37f93caf0 msgr2=0x55b37f93ef00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:49.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.666+0000 7f6ca7a12800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:49.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.666+0000 7f6ca7a12800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:49.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.666+0000 7f6ca7a12800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:49.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.666+0000 7f6ca7a12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:49.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.666+0000 7f6ca7a12800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.666+0000 7f6ca7a12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.666+0000 7f6ca7a12800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.668 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.666+0000 7f6ca7a12800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:49.668 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.666+0000 7f6ca7a12800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.666+0000 7f6ca7a12800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:49.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.666+0000 7f6ca7a12800 20 zone default found 2023-12-03T11:37:49.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.666+0000 7f6ca7a12800 4 Realm: () 2023-12-03T11:37:49.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.667+0000 7f6ca7a12800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:49.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.667+0000 7f6ca7a12800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:49.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.667+0000 7f6ca7a12800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:49.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.667+0000 7f6ca7a12800 20 zonegroup default 2023-12-03T11:37:49.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.667+0000 7f6ca7a12800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.667+0000 7f6ca7a12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.667+0000 7f6ca7a12800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.667+0000 7f6ca7a12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.667+0000 7f6ca7a12800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.667+0000 7f6ca7a12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.670 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.667+0000 7f6ca7a12800 20 started sync module instance, tier type = 2023-12-03T11:37:49.670 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.667+0000 7f6ca7a12800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:49.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.674+0000 7f6ca3858640 0 -- 172.21.15.44:0/4248943490 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f6c98027020 msgr2=0x7f6c98061960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:49.677 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.676+0000 7f6ca7a12800 20 add_watcher() i=0 2023-12-03T11:37:49.677 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.676+0000 7f6ca7a12800 20 add_watcher() i=1 2023-12-03T11:37:49.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.676+0000 7f6ca7a12800 20 add_watcher() i=2 2023-12-03T11:37:49.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.676+0000 7f6ca7a12800 20 add_watcher() i=3 2023-12-03T11:37:49.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.676+0000 7f6ca7a12800 20 add_watcher() i=4 2023-12-03T11:37:49.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.676+0000 7f6ca7a12800 20 add_watcher() i=5 2023-12-03T11:37:49.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.676+0000 7f6ca7a12800 20 add_watcher() i=6 2023-12-03T11:37:49.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.677+0000 7f6ca7a12800 20 add_watcher() i=7 2023-12-03T11:37:49.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.677+0000 7f6ca7a12800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:49.680 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.679+0000 7f6c697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:49.680 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.679+0000 7f6ca7a12800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:49.680 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.679+0000 7f6ca7a12800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:49.686 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.685+0000 7f6ca7a12800 5 note: GC not initialized 2023-12-03T11:37:49.686 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.685+0000 7f6bd7fff640 20 reqs_thread_entry: start 2023-12-03T11:37:49.686 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.685+0000 7f6ca7a12800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:49.687 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.685+0000 7f6ca7a12800 20 Filter name: none 2023-12-03T11:37:49.687 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.685+0000 7f6bd5ffb640 20 reqs_thread_entry: start 2023-12-03T11:37:49.687 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.685+0000 7f6ca7a12800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.687 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.686+0000 7f6ca7a12800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:37:49.687 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.686+0000 7f6ca7a12800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.688 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.687+0000 7f6ca7a12800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:37:49.688 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.687+0000 7f6ca7a12800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:49.688 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.687+0000 7f6ca7a12800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.688 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.687+0000 7f6ca7a12800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:37:49.688 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.687+0000 7f6ca7a12800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.689 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.688+0000 7f6ca7a12800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:37:49.689 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.688+0000 7f6ca7a12800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:49.689 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.688+0000 7f6ca7a12800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.689 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.689+0000 7f6ca7a12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.690 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.689+0000 7f6c697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:49.693 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.692+0000 7f6ca7a12800 20 remove_watcher() i=0 2023-12-03T11:37:49.693 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.692+0000 7f6ca7a12800 2 removed watcher, disabling cache 2023-12-03T11:37:49.694 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.693+0000 7f6ca7a12800 20 remove_watcher() i=1 2023-12-03T11:37:49.695 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.694+0000 7f6ca7a12800 20 remove_watcher() i=2 2023-12-03T11:37:49.696 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.695+0000 7f6ca7a12800 20 remove_watcher() i=3 2023-12-03T11:37:49.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.696+0000 7f6ca7a12800 20 remove_watcher() i=4 2023-12-03T11:37:49.698 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.697+0000 7f6ca7a12800 20 remove_watcher() i=5 2023-12-03T11:37:49.699 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.698+0000 7f6ca7a12800 20 remove_watcher() i=6 2023-12-03T11:37:49.700 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.699+0000 7f6ca7a12800 20 remove_watcher() i=7 2023-12-03T11:37:49.705 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:49.705 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:37:49.705 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: a-bucket id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 num_objects: 8 size_kb: 1 num_shards: 2 2023-12-03T11:37:49.705 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:49.706 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 3 2023-12-03T11:37:49.736 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:49.736 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:49.750 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.749+0000 7f0586085800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.752 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.751+0000 7f0586085800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.752 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.751+0000 7f0586085800 20 realm 2023-12-03T11:37:49.752 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.751+0000 7f0586085800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.752 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.751+0000 7f0586085800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.753 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.751+0000 7f0586085800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:49.753 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.751+0000 7f0586085800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.753 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.751+0000 7f0586085800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.753 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.751+0000 7f0586085800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.753 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.752+0000 7f0586085800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:49.753 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.752+0000 7f0586085800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.753+0000 7f0586085800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:49.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.753+0000 7f0586085800 20 searching for the correct realm 2023-12-03T11:37:49.763 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.762+0000 7f0583b85640 0 -- 172.21.15.44:0/380554511 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x5617688817f0 msgr2=0x561768883c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:37:49.767 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.764+0000 7f0586085800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:49.767 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.764+0000 7f0586085800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:49.767 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.764+0000 7f0586085800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:49.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.764+0000 7f0586085800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:49.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.764+0000 7f0586085800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.764+0000 7f0586085800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.764+0000 7f0586085800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.765+0000 7f0586085800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:49.768 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.765+0000 7f0586085800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.769 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.765+0000 7f0586085800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:49.769 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.765+0000 7f0586085800 20 zone default found 2023-12-03T11:37:49.769 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.765+0000 7f0586085800 4 Realm: () 2023-12-03T11:37:49.769 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.765+0000 7f0586085800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:49.769 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.765+0000 7f0586085800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:49.769 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.765+0000 7f0586085800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:49.769 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.765+0000 7f0586085800 20 zonegroup default 2023-12-03T11:37:49.770 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.765+0000 7f0586085800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.770 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.765+0000 7f0586085800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.770 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.765+0000 7f0586085800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.770 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.765+0000 7f0586085800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.770 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.765+0000 7f0586085800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.771 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.766+0000 7f0586085800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.771 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.766+0000 7f0586085800 20 started sync module instance, tier type = 2023-12-03T11:37:49.771 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.766+0000 7f0586085800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:49.772 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.771+0000 7f0583384640 0 -- 172.21.15.44:0/380554511 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x561768885020 msgr2=0x561768887410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:49.776 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.774+0000 7f0586085800 20 add_watcher() i=0 2023-12-03T11:37:49.776 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.774+0000 7f0586085800 20 add_watcher() i=1 2023-12-03T11:37:49.776 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.774+0000 7f0586085800 20 add_watcher() i=2 2023-12-03T11:37:49.777 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.774+0000 7f0586085800 20 add_watcher() i=3 2023-12-03T11:37:49.777 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.774+0000 7f0586085800 20 add_watcher() i=4 2023-12-03T11:37:49.777 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.774+0000 7f0586085800 20 add_watcher() i=5 2023-12-03T11:37:49.777 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.775+0000 7f0586085800 20 add_watcher() i=6 2023-12-03T11:37:49.778 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.775+0000 7f0586085800 20 add_watcher() i=7 2023-12-03T11:37:49.778 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.775+0000 7f0586085800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:49.779 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.777+0000 7f0549fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:49.779 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.777+0000 7f0586085800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:49.779 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.777+0000 7f0586085800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:49.788 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.783+0000 7f0586085800 5 note: GC not initialized 2023-12-03T11:37:49.788 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.784+0000 7f04c0ff9640 20 reqs_thread_entry: start 2023-12-03T11:37:49.788 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.784+0000 7f0586085800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:49.788 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.784+0000 7f0586085800 20 Filter name: none 2023-12-03T11:37:49.789 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.784+0000 7f04b67fc640 20 reqs_thread_entry: start 2023-12-03T11:37:49.789 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.784+0000 7f0586085800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2023-12-03T11:37:49.789 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.784+0000 7f0586085800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.789 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.784+0000 7f0586085800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:37:49.789 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.785+0000 7f0586085800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2023-12-03T11:37:49.789 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.785+0000 7f0586085800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2023-12-03T11:37:49.790 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.785+0000 7f0586085800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 : miss 2023-12-03T11:37:49.790 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.785+0000 7f0586085800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.790 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.785+0000 7f0586085800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:37:49.790 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.785+0000 7f0586085800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 info.flags=0x17 2023-12-03T11:37:49.790 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.785+0000 7f0586085800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 to cache LRU end 2023-12-03T11:37:49.790 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.785+0000 7f0586085800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:37:49.790 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.785+0000 7f0586085800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:37:49.790 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.785+0000 7f0586085800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 2023-12-03T11:37:49.791 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.788+0000 7f0549fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:49.791 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.790+0000 7f0586085800 20 remove_watcher() i=0 2023-12-03T11:37:49.791 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.790+0000 7f0586085800 2 removed watcher, disabling cache 2023-12-03T11:37:49.792 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.791+0000 7f0586085800 20 remove_watcher() i=1 2023-12-03T11:37:49.793 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.792+0000 7f0586085800 20 remove_watcher() i=2 2023-12-03T11:37:49.794 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.793+0000 7f0586085800 20 remove_watcher() i=3 2023-12-03T11:37:49.795 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.794+0000 7f0586085800 20 remove_watcher() i=4 2023-12-03T11:37:49.796 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.795+0000 7f0586085800 20 remove_watcher() i=5 2023-12-03T11:37:49.797 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.796+0000 7f0586085800 20 remove_watcher() i=6 2023-12-03T11:37:49.798 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.797+0000 7f0586085800 20 remove_watcher() i=7 2023-12-03T11:37:49.804 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin reshard list 2023-12-03T11:37:49.830 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:49.830 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:49.844 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.843+0000 7fbf0752f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.846 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.845+0000 7fbf0752f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.847 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.845+0000 7fbf0752f800 20 realm 2023-12-03T11:37:49.847 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.845+0000 7fbf0752f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.847 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.845+0000 7fbf0752f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.847 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.845+0000 7fbf0752f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:49.847 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.845+0000 7fbf0752f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.847 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.845+0000 7fbf0752f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.847 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.845+0000 7fbf0752f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.847 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.846+0000 7fbf0752f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:49.848 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.846+0000 7fbf0752f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.848 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.847+0000 7fbf0752f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:49.848 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.847+0000 7fbf0752f800 20 searching for the correct realm 2023-12-03T11:37:49.857 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.856+0000 7fbf03268640 0 -- 172.21.15.44:0/3737072910 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55bc8281d6d0 msgr2=0x55bc8281fac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:49.859 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.858+0000 7fbf0752f800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:49.859 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.858+0000 7fbf0752f800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:49.859 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.858+0000 7fbf0752f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:49.859 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.858+0000 7fbf0752f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:49.859 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.858+0000 7fbf0752f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.859 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.858+0000 7fbf0752f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.859 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.858+0000 7fbf0752f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.858+0000 7fbf0752f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:49.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.858+0000 7fbf0752f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.859+0000 7fbf0752f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:49.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.859+0000 7fbf0752f800 20 zone default found 2023-12-03T11:37:49.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.859+0000 7fbf0752f800 4 Realm: () 2023-12-03T11:37:49.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.859+0000 7fbf0752f800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:49.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.859+0000 7fbf0752f800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:49.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.859+0000 7fbf0752f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:49.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.859+0000 7fbf0752f800 20 zonegroup default 2023-12-03T11:37:49.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.859+0000 7fbf0752f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.862 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.859+0000 7fbf0752f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.862 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.859+0000 7fbf0752f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.862 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.859+0000 7fbf0752f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.862 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.859+0000 7fbf0752f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.862 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.860+0000 7fbf0752f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.862 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.860+0000 7fbf0752f800 20 started sync module instance, tier type = 2023-12-03T11:37:49.862 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.860+0000 7fbf0752f800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:49.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.866+0000 7fbf03a69640 0 -- 172.21.15.44:0/3737072910 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55bc82825730 msgr2=0x55bc82827bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:49.870 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.869+0000 7fbf0752f800 20 add_watcher() i=0 2023-12-03T11:37:49.870 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.869+0000 7fbf0752f800 20 add_watcher() i=1 2023-12-03T11:37:49.870 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.869+0000 7fbf0752f800 20 add_watcher() i=2 2023-12-03T11:37:49.870 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.869+0000 7fbf0752f800 20 add_watcher() i=3 2023-12-03T11:37:49.870 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.869+0000 7fbf0752f800 20 add_watcher() i=4 2023-12-03T11:37:49.870 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.869+0000 7fbf0752f800 20 add_watcher() i=5 2023-12-03T11:37:49.870 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.869+0000 7fbf0752f800 20 add_watcher() i=6 2023-12-03T11:37:49.871 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.870+0000 7fbf0752f800 20 add_watcher() i=7 2023-12-03T11:37:49.871 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.870+0000 7fbf0752f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:49.872 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.871+0000 7fbec97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:49.872 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.871+0000 7fbf0752f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:49.872 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.871+0000 7fbf0752f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:49.878 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.877+0000 7fbf0752f800 5 note: GC not initialized 2023-12-03T11:37:49.879 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.878+0000 7fbe37fff640 20 reqs_thread_entry: start 2023-12-03T11:37:49.879 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.878+0000 7fbf0752f800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:49.879 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.878+0000 7fbf0752f800 20 Filter name: none 2023-12-03T11:37:49.879 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.878+0000 7fbe35ffb640 20 reqs_thread_entry: start 2023-12-03T11:37:49.887 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.886+0000 7fbec97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:49.889 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.888+0000 7fbf0752f800 20 remove_watcher() i=0 2023-12-03T11:37:49.889 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.888+0000 7fbf0752f800 2 removed watcher, disabling cache 2023-12-03T11:37:49.890 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.890+0000 7fbf0752f800 20 remove_watcher() i=1 2023-12-03T11:37:49.892 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:49.891+0000 7fbf0752f800 20 remove_watcher() i=2 2023-12-03T11:37:50.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.057+0000 7fbf0752f800 20 remove_watcher() i=3 2023-12-03T11:37:50.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.059+0000 7fbf0752f800 20 remove_watcher() i=4 2023-12-03T11:37:50.061 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.060+0000 7fbf0752f800 20 remove_watcher() i=5 2023-12-03T11:37:50.062 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.061+0000 7fbf0752f800 20 remove_watcher() i=6 2023-12-03T11:37:50.063 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.062+0000 7fbf0752f800 20 remove_watcher() i=7 2023-12-03T11:37:50.068 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard process non empty bucket 2023-12-03T11:37:50.069 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:50.070 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin reshard process 2023-12-03T11:37:50.097 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:50.097 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:50.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.111+0000 7fd50da0f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.112+0000 7fd50da0f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.112+0000 7fd50da0f800 20 realm 2023-12-03T11:37:50.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.112+0000 7fd50da0f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.112+0000 7fd50da0f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.112+0000 7fd50da0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:50.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.112+0000 7fd50da0f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.113+0000 7fd50da0f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.113+0000 7fd50da0f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.115 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.114+0000 7fd50da0f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:50.115 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.114+0000 7fd50da0f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.115 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.114+0000 7fd50da0f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:50.115 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.114+0000 7fd50da0f800 20 searching for the correct realm 2023-12-03T11:37:50.124 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.123+0000 7fd50988d640 0 -- 172.21.15.44:0/1510224220 >> [v2:172.21.15.44:6808/1530174506,v1:172.21.15.44:6809/1530174506] conn(0x55ef3319c530 msgr2=0x55ef3319e920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:50.126 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.125+0000 7fd50da0f800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:50.126 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.125+0000 7fd50da0f800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:50.126 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.125+0000 7fd50da0f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:50.126 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.125+0000 7fd50da0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:50.126 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.125+0000 7fd50da0f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.126 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.125+0000 7fd50da0f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.126 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.125+0000 7fd50da0f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.127 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.125+0000 7fd50da0f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:50.127 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.125+0000 7fd50da0f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.127 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.125+0000 7fd50da0f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:50.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.125+0000 7fd50da0f800 20 zone default found 2023-12-03T11:37:50.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.125+0000 7fd50da0f800 4 Realm: () 2023-12-03T11:37:50.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.125+0000 7fd50da0f800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:50.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.125+0000 7fd50da0f800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:50.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.125+0000 7fd50da0f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:50.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.125+0000 7fd50da0f800 20 zonegroup default 2023-12-03T11:37:50.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.125+0000 7fd50da0f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.126+0000 7fd50da0f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.126+0000 7fd50da0f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.126+0000 7fd50da0f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.126+0000 7fd50da0f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.126+0000 7fd50da0f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.126+0000 7fd50da0f800 20 started sync module instance, tier type = 2023-12-03T11:37:50.128 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.126+0000 7fd50da0f800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:50.131 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.130+0000 7fd50908c640 0 -- 172.21.15.44:0/1510224220 >> [v2:172.21.15.91:6808/776869758,v1:172.21.15.91:6809/776869758] conn(0x7fd504024950 msgr2=0x7fd5040153c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:50.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.136+0000 7fd50da0f800 20 add_watcher() i=0 2023-12-03T11:37:50.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.136+0000 7fd50da0f800 20 add_watcher() i=1 2023-12-03T11:37:50.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.136+0000 7fd50da0f800 20 add_watcher() i=2 2023-12-03T11:37:50.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.136+0000 7fd50da0f800 20 add_watcher() i=3 2023-12-03T11:37:50.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.136+0000 7fd50da0f800 20 add_watcher() i=4 2023-12-03T11:37:50.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.136+0000 7fd50da0f800 20 add_watcher() i=5 2023-12-03T11:37:50.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.136+0000 7fd50da0f800 20 add_watcher() i=6 2023-12-03T11:37:50.137 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.137+0000 7fd50da0f800 20 add_watcher() i=7 2023-12-03T11:37:50.138 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.137+0000 7fd50da0f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:50.139 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.138+0000 7fd4cefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:50.140 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.139+0000 7fd50da0f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:50.140 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.139+0000 7fd50da0f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:50.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.145+0000 7fd50da0f800 5 note: GC not initialized 2023-12-03T11:37:50.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.145+0000 7fd43dffb640 20 reqs_thread_entry: start 2023-12-03T11:37:50.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.145+0000 7fd50da0f800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:50.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.145+0000 7fd50da0f800 20 Filter name: none 2023-12-03T11:37:50.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.145+0000 7fd42f7fe640 20 reqs_thread_entry: start 2023-12-03T11:37:50.147 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.145+0000 7fd50da0f800 20 processing logshard = reshard.0000000000 2023-12-03T11:37:50.149 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.148+0000 7fd50da0f800 20 finish processing logshard = reshard.0000000000 , ret = 0 2023-12-03T11:37:50.149 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.148+0000 7fd50da0f800 20 processing logshard = reshard.0000000001 2023-12-03T11:37:50.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.151+0000 7fd50da0f800 20 finish processing logshard = reshard.0000000001 , ret = 0 2023-12-03T11:37:50.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.151+0000 7fd50da0f800 20 processing logshard = reshard.0000000002 2023-12-03T11:37:50.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.154+0000 7fd50da0f800 20 finish processing logshard = reshard.0000000002 , ret = 0 2023-12-03T11:37:50.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.154+0000 7fd50da0f800 20 processing logshard = reshard.0000000003 2023-12-03T11:37:50.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.156+0000 7fd50da0f800 20 finish processing logshard = reshard.0000000003 , ret = 0 2023-12-03T11:37:50.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.156+0000 7fd50da0f800 20 processing logshard = reshard.0000000004 2023-12-03T11:37:50.159 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.158+0000 7fd50da0f800 20 finish processing logshard = reshard.0000000004 , ret = 0 2023-12-03T11:37:50.159 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.158+0000 7fd50da0f800 20 processing logshard = reshard.0000000005 2023-12-03T11:37:50.162 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.161+0000 7fd50da0f800 20 finish processing logshard = reshard.0000000005 , ret = 0 2023-12-03T11:37:50.162 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.161+0000 7fd50da0f800 20 processing logshard = reshard.0000000006 2023-12-03T11:37:50.164 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.163+0000 7fd50da0f800 20 process_entry resharding a-bucket 2023-12-03T11:37:50.164 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.163+0000 7fd50da0f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2023-12-03T11:37:50.164 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.163+0000 7fd50da0f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.165 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.163+0000 7fd50da0f800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:37:50.165 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.163+0000 7fd50da0f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2023-12-03T11:37:50.165 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.163+0000 7fd50da0f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2023-12-03T11:37:50.165 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.163+0000 7fd50da0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 : miss 2023-12-03T11:37:50.165 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.163+0000 7fd50da0f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.166 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.164+0000 7fd50da0f800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:37:50.166 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.164+0000 7fd50da0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 info.flags=0x17 2023-12-03T11:37:50.166 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.164+0000 7fd50da0f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 to cache LRU end 2023-12-03T11:37:50.166 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.164+0000 7fd50da0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:37:50.166 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.164+0000 7fd50da0f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:37:50.166 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.164+0000 7fd50da0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 2023-12-03T11:37:50.171 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.170+0000 7fd50da0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 info.flags=0x17 2023-12-03T11:37:50.171 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.170+0000 7fd50da0f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 to cache LRU end 2023-12-03T11:37:50.171 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.170+0000 7fd50da0f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:37:50.171 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.170+0000 7fd50da0f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16, ofs0, ns] 2023-12-03T11:37:50.171 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.170+0000 7fd4eaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693247 cookie 94485842877168 notifier 6273 bl.length()=789 2023-12-03T11:37:50.171 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.170+0000 7fd4eaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 info.flags=0x17 2023-12-03T11:37:50.172 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.170+0000 7fd4eaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 to cache LRU end 2023-12-03T11:37:50.172 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.170+0000 7fd4eaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:37:50.172 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.170+0000 7fd50da0f800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): orig_sources= new_sources= 2023-12-03T11:37:50.172 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.170+0000 7fd50da0f800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): potential sources added=[] removed=[] 2023-12-03T11:37:50.172 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.170+0000 7fd50da0f800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): orig_dests= new_dests= 2023-12-03T11:37:50.172 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.170+0000 7fd50da0f800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): potential dests added=[] removed=[] 2023-12-03T11:37:50.173 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.172+0000 7fd50da0f800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.2.0 2023-12-03T11:37:50.173 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.172+0000 7fd50da0f800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.2.0 2023-12-03T11:37:50.173 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.172+0000 7fd50da0f800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.2.1 2023-12-03T11:37:50.173 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.172+0000 7fd50da0f800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.2.1 2023-12-03T11:37:50.173 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.172+0000 7fd50da0f800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.2.2 2023-12-03T11:37:50.173 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.172+0000 7fd50da0f800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.2.2 2023-12-03T11:37:50.173 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.172+0000 7fd50da0f800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.1.0 2023-12-03T11:37:50.173 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.172+0000 7fd50da0f800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.1.0 2023-12-03T11:37:50.173 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.172+0000 7fd50da0f800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.1.1 2023-12-03T11:37:50.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.172+0000 7fd50da0f800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.1.1 2023-12-03T11:37:50.175 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.174+0000 7fd50da0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 : hit (requested=0x17, cached=0x17) 2023-12-03T11:37:50.175 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.174+0000 7fd50da0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 2023-12-03T11:37:50.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.175+0000 7fd50da0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 info.flags=0x17 2023-12-03T11:37:50.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.175+0000 7fd50da0f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 to cache LRU end 2023-12-03T11:37:50.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.175+0000 7fd50da0f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:37:50.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.175+0000 7fd50da0f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16, ofs0, ns] 2023-12-03T11:37:50.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.175+0000 7fd4eaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693248 cookie 94485842877168 notifier 6273 bl.length()=757 2023-12-03T11:37:50.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.175+0000 7fd4eaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 info.flags=0x17 2023-12-03T11:37:50.177 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.175+0000 7fd4eaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 to cache LRU end 2023-12-03T11:37:50.177 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.175+0000 7fd4eaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:37:50.177 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.175+0000 7fd50da0f800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): orig_sources= new_sources= 2023-12-03T11:37:50.177 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.175+0000 7fd50da0f800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): potential sources added=[] removed=[] 2023-12-03T11:37:50.177 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.175+0000 7fd50da0f800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): orig_dests= new_dests= 2023-12-03T11:37:50.177 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.175+0000 7fd50da0f800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): potential dests added=[] removed=[] 2023-12-03T11:37:50.178 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.177+0000 7fd50da0f800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2023-12-03T11:37:50.179 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.178+0000 7fd50da0f800 20 process_entry removing reshard queue entry for bucket a-bucket 2023-12-03T11:37:50.180 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.180+0000 7fd50da0f800 20 finish processing logshard = reshard.0000000006 , ret = 0 2023-12-03T11:37:50.180 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.180+0000 7fd50da0f800 20 processing logshard = reshard.0000000007 2023-12-03T11:37:50.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.181+0000 7fd50da0f800 20 finish processing logshard = reshard.0000000007 , ret = 0 2023-12-03T11:37:50.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.181+0000 7fd50da0f800 20 processing logshard = reshard.0000000008 2023-12-03T11:37:50.185 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.184+0000 7fd50da0f800 20 finish processing logshard = reshard.0000000008 , ret = 0 2023-12-03T11:37:50.185 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.184+0000 7fd50da0f800 20 processing logshard = reshard.0000000009 2023-12-03T11:37:50.188 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.187+0000 7fd50da0f800 20 finish processing logshard = reshard.0000000009 , ret = 0 2023-12-03T11:37:50.188 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.187+0000 7fd50da0f800 20 processing logshard = reshard.0000000010 2023-12-03T11:37:50.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.189+0000 7fd50da0f800 20 finish processing logshard = reshard.0000000010 , ret = 0 2023-12-03T11:37:50.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.189+0000 7fd50da0f800 20 processing logshard = reshard.0000000011 2023-12-03T11:37:50.192 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.192+0000 7fd50da0f800 20 finish processing logshard = reshard.0000000011 , ret = 0 2023-12-03T11:37:50.192 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.192+0000 7fd50da0f800 20 processing logshard = reshard.0000000012 2023-12-03T11:37:50.195 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.194+0000 7fd50da0f800 20 finish processing logshard = reshard.0000000012 , ret = 0 2023-12-03T11:37:50.195 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.194+0000 7fd50da0f800 20 processing logshard = reshard.0000000013 2023-12-03T11:37:50.198 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.197+0000 7fd50da0f800 20 finish processing logshard = reshard.0000000013 , ret = 0 2023-12-03T11:37:50.198 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.197+0000 7fd50da0f800 20 processing logshard = reshard.0000000014 2023-12-03T11:37:50.200 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.199+0000 7fd50da0f800 20 finish processing logshard = reshard.0000000014 , ret = 0 2023-12-03T11:37:50.200 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.199+0000 7fd50da0f800 20 processing logshard = reshard.0000000015 2023-12-03T11:37:50.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.202+0000 7fd50da0f800 20 finish processing logshard = reshard.0000000015 , ret = 0 2023-12-03T11:37:50.203 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.202+0000 7fd4cefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:50.205 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.204+0000 7fd50da0f800 20 remove_watcher() i=0 2023-12-03T11:37:50.205 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.204+0000 7fd50da0f800 2 removed watcher, disabling cache 2023-12-03T11:37:50.206 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.205+0000 7fd50da0f800 20 remove_watcher() i=1 2023-12-03T11:37:50.208 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.206+0000 7fd50da0f800 20 remove_watcher() i=2 2023-12-03T11:37:50.208 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.207+0000 7fd50da0f800 20 remove_watcher() i=3 2023-12-03T11:37:50.209 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.208+0000 7fd50da0f800 20 remove_watcher() i=4 2023-12-03T11:37:50.210 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.210+0000 7fd50da0f800 20 remove_watcher() i=5 2023-12-03T11:37:50.211 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.210+0000 7fd50da0f800 20 remove_watcher() i=6 2023-12-03T11:37:50.212 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.211+0000 7fd50da0f800 20 remove_watcher() i=7 2023-12-03T11:37:50.219 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket a-bucket 2023-12-03T11:37:50.246 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:50.246 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:50.261 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.259+0000 7f2d50f33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.263 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.261+0000 7f2d50f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.263 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.261+0000 7f2d50f33800 20 realm 2023-12-03T11:37:50.263 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.261+0000 7f2d50f33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.263 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.262+0000 7f2d50f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.263 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.262+0000 7f2d50f33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:50.263 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.262+0000 7f2d50f33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.263 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.262+0000 7f2d50f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.263 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.262+0000 7f2d50f33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.264 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.263+0000 7f2d50f33800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:50.264 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.263+0000 7f2d50f33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.264 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.263+0000 7f2d50f33800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:50.265 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.263+0000 7f2d50f33800 20 searching for the correct realm 2023-12-03T11:37:50.274 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.273+0000 7f2d4cb7e640 0 -- 172.21.15.44:0/705001360 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55e5949b68e0 msgr2=0x55e5949b8cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:50.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.274+0000 7f2d50f33800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:50.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.274+0000 7f2d50f33800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:50.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.274+0000 7f2d50f33800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:50.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.274+0000 7f2d50f33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:50.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.274+0000 7f2d50f33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.274+0000 7f2d50f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.274+0000 7f2d50f33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.276 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.274+0000 7f2d50f33800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:50.276 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.274+0000 7f2d50f33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.276 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.275+0000 7f2d50f33800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:50.276 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.275+0000 7f2d50f33800 20 zone default found 2023-12-03T11:37:50.276 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.275+0000 7f2d50f33800 4 Realm: () 2023-12-03T11:37:50.277 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.275+0000 7f2d50f33800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:50.277 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.275+0000 7f2d50f33800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:50.277 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.275+0000 7f2d50f33800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:50.277 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.275+0000 7f2d50f33800 20 zonegroup default 2023-12-03T11:37:50.277 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.275+0000 7f2d50f33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.277 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.275+0000 7f2d50f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.277 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.275+0000 7f2d50f33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.277 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.275+0000 7f2d50f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.277 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.275+0000 7f2d50f33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.277 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.276+0000 7f2d50f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.278 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.276+0000 7f2d50f33800 20 started sync module instance, tier type = 2023-12-03T11:37:50.278 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.276+0000 7f2d50f33800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:50.283 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.282+0000 7f2d4d37f640 0 -- 172.21.15.44:0/705001360 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f2d4006fba0 msgr2=0x7f2d4007e3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:50.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.284+0000 7f2d50f33800 20 add_watcher() i=0 2023-12-03T11:37:50.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.284+0000 7f2d50f33800 20 add_watcher() i=1 2023-12-03T11:37:50.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.284+0000 7f2d50f33800 20 add_watcher() i=2 2023-12-03T11:37:50.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.284+0000 7f2d50f33800 20 add_watcher() i=3 2023-12-03T11:37:50.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.284+0000 7f2d50f33800 20 add_watcher() i=4 2023-12-03T11:37:50.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.284+0000 7f2d50f33800 20 add_watcher() i=5 2023-12-03T11:37:50.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.284+0000 7f2d50f33800 20 add_watcher() i=6 2023-12-03T11:37:50.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.285+0000 7f2d50f33800 20 add_watcher() i=7 2023-12-03T11:37:50.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.285+0000 7f2d50f33800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:50.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.287+0000 7f2d12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:50.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.287+0000 7f2d50f33800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:50.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.287+0000 7f2d50f33800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:50.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.293+0000 7f2d50f33800 5 note: GC not initialized 2023-12-03T11:37:50.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.293+0000 7f2c81ffb640 20 reqs_thread_entry: start 2023-12-03T11:37:50.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.293+0000 7f2d50f33800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:50.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.293+0000 7f2d50f33800 20 Filter name: none 2023-12-03T11:37:50.295 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.293+0000 7f2c737fe640 20 reqs_thread_entry: start 2023-12-03T11:37:50.295 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.293+0000 7f2d50f33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.295 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.294+0000 7f2d50f33800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:37:50.295 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.294+0000 7f2d50f33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.296 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.294+0000 7f2d50f33800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:37:50.296 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.294+0000 7f2d50f33800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:50.296 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.294+0000 7f2d50f33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.296 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.295+0000 7f2d50f33800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:37:50.296 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.295+0000 7f2d50f33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.296 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.295+0000 7f2d50f33800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:37:50.296 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.295+0000 7f2d50f33800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:50.296 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.295+0000 7f2d50f33800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.297 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.296+0000 7f2d50f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.297 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.297+0000 7f2d12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:50.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.299+0000 7f2d50f33800 20 remove_watcher() i=0 2023-12-03T11:37:50.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.299+0000 7f2d50f33800 2 removed watcher, disabling cache 2023-12-03T11:37:50.301 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.300+0000 7f2d50f33800 20 remove_watcher() i=1 2023-12-03T11:37:50.302 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.301+0000 7f2d50f33800 20 remove_watcher() i=2 2023-12-03T11:37:50.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.303+0000 7f2d50f33800 20 remove_watcher() i=3 2023-12-03T11:37:50.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.304+0000 7f2d50f33800 20 remove_watcher() i=4 2023-12-03T11:37:50.306 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.305+0000 7f2d50f33800 20 remove_watcher() i=5 2023-12-03T11:37:50.307 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.306+0000 7f2d50f33800 20 remove_watcher() i=6 2023-12-03T11:37:50.308 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.307+0000 7f2d50f33800 20 remove_watcher() i=7 2023-12-03T11:37:50.313 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:50.313 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:37:50.313 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: a-bucket id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 num_objects: 8 size_kb: 1 num_shards: 3 2023-12-03T11:37:50.313 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:50.313 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2023-12-03T11:37:50.313 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:50.509 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2023-12-03T11:37:50.537 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:50.537 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:50.551 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.550+0000 7ff587d48800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.553 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.551+0000 7ff587d48800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.553 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.551+0000 7ff587d48800 20 realm 2023-12-03T11:37:50.553 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.551+0000 7ff587d48800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.553 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.552+0000 7ff587d48800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.553 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.552+0000 7ff587d48800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:50.553 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.552+0000 7ff587d48800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.553 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.552+0000 7ff587d48800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.553 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.552+0000 7ff587d48800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.554 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.553+0000 7ff587d48800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:50.554 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.553+0000 7ff587d48800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.554 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.553+0000 7ff587d48800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:50.554 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.553+0000 7ff587d48800 20 searching for the correct realm 2023-12-03T11:37:50.564 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.563+0000 7ff58430f640 0 -- 172.21.15.44:0/761151162 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55c85c4414a0 msgr2=0x55c85c443960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:50.565 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.564+0000 7ff587d48800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:50.565 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.564+0000 7ff587d48800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:50.565 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.564+0000 7ff587d48800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:50.565 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.564+0000 7ff587d48800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:50.565 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.564+0000 7ff587d48800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.565 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.564+0000 7ff587d48800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.565 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.564+0000 7ff587d48800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.566 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.564+0000 7ff587d48800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:50.566 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.564+0000 7ff587d48800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.565+0000 7ff587d48800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:50.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.565+0000 7ff587d48800 20 zone default found 2023-12-03T11:37:50.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.565+0000 7ff587d48800 4 Realm: () 2023-12-03T11:37:50.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.565+0000 7ff587d48800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:50.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.565+0000 7ff587d48800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:50.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.565+0000 7ff587d48800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:50.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.565+0000 7ff587d48800 20 zonegroup default 2023-12-03T11:37:50.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.565+0000 7ff587d48800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.565+0000 7ff587d48800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.565+0000 7ff587d48800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.565+0000 7ff587d48800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.568 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.565+0000 7ff587d48800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.568 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.565+0000 7ff587d48800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.568 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.565+0000 7ff587d48800 20 started sync module instance, tier type = 2023-12-03T11:37:50.568 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.565+0000 7ff587d48800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:50.574 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.573+0000 7ff58430f640 0 -- 172.21.15.44:0/761151162 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x7ff55c079e10 msgr2=0x7ff55c07c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:50.575 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.574+0000 7ff587d48800 20 add_watcher() i=0 2023-12-03T11:37:50.575 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.574+0000 7ff587d48800 20 add_watcher() i=1 2023-12-03T11:37:50.575 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.574+0000 7ff587d48800 20 add_watcher() i=2 2023-12-03T11:37:50.575 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.574+0000 7ff587d48800 20 add_watcher() i=3 2023-12-03T11:37:50.575 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.574+0000 7ff587d48800 20 add_watcher() i=4 2023-12-03T11:37:50.576 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.575+0000 7ff587d48800 20 add_watcher() i=5 2023-12-03T11:37:50.576 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.575+0000 7ff587d48800 20 add_watcher() i=6 2023-12-03T11:37:50.576 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.575+0000 7ff587d48800 20 add_watcher() i=7 2023-12-03T11:37:50.576 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.575+0000 7ff587d48800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:50.578 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.577+0000 7ff549fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:50.578 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.577+0000 7ff587d48800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:50.578 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.577+0000 7ff587d48800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:50.584 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.583+0000 7ff587d48800 5 note: GC not initialized 2023-12-03T11:37:50.585 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.583+0000 7ff4c0ff9640 20 reqs_thread_entry: start 2023-12-03T11:37:50.585 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.583+0000 7ff587d48800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:50.585 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.583+0000 7ff587d48800 20 Filter name: none 2023-12-03T11:37:50.585 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.584+0000 7ff4b67fc640 20 reqs_thread_entry: start 2023-12-03T11:37:50.585 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.584+0000 7ff587d48800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.586 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.584+0000 7ff587d48800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:37:50.586 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.584+0000 7ff587d48800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.586 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.585+0000 7ff587d48800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:37:50.586 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.585+0000 7ff587d48800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:50.586 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.585+0000 7ff587d48800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.586 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.585+0000 7ff587d48800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:37:50.586 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.585+0000 7ff587d48800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.587 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.585+0000 7ff587d48800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:37:50.587 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.585+0000 7ff587d48800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:50.587 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.586+0000 7ff587d48800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.587 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.586+0000 7ff587d48800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.588 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.587+0000 7ff549fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:50.590 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.589+0000 7ff587d48800 20 remove_watcher() i=0 2023-12-03T11:37:50.590 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.589+0000 7ff587d48800 2 removed watcher, disabling cache 2023-12-03T11:37:50.591 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.590+0000 7ff587d48800 20 remove_watcher() i=1 2023-12-03T11:37:50.592 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.591+0000 7ff587d48800 20 remove_watcher() i=2 2023-12-03T11:37:50.593 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.592+0000 7ff587d48800 20 remove_watcher() i=3 2023-12-03T11:37:50.594 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.593+0000 7ff587d48800 20 remove_watcher() i=4 2023-12-03T11:37:50.595 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.594+0000 7ff587d48800 20 remove_watcher() i=5 2023-12-03T11:37:50.596 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.595+0000 7ff587d48800 20 remove_watcher() i=6 2023-12-03T11:37:50.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.596+0000 7ff587d48800 20 remove_watcher() i=7 2023-12-03T11:37:50.602 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:50.602 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:37:50.602 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-set-target-layout id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:37:50.602 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:50.603 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2023-12-03T11:37:50.636 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:50.636 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:50.650 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.649+0000 7f5427812800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.652 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.651+0000 7f5427812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.652 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.651+0000 7f5427812800 20 realm 2023-12-03T11:37:50.652 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.651+0000 7f5427812800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.652 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.651+0000 7f5427812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.652 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.651+0000 7f5427812800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:50.652 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.651+0000 7f5427812800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.651+0000 7f5427812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.651+0000 7f5427812800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.652+0000 7f5427812800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:50.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.652+0000 7f5427812800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.653+0000 7f5427812800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:50.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.653+0000 7f5427812800 20 searching for the correct realm 2023-12-03T11:37:50.663 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.662+0000 7f5422f2a640 0 -- 172.21.15.44:0/2851745740 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x5569d92b0180 msgr2=0x5569d92b25d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:50.664 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.663+0000 7f5427812800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:50.664 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.663+0000 7f5427812800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:50.664 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.663+0000 7f5427812800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:50.664 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.663+0000 7f5427812800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:50.664 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.663+0000 7f5427812800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.664 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.663+0000 7f5427812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.664 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.663+0000 7f5427812800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.665 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.663+0000 7f5427812800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:50.665 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.663+0000 7f5427812800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.665 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.664+0000 7f5427812800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:50.665 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.664+0000 7f5427812800 20 zone default found 2023-12-03T11:37:50.666 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.664+0000 7f5427812800 4 Realm: () 2023-12-03T11:37:50.666 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.664+0000 7f5427812800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:50.666 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.664+0000 7f5427812800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:50.666 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.664+0000 7f5427812800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:50.666 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.664+0000 7f5427812800 20 zonegroup default 2023-12-03T11:37:50.666 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.664+0000 7f5427812800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.666 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.664+0000 7f5427812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.666 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.664+0000 7f5427812800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.666 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.664+0000 7f5427812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.666 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.664+0000 7f5427812800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.665+0000 7f5427812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.665+0000 7f5427812800 20 started sync module instance, tier type = 2023-12-03T11:37:50.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.665+0000 7f5427812800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:50.672 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.671+0000 7f542372b640 0 -- 172.21.15.44:0/2851745740 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x5569d92b8260 msgr2=0x5569d92ba720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:50.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.674+0000 7f5427812800 20 add_watcher() i=0 2023-12-03T11:37:50.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.674+0000 7f5427812800 20 add_watcher() i=1 2023-12-03T11:37:50.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.674+0000 7f5427812800 20 add_watcher() i=2 2023-12-03T11:37:50.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.674+0000 7f5427812800 20 add_watcher() i=3 2023-12-03T11:37:50.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.674+0000 7f5427812800 20 add_watcher() i=4 2023-12-03T11:37:50.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.674+0000 7f5427812800 20 add_watcher() i=5 2023-12-03T11:37:50.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.674+0000 7f5427812800 20 add_watcher() i=6 2023-12-03T11:37:50.676 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.675+0000 7f5427812800 20 add_watcher() i=7 2023-12-03T11:37:50.676 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.675+0000 7f5427812800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:50.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.676+0000 7f5363fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:50.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.677+0000 7f5427812800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:50.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.677+0000 7f5427812800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:50.684 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.683+0000 7f5427812800 5 note: GC not initialized 2023-12-03T11:37:50.684 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.683+0000 7f5352ffd640 20 reqs_thread_entry: start 2023-12-03T11:37:50.685 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.683+0000 7f5427812800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:50.685 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.683+0000 7f5427812800 20 Filter name: none 2023-12-03T11:37:50.685 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.683+0000 7f5350ff9640 20 reqs_thread_entry: start 2023-12-03T11:37:50.685 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.683+0000 7f5427812800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2023-12-03T11:37:50.685 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.683+0000 7f5427812800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.685 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.684+0000 7f5427812800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:37:50.686 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.684+0000 7f5427812800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2023-12-03T11:37:50.686 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.684+0000 7f5427812800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2023-12-03T11:37:50.686 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.684+0000 7f5427812800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18 : miss 2023-12-03T11:37:50.686 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.684+0000 7f5427812800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.686 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.684+0000 7f5427812800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:37:50.686 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.684+0000 7f5427812800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18 info.flags=0x17 2023-12-03T11:37:50.686 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.684+0000 7f5427812800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18 to cache LRU end 2023-12-03T11:37:50.686 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.684+0000 7f5427812800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:37:50.686 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.684+0000 7f5427812800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:37:50.686 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.684+0000 7f5427812800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18 2023-12-03T11:37:50.688 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.687+0000 7f5427812800 -1 Injecting error=-5 at location=set_target_layout 2023-12-03T11:37:50.688 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.687+0000 7f5427812800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2023-12-03T11:37:50.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.690+0000 7f5363fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:50.692 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.692+0000 7f5427812800 20 remove_watcher() i=0 2023-12-03T11:37:50.693 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.692+0000 7f5427812800 2 removed watcher, disabling cache 2023-12-03T11:37:50.693 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.693+0000 7f5427812800 20 remove_watcher() i=1 2023-12-03T11:37:50.695 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.694+0000 7f5427812800 20 remove_watcher() i=2 2023-12-03T11:37:50.695 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.695+0000 7f5427812800 20 remove_watcher() i=3 2023-12-03T11:37:50.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.696+0000 7f5427812800 20 remove_watcher() i=4 2023-12-03T11:37:50.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.697+0000 7f5427812800 20 remove_watcher() i=5 2023-12-03T11:37:50.698 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.698+0000 7f5427812800 20 remove_watcher() i=6 2023-12-03T11:37:50.699 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.699+0000 7f5427812800 20 remove_watcher() i=7 2023-12-03T11:37:50.706 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2023-12-03T11:37:50.733 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:50.734 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:50.748 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.747+0000 7fa924a8c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.750 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.749+0000 7fa924a8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.750 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.749+0000 7fa924a8c800 20 realm 2023-12-03T11:37:50.750 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.749+0000 7fa924a8c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.750 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.749+0000 7fa924a8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.750 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.749+0000 7fa924a8c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:50.750 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.749+0000 7fa924a8c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.750 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.749+0000 7fa924a8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.751 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.749+0000 7fa924a8c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.751 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.750+0000 7fa924a8c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:50.751 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.750+0000 7fa924a8c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.752 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.751+0000 7fa924a8c800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:50.752 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.751+0000 7fa924a8c800 20 searching for the correct realm 2023-12-03T11:37:50.761 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.760+0000 7fa92258c640 0 -- 172.21.15.44:0/2087746836 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55f6ea9d9d60 msgr2=0x55f6ea9dc150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:50.762 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.761+0000 7fa924a8c800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:50.763 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.761+0000 7fa924a8c800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:50.763 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.761+0000 7fa924a8c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:50.763 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.761+0000 7fa924a8c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:50.763 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.761+0000 7fa924a8c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.763 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.762+0000 7fa924a8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.763 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.762+0000 7fa924a8c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.762+0000 7fa924a8c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:50.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.762+0000 7fa924a8c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.762+0000 7fa924a8c800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:50.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.762+0000 7fa924a8c800 20 zone default found 2023-12-03T11:37:50.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.762+0000 7fa924a8c800 4 Realm: () 2023-12-03T11:37:50.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.762+0000 7fa924a8c800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:50.765 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.762+0000 7fa924a8c800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:50.765 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.762+0000 7fa924a8c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:50.765 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.762+0000 7fa924a8c800 20 zonegroup default 2023-12-03T11:37:50.765 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.762+0000 7fa924a8c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.765 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.762+0000 7fa924a8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.765 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.762+0000 7fa924a8c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.765 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.763+0000 7fa924a8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.765 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.763+0000 7fa924a8c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.765 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.763+0000 7fa924a8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.765 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.763+0000 7fa924a8c800 20 started sync module instance, tier type = 2023-12-03T11:37:50.765 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.763+0000 7fa924a8c800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:50.769 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.768+0000 7fa922d8d640 0 -- 172.21.15.44:0/2087746836 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7fa918028920 msgr2=0x7fa91803b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:37:50.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.772+0000 7fa924a8c800 20 add_watcher() i=0 2023-12-03T11:37:50.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.772+0000 7fa924a8c800 20 add_watcher() i=1 2023-12-03T11:37:50.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.772+0000 7fa924a8c800 20 add_watcher() i=2 2023-12-03T11:37:50.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.772+0000 7fa924a8c800 20 add_watcher() i=3 2023-12-03T11:37:50.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.772+0000 7fa924a8c800 20 add_watcher() i=4 2023-12-03T11:37:50.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.772+0000 7fa924a8c800 20 add_watcher() i=5 2023-12-03T11:37:50.774 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.772+0000 7fa924a8c800 20 add_watcher() i=6 2023-12-03T11:37:50.774 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.773+0000 7fa924a8c800 20 add_watcher() i=7 2023-12-03T11:37:50.774 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.773+0000 7fa924a8c800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:50.775 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.775+0000 7fa8e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:50.776 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.775+0000 7fa924a8c800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:50.776 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.775+0000 7fa924a8c800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:50.782 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.781+0000 7fa924a8c800 5 note: GC not initialized 2023-12-03T11:37:50.782 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.781+0000 7fa856ffd640 20 reqs_thread_entry: start 2023-12-03T11:37:50.782 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.781+0000 7fa924a8c800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:50.783 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.781+0000 7fa924a8c800 20 Filter name: none 2023-12-03T11:37:50.783 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.781+0000 7fa854ff9640 20 reqs_thread_entry: start 2023-12-03T11:37:50.783 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.781+0000 7fa924a8c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.784 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.782+0000 7fa924a8c800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:37:50.784 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.782+0000 7fa924a8c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.784 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.782+0000 7fa924a8c800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:37:50.784 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.782+0000 7fa924a8c800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:50.784 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.782+0000 7fa924a8c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.784 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.783+0000 7fa924a8c800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:37:50.784 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.783+0000 7fa924a8c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.784 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.783+0000 7fa924a8c800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:37:50.784 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.783+0000 7fa924a8c800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:50.785 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.783+0000 7fa924a8c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.785 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.784+0000 7fa924a8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.785 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.784+0000 7fa8e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:50.787 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.786+0000 7fa924a8c800 20 remove_watcher() i=0 2023-12-03T11:37:50.787 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.786+0000 7fa924a8c800 2 removed watcher, disabling cache 2023-12-03T11:37:50.788 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.787+0000 7fa924a8c800 20 remove_watcher() i=1 2023-12-03T11:37:50.789 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.788+0000 7fa924a8c800 20 remove_watcher() i=2 2023-12-03T11:37:50.790 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.789+0000 7fa924a8c800 20 remove_watcher() i=3 2023-12-03T11:37:50.791 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.790+0000 7fa924a8c800 20 remove_watcher() i=4 2023-12-03T11:37:50.792 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.792+0000 7fa924a8c800 20 remove_watcher() i=5 2023-12-03T11:37:50.793 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.793+0000 7fa924a8c800 20 remove_watcher() i=6 2023-12-03T11:37:50.794 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.794+0000 7fa924a8c800 20 remove_watcher() i=7 2023-12-03T11:37:50.799 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:50.799 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:37:50.800 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-set-target-layout id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:37:50.800 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:50.851 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:37:50.883 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:50.883 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:50.899 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.898+0000 7fa706d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.901 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.900+0000 7fa706d1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.902 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.900+0000 7fa706d1e800 20 realm 2023-12-03T11:37:50.902 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.900+0000 7fa706d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.902 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.900+0000 7fa706d1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.902 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.900+0000 7fa706d1e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:50.902 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.900+0000 7fa706d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.902 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.901+0000 7fa706d1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.902 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.901+0000 7fa706d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.902+0000 7fa706d1e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:50.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.902+0000 7fa706d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.902+0000 7fa706d1e800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:50.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.902+0000 7fa706d1e800 20 searching for the correct realm 2023-12-03T11:37:50.913 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.912+0000 7fa704825640 0 -- 172.21.15.44:0/3846199624 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x558de21c79c0 msgr2=0x558de21c9dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:50.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.913+0000 7fa706d1e800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:50.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.913+0000 7fa706d1e800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:50.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.913+0000 7fa706d1e800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:50.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.913+0000 7fa706d1e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:50.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.913+0000 7fa706d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.913+0000 7fa706d1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.913+0000 7fa706d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.913+0000 7fa706d1e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:50.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.913+0000 7fa706d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.913+0000 7fa706d1e800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:50.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.913+0000 7fa706d1e800 20 zone default found 2023-12-03T11:37:50.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.913+0000 7fa706d1e800 4 Realm: () 2023-12-03T11:37:50.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.913+0000 7fa706d1e800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:50.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.913+0000 7fa706d1e800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:50.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.913+0000 7fa706d1e800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:50.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.913+0000 7fa706d1e800 20 zonegroup default 2023-12-03T11:37:50.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.913+0000 7fa706d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.914+0000 7fa706d1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.914+0000 7fa706d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.914+0000 7fa706d1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.914+0000 7fa706d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.914+0000 7fa706d1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:50.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.914+0000 7fa706d1e800 20 started sync module instance, tier type = 2023-12-03T11:37:50.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.914+0000 7fa706d1e800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:50.923 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.922+0000 7fa705026640 0 -- 172.21.15.44:0/3846199624 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x558de21cfa20 msgr2=0x558de21d1ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:50.926 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.924+0000 7fa706d1e800 20 add_watcher() i=0 2023-12-03T11:37:50.926 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.924+0000 7fa706d1e800 20 add_watcher() i=1 2023-12-03T11:37:50.926 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.924+0000 7fa706d1e800 20 add_watcher() i=2 2023-12-03T11:37:50.926 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.924+0000 7fa706d1e800 20 add_watcher() i=3 2023-12-03T11:37:50.926 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.924+0000 7fa706d1e800 20 add_watcher() i=4 2023-12-03T11:37:50.926 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.924+0000 7fa706d1e800 20 add_watcher() i=5 2023-12-03T11:37:50.926 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.925+0000 7fa706d1e800 20 add_watcher() i=6 2023-12-03T11:37:50.926 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.925+0000 7fa706d1e800 20 add_watcher() i=7 2023-12-03T11:37:50.927 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.925+0000 7fa706d1e800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:50.928 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.927+0000 7fa6cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:50.928 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.927+0000 7fa706d1e800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:50.928 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.927+0000 7fa706d1e800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:50.935 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.933+0000 7fa706d1e800 5 note: GC not initialized 2023-12-03T11:37:50.935 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.933+0000 7fa639ffb640 20 reqs_thread_entry: start 2023-12-03T11:37:50.935 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.933+0000 7fa706d1e800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:50.935 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.934+0000 7fa706d1e800 20 Filter name: none 2023-12-03T11:37:50.935 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.934+0000 7fa62b7fe640 20 reqs_thread_entry: start 2023-12-03T11:37:50.935 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.934+0000 7fa706d1e800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2023-12-03T11:37:50.935 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.934+0000 7fa706d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.936 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.934+0000 7fa706d1e800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:37:50.936 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.934+0000 7fa706d1e800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2023-12-03T11:37:50.936 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.934+0000 7fa706d1e800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2023-12-03T11:37:50.936 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.934+0000 7fa706d1e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18 : miss 2023-12-03T11:37:50.936 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.934+0000 7fa706d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:50.936 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.935+0000 7fa706d1e800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:37:50.936 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.935+0000 7fa706d1e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18 info.flags=0x17 2023-12-03T11:37:50.936 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.935+0000 7fa706d1e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18 to cache LRU end 2023-12-03T11:37:50.936 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.935+0000 7fa706d1e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:37:50.936 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.935+0000 7fa706d1e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:37:50.936 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.935+0000 7fa706d1e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18 2023-12-03T11:37:50.940 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.938+0000 7fa706d1e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18 info.flags=0x17 2023-12-03T11:37:50.940 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.938+0000 7fa706d1e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18 to cache LRU end 2023-12-03T11:37:50.940 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.938+0000 7fa706d1e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:37:50.940 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.938+0000 7fa706d1e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18, ofs0, ns] 2023-12-03T11:37:50.940 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.939+0000 7fa6eb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693250 cookie 94067872275392 notifier 6378 bl.length()=887 2023-12-03T11:37:50.940 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.939+0000 7fa6eb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18 info.flags=0x17 2023-12-03T11:37:50.940 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.939+0000 7fa6eb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18 to cache LRU end 2023-12-03T11:37:50.940 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.939+0000 7fa6eb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:37:50.940 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.939+0000 7fa706d1e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18]): orig_sources= new_sources= 2023-12-03T11:37:50.940 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.939+0000 7fa706d1e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18]): potential sources added=[] removed=[] 2023-12-03T11:37:50.941 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.939+0000 7fa706d1e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18]): orig_dests= new_dests= 2023-12-03T11:37:50.941 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.939+0000 7fa706d1e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18]): potential dests added=[] removed=[] 2023-12-03T11:37:50.941 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.940+0000 7fa706d1e800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18.1.0 2023-12-03T11:37:50.941 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.940+0000 7fa706d1e800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18.1.0 2023-12-03T11:37:50.941 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.940+0000 7fa706d1e800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18.1.1 2023-12-03T11:37:50.941 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.940+0000 7fa706d1e800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18.1.1 2023-12-03T11:37:50.941 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.940+0000 7fa706d1e800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18.0 2023-12-03T11:37:50.943 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.942+0000 7fa706d1e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18 : hit (requested=0x17, cached=0x17) 2023-12-03T11:37:50.943 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.942+0000 7fa706d1e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18 2023-12-03T11:37:50.945 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.944+0000 7fa706d1e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18 info.flags=0x17 2023-12-03T11:37:50.945 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.944+0000 7fa706d1e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18 to cache LRU end 2023-12-03T11:37:50.945 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.944+0000 7fa706d1e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:37:50.945 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.944+0000 7fa706d1e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18, ofs0, ns] 2023-12-03T11:37:50.945 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.944+0000 7fa6eaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693251 cookie 94067872275392 notifier 6378 bl.length()=855 2023-12-03T11:37:50.945 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.944+0000 7fa6eaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18 info.flags=0x17 2023-12-03T11:37:50.945 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.944+0000 7fa6eaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18 to cache LRU end 2023-12-03T11:37:50.945 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.944+0000 7fa6eaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:37:50.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.944+0000 7fa706d1e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18]): orig_sources= new_sources= 2023-12-03T11:37:50.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.944+0000 7fa706d1e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18]): potential sources added=[] removed=[] 2023-12-03T11:37:50.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.944+0000 7fa706d1e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18]): orig_dests= new_dests= 2023-12-03T11:37:50.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.944+0000 7fa706d1e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18]): potential dests added=[] removed=[] 2023-12-03T11:37:50.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.945+0000 7fa706d1e800 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2023-12-03T11:37:50.948 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.947+0000 7fa6cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:50.950 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.949+0000 7fa706d1e800 20 remove_watcher() i=0 2023-12-03T11:37:50.950 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.949+0000 7fa706d1e800 2 removed watcher, disabling cache 2023-12-03T11:37:50.951 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.950+0000 7fa706d1e800 20 remove_watcher() i=1 2023-12-03T11:37:50.952 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.951+0000 7fa706d1e800 20 remove_watcher() i=2 2023-12-03T11:37:50.953 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.952+0000 7fa706d1e800 20 remove_watcher() i=3 2023-12-03T11:37:50.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.953+0000 7fa706d1e800 20 remove_watcher() i=4 2023-12-03T11:37:50.955 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.954+0000 7fa706d1e800 20 remove_watcher() i=5 2023-12-03T11:37:50.956 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.955+0000 7fa706d1e800 20 remove_watcher() i=6 2023-12-03T11:37:50.957 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:50.956+0000 7fa706d1e800 20 remove_watcher() i=7 2023-12-03T11:37:50.964 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2023-12-03T11:37:50.991 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:50.991 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:51.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.004+0000 7fe3b7f27800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.006+0000 7fe3b7f27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.006+0000 7fe3b7f27800 20 realm 2023-12-03T11:37:51.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.006+0000 7fe3b7f27800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.006+0000 7fe3b7f27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.006+0000 7fe3b7f27800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:51.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.006+0000 7fe3b7f27800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.007+0000 7fe3b7f27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.007+0000 7fe3b7f27800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.009 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.007+0000 7fe3b7f27800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:51.009 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.007+0000 7fe3b7f27800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.009 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.008+0000 7fe3b7f27800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:51.009 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.008+0000 7fe3b7f27800 20 searching for the correct realm 2023-12-03T11:37:51.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.017+0000 7fe3b43f5640 0 -- 172.21.15.44:0/1983681374 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55878e4fe7e0 msgr2=0x55878e500c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:51.020 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.019+0000 7fe3b7f27800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:51.020 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.019+0000 7fe3b7f27800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:51.020 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.019+0000 7fe3b7f27800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:51.020 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.019+0000 7fe3b7f27800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:51.020 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.019+0000 7fe3b7f27800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.020 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.019+0000 7fe3b7f27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.020 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.019+0000 7fe3b7f27800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.021 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.019+0000 7fe3b7f27800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:51.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.019+0000 7fe3b7f27800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.020+0000 7fe3b7f27800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:51.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.020+0000 7fe3b7f27800 20 zone default found 2023-12-03T11:37:51.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.020+0000 7fe3b7f27800 4 Realm: () 2023-12-03T11:37:51.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.020+0000 7fe3b7f27800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:51.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.020+0000 7fe3b7f27800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:51.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.020+0000 7fe3b7f27800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:51.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.020+0000 7fe3b7f27800 20 zonegroup default 2023-12-03T11:37:51.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.020+0000 7fe3b7f27800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.020+0000 7fe3b7f27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.020+0000 7fe3b7f27800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.020+0000 7fe3b7f27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.020+0000 7fe3b7f27800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.021+0000 7fe3b7f27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.022 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.021+0000 7fe3b7f27800 20 started sync module instance, tier type = 2023-12-03T11:37:51.023 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.021+0000 7fe3b7f27800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:51.026 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.025+0000 7fe3b43f5640 0 -- 172.21.15.44:0/1983681374 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7fe3a80724f0 msgr2=0x7fe3a8089a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:37:51.031 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.030+0000 7fe3b7f27800 20 add_watcher() i=0 2023-12-03T11:37:51.031 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.030+0000 7fe3b7f27800 20 add_watcher() i=1 2023-12-03T11:37:51.031 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.030+0000 7fe3b7f27800 20 add_watcher() i=2 2023-12-03T11:37:51.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.030+0000 7fe3b7f27800 20 add_watcher() i=3 2023-12-03T11:37:51.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.030+0000 7fe3b7f27800 20 add_watcher() i=4 2023-12-03T11:37:51.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.030+0000 7fe3b7f27800 20 add_watcher() i=5 2023-12-03T11:37:51.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.030+0000 7fe3b7f27800 20 add_watcher() i=6 2023-12-03T11:37:51.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.031+0000 7fe3b7f27800 20 add_watcher() i=7 2023-12-03T11:37:51.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.031+0000 7fe3b7f27800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:51.034 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.033+0000 7fe379fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:51.034 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.033+0000 7fe3b7f27800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:51.034 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.033+0000 7fe3b7f27800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:51.040 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.039+0000 7fe3b7f27800 5 note: GC not initialized 2023-12-03T11:37:51.041 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.039+0000 7fe2f0ff9640 20 reqs_thread_entry: start 2023-12-03T11:37:51.041 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.039+0000 7fe3b7f27800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:51.041 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.039+0000 7fe3b7f27800 20 Filter name: none 2023-12-03T11:37:51.041 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.039+0000 7fe2e67fc640 20 reqs_thread_entry: start 2023-12-03T11:37:51.041 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.040+0000 7fe3b7f27800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.041 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.040+0000 7fe3b7f27800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:37:51.041 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.040+0000 7fe3b7f27800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.042 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.041+0000 7fe3b7f27800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:37:51.042 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.041+0000 7fe3b7f27800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:51.042 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.041+0000 7fe3b7f27800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.042 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.041+0000 7fe3b7f27800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:37:51.042 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.041+0000 7fe3b7f27800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.043 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.041+0000 7fe3b7f27800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:37:51.043 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.041+0000 7fe3b7f27800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:51.043 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.042+0000 7fe3b7f27800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.043 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.042+0000 7fe3b7f27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.044 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.043+0000 7fe379fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:51.046 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.045+0000 7fe3b7f27800 20 remove_watcher() i=0 2023-12-03T11:37:51.046 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.045+0000 7fe3b7f27800 2 removed watcher, disabling cache 2023-12-03T11:37:51.047 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.046+0000 7fe3b7f27800 20 remove_watcher() i=1 2023-12-03T11:37:51.048 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.047+0000 7fe3b7f27800 20 remove_watcher() i=2 2023-12-03T11:37:51.049 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.048+0000 7fe3b7f27800 20 remove_watcher() i=3 2023-12-03T11:37:51.050 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.049+0000 7fe3b7f27800 20 remove_watcher() i=4 2023-12-03T11:37:51.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.050+0000 7fe3b7f27800 20 remove_watcher() i=5 2023-12-03T11:37:51.052 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.051+0000 7fe3b7f27800 20 remove_watcher() i=6 2023-12-03T11:37:51.053 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.052+0000 7fe3b7f27800 20 remove_watcher() i=7 2023-12-03T11:37:51.058 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:51.058 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:37:51.058 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-set-target-layout id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.18 num_objects: 19 size_kb: 1 num_shards: 2 2023-12-03T11:37:51.058 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:51.136 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2023-12-03T11:37:51.136 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:51.310 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2023-12-03T11:37:51.337 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:51.337 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:51.352 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.351+0000 7fd2ba52c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.352+0000 7fd2ba52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.352+0000 7fd2ba52c800 20 realm 2023-12-03T11:37:51.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.352+0000 7fd2ba52c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.353+0000 7fd2ba52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.353+0000 7fd2ba52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:51.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.353+0000 7fd2ba52c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.353+0000 7fd2ba52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.354 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.353+0000 7fd2ba52c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.355 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.354+0000 7fd2ba52c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:51.355 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.354+0000 7fd2ba52c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.355 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.354+0000 7fd2ba52c800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:51.356 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.354+0000 7fd2ba52c800 20 searching for the correct realm 2023-12-03T11:37:51.365 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.364+0000 7fd2b62f0640 0 -- 172.21.15.44:0/2331885965 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55fd25f8ee30 msgr2=0x55fd25f91220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:51.366 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.365+0000 7fd2ba52c800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:51.366 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.365+0000 7fd2ba52c800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:51.366 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.365+0000 7fd2ba52c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:51.367 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.365+0000 7fd2ba52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:51.367 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.365+0000 7fd2ba52c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.367 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.365+0000 7fd2ba52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.367 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.365+0000 7fd2ba52c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.368 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.366+0000 7fd2ba52c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:51.368 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.366+0000 7fd2ba52c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.368 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.366+0000 7fd2ba52c800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:51.368 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.366+0000 7fd2ba52c800 20 zone default found 2023-12-03T11:37:51.368 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.366+0000 7fd2ba52c800 4 Realm: () 2023-12-03T11:37:51.368 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.366+0000 7fd2ba52c800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:51.368 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.366+0000 7fd2ba52c800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:51.368 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.366+0000 7fd2ba52c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:51.369 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.366+0000 7fd2ba52c800 20 zonegroup default 2023-12-03T11:37:51.369 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.366+0000 7fd2ba52c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.369 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.366+0000 7fd2ba52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.369 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.366+0000 7fd2ba52c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.369 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.366+0000 7fd2ba52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.369 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.366+0000 7fd2ba52c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.369 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.367+0000 7fd2ba52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.369 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.367+0000 7fd2ba52c800 20 started sync module instance, tier type = 2023-12-03T11:37:51.369 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.367+0000 7fd2ba52c800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:51.374 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.373+0000 7fd2b6af1640 0 -- 172.21.15.44:0/2331885965 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55fd25f96f60 msgr2=0x55fd25f993b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:37:51.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.376+0000 7fd2ba52c800 20 add_watcher() i=0 2023-12-03T11:37:51.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.376+0000 7fd2ba52c800 20 add_watcher() i=1 2023-12-03T11:37:51.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.376+0000 7fd2ba52c800 20 add_watcher() i=2 2023-12-03T11:37:51.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.376+0000 7fd2ba52c800 20 add_watcher() i=3 2023-12-03T11:37:51.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.376+0000 7fd2ba52c800 20 add_watcher() i=4 2023-12-03T11:37:51.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.376+0000 7fd2ba52c800 20 add_watcher() i=5 2023-12-03T11:37:51.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.376+0000 7fd2ba52c800 20 add_watcher() i=6 2023-12-03T11:37:51.378 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.377+0000 7fd2ba52c800 20 add_watcher() i=7 2023-12-03T11:37:51.378 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.377+0000 7fd2ba52c800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:51.379 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.378+0000 7fd27bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:51.379 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.379+0000 7fd2ba52c800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:51.380 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.379+0000 7fd2ba52c800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:51.386 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.384+0000 7fd2ba52c800 5 note: GC not initialized 2023-12-03T11:37:51.386 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.385+0000 7fd1eaffd640 20 reqs_thread_entry: start 2023-12-03T11:37:51.386 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.385+0000 7fd2ba52c800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:51.386 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.385+0000 7fd2ba52c800 20 Filter name: none 2023-12-03T11:37:51.386 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.385+0000 7fd1e8ff9640 20 reqs_thread_entry: start 2023-12-03T11:37:51.386 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.385+0000 7fd2ba52c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.387 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.385+0000 7fd2ba52c800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:37:51.387 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.385+0000 7fd2ba52c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.386+0000 7fd2ba52c800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:37:51.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.386+0000 7fd2ba52c800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:51.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.386+0000 7fd2ba52c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.386+0000 7fd2ba52c800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:37:51.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.386+0000 7fd2ba52c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.387+0000 7fd2ba52c800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:37:51.388 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.387+0000 7fd2ba52c800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:51.389 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.387+0000 7fd2ba52c800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.389 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.387+0000 7fd2ba52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.389 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.388+0000 7fd27bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:51.391 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.390+0000 7fd2ba52c800 20 remove_watcher() i=0 2023-12-03T11:37:51.391 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.390+0000 7fd2ba52c800 2 removed watcher, disabling cache 2023-12-03T11:37:51.392 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.391+0000 7fd2ba52c800 20 remove_watcher() i=1 2023-12-03T11:37:51.393 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.392+0000 7fd2ba52c800 20 remove_watcher() i=2 2023-12-03T11:37:51.394 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.393+0000 7fd2ba52c800 20 remove_watcher() i=3 2023-12-03T11:37:51.395 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.394+0000 7fd2ba52c800 20 remove_watcher() i=4 2023-12-03T11:37:51.396 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.396+0000 7fd2ba52c800 20 remove_watcher() i=5 2023-12-03T11:37:51.397 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.396+0000 7fd2ba52c800 20 remove_watcher() i=6 2023-12-03T11:37:51.398 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.397+0000 7fd2ba52c800 20 remove_watcher() i=7 2023-12-03T11:37:51.403 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:51.403 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:37:51.403 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-set-target-layout id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:37:51.403 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:51.405 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2023-12-03T11:37:51.440 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:51.440 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:51.454 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.453+0000 7f2f6fb3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.456 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.454+0000 7f2f6fb3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.456 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.454+0000 7f2f6fb3d800 20 realm 2023-12-03T11:37:51.456 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.454+0000 7f2f6fb3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.456 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.455+0000 7f2f6fb3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.456 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.455+0000 7f2f6fb3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:51.456 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.455+0000 7f2f6fb3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.456 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.455+0000 7f2f6fb3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.456 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.455+0000 7f2f6fb3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.456+0000 7f2f6fb3d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:51.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.456+0000 7f2f6fb3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.458 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.456+0000 7f2f6fb3d800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:51.458 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.456+0000 7f2f6fb3d800 20 searching for the correct realm 2023-12-03T11:37:51.467 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.466+0000 7f2f6b0a2640 0 -- 172.21.15.44:0/829333115 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x563e44119a50 msgr2=0x563e4411be40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:51.468 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.467+0000 7f2f6fb3d800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:51.468 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.467+0000 7f2f6fb3d800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:51.468 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.467+0000 7f2f6fb3d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:51.468 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.467+0000 7f2f6fb3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:51.468 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.467+0000 7f2f6fb3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.468 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.467+0000 7f2f6fb3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.469 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.467+0000 7f2f6fb3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.469 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.468+0000 7f2f6fb3d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:51.469 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.468+0000 7f2f6fb3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.469 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.468+0000 7f2f6fb3d800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:51.469 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.468+0000 7f2f6fb3d800 20 zone default found 2023-12-03T11:37:51.469 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.468+0000 7f2f6fb3d800 4 Realm: () 2023-12-03T11:37:51.469 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.468+0000 7f2f6fb3d800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:51.470 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.468+0000 7f2f6fb3d800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:51.470 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.468+0000 7f2f6fb3d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:51.470 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.468+0000 7f2f6fb3d800 20 zonegroup default 2023-12-03T11:37:51.470 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.468+0000 7f2f6fb3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.470 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.469+0000 7f2f6fb3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.471 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.469+0000 7f2f6fb3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.471 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.469+0000 7f2f6fb3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.471 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.469+0000 7f2f6fb3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.471 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.469+0000 7f2f6fb3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.471 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.469+0000 7f2f6fb3d800 20 started sync module instance, tier type = 2023-12-03T11:37:51.471 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.469+0000 7f2f6fb3d800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:51.477 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.475+0000 7f2f6b0a2640 0 -- 172.21.15.44:0/829333115 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x7f2f44079d90 msgr2=0x7f2f4407c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:51.480 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.479+0000 7f2f6fb3d800 20 add_watcher() i=0 2023-12-03T11:37:51.480 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.479+0000 7f2f6fb3d800 20 add_watcher() i=1 2023-12-03T11:37:51.480 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.479+0000 7f2f6fb3d800 20 add_watcher() i=2 2023-12-03T11:37:51.480 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.479+0000 7f2f6fb3d800 20 add_watcher() i=3 2023-12-03T11:37:51.480 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.479+0000 7f2f6fb3d800 20 add_watcher() i=4 2023-12-03T11:37:51.480 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.479+0000 7f2f6fb3d800 20 add_watcher() i=5 2023-12-03T11:37:51.480 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.479+0000 7f2f6fb3d800 20 add_watcher() i=6 2023-12-03T11:37:51.481 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.480+0000 7f2f6fb3d800 20 add_watcher() i=7 2023-12-03T11:37:51.481 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.480+0000 7f2f6fb3d800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:51.482 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.482+0000 7f2f31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:51.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.482+0000 7f2f6fb3d800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:51.483 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.482+0000 7f2f6fb3d800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:51.490 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.488+0000 7f2f6fb3d800 5 note: GC not initialized 2023-12-03T11:37:51.490 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.488+0000 7f2ea8ff9640 20 reqs_thread_entry: start 2023-12-03T11:37:51.490 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.488+0000 7f2f6fb3d800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:51.490 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.488+0000 7f2f6fb3d800 20 Filter name: none 2023-12-03T11:37:51.490 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.489+0000 7f2e9e7fc640 20 reqs_thread_entry: start 2023-12-03T11:37:51.490 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.489+0000 7f2f6fb3d800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2023-12-03T11:37:51.490 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.489+0000 7f2f6fb3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.491 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.489+0000 7f2f6fb3d800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:37:51.491 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.489+0000 7f2f6fb3d800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2023-12-03T11:37:51.491 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.489+0000 7f2f6fb3d800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2023-12-03T11:37:51.491 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.489+0000 7f2f6fb3d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19 : miss 2023-12-03T11:37:51.491 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.489+0000 7f2f6fb3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.491 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.490+0000 7f2f6fb3d800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:37:51.491 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.490+0000 7f2f6fb3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19 info.flags=0x17 2023-12-03T11:37:51.491 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.490+0000 7f2f6fb3d800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19 to cache LRU end 2023-12-03T11:37:51.491 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.490+0000 7f2f6fb3d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:37:51.492 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.490+0000 7f2f6fb3d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:37:51.492 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.490+0000 7f2f6fb3d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19 2023-12-03T11:37:51.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.493+0000 7f2f6fb3d800 -1 Injecting error=-125 at location=set_target_layout 2023-12-03T11:37:51.495 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.494+0000 7f2f6fb3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19 info.flags=0x17 2023-12-03T11:37:51.495 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.494+0000 7f2f6fb3d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19 to cache LRU end 2023-12-03T11:37:51.495 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.494+0000 7f2f6fb3d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:37:51.495 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.494+0000 7f2f6fb3d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19, ofs0, ns] 2023-12-03T11:37:51.495 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.494+0000 7f2f527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693254 cookie 94825429998048 notifier 6128 bl.length()=887 2023-12-03T11:37:51.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.494+0000 7f2f527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19 info.flags=0x17 2023-12-03T11:37:51.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.494+0000 7f2f527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19 to cache LRU end 2023-12-03T11:37:51.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.494+0000 7f2f527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:37:51.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.495+0000 7f2f6fb3d800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19]): orig_sources= new_sources= 2023-12-03T11:37:51.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.495+0000 7f2f6fb3d800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19]): potential sources added=[] removed=[] 2023-12-03T11:37:51.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.495+0000 7f2f6fb3d800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19]): orig_dests= new_dests= 2023-12-03T11:37:51.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.495+0000 7f2f6fb3d800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19]): potential dests added=[] removed=[] 2023-12-03T11:37:51.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.496+0000 7f2f6fb3d800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19.1.0 2023-12-03T11:37:51.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.496+0000 7f2f6fb3d800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19.1.0 2023-12-03T11:37:51.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.496+0000 7f2f6fb3d800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19.1.1 2023-12-03T11:37:51.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.496+0000 7f2f6fb3d800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19.1.1 2023-12-03T11:37:51.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.496+0000 7f2f6fb3d800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19.0 2023-12-03T11:37:51.499 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.498+0000 7f2f6fb3d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19 : hit (requested=0x17, cached=0x17) 2023-12-03T11:37:51.499 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.498+0000 7f2f6fb3d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19 2023-12-03T11:37:51.500 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.499+0000 7f2f6fb3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19 info.flags=0x17 2023-12-03T11:37:51.500 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.499+0000 7f2f6fb3d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19 to cache LRU end 2023-12-03T11:37:51.500 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.499+0000 7f2f6fb3d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:37:51.501 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.499+0000 7f2f6fb3d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19, ofs0, ns] 2023-12-03T11:37:51.501 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.499+0000 7f2f51ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693255 cookie 94825429998048 notifier 6128 bl.length()=855 2023-12-03T11:37:51.501 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.499+0000 7f2f51ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19 info.flags=0x17 2023-12-03T11:37:51.501 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.499+0000 7f2f51ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19 to cache LRU end 2023-12-03T11:37:51.501 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.499+0000 7f2f51ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:37:51.501 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.500+0000 7f2f6fb3d800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19]): orig_sources= new_sources= 2023-12-03T11:37:51.501 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.500+0000 7f2f6fb3d800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19]): potential sources added=[] removed=[] 2023-12-03T11:37:51.501 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.500+0000 7f2f6fb3d800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19]): orig_dests= new_dests= 2023-12-03T11:37:51.501 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.500+0000 7f2f6fb3d800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19]): potential dests added=[] removed=[] 2023-12-03T11:37:51.502 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.501+0000 7f2f6fb3d800 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2023-12-03T11:37:51.504 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.503+0000 7f2f31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:51.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.505+0000 7f2f6fb3d800 20 remove_watcher() i=0 2023-12-03T11:37:51.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.505+0000 7f2f6fb3d800 2 removed watcher, disabling cache 2023-12-03T11:37:51.507 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.506+0000 7f2f6fb3d800 20 remove_watcher() i=1 2023-12-03T11:37:51.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.507+0000 7f2f6fb3d800 20 remove_watcher() i=2 2023-12-03T11:37:51.509 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.508+0000 7f2f6fb3d800 20 remove_watcher() i=3 2023-12-03T11:37:51.510 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.509+0000 7f2f6fb3d800 20 remove_watcher() i=4 2023-12-03T11:37:51.511 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.510+0000 7f2f6fb3d800 20 remove_watcher() i=5 2023-12-03T11:37:51.512 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.511+0000 7f2f6fb3d800 20 remove_watcher() i=6 2023-12-03T11:37:51.513 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.512+0000 7f2f6fb3d800 20 remove_watcher() i=7 2023-12-03T11:37:51.519 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2023-12-03T11:37:51.547 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:51.547 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:51.562 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.561+0000 7f77a32c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.564 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.563+0000 7f77a32c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.564 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.563+0000 7f77a32c0800 20 realm 2023-12-03T11:37:51.564 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.563+0000 7f77a32c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.564 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.563+0000 7f77a32c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.564 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.563+0000 7f77a32c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:51.564 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.563+0000 7f77a32c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.564 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.563+0000 7f77a32c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.564 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.563+0000 7f77a32c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.565 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.564+0000 7f77a32c0800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:51.565 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.564+0000 7f77a32c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.565 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.564+0000 7f77a32c0800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:51.566 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.564+0000 7f77a32c0800 20 searching for the correct realm 2023-12-03T11:37:51.573 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.572+0000 7f77a0dc0640 0 -- 172.21.15.44:0/2817415365 >> [v2:172.21.15.44:6800/4244511941,v1:172.21.15.44:6801/4244511941] conn(0x7f778c0cdca0 msgr2=0x7f778c09f7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:51.577 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.575+0000 7f77a32c0800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:51.577 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.575+0000 7f77a32c0800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:51.577 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.575+0000 7f77a32c0800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:51.577 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.575+0000 7f77a32c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:51.577 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.575+0000 7f77a32c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.577 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.575+0000 7f77a32c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.578 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.575+0000 7f77a32c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.578 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.576+0000 7f77a32c0800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:51.578 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.576+0000 7f77a32c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.578 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.576+0000 7f77a32c0800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:51.578 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.576+0000 7f77a32c0800 20 zone default found 2023-12-03T11:37:51.578 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.576+0000 7f77a32c0800 4 Realm: () 2023-12-03T11:37:51.578 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.576+0000 7f77a32c0800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:51.578 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.576+0000 7f77a32c0800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:51.578 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.576+0000 7f77a32c0800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:51.578 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.576+0000 7f77a32c0800 20 zonegroup default 2023-12-03T11:37:51.578 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.576+0000 7f77a32c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.578 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.576+0000 7f77a32c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.578 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.576+0000 7f77a32c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.579 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.576+0000 7f77a32c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.579 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.576+0000 7f77a32c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.579 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.577+0000 7f77a32c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.579 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.577+0000 7f77a32c0800 20 started sync module instance, tier type = 2023-12-03T11:37:51.579 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.577+0000 7f77a32c0800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:51.579 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.578+0000 7f77a15c1640 0 -- 172.21.15.44:0/2817415365 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f778c098380 msgr2=0x7f778c0b2000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:51.590 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.589+0000 7f77a32c0800 20 add_watcher() i=0 2023-12-03T11:37:51.590 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.589+0000 7f77a32c0800 20 add_watcher() i=1 2023-12-03T11:37:51.590 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.589+0000 7f77a32c0800 20 add_watcher() i=2 2023-12-03T11:37:51.590 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.589+0000 7f77a32c0800 20 add_watcher() i=3 2023-12-03T11:37:51.590 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.589+0000 7f77a32c0800 20 add_watcher() i=4 2023-12-03T11:37:51.590 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.589+0000 7f77a32c0800 20 add_watcher() i=5 2023-12-03T11:37:51.590 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.589+0000 7f77a32c0800 20 add_watcher() i=6 2023-12-03T11:37:51.590 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.590+0000 7f77a32c0800 20 add_watcher() i=7 2023-12-03T11:37:51.591 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.590+0000 7f77a32c0800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:51.592 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.591+0000 7f77667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:51.593 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.592+0000 7f77a32c0800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:51.593 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.592+0000 7f77a32c0800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:51.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.598+0000 7f77a32c0800 5 note: GC not initialized 2023-12-03T11:37:51.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.598+0000 7f76d57fa640 20 reqs_thread_entry: start 2023-12-03T11:37:51.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.598+0000 7f77a32c0800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:51.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.598+0000 7f77a32c0800 20 Filter name: none 2023-12-03T11:37:51.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.598+0000 7f76ceffd640 20 reqs_thread_entry: start 2023-12-03T11:37:51.600 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.598+0000 7f77a32c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.600 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.599+0000 7f77a32c0800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:37:51.600 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.599+0000 7f77a32c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.599+0000 7f77a32c0800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:37:51.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.599+0000 7f77a32c0800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:51.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.599+0000 7f77a32c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.600+0000 7f77a32c0800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:37:51.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.600+0000 7f77a32c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.600+0000 7f77a32c0800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:37:51.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.600+0000 7f77a32c0800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:51.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.601+0000 7f77a32c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.601+0000 7f77a32c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.601+0000 7f77667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:51.604 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.603+0000 7f77a32c0800 20 remove_watcher() i=0 2023-12-03T11:37:51.604 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.603+0000 7f77a32c0800 2 removed watcher, disabling cache 2023-12-03T11:37:51.605 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.604+0000 7f77a32c0800 20 remove_watcher() i=1 2023-12-03T11:37:51.607 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.606+0000 7f77a32c0800 20 remove_watcher() i=2 2023-12-03T11:37:51.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.607+0000 7f77a32c0800 20 remove_watcher() i=3 2023-12-03T11:37:51.609 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.608+0000 7f77a32c0800 20 remove_watcher() i=4 2023-12-03T11:37:51.610 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.609+0000 7f77a32c0800 20 remove_watcher() i=5 2023-12-03T11:37:51.611 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.610+0000 7f77a32c0800 20 remove_watcher() i=6 2023-12-03T11:37:51.612 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.611+0000 7f77a32c0800 20 remove_watcher() i=7 2023-12-03T11:37:51.617 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:51.617 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:37:51.617 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-set-target-layout id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.19 num_objects: 20 size_kb: 1 num_shards: 2 2023-12-03T11:37:51.617 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:51.692 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with abort at set_target_layout 2023-12-03T11:37:51.692 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:51.875 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2023-12-03T11:37:51.902 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:51.902 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:51.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.916+0000 7f8ff112f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.917+0000 7f8ff112f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.917+0000 7f8ff112f800 20 realm 2023-12-03T11:37:51.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.917+0000 7f8ff112f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.918+0000 7f8ff112f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.918+0000 7f8ff112f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:51.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.918+0000 7f8ff112f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.918+0000 7f8ff112f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.918+0000 7f8ff112f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.920 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.919+0000 7f8ff112f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:51.920 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.919+0000 7f8ff112f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.920 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.919+0000 7f8ff112f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:51.921 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.919+0000 7f8ff112f800 20 searching for the correct realm 2023-12-03T11:37:51.930 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.929+0000 7f8fec667640 0 -- 172.21.15.44:0/3888159233 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x55f8817ef690 msgr2=0x55f8817f1a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:51.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.931+0000 7f8ff112f800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:51.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.931+0000 7f8ff112f800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:51.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.931+0000 7f8ff112f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:51.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.931+0000 7f8ff112f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:51.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.931+0000 7f8ff112f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.932 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.931+0000 7f8ff112f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.933 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.931+0000 7f8ff112f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.931+0000 7f8ff112f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:51.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.931+0000 7f8ff112f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.932+0000 7f8ff112f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:51.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.932+0000 7f8ff112f800 20 zone default found 2023-12-03T11:37:51.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.932+0000 7f8ff112f800 4 Realm: () 2023-12-03T11:37:51.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.932+0000 7f8ff112f800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:51.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.932+0000 7f8ff112f800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:51.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.932+0000 7f8ff112f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:51.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.932+0000 7f8ff112f800 20 zonegroup default 2023-12-03T11:37:51.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.932+0000 7f8ff112f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.932+0000 7f8ff112f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.932+0000 7f8ff112f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.932+0000 7f8ff112f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.934 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.932+0000 7f8ff112f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.935 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.933+0000 7f8ff112f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.935 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.933+0000 7f8ff112f800 20 started sync module instance, tier type = 2023-12-03T11:37:51.935 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.933+0000 7f8ff112f800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:51.939 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.938+0000 7f8fec667640 0 -- 172.21.15.44:0/3888159233 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x7f8fc8079d90 msgr2=0x7f8fc807c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:51.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.946+0000 7f8ff112f800 20 add_watcher() i=0 2023-12-03T11:37:51.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.946+0000 7f8ff112f800 20 add_watcher() i=1 2023-12-03T11:37:51.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.946+0000 7f8ff112f800 20 add_watcher() i=2 2023-12-03T11:37:51.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.946+0000 7f8ff112f800 20 add_watcher() i=3 2023-12-03T11:37:51.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.946+0000 7f8ff112f800 20 add_watcher() i=4 2023-12-03T11:37:51.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.946+0000 7f8ff112f800 20 add_watcher() i=5 2023-12-03T11:37:51.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.946+0000 7f8ff112f800 20 add_watcher() i=6 2023-12-03T11:37:51.949 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.948+0000 7f8ff112f800 20 add_watcher() i=7 2023-12-03T11:37:51.949 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.948+0000 7f8ff112f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:51.951 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.950+0000 7f8fb2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:51.951 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.950+0000 7f8ff112f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:51.951 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.950+0000 7f8ff112f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:51.957 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.956+0000 7f8ff112f800 5 note: GC not initialized 2023-12-03T11:37:51.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.956+0000 7f8f21ffb640 20 reqs_thread_entry: start 2023-12-03T11:37:51.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.956+0000 7f8ff112f800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:51.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.956+0000 7f8ff112f800 20 Filter name: none 2023-12-03T11:37:51.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.956+0000 7f8f137fe640 20 reqs_thread_entry: start 2023-12-03T11:37:51.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.957+0000 7f8ff112f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.957+0000 7f8ff112f800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:37:51.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.957+0000 7f8ff112f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.959 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.958+0000 7f8ff112f800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:37:51.959 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.958+0000 7f8ff112f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:51.959 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.958+0000 7f8ff112f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.959 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.958+0000 7f8ff112f800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:37:51.959 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.958+0000 7f8ff112f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.958+0000 7f8ff112f800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:37:51.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.958+0000 7f8ff112f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:51.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.959+0000 7f8ff112f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.959+0000 7f8ff112f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.961 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.960+0000 7f8fb2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:51.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.962+0000 7f8ff112f800 20 remove_watcher() i=0 2023-12-03T11:37:51.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.962+0000 7f8ff112f800 2 removed watcher, disabling cache 2023-12-03T11:37:51.964 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.963+0000 7f8ff112f800 20 remove_watcher() i=1 2023-12-03T11:37:51.965 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.964+0000 7f8ff112f800 20 remove_watcher() i=2 2023-12-03T11:37:51.966 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.965+0000 7f8ff112f800 20 remove_watcher() i=3 2023-12-03T11:37:51.967 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.966+0000 7f8ff112f800 20 remove_watcher() i=4 2023-12-03T11:37:51.968 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.967+0000 7f8ff112f800 20 remove_watcher() i=5 2023-12-03T11:37:51.969 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.968+0000 7f8ff112f800 20 remove_watcher() i=6 2023-12-03T11:37:51.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:51.969+0000 7f8ff112f800 20 remove_watcher() i=7 2023-12-03T11:37:51.975 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:51.975 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:37:51.975 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-set-target-layout id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:37:51.975 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:51.976 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2023-12-03T11:37:52.009 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:52.009 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:52.221 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.220+0000 7f2eccc33640 0 --2- 172.21.15.44:0/2405233110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c3ad99e920 0x55c3ad9a7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-12-03T11:37:52.225 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.224+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.227 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.226+0000 7f2ed072b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.228 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.226+0000 7f2ed072b800 20 realm 2023-12-03T11:37:52.228 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.226+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.228 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.226+0000 7f2ed072b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.228 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.226+0000 7f2ed072b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:52.228 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.226+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.228 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.227+0000 7f2ed072b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.228 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.227+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.229 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.228+0000 7f2ed072b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:52.229 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.228+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.229 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.228+0000 7f2ed072b800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:52.229 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.228+0000 7f2ed072b800 20 searching for the correct realm 2023-12-03T11:37:52.237 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.236+0000 7f2ecc432640 0 -- 172.21.15.44:0/1603041878 >> [v2:172.21.15.44:6800/4244511941,v1:172.21.15.44:6801/4244511941] conn(0x7f2ec0083460 msgr2=0x7f2ec00838e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:52.240 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.239+0000 7f2ed072b800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:52.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.239+0000 7f2ed072b800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:52.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.239+0000 7f2ed072b800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:52.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.239+0000 7f2ed072b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:52.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.239+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.239+0000 7f2ed072b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.239+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.240+0000 7f2ed072b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:52.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.240+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.240+0000 7f2ed072b800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:52.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.240+0000 7f2ed072b800 20 zone default found 2023-12-03T11:37:52.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.240+0000 7f2ed072b800 4 Realm: () 2023-12-03T11:37:52.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.240+0000 7f2ed072b800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:52.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.240+0000 7f2ed072b800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:52.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.240+0000 7f2ed072b800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:52.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.240+0000 7f2ed072b800 20 zonegroup default 2023-12-03T11:37:52.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.240+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.240+0000 7f2ed072b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.240+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.241+0000 7f2ed072b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.241+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.241+0000 7f2ed072b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.241+0000 7f2ed072b800 20 started sync module instance, tier type = 2023-12-03T11:37:52.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.241+0000 7f2ed072b800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:52.244 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.242+0000 7f2eccc33640 0 -- 172.21.15.44:0/1603041878 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f2ec0070920 msgr2=0x7f2ec00803e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:52.251 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.250+0000 7f2ed072b800 20 add_watcher() i=0 2023-12-03T11:37:52.251 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.250+0000 7f2ed072b800 20 add_watcher() i=1 2023-12-03T11:37:52.251 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.250+0000 7f2ed072b800 20 add_watcher() i=2 2023-12-03T11:37:52.251 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.250+0000 7f2ed072b800 20 add_watcher() i=3 2023-12-03T11:37:52.251 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.250+0000 7f2ed072b800 20 add_watcher() i=4 2023-12-03T11:37:52.251 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.250+0000 7f2ed072b800 20 add_watcher() i=5 2023-12-03T11:37:52.251 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.250+0000 7f2ed072b800 20 add_watcher() i=6 2023-12-03T11:37:52.252 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.251+0000 7f2ed072b800 20 add_watcher() i=7 2023-12-03T11:37:52.252 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.251+0000 7f2ed072b800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:52.254 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.253+0000 7f2e927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:52.254 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.253+0000 7f2ed072b800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:52.254 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.253+0000 7f2ed072b800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:52.260 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.259+0000 7f2ed072b800 5 note: GC not initialized 2023-12-03T11:37:52.261 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.259+0000 7f2e017fa640 20 reqs_thread_entry: start 2023-12-03T11:37:52.261 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.259+0000 7f2ed072b800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:52.261 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.259+0000 7f2ed072b800 20 Filter name: none 2023-12-03T11:37:52.261 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.259+0000 7f2dfaffd640 20 reqs_thread_entry: start 2023-12-03T11:37:52.261 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.259+0000 7f2ed072b800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2023-12-03T11:37:52.261 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.259+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.262 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.260+0000 7f2ed072b800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:37:52.262 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.260+0000 7f2ed072b800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2023-12-03T11:37:52.262 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.260+0000 7f2ed072b800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2023-12-03T11:37:52.262 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.260+0000 7f2ed072b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 : miss 2023-12-03T11:37:52.262 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.260+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.262 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.260+0000 7f2ed072b800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:37:52.262 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.260+0000 7f2ed072b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 info.flags=0x17 2023-12-03T11:37:52.262 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.260+0000 7f2ed072b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 to cache LRU end 2023-12-03T11:37:52.262 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.260+0000 7f2ed072b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:37:52.263 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.260+0000 7f2ed072b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:37:52.263 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.261+0000 7f2ed072b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 2023-12-03T11:37:52.264 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2ed072b800 time 2023-12-03T11:37:52.264732+0000 2023-12-03T11:37:52.264 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:37:52.265 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:37:52.265 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2ed336eef8] 2023-12-03T11:37:52.265 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f2ed336f0b6] 2023-12-03T11:37:52.265 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c3acd39a71] 2023-12-03T11:37:52.266 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0x79787a) [0x55c3acd4187a] 2023-12-03T11:37:52.266 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55c3acd45e6b] 2023-12-03T11:37:52.266 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2023-12-03T11:37:52.266 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f2ed0c3feb0] 2023-12-03T11:37:52.266 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2023-12-03T11:37:52.266 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2023-12-03T11:37:52.266 INFO:tasks.workunit.client.0.smithi044.stderr:*** Caught signal (Aborted) ** 2023-12-03T11:37:52.266 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f2ed072b800 thread_name:radosgw-admin 2023-12-03T11:37:52.266 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.264+0000 7f2ed072b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2ed072b800 time 2023-12-03T11:37:52.264732+0000 2023-12-03T11:37:52.266 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:37:52.266 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.266 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:37:52.267 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2ed336eef8] 2023-12-03T11:37:52.267 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f2ed336f0b6] 2023-12-03T11:37:52.267 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c3acd39a71] 2023-12-03T11:37:52.267 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0x79787a) [0x55c3acd4187a] 2023-12-03T11:37:52.267 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55c3acd45e6b] 2023-12-03T11:37:52.267 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2023-12-03T11:37:52.267 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f2ed0c3feb0] 2023-12-03T11:37:52.267 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2023-12-03T11:37:52.267 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2023-12-03T11:37:52.267 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.284 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:37:52.284 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f2ed0c54db0] 2023-12-03T11:37:52.284 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f2ed0ca154c] 2023-12-03T11:37:52.284 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2023-12-03T11:37:52.284 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2023-12-03T11:37:52.284 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2ed336ef52] 2023-12-03T11:37:52.284 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f2ed336f0b6] 2023-12-03T11:37:52.285 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c3acd39a71] 2023-12-03T11:37:52.285 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0x79787a) [0x55c3acd4187a] 2023-12-03T11:37:52.285 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55c3acd45e6b] 2023-12-03T11:37:52.285 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2023-12-03T11:37:52.285 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f2ed0c3feb0] 2023-12-03T11:37:52.285 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2023-12-03T11:37:52.285 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2023-12-03T11:37:52.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.265+0000 7f2ed072b800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:37:52.285 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f2ed072b800 thread_name:radosgw-admin 2023-12-03T11:37:52.285 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.285 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:37:52.285 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f2ed0c54db0] 2023-12-03T11:37:52.285 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f2ed0ca154c] 2023-12-03T11:37:52.286 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2023-12-03T11:37:52.286 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2023-12-03T11:37:52.286 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2ed336ef52] 2023-12-03T11:37:52.286 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f2ed336f0b6] 2023-12-03T11:37:52.286 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c3acd39a71] 2023-12-03T11:37:52.286 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0x79787a) [0x55c3acd4187a] 2023-12-03T11:37:52.286 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55c3acd45e6b] 2023-12-03T11:37:52.286 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2023-12-03T11:37:52.286 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f2ed0c3feb0] 2023-12-03T11:37:52.286 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2023-12-03T11:37:52.286 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2023-12-03T11:37:52.287 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:37:52.287 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.287 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2023-12-03T11:37:52.287 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e690) adding con mode: crc 2023-12-03T11:37:52.287 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e690) adding con mode: secure 2023-12-03T11:37:52.287 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e690) adding con mode: crc 2023-12-03T11:37:52.287 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e690) adding con mode: secure 2023-12-03T11:37:52.287 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e690) adding con mode: crc 2023-12-03T11:37:52.287 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e690) adding con mode: crc 2023-12-03T11:37:52.287 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e690) adding con mode: secure 2023-12-03T11:37:52.287 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e690) adding con mode: crc 2023-12-03T11:37:52.287 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e690) adding con mode: secure 2023-12-03T11:37:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e690) adding con mode: crc 2023-12-03T11:37:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e690) adding con mode: secure 2023-12-03T11:37:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2023-12-03T11:37:52.018+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2023-12-03T11:37:52.018+0000 7f2ed072b800 10 monclient: init 2023-12-03T11:37:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding auth protocol: cephx 2023-12-03T11:37:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding auth protocol: cephx 2023-12-03T11:37:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding auth protocol: cephx 2023-12-03T11:37:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: secure 2023-12-03T11:37:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: crc 2023-12-03T11:37:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: secure 2023-12-03T11:37:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: crc 2023-12-03T11:37:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: secure 2023-12-03T11:37:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: crc 2023-12-03T11:37:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: crc 2023-12-03T11:37:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: secure 2023-12-03T11:37:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: crc 2023-12-03T11:37:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: secure 2023-12-03T11:37:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: crc 2023-12-03T11:37:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: secure 2023-12-03T11:37:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2023-12-03T11:37:52.018+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2023-12-03T11:37:52.018+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2023-12-03T11:37:52.019+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command rotate-key cmddesc rotate-key hook 0x7ffe48a86088 EEXIST 2023-12-03T11:37:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2023-12-03T11:37:52.019+0000 7f2ed072b800 10 monclient: _reopen_session rank -1 2023-12-03T11:37:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2023-12-03T11:37:52.019+0000 7f2ed072b800 10 monclient: _add_conns ranks=[0,1,2] 2023-12-03T11:37:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2023-12-03T11:37:52.019+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-a con 0x55c3ad99e920 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:37:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2023-12-03T11:37:52.019+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-b con 0x55c3ad99ed00 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:37:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2023-12-03T11:37:52.019+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-c con 0x55c3ad972e00 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:37:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2023-12-03T11:37:52.019+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2023-12-03T11:37:52.019+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2023-12-03T11:37:52.019+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2023-12-03T11:37:52.019+0000 7f2ed072b800 10 monclient(hunting): _renew_subs 2023-12-03T11:37:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2023-12-03T11:37:52.019+0000 7f2ed072b800 10 monclient(hunting): authenticate will time out at 1551.244797s 2023-12-03T11:37:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2023-12-03T11:37:52.019+0000 7f2eccc33640 10 monclient(hunting): get_auth_request con 0x55c3ad99e920 auth_method 0 2023-12-03T11:37:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2023-12-03T11:37:52.019+0000 7f2eccc33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2023-12-03T11:37:52.019+0000 7f2eccc33640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2023-12-03T11:37:52.019+0000 7f2eccc33640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:37:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2023-12-03T11:37:52.019+0000 7f2ecbc31640 10 monclient(hunting): get_auth_request con 0x55c3ad972e00 auth_method 0 2023-12-03T11:37:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2023-12-03T11:37:52.019+0000 7f2ecbc31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2023-12-03T11:37:52.019+0000 7f2ecbc31640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2023-12-03T11:37:52.019+0000 7f2ecbc31640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:37:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2023-12-03T11:37:52.019+0000 7f2eccc33640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:37:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2023-12-03T11:37:52.019+0000 7f2eccc33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:37:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2023-12-03T11:37:52.019+0000 7f2eccc33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:37:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2023-12-03T11:37:52.019+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:37:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2023-12-03T11:37:52.019+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:37:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2023-12-03T11:37:52.019+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:37:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2023-12-03T11:37:52.019+0000 7f2ecc432640 10 monclient(hunting): get_auth_request con 0x55c3ad99ed00 auth_method 0 2023-12-03T11:37:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2023-12-03T11:37:52.019+0000 7f2ecc432640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2023-12-03T11:37:52.019+0000 7f2ecc432640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2023-12-03T11:37:52.019+0000 7f2ecc432640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:37:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2023-12-03T11:37:52.019+0000 7f2ec9c2d640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:37:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2023-12-03T11:37:52.019+0000 7f2ec9c2d640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:37:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2023-12-03T11:37:52.019+0000 7f2ec9c2d640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:37:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2023-12-03T11:37:52.019+0000 7f2eccc33640 10 monclient(hunting): handle_auth_done global_id 6507 payload 274 2023-12-03T11:37:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2023-12-03T11:37:52.019+0000 7f2eccc33640 10 monclient: _finish_hunting 0 2023-12-03T11:37:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2023-12-03T11:37:52.019+0000 7f2eccc33640 1 monclient: found mon.noname-a 2023-12-03T11:37:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2023-12-03T11:37:52.019+0000 7f2eccc33640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2023-12-03T11:37:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2023-12-03T11:37:52.019+0000 7f2eccc33640 10 monclient: get_auth_request con 0x7f2eb8069850 auth_method 0 2023-12-03T11:37:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2023-12-03T11:37:52.220+0000 7f2eccc33640 10 monclient: get_auth_request con 0x55c3ad99e920 auth_method 0 2023-12-03T11:37:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2023-12-03T11:37:52.220+0000 7f2eccc33640 0 --2- 172.21.15.44:0/2405233110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c3ad99e920 0x55c3ad9a7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-12-03T11:37:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2023-12-03T11:37:52.220+0000 7f2eb2ffd640 10 monclient: ms_handle_reset current mon [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:37:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2023-12-03T11:37:52.220+0000 7f2eb2ffd640 10 monclient: _reopen_session rank -1 2023-12-03T11:37:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2023-12-03T11:37:52.220+0000 7f2eb2ffd640 10 monclient: _add_conns ranks=[0,2,1] 2023-12-03T11:37:52.293 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2023-12-03T11:37:52.220+0000 7f2eb2ffd640 10 monclient(hunting): picked mon.noname-a con 0x7f2ea8001dc0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:37:52.293 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2023-12-03T11:37:52.220+0000 7f2eb2ffd640 10 monclient(hunting): picked mon.noname-c con 0x55c3ad972e00 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:37:52.293 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2023-12-03T11:37:52.220+0000 7f2eb2ffd640 10 monclient(hunting): picked mon.noname-b con 0x7f2ea8007310 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:37:52.293 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2023-12-03T11:37:52.220+0000 7f2eb2ffd640 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.293 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2023-12-03T11:37:52.220+0000 7f2eb2ffd640 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.293 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2023-12-03T11:37:52.220+0000 7f2eb2ffd640 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.293 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2023-12-03T11:37:52.220+0000 7f2eb2ffd640 10 monclient(hunting): _renew_subs 2023-12-03T11:37:52.293 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2023-12-03T11:37:52.220+0000 7f2eb2ffd640 10 monclient(hunting): ms_handle_reset hunted mon [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:37:52.293 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2023-12-03T11:37:52.220+0000 7f2ecc432640 10 monclient(hunting): get_auth_request con 0x7f2ea8001dc0 auth_method 0 2023-12-03T11:37:52.293 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2023-12-03T11:37:52.220+0000 7f2ecc432640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.293 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2023-12-03T11:37:52.220+0000 7f2ecc432640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.293 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2023-12-03T11:37:52.220+0000 7f2ecc432640 10 monclient(hunting): _init_auth already have auth, reseting 2023-12-03T11:37:52.293 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2023-12-03T11:37:52.220+0000 7f2ecbc31640 10 monclient(hunting): get_auth_request con 0x55c3ad972e00 auth_method 0 2023-12-03T11:37:52.293 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2023-12-03T11:37:52.220+0000 7f2ecbc31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.294 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2023-12-03T11:37:52.220+0000 7f2ecbc31640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.294 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2023-12-03T11:37:52.220+0000 7f2ecbc31640 10 monclient(hunting): _init_auth already have auth, reseting 2023-12-03T11:37:52.294 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2023-12-03T11:37:52.220+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:37:52.294 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2023-12-03T11:37:52.220+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:37:52.294 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2023-12-03T11:37:52.220+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2023-12-03T11:37:52.294 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2023-12-03T11:37:52.220+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:37:52.294 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2023-12-03T11:37:52.220+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:37:52.294 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2023-12-03T11:37:52.220+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2023-12-03T11:37:52.294 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2023-12-03T11:37:52.220+0000 7f2eccc33640 10 monclient(hunting): get_auth_request con 0x7f2ea8007310 auth_method 0 2023-12-03T11:37:52.294 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2023-12-03T11:37:52.220+0000 7f2eccc33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.294 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2023-12-03T11:37:52.220+0000 7f2eccc33640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.294 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2023-12-03T11:37:52.220+0000 7f2eccc33640 10 monclient(hunting): _init_auth already have auth, reseting 2023-12-03T11:37:52.294 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2023-12-03T11:37:52.220+0000 7f2ecc432640 10 monclient(hunting): handle_auth_done global_id 6507 payload 293 2023-12-03T11:37:52.295 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2023-12-03T11:37:52.220+0000 7f2ecc432640 10 monclient: _finish_hunting 0 2023-12-03T11:37:52.295 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2023-12-03T11:37:52.220+0000 7f2ecc432640 1 monclient: found mon.noname-a 2023-12-03T11:37:52.295 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2023-12-03T11:37:52.220+0000 7f2ecc432640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2023-12-03T11:37:52.295 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2023-12-03T11:37:52.221+0000 7f2eb2ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:37:52.295 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2023-12-03T11:37:52.221+0000 7f2eb2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:37:52.295 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2023-12-03T11:37:52.221+0000 7f2eb2ffd640 10 monclient: dump: 2023-12-03T11:37:52.295 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:37:52.295 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:37:52.295 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.295 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.295 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:37:52.295 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:37:52.295 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:37:52.296 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:37:52.296 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:37:52.296 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.296 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2023-12-03T11:37:52.221+0000 7f2eb2ffd640 10 monclient: _finish_auth 0 2023-12-03T11:37:52.296 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2023-12-03T11:37:52.221+0000 7f2eb2ffd640 10 monclient: _check_auth_tickets 2023-12-03T11:37:52.296 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2023-12-03T11:37:52.221+0000 7f2eb2ffd640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:37:52.296 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2023-12-03T11:37:52.221+0000 7f2ed072b800 5 monclient: authenticate success, global_id 6507 2023-12-03T11:37:52.296 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2023-12-03T11:37:52.221+0000 7f2ed072b800 10 monclient: get_monmap_and_config success 2023-12-03T11:37:52.296 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2023-12-03T11:37:52.221+0000 7f2ed072b800 4 set_mon_vals no callback set 2023-12-03T11:37:52.296 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2023-12-03T11:37:52.221+0000 7f2eb2ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:37:52.296 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2023-12-03T11:37:52.221+0000 7f2eb2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:37:52.296 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2023-12-03T11:37:52.221+0000 7f2eb2ffd640 10 monclient: dump: 2023-12-03T11:37:52.296 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:37:52.297 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:37:52.297 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.297 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.297 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:37:52.297 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:37:52.297 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:37:52.297 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:37:52.297 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:37:52.297 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.297 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2023-12-03T11:37:52.221+0000 7f2ed072b800 10 monclient: shutdown 2023-12-03T11:37:52.297 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2023-12-03T11:37:52.222+0000 7f2ed072b800 10 monclient: build_initial_monmap 2023-12-03T11:37:52.297 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2023-12-03T11:37:52.222+0000 7f2ed072b800 1 build_initial for_mkfs: 0 2023-12-03T11:37:52.298 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2023-12-03T11:37:52.222+0000 7f2ed072b800 10 monclient: monmap: 2023-12-03T11:37:52.298 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:37:52.298 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:37:52.298 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:37:52.298 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:37:52.298 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:37:52.298 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:37:52.298 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:37:52.298 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:37:52.298 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:37:52.298 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.298 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding auth protocol: cephx 2023-12-03T11:37:52.299 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding auth protocol: cephx 2023-12-03T11:37:52.299 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding auth protocol: cephx 2023-12-03T11:37:52.299 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: secure 2023-12-03T11:37:52.299 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: crc 2023-12-03T11:37:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: secure 2023-12-03T11:37:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: crc 2023-12-03T11:37:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: secure 2023-12-03T11:37:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: crc 2023-12-03T11:37:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: crc 2023-12-03T11:37:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: secure 2023-12-03T11:37:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: crc 2023-12-03T11:37:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: secure 2023-12-03T11:37:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: crc 2023-12-03T11:37:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: secure 2023-12-03T11:37:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2023-12-03T11:37:52.222+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2023-12-03T11:37:52.222+0000 7f2ed072b800 1 librados: starting msgr at 2023-12-03T11:37:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2023-12-03T11:37:52.222+0000 7f2ed072b800 1 librados: starting objecter 2023-12-03T11:37:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command objecter_requests cmddesc objecter_requests hook 0x55c3ad99d440 EEXIST 2023-12-03T11:37:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2023-12-03T11:37:52.222+0000 7f2ed072b800 1 librados: setting wanted keys 2023-12-03T11:37:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2023-12-03T11:37:52.222+0000 7f2ed072b800 1 librados: calling monclient init 2023-12-03T11:37:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2023-12-03T11:37:52.222+0000 7f2ed072b800 10 monclient: init 2023-12-03T11:37:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding auth protocol: cephx 2023-12-03T11:37:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding auth protocol: cephx 2023-12-03T11:37:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding auth protocol: cephx 2023-12-03T11:37:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: secure 2023-12-03T11:37:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: crc 2023-12-03T11:37:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: secure 2023-12-03T11:37:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: crc 2023-12-03T11:37:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: secure 2023-12-03T11:37:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: crc 2023-12-03T11:37:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: crc 2023-12-03T11:37:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: secure 2023-12-03T11:37:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: crc 2023-12-03T11:37:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: secure 2023-12-03T11:37:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: crc 2023-12-03T11:37:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: secure 2023-12-03T11:37:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2023-12-03T11:37:52.222+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2023-12-03T11:37:52.222+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command rotate-key cmddesc rotate-key hook 0x55c3ad96c860 EEXIST 2023-12-03T11:37:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2023-12-03T11:37:52.222+0000 7f2ed072b800 10 monclient: _reopen_session rank -1 2023-12-03T11:37:52.304 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2023-12-03T11:37:52.222+0000 7f2ed072b800 10 monclient: _add_conns ranks=[2,1,0] 2023-12-03T11:37:52.304 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-c con 0x55c3ad972e00 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:37:52.304 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-b con 0x7f2ea8001dc0 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:37:52.304 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-a con 0x7f2ea8007310 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:37:52.304 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.304 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.304 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.304 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient(hunting): _renew_subs 2023-12-03T11:37:52.304 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient(hunting): authenticate will time out at 1551.448699s 2023-12-03T11:37:52.304 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2023-12-03T11:37:52.223+0000 7f2ecc432640 10 monclient(hunting): get_auth_request con 0x55c3ad972e00 auth_method 0 2023-12-03T11:37:52.304 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2023-12-03T11:37:52.223+0000 7f2ecc432640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.304 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2023-12-03T11:37:52.223+0000 7f2ecc432640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.304 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2023-12-03T11:37:52.223+0000 7f2ecc432640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:37:52.305 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2023-12-03T11:37:52.223+0000 7f2eccc33640 10 monclient(hunting): get_auth_request con 0x7f2ea8007310 auth_method 0 2023-12-03T11:37:52.305 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2023-12-03T11:37:52.223+0000 7f2eccc33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.305 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2023-12-03T11:37:52.223+0000 7f2eccc33640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.305 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2023-12-03T11:37:52.223+0000 7f2eccc33640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:37:52.305 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2023-12-03T11:37:52.223+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:37:52.305 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2023-12-03T11:37:52.223+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:37:52.305 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2023-12-03T11:37:52.223+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:37:52.305 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2023-12-03T11:37:52.223+0000 7f2eccc33640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:37:52.305 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2023-12-03T11:37:52.223+0000 7f2eccc33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:37:52.305 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2023-12-03T11:37:52.223+0000 7f2eccc33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:37:52.305 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2023-12-03T11:37:52.223+0000 7f2ecc432640 10 monclient(hunting): handle_auth_done global_id 6188 payload 824 2023-12-03T11:37:52.305 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2023-12-03T11:37:52.223+0000 7f2ecc432640 10 monclient: _finish_hunting 0 2023-12-03T11:37:52.305 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2023-12-03T11:37:52.223+0000 7f2ecc432640 1 monclient: found mon.noname-c 2023-12-03T11:37:52.306 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2023-12-03T11:37:52.223+0000 7f2ecc432640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2023-12-03T11:37:52.306 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2023-12-03T11:37:52.223+0000 7f2ecbc31640 10 monclient: get_auth_request con 0x7f2ea8001dc0 auth_method 0 2023-12-03T11:37:52.306 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2023-12-03T11:37:52.223+0000 7f2eb17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:37:52.306 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2023-12-03T11:37:52.223+0000 7f2eb17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:37:52.306 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2023-12-03T11:37:52.223+0000 7f2eb17fa640 10 monclient: dump: 2023-12-03T11:37:52.306 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:37:52.306 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:37:52.306 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.306 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.306 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:37:52.307 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:37:52.307 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:37:52.307 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:37:52.307 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:37:52.307 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.307 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2023-12-03T11:37:52.223+0000 7f2eb17fa640 10 monclient: _finish_auth 0 2023-12-03T11:37:52.307 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2023-12-03T11:37:52.223+0000 7f2eb17fa640 10 monclient: _check_auth_tickets 2023-12-03T11:37:52.307 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2023-12-03T11:37:52.223+0000 7f2eb17fa640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:37:52.307 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2023-12-03T11:37:52.223+0000 7f2eb17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:37:52.307 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2023-12-03T11:37:52.223+0000 7f2eb17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:37:52.307 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2023-12-03T11:37:52.223+0000 7f2eb17fa640 10 monclient: dump: 2023-12-03T11:37:52.307 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:37:52.308 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:37:52.308 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.308 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.308 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:37:52.308 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:37:52.308 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:37:52.308 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:37:52.308 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:37:52.308 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.308 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2023-12-03T11:37:52.223+0000 7f2ed072b800 5 monclient: authenticate success, global_id 6188 2023-12-03T11:37:52.308 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient: _renew_subs 2023-12-03T11:37:52.308 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2023-12-03T11:37:52.223+0000 7f2eb2ffd640 4 set_mon_vals no callback set 2023-12-03T11:37:52.308 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:37:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient: _renew_subs 2023-12-03T11:37:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:37:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2023-12-03T11:37:52.223+0000 7f2ed072b800 1 librados: init done 2023-12-03T11:37:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2023-12-03T11:37:52.224+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2023-12-03T11:37:52.225+0000 7f2eb17fa640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:37:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2023-12-03T11:37:52.225+0000 7f2eb17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:37:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2023-12-03T11:37:52.225+0000 7f2eb17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:37:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2023-12-03T11:37:52.225+0000 7f2ecbc31640 10 monclient: get_auth_request con 0x7f2ea806a650 auth_method 0 2023-12-03T11:37:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2023-12-03T11:37:52.226+0000 7f2eccc33640 10 monclient: get_auth_request con 0x55c3ad9b9ef0 auth_method 0 2023-12-03T11:37:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2023-12-03T11:37:52.226+0000 7f2ed072b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2023-12-03T11:37:52.226+0000 7f2ed072b800 20 realm 2023-12-03T11:37:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2023-12-03T11:37:52.226+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2023-12-03T11:37:52.226+0000 7f2ed072b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2023-12-03T11:37:52.226+0000 7f2ed072b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2023-12-03T11:37:52.226+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2023-12-03T11:37:52.227+0000 7f2ed072b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2023-12-03T11:37:52.227+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2023-12-03T11:37:52.227+0000 7f2ecc432640 10 monclient: get_auth_request con 0x55c3ad9bdf30 auth_method 0 2023-12-03T11:37:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2023-12-03T11:37:52.228+0000 7f2ed072b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2023-12-03T11:37:52.228+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2023-12-03T11:37:52.228+0000 7f2ecbc31640 10 monclient: get_auth_request con 0x55c3ad9c1760 auth_method 0 2023-12-03T11:37:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2023-12-03T11:37:52.228+0000 7f2ed072b800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2023-12-03T11:37:52.228+0000 7f2ed072b800 20 searching for the correct realm 2023-12-03T11:37:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2023-12-03T11:37:52.228+0000 7f2eccc33640 10 monclient: get_auth_request con 0x55c3ad9c6070 auth_method 0 2023-12-03T11:37:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2023-12-03T11:37:52.229+0000 7f2ecc432640 10 monclient: get_auth_request con 0x7f2ec40293f0 auth_method 0 2023-12-03T11:37:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2023-12-03T11:37:52.230+0000 7f2ecbc31640 10 monclient: get_auth_request con 0x7f2ec0072410 auth_method 0 2023-12-03T11:37:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2023-12-03T11:37:52.232+0000 7f2eccc33640 10 monclient: get_auth_request con 0x7f2ec0070920 auth_method 0 2023-12-03T11:37:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2023-12-03T11:37:52.234+0000 7f2ecc432640 10 monclient: get_auth_request con 0x7f2ec0083460 auth_method 0 2023-12-03T11:37:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2023-12-03T11:37:52.236+0000 7f2ecc432640 0 -- 172.21.15.44:0/1603041878 >> [v2:172.21.15.44:6800/4244511941,v1:172.21.15.44:6801/4244511941] conn(0x7f2ec0083460 msgr2=0x7f2ec00838e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2023-12-03T11:37:52.236+0000 7f2eb17fa640 1 client.6188.objecter ms_handle_reset 0x7f2ec0083460 session 0x7f2ec0070d80 osd.0 2023-12-03T11:37:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2023-12-03T11:37:52.236+0000 7f2eb17fa640 10 monclient: _renew_subs 2023-12-03T11:37:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2023-12-03T11:37:52.236+0000 7f2eb17fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:37:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2023-12-03T11:37:52.236+0000 7f2ecc432640 10 monclient: get_auth_request con 0x7f2ea807abf0 auth_method 0 2023-12-03T11:37:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2023-12-03T11:37:52.239+0000 7f2ed072b800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2023-12-03T11:37:52.239+0000 7f2ed072b800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2023-12-03T11:37:52.239+0000 7f2ed072b800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2023-12-03T11:37:52.239+0000 7f2ed072b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2023-12-03T11:37:52.239+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2023-12-03T11:37:52.239+0000 7f2ed072b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2023-12-03T11:37:52.239+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2023-12-03T11:37:52.240+0000 7f2ed072b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2023-12-03T11:37:52.240+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2023-12-03T11:37:52.240+0000 7f2ed072b800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2023-12-03T11:37:52.240+0000 7f2ed072b800 20 zone default found 2023-12-03T11:37:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2023-12-03T11:37:52.240+0000 7f2ed072b800 4 Realm: () 2023-12-03T11:37:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2023-12-03T11:37:52.240+0000 7f2ed072b800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2023-12-03T11:37:52.240+0000 7f2ed072b800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2023-12-03T11:37:52.240+0000 7f2ed072b800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2023-12-03T11:37:52.240+0000 7f2ed072b800 20 zonegroup default 2023-12-03T11:37:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2023-12-03T11:37:52.240+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2023-12-03T11:37:52.240+0000 7f2ed072b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2023-12-03T11:37:52.240+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2023-12-03T11:37:52.241+0000 7f2ed072b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.313 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2023-12-03T11:37:52.241+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.313 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2023-12-03T11:37:52.241+0000 7f2ed072b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.313 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2023-12-03T11:37:52.241+0000 7f2ed072b800 20 started sync module instance, tier type = 2023-12-03T11:37:52.313 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2023-12-03T11:37:52.241+0000 7f2ed072b800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:52.313 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2023-12-03T11:37:52.242+0000 7f2eccc33640 0 -- 172.21.15.44:0/1603041878 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f2ec0070920 msgr2=0x7f2ec00803e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:52.313 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2023-12-03T11:37:52.242+0000 7f2eb17fa640 1 client.6188.objecter ms_handle_reset 0x7f2ec0070920 session 0x7f2ec0054ba0 osd.6 2023-12-03T11:37:52.313 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2023-12-03T11:37:52.242+0000 7f2eccc33640 10 monclient: get_auth_request con 0x7f2ec0083460 auth_method 0 2023-12-03T11:37:52.313 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2023-12-03T11:37:52.250+0000 7f2ed072b800 20 add_watcher() i=0 2023-12-03T11:37:52.313 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2023-12-03T11:37:52.250+0000 7f2ed072b800 20 add_watcher() i=1 2023-12-03T11:37:52.313 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2023-12-03T11:37:52.250+0000 7f2ed072b800 20 add_watcher() i=2 2023-12-03T11:37:52.313 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2023-12-03T11:37:52.250+0000 7f2ed072b800 20 add_watcher() i=3 2023-12-03T11:37:52.313 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2023-12-03T11:37:52.250+0000 7f2ed072b800 20 add_watcher() i=4 2023-12-03T11:37:52.314 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2023-12-03T11:37:52.250+0000 7f2ed072b800 20 add_watcher() i=5 2023-12-03T11:37:52.314 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2023-12-03T11:37:52.250+0000 7f2ed072b800 20 add_watcher() i=6 2023-12-03T11:37:52.314 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2023-12-03T11:37:52.251+0000 7f2ed072b800 20 add_watcher() i=7 2023-12-03T11:37:52.314 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2023-12-03T11:37:52.251+0000 7f2ed072b800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:52.314 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding auth protocol: cephx 2023-12-03T11:37:52.314 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding auth protocol: cephx 2023-12-03T11:37:52.314 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding auth protocol: cephx 2023-12-03T11:37:52.314 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: secure 2023-12-03T11:37:52.314 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: crc 2023-12-03T11:37:52.314 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: secure 2023-12-03T11:37:52.314 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: crc 2023-12-03T11:37:52.314 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2023-12-03T11:37:52.253+0000 7f2e927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:52.314 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: secure 2023-12-03T11:37:52.315 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: crc 2023-12-03T11:37:52.315 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: crc 2023-12-03T11:37:52.315 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: secure 2023-12-03T11:37:52.315 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: crc 2023-12-03T11:37:52.315 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: secure 2023-12-03T11:37:52.315 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: crc 2023-12-03T11:37:52.315 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: secure 2023-12-03T11:37:52.315 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2023-12-03T11:37:52.253+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.315 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2023-12-03T11:37:52.253+0000 7f2ed072b800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:52.315 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2023-12-03T11:37:52.253+0000 7f2ed072b800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:52.315 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command cache list hook 0x55c3ad949310 2023-12-03T11:37:52.315 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command cache inspect hook 0x55c3ad949310 2023-12-03T11:37:52.316 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command cache erase hook 0x55c3ad949310 2023-12-03T11:37:52.316 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command cache zap hook 0x55c3ad949310 2023-12-03T11:37:52.316 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2023-12-03T11:37:52.253+0000 7f2ed072b800 10 monclient: get_monmap_and_config 2023-12-03T11:37:52.316 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2023-12-03T11:37:52.253+0000 7f2ed072b800 10 monclient: build_initial_monmap 2023-12-03T11:37:52.316 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2023-12-03T11:37:52.253+0000 7f2ed072b800 1 build_initial for_mkfs: 0 2023-12-03T11:37:52.316 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2023-12-03T11:37:52.253+0000 7f2ed072b800 10 monclient: monmap: 2023-12-03T11:37:52.316 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:37:52.316 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:37:52.316 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:37:52.316 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:37:52.316 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:37:52.316 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:37:52.316 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:37:52.316 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:37:52.317 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:37:52.317 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.317 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding auth protocol: cephx 2023-12-03T11:37:52.317 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding auth protocol: cephx 2023-12-03T11:37:52.317 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding auth protocol: cephx 2023-12-03T11:37:52.317 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.317 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.317 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.317 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.317 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.317 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.317 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.317 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.318 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.318 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.318 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.318 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.318 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2023-12-03T11:37:52.253+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.318 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2023-12-03T11:37:52.254+0000 7f2ed072b800 10 monclient: init 2023-12-03T11:37:52.318 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding auth protocol: cephx 2023-12-03T11:37:52.318 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding auth protocol: cephx 2023-12-03T11:37:52.318 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding auth protocol: cephx 2023-12-03T11:37:52.318 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: secure 2023-12-03T11:37:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: crc 2023-12-03T11:37:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: secure 2023-12-03T11:37:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: crc 2023-12-03T11:37:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: secure 2023-12-03T11:37:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: crc 2023-12-03T11:37:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: crc 2023-12-03T11:37:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: secure 2023-12-03T11:37:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: crc 2023-12-03T11:37:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: secure 2023-12-03T11:37:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: crc 2023-12-03T11:37:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: secure 2023-12-03T11:37:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2023-12-03T11:37:52.254+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2023-12-03T11:37:52.254+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command rotate-key cmddesc rotate-key hook 0x7ffe48a86608 EEXIST 2023-12-03T11:37:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2023-12-03T11:37:52.254+0000 7f2ed072b800 10 monclient: _reopen_session rank -1 2023-12-03T11:37:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2023-12-03T11:37:52.254+0000 7f2ed072b800 10 monclient: _add_conns ranks=[1,2,0] 2023-12-03T11:37:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2023-12-03T11:37:52.254+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-b con 0x55c3ad9d55e0 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:37:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2023-12-03T11:37:52.254+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-c con 0x55c3ada05d40 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:37:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2023-12-03T11:37:52.254+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-a con 0x55c3ada06790 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:37:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2023-12-03T11:37:52.254+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2023-12-03T11:37:52.254+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2023-12-03T11:37:52.254+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2023-12-03T11:37:52.254+0000 7f2ed072b800 10 monclient(hunting): _renew_subs 2023-12-03T11:37:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2023-12-03T11:37:52.254+0000 7f2ed072b800 10 monclient(hunting): authenticate will time out at 1551.480177s 2023-12-03T11:37:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2023-12-03T11:37:52.254+0000 7f2ecc432640 10 monclient(hunting): get_auth_request con 0x55c3ada05d40 auth_method 0 2023-12-03T11:37:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2023-12-03T11:37:52.254+0000 7f2ecc432640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2023-12-03T11:37:52.254+0000 7f2ecc432640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2023-12-03T11:37:52.254+0000 7f2ecc432640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:37:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2023-12-03T11:37:52.254+0000 7f2ecbc31640 10 monclient(hunting): get_auth_request con 0x55c3ada06790 auth_method 0 2023-12-03T11:37:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2023-12-03T11:37:52.254+0000 7f2ecbc31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2023-12-03T11:37:52.254+0000 7f2ecbc31640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2023-12-03T11:37:52.254+0000 7f2ecbc31640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:37:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2023-12-03T11:37:52.254+0000 7f2eccc33640 10 monclient(hunting): get_auth_request con 0x55c3ad9d55e0 auth_method 0 2023-12-03T11:37:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2023-12-03T11:37:52.254+0000 7f2eccc33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2023-12-03T11:37:52.254+0000 7f2eccc33640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2023-12-03T11:37:52.254+0000 7f2eccc33640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:37:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2023-12-03T11:37:52.254+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:37:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2023-12-03T11:37:52.254+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:37:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2023-12-03T11:37:52.254+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:37:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2023-12-03T11:37:52.254+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:37:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2023-12-03T11:37:52.254+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:37:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2023-12-03T11:37:52.254+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:37:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2023-12-03T11:37:52.254+0000 7f2eccc33640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:37:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2023-12-03T11:37:52.254+0000 7f2eccc33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:37:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2023-12-03T11:37:52.254+0000 7f2eccc33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:37:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2023-12-03T11:37:52.254+0000 7f2ecc432640 10 monclient(hunting): handle_auth_done global_id 6191 payload 274 2023-12-03T11:37:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2023-12-03T11:37:52.254+0000 7f2ecc432640 10 monclient: _finish_hunting 0 2023-12-03T11:37:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2023-12-03T11:37:52.254+0000 7f2ecc432640 1 monclient: found mon.noname-c 2023-12-03T11:37:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2023-12-03T11:37:52.254+0000 7f2ecc432640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2023-12-03T11:37:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2023-12-03T11:37:52.255+0000 7f2e91fe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:37:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2023-12-03T11:37:52.255+0000 7f2e91fe3640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2023-12-03T11:37:52.255+0000 7f2e91fe3640 10 monclient: dump: 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2023-12-03T11:37:52.255+0000 7f2e91fe3640 10 monclient: _finish_auth 0 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2023-12-03T11:37:52.255+0000 7f2e91fe3640 10 monclient: _check_auth_tickets 2023-12-03T11:37:52.324 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2023-12-03T11:37:52.255+0000 7f2e91fe3640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:37:52.324 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2023-12-03T11:37:52.255+0000 7f2ed072b800 5 monclient: authenticate success, global_id 6191 2023-12-03T11:37:52.324 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2023-12-03T11:37:52.255+0000 7f2ed072b800 10 monclient: get_monmap_and_config success 2023-12-03T11:37:52.324 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2023-12-03T11:37:52.255+0000 7f2ed072b800 4 set_mon_vals no callback set 2023-12-03T11:37:52.324 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2023-12-03T11:37:52.255+0000 7f2e91fe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:37:52.324 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2023-12-03T11:37:52.255+0000 7f2e91fe3640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:37:52.324 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2023-12-03T11:37:52.255+0000 7f2e91fe3640 10 monclient: dump: 2023-12-03T11:37:52.324 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:37:52.324 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:37:52.324 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.324 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.324 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:37:52.324 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:37:52.324 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:37:52.324 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:37:52.325 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:37:52.325 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.325 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2023-12-03T11:37:52.255+0000 7f2ed072b800 10 monclient: shutdown 2023-12-03T11:37:52.325 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2023-12-03T11:37:52.256+0000 7f2ed072b800 10 monclient: build_initial_monmap 2023-12-03T11:37:52.325 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2023-12-03T11:37:52.256+0000 7f2ed072b800 1 build_initial for_mkfs: 0 2023-12-03T11:37:52.325 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2023-12-03T11:37:52.256+0000 7f2ed072b800 10 monclient: monmap: 2023-12-03T11:37:52.325 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:37:52.325 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:37:52.325 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:37:52.325 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:37:52.325 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:37:52.325 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:37:52.326 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:37:52.326 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:37:52.326 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:37:52.326 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.326 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding auth protocol: cephx 2023-12-03T11:37:52.326 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding auth protocol: cephx 2023-12-03T11:37:52.326 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding auth protocol: cephx 2023-12-03T11:37:52.326 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.326 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.326 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.326 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.326 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.326 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.327 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.327 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.327 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.327 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.327 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.327 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.327 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2023-12-03T11:37:52.256+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.327 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2023-12-03T11:37:52.256+0000 7f2ed072b800 1 librados: starting msgr at 2023-12-03T11:37:52.327 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2023-12-03T11:37:52.256+0000 7f2ed072b800 1 librados: starting objecter 2023-12-03T11:37:52.327 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command objecter_requests cmddesc objecter_requests hook 0x55c3ad9c58d0 EEXIST 2023-12-03T11:37:52.327 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2023-12-03T11:37:52.256+0000 7f2ed072b800 1 librados: setting wanted keys 2023-12-03T11:37:52.327 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2023-12-03T11:37:52.256+0000 7f2ed072b800 1 librados: calling monclient init 2023-12-03T11:37:52.327 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2023-12-03T11:37:52.256+0000 7f2ed072b800 10 monclient: init 2023-12-03T11:37:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding auth protocol: cephx 2023-12-03T11:37:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding auth protocol: cephx 2023-12-03T11:37:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding auth protocol: cephx 2023-12-03T11:37:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: secure 2023-12-03T11:37:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: crc 2023-12-03T11:37:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: secure 2023-12-03T11:37:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: crc 2023-12-03T11:37:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: secure 2023-12-03T11:37:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: crc 2023-12-03T11:37:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: crc 2023-12-03T11:37:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: secure 2023-12-03T11:37:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: crc 2023-12-03T11:37:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: secure 2023-12-03T11:37:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: crc 2023-12-03T11:37:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: secure 2023-12-03T11:37:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2023-12-03T11:37:52.256+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2023-12-03T11:37:52.256+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command rotate-key cmddesc rotate-key hook 0x55c3ada07270 EEXIST 2023-12-03T11:37:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2023-12-03T11:37:52.256+0000 7f2ed072b800 10 monclient: _reopen_session rank -1 2023-12-03T11:37:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2023-12-03T11:37:52.256+0000 7f2ed072b800 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:37:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2023-12-03T11:37:52.256+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-b con 0x55c3ada05d40 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:37:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2023-12-03T11:37:52.256+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-a con 0x55c3ada06790 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:37:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2023-12-03T11:37:52.257+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-c con 0x55c3ad9da1d0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:37:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2023-12-03T11:37:52.257+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2023-12-03T11:37:52.257+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.330 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2023-12-03T11:37:52.257+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.330 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2023-12-03T11:37:52.257+0000 7f2ed072b800 10 monclient(hunting): _renew_subs 2023-12-03T11:37:52.330 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2023-12-03T11:37:52.257+0000 7f2ed072b800 10 monclient(hunting): authenticate will time out at 1551.482677s 2023-12-03T11:37:52.330 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2023-12-03T11:37:52.257+0000 7f2ecc432640 10 monclient(hunting): get_auth_request con 0x55c3ada06790 auth_method 0 2023-12-03T11:37:52.330 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2023-12-03T11:37:52.257+0000 7f2ecc432640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.330 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2023-12-03T11:37:52.257+0000 7f2ecc432640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.330 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2023-12-03T11:37:52.257+0000 7f2ecc432640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:37:52.330 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2023-12-03T11:37:52.257+0000 7f2ecbc31640 10 monclient(hunting): get_auth_request con 0x55c3ad9da1d0 auth_method 0 2023-12-03T11:37:52.330 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2023-12-03T11:37:52.257+0000 7f2ecbc31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.330 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2023-12-03T11:37:52.257+0000 7f2ecbc31640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.330 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2023-12-03T11:37:52.257+0000 7f2ecbc31640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:37:52.330 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2023-12-03T11:37:52.257+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:37:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2023-12-03T11:37:52.257+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:37:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2023-12-03T11:37:52.257+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:37:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2023-12-03T11:37:52.257+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:37:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2023-12-03T11:37:52.257+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:37:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2023-12-03T11:37:52.257+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:37:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2023-12-03T11:37:52.257+0000 7f2eccc33640 10 monclient(hunting): get_auth_request con 0x55c3ada05d40 auth_method 0 2023-12-03T11:37:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2023-12-03T11:37:52.257+0000 7f2eccc33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2023-12-03T11:37:52.257+0000 7f2eccc33640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2023-12-03T11:37:52.257+0000 7f2eccc33640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:37:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2023-12-03T11:37:52.257+0000 7f2ecc432640 10 monclient(hunting): handle_auth_done global_id 6516 payload 824 2023-12-03T11:37:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2023-12-03T11:37:52.257+0000 7f2ecc432640 10 monclient: _finish_hunting 0 2023-12-03T11:37:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2023-12-03T11:37:52.257+0000 7f2ecc432640 1 monclient: found mon.noname-a 2023-12-03T11:37:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2023-12-03T11:37:52.257+0000 7f2ecc432640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2023-12-03T11:37:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2023-12-03T11:37:52.257+0000 7f2e03fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:37:52.332 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2023-12-03T11:37:52.257+0000 7f2e03fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:37:52.332 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2023-12-03T11:37:52.257+0000 7f2e03fff640 10 monclient: dump: 2023-12-03T11:37:52.332 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:37:52.332 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:37:52.332 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.332 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.332 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:37:52.332 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:37:52.332 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:37:52.332 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:37:52.332 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:37:52.332 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.332 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2023-12-03T11:37:52.257+0000 7f2e03fff640 10 monclient: _finish_auth 0 2023-12-03T11:37:52.333 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2023-12-03T11:37:52.257+0000 7f2e03fff640 10 monclient: _check_auth_tickets 2023-12-03T11:37:52.333 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2023-12-03T11:37:52.257+0000 7f2e03fff640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:37:52.333 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2023-12-03T11:37:52.257+0000 7f2e03fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:37:52.333 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2023-12-03T11:37:52.257+0000 7f2e03fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:37:52.333 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2023-12-03T11:37:52.257+0000 7f2e03fff640 10 monclient: dump: 2023-12-03T11:37:52.333 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:37:52.333 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:37:52.333 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.333 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.333 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:37:52.333 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:37:52.333 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:37:52.333 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:37:52.334 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:37:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2023-12-03T11:37:52.257+0000 7f2ed072b800 5 monclient: authenticate success, global_id 6516 2023-12-03T11:37:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2023-12-03T11:37:52.257+0000 7f2ed072b800 10 monclient: _renew_subs 2023-12-03T11:37:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2023-12-03T11:37:52.257+0000 7f2e91fe3640 4 set_mon_vals no callback set 2023-12-03T11:37:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2023-12-03T11:37:52.257+0000 7f2ed072b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2023-12-03T11:37:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2023-12-03T11:37:52.257+0000 7f2ed072b800 10 monclient: _renew_subs 2023-12-03T11:37:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2023-12-03T11:37:52.257+0000 7f2ed072b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2023-12-03T11:37:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2023-12-03T11:37:52.257+0000 7f2ed072b800 1 librados: init done 2023-12-03T11:37:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2023-12-03T11:37:52.257+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command cr dump hook 0x55c3ad9db1e8 2023-12-03T11:37:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2023-12-03T11:37:52.259+0000 7f2e03fff640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:37:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2023-12-03T11:37:52.259+0000 7f2e03fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:37:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2023-12-03T11:37:52.259+0000 7f2e03fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:37:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2023-12-03T11:37:52.259+0000 7f2eccc33640 10 monclient: get_auth_request con 0x7f2e08069820 auth_method 0 2023-12-03T11:37:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2023-12-03T11:37:52.259+0000 7f2ed072b800 5 note: GC not initialized 2023-12-03T11:37:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2023-12-03T11:37:52.259+0000 7f2e017fa640 20 reqs_thread_entry: start 2023-12-03T11:37:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2023-12-03T11:37:52.259+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command sync trace show hook 0x7f2ec0004460 2023-12-03T11:37:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2023-12-03T11:37:52.259+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command sync trace history hook 0x7f2ec0004460 2023-12-03T11:37:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2023-12-03T11:37:52.259+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command sync trace active hook 0x7f2ec0004460 2023-12-03T11:37:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2023-12-03T11:37:52.259+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command sync trace active_short hook 0x7f2ec0004460 2023-12-03T11:37:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2023-12-03T11:37:52.259+0000 7f2ed072b800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2023-12-03T11:37:52.259+0000 7f2ed072b800 20 Filter name: none 2023-12-03T11:37:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2023-12-03T11:37:52.259+0000 7f2dfaffd640 20 reqs_thread_entry: start 2023-12-03T11:37:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2023-12-03T11:37:52.259+0000 7f2ed072b800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2023-12-03T11:37:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2023-12-03T11:37:52.259+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2023-12-03T11:37:52.260+0000 7f2ed072b800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:37:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2023-12-03T11:37:52.260+0000 7f2ed072b800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2023-12-03T11:37:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2023-12-03T11:37:52.260+0000 7f2ed072b800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2023-12-03T11:37:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2023-12-03T11:37:52.260+0000 7f2ed072b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 : miss 2023-12-03T11:37:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2023-12-03T11:37:52.260+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2023-12-03T11:37:52.260+0000 7f2ed072b800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:37:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2023-12-03T11:37:52.260+0000 7f2ed072b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 info.flags=0x17 2023-12-03T11:37:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2023-12-03T11:37:52.260+0000 7f2ed072b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 to cache LRU end 2023-12-03T11:37:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2023-12-03T11:37:52.260+0000 7f2ed072b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:37:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2023-12-03T11:37:52.260+0000 7f2ed072b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:37:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2023-12-03T11:37:52.261+0000 7f2ed072b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 2023-12-03T11:37:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2023-12-03T11:37:52.261+0000 7f2ecbc31640 10 monclient: get_auth_request con 0x55c3ada544b0 auth_method 0 2023-12-03T11:37:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2023-12-03T11:37:52.264+0000 7f2ed072b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2ed072b800 time 2023-12-03T11:37:52.264732+0000 2023-12-03T11:37:52.337 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:37:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:37:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2ed336eef8] 2023-12-03T11:37:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f2ed336f0b6] 2023-12-03T11:37:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c3acd39a71] 2023-12-03T11:37:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0x79787a) [0x55c3acd4187a] 2023-12-03T11:37:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55c3acd45e6b] 2023-12-03T11:37:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2023-12-03T11:37:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f2ed0c3feb0] 2023-12-03T11:37:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2023-12-03T11:37:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2023-12-03T11:37:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.338 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2023-12-03T11:37:52.265+0000 7f2ed072b800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:37:52.338 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f2ed072b800 thread_name:radosgw-admin 2023-12-03T11:37:52.338 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.338 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:37:52.338 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f2ed0c54db0] 2023-12-03T11:37:52.338 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f2ed0ca154c] 2023-12-03T11:37:52.338 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2023-12-03T11:37:52.338 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2023-12-03T11:37:52.338 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2ed336ef52] 2023-12-03T11:37:52.338 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f2ed336f0b6] 2023-12-03T11:37:52.338 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c3acd39a71] 2023-12-03T11:37:52.338 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0x79787a) [0x55c3acd4187a] 2023-12-03T11:37:52.339 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55c3acd45e6b] 2023-12-03T11:37:52.339 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2023-12-03T11:37:52.339 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f2ed0c3feb0] 2023-12-03T11:37:52.339 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2023-12-03T11:37:52.339 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2023-12-03T11:37:52.339 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:37:52.339 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.339 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2023-12-03T11:37:52.339 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2023-12-03T11:37:52.339 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2023-12-03T11:37:52.339 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2023-12-03T11:37:52.339 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2023-12-03T11:37:52.339 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2023-12-03T11:37:52.339 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2023-12-03T11:37:52.340 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2023-12-03T11:37:52.340 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2023-12-03T11:37:52.340 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2023-12-03T11:37:52.340 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2023-12-03T11:37:52.340 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2023-12-03T11:37:52.340 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2023-12-03T11:37:52.340 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2023-12-03T11:37:52.340 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2023-12-03T11:37:52.340 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2023-12-03T11:37:52.340 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2023-12-03T11:37:52.340 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2023-12-03T11:37:52.340 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2023-12-03T11:37:52.340 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2023-12-03T11:37:52.341 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2023-12-03T11:37:52.341 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2023-12-03T11:37:52.341 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2023-12-03T11:37:52.341 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:37:52.341 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2023-12-03T11:37:52.341 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2023-12-03T11:37:52.341 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2023-12-03T11:37:52.341 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2023-12-03T11:37:52.341 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2023-12-03T11:37:52.341 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2023-12-03T11:37:52.341 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2023-12-03T11:37:52.341 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2023-12-03T11:37:52.341 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2023-12-03T11:37:52.341 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2023-12-03T11:37:52.342 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2023-12-03T11:37:52.342 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2023-12-03T11:37:52.342 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2023-12-03T11:37:52.342 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2023-12-03T11:37:52.342 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2023-12-03T11:37:52.342 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2023-12-03T11:37:52.342 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2023-12-03T11:37:52.342 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2023-12-03T11:37:52.342 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2023-12-03T11:37:52.342 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2023-12-03T11:37:52.342 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2023-12-03T11:37:52.342 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:37:52.342 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2023-12-03T11:37:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2023-12-03T11:37:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2023-12-03T11:37:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2023-12-03T11:37:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2023-12-03T11:37:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2023-12-03T11:37:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2023-12-03T11:37:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2023-12-03T11:37:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2023-12-03T11:37:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2023-12-03T11:37:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2023-12-03T11:37:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2023-12-03T11:37:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2023-12-03T11:37:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2023-12-03T11:37:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2023-12-03T11:37:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2023-12-03T11:37:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2023-12-03T11:37:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2023-12-03T11:37:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:37:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2023-12-03T11:37:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:37:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2023-12-03T11:37:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2023-12-03T11:37:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2023-12-03T11:37:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2023-12-03T11:37:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2023-12-03T11:37:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2023-12-03T11:37:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:37:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2023-12-03T11:37:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2023-12-03T11:37:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:37:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2023-12-03T11:37:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2023-12-03T11:37:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2023-12-03T11:37:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2023-12-03T11:37:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2023-12-03T11:37:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2023-12-03T11:37:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2023-12-03T11:37:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2023-12-03T11:37:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2023-12-03T11:37:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2023-12-03T11:37:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2023-12-03T11:37:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2023-12-03T11:37:52.345 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:37:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2dfaffd640 / http_manager 2023-12-03T11:37:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2e017fa640 / http_manager 2023-12-03T11:37:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2e03fff640 / ms_dispatch 2023-12-03T11:37:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2e91fe3640 / io_context_pool 2023-12-03T11:37:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2e927e4640 / rgw_dt_lg_renew 2023-12-03T11:37:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2eb17fa640 / ms_dispatch 2023-12-03T11:37:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2eb2ffd640 / io_context_pool 2023-12-03T11:37:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2ec9c2d640 / ms_dispatch 2023-12-03T11:37:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2ecbc31640 / msgr-worker-2 2023-12-03T11:37:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2ecc432640 / msgr-worker-1 2023-12-03T11:37:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2eccc33640 / msgr-worker-0 2023-12-03T11:37:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2ed072b800 / radosgw-admin 2023-12-03T11:37:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2023-12-03T11:37:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2023-12-03T11:37:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/log/ceph/ceph-client.admin.101764.log 2023-12-03T11:37:52.347 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2023-12-03T11:37:52.347 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2023-12-03T11:37:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e690) adding con mode: crc 2023-12-03T11:37:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e690) adding con mode: secure 2023-12-03T11:37:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e690) adding con mode: crc 2023-12-03T11:37:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e690) adding con mode: secure 2023-12-03T11:37:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e690) adding con mode: crc 2023-12-03T11:37:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e690) adding con mode: crc 2023-12-03T11:37:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e690) adding con mode: secure 2023-12-03T11:37:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e690) adding con mode: crc 2023-12-03T11:37:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e690) adding con mode: secure 2023-12-03T11:37:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e690) adding con mode: crc 2023-12-03T11:37:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e690) adding con mode: secure 2023-12-03T11:37:52.348 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2023-12-03T11:37:52.018+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.348 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2023-12-03T11:37:52.018+0000 7f2ed072b800 10 monclient: init 2023-12-03T11:37:52.348 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding auth protocol: cephx 2023-12-03T11:37:52.348 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding auth protocol: cephx 2023-12-03T11:37:52.348 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding auth protocol: cephx 2023-12-03T11:37:52.348 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: secure 2023-12-03T11:37:52.348 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: crc 2023-12-03T11:37:52.348 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: secure 2023-12-03T11:37:52.348 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: crc 2023-12-03T11:37:52.348 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: secure 2023-12-03T11:37:52.348 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: crc 2023-12-03T11:37:52.348 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: crc 2023-12-03T11:37:52.348 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: secure 2023-12-03T11:37:52.348 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: crc 2023-12-03T11:37:52.349 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: secure 2023-12-03T11:37:52.349 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: crc 2023-12-03T11:37:52.349 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2023-12-03T11:37:52.018+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a85f40) adding con mode: secure 2023-12-03T11:37:52.349 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2023-12-03T11:37:52.018+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.349 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2023-12-03T11:37:52.018+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.349 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2023-12-03T11:37:52.019+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command rotate-key cmddesc rotate-key hook 0x7ffe48a86088 EEXIST 2023-12-03T11:37:52.349 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2023-12-03T11:37:52.019+0000 7f2ed072b800 10 monclient: _reopen_session rank -1 2023-12-03T11:37:52.349 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2023-12-03T11:37:52.019+0000 7f2ed072b800 10 monclient: _add_conns ranks=[0,1,2] 2023-12-03T11:37:52.349 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2023-12-03T11:37:52.019+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-a con 0x55c3ad99e920 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:37:52.349 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2023-12-03T11:37:52.019+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-b con 0x55c3ad99ed00 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:37:52.349 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2023-12-03T11:37:52.019+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-c con 0x55c3ad972e00 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:37:52.349 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2023-12-03T11:37:52.019+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.349 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2023-12-03T11:37:52.019+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.350 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2023-12-03T11:37:52.019+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.350 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2023-12-03T11:37:52.019+0000 7f2ed072b800 10 monclient(hunting): _renew_subs 2023-12-03T11:37:52.350 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2023-12-03T11:37:52.019+0000 7f2ed072b800 10 monclient(hunting): authenticate will time out at 1551.244797s 2023-12-03T11:37:52.350 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2023-12-03T11:37:52.019+0000 7f2eccc33640 10 monclient(hunting): get_auth_request con 0x55c3ad99e920 auth_method 0 2023-12-03T11:37:52.350 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2023-12-03T11:37:52.019+0000 7f2eccc33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.350 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2023-12-03T11:37:52.019+0000 7f2eccc33640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.350 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2023-12-03T11:37:52.019+0000 7f2eccc33640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:37:52.350 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2023-12-03T11:37:52.019+0000 7f2ecbc31640 10 monclient(hunting): get_auth_request con 0x55c3ad972e00 auth_method 0 2023-12-03T11:37:52.350 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2023-12-03T11:37:52.019+0000 7f2ecbc31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.350 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2023-12-03T11:37:52.019+0000 7f2ecbc31640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.350 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2023-12-03T11:37:52.019+0000 7f2ecbc31640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:37:52.350 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2023-12-03T11:37:52.019+0000 7f2eccc33640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:37:52.350 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2023-12-03T11:37:52.019+0000 7f2eccc33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:37:52.351 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2023-12-03T11:37:52.019+0000 7f2eccc33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:37:52.351 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2023-12-03T11:37:52.019+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:37:52.351 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2023-12-03T11:37:52.019+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:37:52.351 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2023-12-03T11:37:52.019+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:37:52.351 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2023-12-03T11:37:52.019+0000 7f2ecc432640 10 monclient(hunting): get_auth_request con 0x55c3ad99ed00 auth_method 0 2023-12-03T11:37:52.351 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2023-12-03T11:37:52.019+0000 7f2ecc432640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.351 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2023-12-03T11:37:52.019+0000 7f2ecc432640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.351 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2023-12-03T11:37:52.019+0000 7f2ecc432640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:37:52.351 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2023-12-03T11:37:52.019+0000 7f2ec9c2d640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:37:52.351 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2023-12-03T11:37:52.019+0000 7f2ec9c2d640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:37:52.351 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2023-12-03T11:37:52.019+0000 7f2ec9c2d640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:37:52.351 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2023-12-03T11:37:52.019+0000 7f2eccc33640 10 monclient(hunting): handle_auth_done global_id 6507 payload 274 2023-12-03T11:37:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2023-12-03T11:37:52.019+0000 7f2eccc33640 10 monclient: _finish_hunting 0 2023-12-03T11:37:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2023-12-03T11:37:52.019+0000 7f2eccc33640 1 monclient: found mon.noname-a 2023-12-03T11:37:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2023-12-03T11:37:52.019+0000 7f2eccc33640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2023-12-03T11:37:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2023-12-03T11:37:52.019+0000 7f2eccc33640 10 monclient: get_auth_request con 0x7f2eb8069850 auth_method 0 2023-12-03T11:37:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2023-12-03T11:37:52.220+0000 7f2eccc33640 10 monclient: get_auth_request con 0x55c3ad99e920 auth_method 0 2023-12-03T11:37:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2023-12-03T11:37:52.220+0000 7f2eccc33640 0 --2- 172.21.15.44:0/2405233110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c3ad99e920 0x55c3ad9a7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-12-03T11:37:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2023-12-03T11:37:52.220+0000 7f2eb2ffd640 10 monclient: ms_handle_reset current mon [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:37:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2023-12-03T11:37:52.220+0000 7f2eb2ffd640 10 monclient: _reopen_session rank -1 2023-12-03T11:37:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2023-12-03T11:37:52.220+0000 7f2eb2ffd640 10 monclient: _add_conns ranks=[0,2,1] 2023-12-03T11:37:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2023-12-03T11:37:52.220+0000 7f2eb2ffd640 10 monclient(hunting): picked mon.noname-a con 0x7f2ea8001dc0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:37:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2023-12-03T11:37:52.220+0000 7f2eb2ffd640 10 monclient(hunting): picked mon.noname-c con 0x55c3ad972e00 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:37:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2023-12-03T11:37:52.220+0000 7f2eb2ffd640 10 monclient(hunting): picked mon.noname-b con 0x7f2ea8007310 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:37:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2023-12-03T11:37:52.220+0000 7f2eb2ffd640 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.353 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2023-12-03T11:37:52.220+0000 7f2eb2ffd640 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.353 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2023-12-03T11:37:52.220+0000 7f2eb2ffd640 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.353 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2023-12-03T11:37:52.220+0000 7f2eb2ffd640 10 monclient(hunting): _renew_subs 2023-12-03T11:37:52.353 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2023-12-03T11:37:52.220+0000 7f2eb2ffd640 10 monclient(hunting): ms_handle_reset hunted mon [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:37:52.353 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2023-12-03T11:37:52.220+0000 7f2ecc432640 10 monclient(hunting): get_auth_request con 0x7f2ea8001dc0 auth_method 0 2023-12-03T11:37:52.353 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2023-12-03T11:37:52.220+0000 7f2ecc432640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.353 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2023-12-03T11:37:52.220+0000 7f2ecc432640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.353 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2023-12-03T11:37:52.220+0000 7f2ecc432640 10 monclient(hunting): _init_auth already have auth, reseting 2023-12-03T11:37:52.353 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2023-12-03T11:37:52.220+0000 7f2ecbc31640 10 monclient(hunting): get_auth_request con 0x55c3ad972e00 auth_method 0 2023-12-03T11:37:52.353 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2023-12-03T11:37:52.220+0000 7f2ecbc31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.353 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2023-12-03T11:37:52.220+0000 7f2ecbc31640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.353 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2023-12-03T11:37:52.220+0000 7f2ecbc31640 10 monclient(hunting): _init_auth already have auth, reseting 2023-12-03T11:37:52.353 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2023-12-03T11:37:52.220+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:37:52.353 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2023-12-03T11:37:52.220+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:37:52.354 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2023-12-03T11:37:52.220+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2023-12-03T11:37:52.354 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2023-12-03T11:37:52.220+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:37:52.354 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2023-12-03T11:37:52.220+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:37:52.354 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2023-12-03T11:37:52.220+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2023-12-03T11:37:52.354 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2023-12-03T11:37:52.220+0000 7f2eccc33640 10 monclient(hunting): get_auth_request con 0x7f2ea8007310 auth_method 0 2023-12-03T11:37:52.354 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2023-12-03T11:37:52.220+0000 7f2eccc33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.354 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2023-12-03T11:37:52.220+0000 7f2eccc33640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.354 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2023-12-03T11:37:52.220+0000 7f2eccc33640 10 monclient(hunting): _init_auth already have auth, reseting 2023-12-03T11:37:52.354 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2023-12-03T11:37:52.220+0000 7f2ecc432640 10 monclient(hunting): handle_auth_done global_id 6507 payload 293 2023-12-03T11:37:52.354 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2023-12-03T11:37:52.220+0000 7f2ecc432640 10 monclient: _finish_hunting 0 2023-12-03T11:37:52.354 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2023-12-03T11:37:52.220+0000 7f2ecc432640 1 monclient: found mon.noname-a 2023-12-03T11:37:52.354 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2023-12-03T11:37:52.220+0000 7f2ecc432640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2023-12-03T11:37:52.355 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2023-12-03T11:37:52.221+0000 7f2eb2ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:37:52.355 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2023-12-03T11:37:52.221+0000 7f2eb2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:37:52.355 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2023-12-03T11:37:52.221+0000 7f2eb2ffd640 10 monclient: dump: 2023-12-03T11:37:52.355 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:37:52.355 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:37:52.355 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.355 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.355 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:37:52.355 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:37:52.355 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:37:52.355 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:37:52.355 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:37:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2023-12-03T11:37:52.221+0000 7f2eb2ffd640 10 monclient: _finish_auth 0 2023-12-03T11:37:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2023-12-03T11:37:52.221+0000 7f2eb2ffd640 10 monclient: _check_auth_tickets 2023-12-03T11:37:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2023-12-03T11:37:52.221+0000 7f2eb2ffd640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:37:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2023-12-03T11:37:52.221+0000 7f2ed072b800 5 monclient: authenticate success, global_id 6507 2023-12-03T11:37:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2023-12-03T11:37:52.221+0000 7f2ed072b800 10 monclient: get_monmap_and_config success 2023-12-03T11:37:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2023-12-03T11:37:52.221+0000 7f2ed072b800 4 set_mon_vals no callback set 2023-12-03T11:37:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2023-12-03T11:37:52.221+0000 7f2eb2ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:37:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2023-12-03T11:37:52.221+0000 7f2eb2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:37:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2023-12-03T11:37:52.221+0000 7f2eb2ffd640 10 monclient: dump: 2023-12-03T11:37:52.356 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:37:52.356 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:37:52.356 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.357 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.357 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:37:52.357 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:37:52.357 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:37:52.357 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:37:52.357 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:37:52.357 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.357 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2023-12-03T11:37:52.221+0000 7f2ed072b800 10 monclient: shutdown 2023-12-03T11:37:52.357 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2023-12-03T11:37:52.222+0000 7f2ed072b800 10 monclient: build_initial_monmap 2023-12-03T11:37:52.357 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2023-12-03T11:37:52.222+0000 7f2ed072b800 1 build_initial for_mkfs: 0 2023-12-03T11:37:52.357 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2023-12-03T11:37:52.222+0000 7f2ed072b800 10 monclient: monmap: 2023-12-03T11:37:52.358 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:37:52.358 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:37:52.358 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:37:52.358 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:37:52.358 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:37:52.358 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:37:52.358 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:37:52.358 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:37:52.358 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:37:52.358 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.358 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding auth protocol: cephx 2023-12-03T11:37:52.358 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding auth protocol: cephx 2023-12-03T11:37:52.358 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding auth protocol: cephx 2023-12-03T11:37:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: secure 2023-12-03T11:37:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: crc 2023-12-03T11:37:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: secure 2023-12-03T11:37:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: crc 2023-12-03T11:37:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: secure 2023-12-03T11:37:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: crc 2023-12-03T11:37:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: crc 2023-12-03T11:37:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: secure 2023-12-03T11:37:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: crc 2023-12-03T11:37:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: secure 2023-12-03T11:37:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: crc 2023-12-03T11:37:52.360 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96e560) adding con mode: secure 2023-12-03T11:37:52.360 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2023-12-03T11:37:52.222+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.360 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2023-12-03T11:37:52.222+0000 7f2ed072b800 1 librados: starting msgr at 2023-12-03T11:37:52.360 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2023-12-03T11:37:52.222+0000 7f2ed072b800 1 librados: starting objecter 2023-12-03T11:37:52.360 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command objecter_requests cmddesc objecter_requests hook 0x55c3ad99d440 EEXIST 2023-12-03T11:37:52.360 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2023-12-03T11:37:52.222+0000 7f2ed072b800 1 librados: setting wanted keys 2023-12-03T11:37:52.360 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2023-12-03T11:37:52.222+0000 7f2ed072b800 1 librados: calling monclient init 2023-12-03T11:37:52.360 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2023-12-03T11:37:52.222+0000 7f2ed072b800 10 monclient: init 2023-12-03T11:37:52.360 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding auth protocol: cephx 2023-12-03T11:37:52.360 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding auth protocol: cephx 2023-12-03T11:37:52.360 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding auth protocol: cephx 2023-12-03T11:37:52.360 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: secure 2023-12-03T11:37:52.361 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: crc 2023-12-03T11:37:52.361 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: secure 2023-12-03T11:37:52.361 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: crc 2023-12-03T11:37:52.361 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: secure 2023-12-03T11:37:52.361 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: crc 2023-12-03T11:37:52.361 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: crc 2023-12-03T11:37:52.361 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: secure 2023-12-03T11:37:52.361 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: crc 2023-12-03T11:37:52.361 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: secure 2023-12-03T11:37:52.361 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: crc 2023-12-03T11:37:52.361 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 AuthRegistry(0x55c3ad96c718) adding con mode: secure 2023-12-03T11:37:52.361 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2023-12-03T11:37:52.222+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.361 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2023-12-03T11:37:52.222+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.362 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2023-12-03T11:37:52.222+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command rotate-key cmddesc rotate-key hook 0x55c3ad96c860 EEXIST 2023-12-03T11:37:52.362 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2023-12-03T11:37:52.222+0000 7f2ed072b800 10 monclient: _reopen_session rank -1 2023-12-03T11:37:52.362 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2023-12-03T11:37:52.222+0000 7f2ed072b800 10 monclient: _add_conns ranks=[2,1,0] 2023-12-03T11:37:52.362 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-c con 0x55c3ad972e00 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:37:52.362 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-b con 0x7f2ea8001dc0 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:37:52.362 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-a con 0x7f2ea8007310 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:37:52.362 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.362 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.362 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.362 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient(hunting): _renew_subs 2023-12-03T11:37:52.362 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient(hunting): authenticate will time out at 1551.448699s 2023-12-03T11:37:52.362 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2023-12-03T11:37:52.223+0000 7f2ecc432640 10 monclient(hunting): get_auth_request con 0x55c3ad972e00 auth_method 0 2023-12-03T11:37:52.362 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2023-12-03T11:37:52.223+0000 7f2ecc432640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.363 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2023-12-03T11:37:52.223+0000 7f2ecc432640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.363 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2023-12-03T11:37:52.223+0000 7f2ecc432640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:37:52.363 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2023-12-03T11:37:52.223+0000 7f2eccc33640 10 monclient(hunting): get_auth_request con 0x7f2ea8007310 auth_method 0 2023-12-03T11:37:52.363 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2023-12-03T11:37:52.223+0000 7f2eccc33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.363 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2023-12-03T11:37:52.223+0000 7f2eccc33640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.363 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2023-12-03T11:37:52.223+0000 7f2eccc33640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:37:52.363 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2023-12-03T11:37:52.223+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:37:52.363 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2023-12-03T11:37:52.223+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:37:52.363 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2023-12-03T11:37:52.223+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:37:52.363 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2023-12-03T11:37:52.223+0000 7f2eccc33640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:37:52.363 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2023-12-03T11:37:52.223+0000 7f2eccc33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:37:52.363 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2023-12-03T11:37:52.223+0000 7f2eccc33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:37:52.363 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2023-12-03T11:37:52.223+0000 7f2ecc432640 10 monclient(hunting): handle_auth_done global_id 6188 payload 824 2023-12-03T11:37:52.364 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2023-12-03T11:37:52.223+0000 7f2ecc432640 10 monclient: _finish_hunting 0 2023-12-03T11:37:52.364 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2023-12-03T11:37:52.223+0000 7f2ecc432640 1 monclient: found mon.noname-c 2023-12-03T11:37:52.364 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2023-12-03T11:37:52.223+0000 7f2ecc432640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2023-12-03T11:37:52.364 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2023-12-03T11:37:52.223+0000 7f2ecbc31640 10 monclient: get_auth_request con 0x7f2ea8001dc0 auth_method 0 2023-12-03T11:37:52.364 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2023-12-03T11:37:52.223+0000 7f2eb17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:37:52.364 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2023-12-03T11:37:52.223+0000 7f2eb17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:37:52.364 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2023-12-03T11:37:52.223+0000 7f2eb17fa640 10 monclient: dump: 2023-12-03T11:37:52.364 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:37:52.364 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:37:52.364 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.364 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.364 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:37:52.364 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:37:52.365 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:37:52.365 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:37:52.365 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:37:52.365 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.365 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2023-12-03T11:37:52.223+0000 7f2eb17fa640 10 monclient: _finish_auth 0 2023-12-03T11:37:52.365 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2023-12-03T11:37:52.223+0000 7f2eb17fa640 10 monclient: _check_auth_tickets 2023-12-03T11:37:52.365 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2023-12-03T11:37:52.223+0000 7f2eb17fa640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:37:52.365 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2023-12-03T11:37:52.223+0000 7f2eb17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:37:52.365 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2023-12-03T11:37:52.223+0000 7f2eb17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:37:52.365 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2023-12-03T11:37:52.223+0000 7f2eb17fa640 10 monclient: dump: 2023-12-03T11:37:52.365 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:37:52.365 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:37:52.365 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.366 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.366 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:37:52.366 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:37:52.366 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:37:52.366 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:37:52.366 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:37:52.366 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.366 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2023-12-03T11:37:52.223+0000 7f2ed072b800 5 monclient: authenticate success, global_id 6188 2023-12-03T11:37:52.366 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient: _renew_subs 2023-12-03T11:37:52.366 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2023-12-03T11:37:52.223+0000 7f2eb2ffd640 4 set_mon_vals no callback set 2023-12-03T11:37:52.366 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:37:52.366 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient: _renew_subs 2023-12-03T11:37:52.366 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2023-12-03T11:37:52.223+0000 7f2ed072b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:37:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2023-12-03T11:37:52.223+0000 7f2ed072b800 1 librados: init done 2023-12-03T11:37:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2023-12-03T11:37:52.224+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2023-12-03T11:37:52.225+0000 7f2eb17fa640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:37:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2023-12-03T11:37:52.225+0000 7f2eb17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:37:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2023-12-03T11:37:52.225+0000 7f2eb17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:37:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2023-12-03T11:37:52.225+0000 7f2ecbc31640 10 monclient: get_auth_request con 0x7f2ea806a650 auth_method 0 2023-12-03T11:37:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2023-12-03T11:37:52.226+0000 7f2eccc33640 10 monclient: get_auth_request con 0x55c3ad9b9ef0 auth_method 0 2023-12-03T11:37:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2023-12-03T11:37:52.226+0000 7f2ed072b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2023-12-03T11:37:52.226+0000 7f2ed072b800 20 realm 2023-12-03T11:37:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2023-12-03T11:37:52.226+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2023-12-03T11:37:52.226+0000 7f2ed072b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2023-12-03T11:37:52.226+0000 7f2ed072b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2023-12-03T11:37:52.226+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2023-12-03T11:37:52.227+0000 7f2ed072b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2023-12-03T11:37:52.227+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2023-12-03T11:37:52.227+0000 7f2ecc432640 10 monclient: get_auth_request con 0x55c3ad9bdf30 auth_method 0 2023-12-03T11:37:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2023-12-03T11:37:52.228+0000 7f2ed072b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2023-12-03T11:37:52.228+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2023-12-03T11:37:52.228+0000 7f2ecbc31640 10 monclient: get_auth_request con 0x55c3ad9c1760 auth_method 0 2023-12-03T11:37:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2023-12-03T11:37:52.228+0000 7f2ed072b800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2023-12-03T11:37:52.228+0000 7f2ed072b800 20 searching for the correct realm 2023-12-03T11:37:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2023-12-03T11:37:52.228+0000 7f2eccc33640 10 monclient: get_auth_request con 0x55c3ad9c6070 auth_method 0 2023-12-03T11:37:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2023-12-03T11:37:52.229+0000 7f2ecc432640 10 monclient: get_auth_request con 0x7f2ec40293f0 auth_method 0 2023-12-03T11:37:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2023-12-03T11:37:52.230+0000 7f2ecbc31640 10 monclient: get_auth_request con 0x7f2ec0072410 auth_method 0 2023-12-03T11:37:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2023-12-03T11:37:52.232+0000 7f2eccc33640 10 monclient: get_auth_request con 0x7f2ec0070920 auth_method 0 2023-12-03T11:37:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2023-12-03T11:37:52.234+0000 7f2ecc432640 10 monclient: get_auth_request con 0x7f2ec0083460 auth_method 0 2023-12-03T11:37:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2023-12-03T11:37:52.236+0000 7f2ecc432640 0 -- 172.21.15.44:0/1603041878 >> [v2:172.21.15.44:6800/4244511941,v1:172.21.15.44:6801/4244511941] conn(0x7f2ec0083460 msgr2=0x7f2ec00838e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2023-12-03T11:37:52.236+0000 7f2eb17fa640 1 client.6188.objecter ms_handle_reset 0x7f2ec0083460 session 0x7f2ec0070d80 osd.0 2023-12-03T11:37:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2023-12-03T11:37:52.236+0000 7f2eb17fa640 10 monclient: _renew_subs 2023-12-03T11:37:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2023-12-03T11:37:52.236+0000 7f2eb17fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:37:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2023-12-03T11:37:52.236+0000 7f2ecc432640 10 monclient: get_auth_request con 0x7f2ea807abf0 auth_method 0 2023-12-03T11:37:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2023-12-03T11:37:52.239+0000 7f2ed072b800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2023-12-03T11:37:52.239+0000 7f2ed072b800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2023-12-03T11:37:52.239+0000 7f2ed072b800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2023-12-03T11:37:52.239+0000 7f2ed072b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2023-12-03T11:37:52.239+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2023-12-03T11:37:52.239+0000 7f2ed072b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2023-12-03T11:37:52.239+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2023-12-03T11:37:52.240+0000 7f2ed072b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2023-12-03T11:37:52.240+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.370 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2023-12-03T11:37:52.240+0000 7f2ed072b800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:52.370 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2023-12-03T11:37:52.240+0000 7f2ed072b800 20 zone default found 2023-12-03T11:37:52.370 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2023-12-03T11:37:52.240+0000 7f2ed072b800 4 Realm: () 2023-12-03T11:37:52.370 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2023-12-03T11:37:52.240+0000 7f2ed072b800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:52.370 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2023-12-03T11:37:52.240+0000 7f2ed072b800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:52.370 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2023-12-03T11:37:52.240+0000 7f2ed072b800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:52.370 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2023-12-03T11:37:52.240+0000 7f2ed072b800 20 zonegroup default 2023-12-03T11:37:52.370 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2023-12-03T11:37:52.240+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.370 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2023-12-03T11:37:52.240+0000 7f2ed072b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.370 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2023-12-03T11:37:52.240+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.370 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2023-12-03T11:37:52.241+0000 7f2ed072b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.371 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2023-12-03T11:37:52.241+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.371 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2023-12-03T11:37:52.241+0000 7f2ed072b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.371 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2023-12-03T11:37:52.241+0000 7f2ed072b800 20 started sync module instance, tier type = 2023-12-03T11:37:52.371 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2023-12-03T11:37:52.241+0000 7f2ed072b800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:52.371 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2023-12-03T11:37:52.242+0000 7f2eccc33640 0 -- 172.21.15.44:0/1603041878 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f2ec0070920 msgr2=0x7f2ec00803e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:52.371 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2023-12-03T11:37:52.242+0000 7f2eb17fa640 1 client.6188.objecter ms_handle_reset 0x7f2ec0070920 session 0x7f2ec0054ba0 osd.6 2023-12-03T11:37:52.371 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2023-12-03T11:37:52.242+0000 7f2eccc33640 10 monclient: get_auth_request con 0x7f2ec0083460 auth_method 0 2023-12-03T11:37:52.371 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2023-12-03T11:37:52.250+0000 7f2ed072b800 20 add_watcher() i=0 2023-12-03T11:37:52.371 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2023-12-03T11:37:52.250+0000 7f2ed072b800 20 add_watcher() i=1 2023-12-03T11:37:52.371 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2023-12-03T11:37:52.250+0000 7f2ed072b800 20 add_watcher() i=2 2023-12-03T11:37:52.371 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2023-12-03T11:37:52.250+0000 7f2ed072b800 20 add_watcher() i=3 2023-12-03T11:37:52.371 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2023-12-03T11:37:52.250+0000 7f2ed072b800 20 add_watcher() i=4 2023-12-03T11:37:52.371 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2023-12-03T11:37:52.250+0000 7f2ed072b800 20 add_watcher() i=5 2023-12-03T11:37:52.372 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2023-12-03T11:37:52.250+0000 7f2ed072b800 20 add_watcher() i=6 2023-12-03T11:37:52.372 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2023-12-03T11:37:52.251+0000 7f2ed072b800 20 add_watcher() i=7 2023-12-03T11:37:52.372 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2023-12-03T11:37:52.251+0000 7f2ed072b800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:52.372 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding auth protocol: cephx 2023-12-03T11:37:52.372 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding auth protocol: cephx 2023-12-03T11:37:52.372 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding auth protocol: cephx 2023-12-03T11:37:52.372 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: secure 2023-12-03T11:37:52.372 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: crc 2023-12-03T11:37:52.372 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: secure 2023-12-03T11:37:52.372 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: crc 2023-12-03T11:37:52.372 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2023-12-03T11:37:52.253+0000 7f2e927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:52.372 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: secure 2023-12-03T11:37:52.372 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: crc 2023-12-03T11:37:52.372 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: crc 2023-12-03T11:37:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: secure 2023-12-03T11:37:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: crc 2023-12-03T11:37:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: secure 2023-12-03T11:37:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: crc 2023-12-03T11:37:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a86970) adding con mode: secure 2023-12-03T11:37:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2023-12-03T11:37:52.253+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2023-12-03T11:37:52.253+0000 7f2ed072b800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2023-12-03T11:37:52.253+0000 7f2ed072b800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command cache list hook 0x55c3ad949310 2023-12-03T11:37:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command cache inspect hook 0x55c3ad949310 2023-12-03T11:37:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command cache erase hook 0x55c3ad949310 2023-12-03T11:37:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command cache zap hook 0x55c3ad949310 2023-12-03T11:37:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2023-12-03T11:37:52.253+0000 7f2ed072b800 10 monclient: get_monmap_and_config 2023-12-03T11:37:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2023-12-03T11:37:52.253+0000 7f2ed072b800 10 monclient: build_initial_monmap 2023-12-03T11:37:52.374 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2023-12-03T11:37:52.253+0000 7f2ed072b800 1 build_initial for_mkfs: 0 2023-12-03T11:37:52.374 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2023-12-03T11:37:52.253+0000 7f2ed072b800 10 monclient: monmap: 2023-12-03T11:37:52.374 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:37:52.374 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:37:52.374 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:37:52.374 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:37:52.374 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:37:52.374 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:37:52.374 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:37:52.374 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:37:52.374 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:37:52.374 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.374 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding auth protocol: cephx 2023-12-03T11:37:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding auth protocol: cephx 2023-12-03T11:37:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding auth protocol: cephx 2023-12-03T11:37:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2023-12-03T11:37:52.253+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.376 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2023-12-03T11:37:52.253+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.376 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2023-12-03T11:37:52.254+0000 7f2ed072b800 10 monclient: init 2023-12-03T11:37:52.376 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding auth protocol: cephx 2023-12-03T11:37:52.376 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding auth protocol: cephx 2023-12-03T11:37:52.376 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding auth protocol: cephx 2023-12-03T11:37:52.376 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: secure 2023-12-03T11:37:52.376 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: crc 2023-12-03T11:37:52.376 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: secure 2023-12-03T11:37:52.376 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: crc 2023-12-03T11:37:52.376 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: secure 2023-12-03T11:37:52.376 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: crc 2023-12-03T11:37:52.376 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: crc 2023-12-03T11:37:52.376 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: secure 2023-12-03T11:37:52.376 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: crc 2023-12-03T11:37:52.377 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: secure 2023-12-03T11:37:52.377 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: crc 2023-12-03T11:37:52.377 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 AuthRegistry(0x7ffe48a864c0) adding con mode: secure 2023-12-03T11:37:52.377 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2023-12-03T11:37:52.254+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.377 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2023-12-03T11:37:52.254+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.377 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2023-12-03T11:37:52.254+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command rotate-key cmddesc rotate-key hook 0x7ffe48a86608 EEXIST 2023-12-03T11:37:52.377 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2023-12-03T11:37:52.254+0000 7f2ed072b800 10 monclient: _reopen_session rank -1 2023-12-03T11:37:52.377 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2023-12-03T11:37:52.254+0000 7f2ed072b800 10 monclient: _add_conns ranks=[1,2,0] 2023-12-03T11:37:52.377 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2023-12-03T11:37:52.254+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-b con 0x55c3ad9d55e0 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:37:52.377 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2023-12-03T11:37:52.254+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-c con 0x55c3ada05d40 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:37:52.377 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2023-12-03T11:37:52.254+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-a con 0x55c3ada06790 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:37:52.377 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2023-12-03T11:37:52.254+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.377 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2023-12-03T11:37:52.254+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.377 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2023-12-03T11:37:52.254+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.378 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2023-12-03T11:37:52.254+0000 7f2ed072b800 10 monclient(hunting): _renew_subs 2023-12-03T11:37:52.378 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2023-12-03T11:37:52.254+0000 7f2ed072b800 10 monclient(hunting): authenticate will time out at 1551.480177s 2023-12-03T11:37:52.378 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2023-12-03T11:37:52.254+0000 7f2ecc432640 10 monclient(hunting): get_auth_request con 0x55c3ada05d40 auth_method 0 2023-12-03T11:37:52.378 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2023-12-03T11:37:52.254+0000 7f2ecc432640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.378 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2023-12-03T11:37:52.254+0000 7f2ecc432640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.378 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2023-12-03T11:37:52.254+0000 7f2ecc432640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:37:52.378 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2023-12-03T11:37:52.254+0000 7f2ecbc31640 10 monclient(hunting): get_auth_request con 0x55c3ada06790 auth_method 0 2023-12-03T11:37:52.378 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2023-12-03T11:37:52.254+0000 7f2ecbc31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.378 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2023-12-03T11:37:52.254+0000 7f2ecbc31640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.378 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2023-12-03T11:37:52.254+0000 7f2ecbc31640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:37:52.378 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2023-12-03T11:37:52.254+0000 7f2eccc33640 10 monclient(hunting): get_auth_request con 0x55c3ad9d55e0 auth_method 0 2023-12-03T11:37:52.378 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2023-12-03T11:37:52.254+0000 7f2eccc33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.378 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2023-12-03T11:37:52.254+0000 7f2eccc33640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.379 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2023-12-03T11:37:52.254+0000 7f2eccc33640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:37:52.379 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2023-12-03T11:37:52.254+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:37:52.379 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2023-12-03T11:37:52.254+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:37:52.379 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2023-12-03T11:37:52.254+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:37:52.379 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2023-12-03T11:37:52.254+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:37:52.379 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2023-12-03T11:37:52.254+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:37:52.379 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2023-12-03T11:37:52.254+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:37:52.379 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2023-12-03T11:37:52.254+0000 7f2eccc33640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:37:52.379 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2023-12-03T11:37:52.254+0000 7f2eccc33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:37:52.379 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2023-12-03T11:37:52.254+0000 7f2eccc33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:37:52.379 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2023-12-03T11:37:52.254+0000 7f2ecc432640 10 monclient(hunting): handle_auth_done global_id 6191 payload 274 2023-12-03T11:37:52.379 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2023-12-03T11:37:52.254+0000 7f2ecc432640 10 monclient: _finish_hunting 0 2023-12-03T11:37:52.379 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2023-12-03T11:37:52.254+0000 7f2ecc432640 1 monclient: found mon.noname-c 2023-12-03T11:37:52.380 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2023-12-03T11:37:52.254+0000 7f2ecc432640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2023-12-03T11:37:52.380 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2023-12-03T11:37:52.255+0000 7f2e91fe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:37:52.380 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2023-12-03T11:37:52.255+0000 7f2e91fe3640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:37:52.380 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2023-12-03T11:37:52.255+0000 7f2e91fe3640 10 monclient: dump: 2023-12-03T11:37:52.380 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:37:52.380 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:37:52.380 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.380 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.380 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:37:52.380 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:37:52.380 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:37:52.380 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:37:52.380 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:37:52.380 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.381 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2023-12-03T11:37:52.255+0000 7f2e91fe3640 10 monclient: _finish_auth 0 2023-12-03T11:37:52.381 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2023-12-03T11:37:52.255+0000 7f2e91fe3640 10 monclient: _check_auth_tickets 2023-12-03T11:37:52.381 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2023-12-03T11:37:52.255+0000 7f2e91fe3640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:37:52.381 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2023-12-03T11:37:52.255+0000 7f2ed072b800 5 monclient: authenticate success, global_id 6191 2023-12-03T11:37:52.381 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2023-12-03T11:37:52.255+0000 7f2ed072b800 10 monclient: get_monmap_and_config success 2023-12-03T11:37:52.381 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2023-12-03T11:37:52.255+0000 7f2ed072b800 4 set_mon_vals no callback set 2023-12-03T11:37:52.381 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2023-12-03T11:37:52.255+0000 7f2e91fe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:37:52.381 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2023-12-03T11:37:52.255+0000 7f2e91fe3640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:37:52.381 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2023-12-03T11:37:52.255+0000 7f2e91fe3640 10 monclient: dump: 2023-12-03T11:37:52.381 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:37:52.381 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:37:52.381 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.381 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.381 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:37:52.381 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:37:52.382 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:37:52.382 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:37:52.382 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:37:52.382 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.382 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2023-12-03T11:37:52.255+0000 7f2ed072b800 10 monclient: shutdown 2023-12-03T11:37:52.382 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2023-12-03T11:37:52.256+0000 7f2ed072b800 10 monclient: build_initial_monmap 2023-12-03T11:37:52.382 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2023-12-03T11:37:52.256+0000 7f2ed072b800 1 build_initial for_mkfs: 0 2023-12-03T11:37:52.382 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2023-12-03T11:37:52.256+0000 7f2ed072b800 10 monclient: monmap: 2023-12-03T11:37:52.382 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:37:52.382 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:37:52.382 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:37:52.382 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:37:52.382 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:37:52.382 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:37:52.382 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:37:52.383 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:37:52.383 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:37:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding auth protocol: cephx 2023-12-03T11:37:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding auth protocol: cephx 2023-12-03T11:37:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding auth protocol: cephx 2023-12-03T11:37:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: crc 2023-12-03T11:37:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada04290) adding con mode: secure 2023-12-03T11:37:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2023-12-03T11:37:52.256+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2023-12-03T11:37:52.256+0000 7f2ed072b800 1 librados: starting msgr at 2023-12-03T11:37:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2023-12-03T11:37:52.256+0000 7f2ed072b800 1 librados: starting objecter 2023-12-03T11:37:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command objecter_requests cmddesc objecter_requests hook 0x55c3ad9c58d0 EEXIST 2023-12-03T11:37:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2023-12-03T11:37:52.256+0000 7f2ed072b800 1 librados: setting wanted keys 2023-12-03T11:37:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2023-12-03T11:37:52.256+0000 7f2ed072b800 1 librados: calling monclient init 2023-12-03T11:37:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2023-12-03T11:37:52.256+0000 7f2ed072b800 10 monclient: init 2023-12-03T11:37:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding auth protocol: cephx 2023-12-03T11:37:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding auth protocol: cephx 2023-12-03T11:37:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding auth protocol: cephx 2023-12-03T11:37:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: secure 2023-12-03T11:37:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: crc 2023-12-03T11:37:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: secure 2023-12-03T11:37:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: crc 2023-12-03T11:37:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: secure 2023-12-03T11:37:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: crc 2023-12-03T11:37:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: crc 2023-12-03T11:37:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: secure 2023-12-03T11:37:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: crc 2023-12-03T11:37:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: secure 2023-12-03T11:37:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: crc 2023-12-03T11:37:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 AuthRegistry(0x55c3ada07128) adding con mode: secure 2023-12-03T11:37:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2023-12-03T11:37:52.256+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.386 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2023-12-03T11:37:52.256+0000 7f2ed072b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:37:52.386 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2023-12-03T11:37:52.256+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command rotate-key cmddesc rotate-key hook 0x55c3ada07270 EEXIST 2023-12-03T11:37:52.386 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2023-12-03T11:37:52.256+0000 7f2ed072b800 10 monclient: _reopen_session rank -1 2023-12-03T11:37:52.386 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2023-12-03T11:37:52.256+0000 7f2ed072b800 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:37:52.386 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2023-12-03T11:37:52.256+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-b con 0x55c3ada05d40 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:37:52.386 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2023-12-03T11:37:52.256+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-a con 0x55c3ada06790 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:37:52.386 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2023-12-03T11:37:52.257+0000 7f2ed072b800 10 monclient(hunting): picked mon.noname-c con 0x55c3ad9da1d0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:37:52.386 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2023-12-03T11:37:52.257+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.386 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2023-12-03T11:37:52.257+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.386 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2023-12-03T11:37:52.257+0000 7f2ed072b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:37:52.386 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2023-12-03T11:37:52.257+0000 7f2ed072b800 10 monclient(hunting): _renew_subs 2023-12-03T11:37:52.386 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2023-12-03T11:37:52.257+0000 7f2ed072b800 10 monclient(hunting): authenticate will time out at 1551.482677s 2023-12-03T11:37:52.386 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2023-12-03T11:37:52.257+0000 7f2ecc432640 10 monclient(hunting): get_auth_request con 0x55c3ada06790 auth_method 0 2023-12-03T11:37:52.387 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2023-12-03T11:37:52.257+0000 7f2ecc432640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.387 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2023-12-03T11:37:52.257+0000 7f2ecc432640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.387 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2023-12-03T11:37:52.257+0000 7f2ecc432640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:37:52.387 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2023-12-03T11:37:52.257+0000 7f2ecbc31640 10 monclient(hunting): get_auth_request con 0x55c3ad9da1d0 auth_method 0 2023-12-03T11:37:52.387 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2023-12-03T11:37:52.257+0000 7f2ecbc31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.387 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2023-12-03T11:37:52.257+0000 7f2ecbc31640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.387 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2023-12-03T11:37:52.257+0000 7f2ecbc31640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:37:52.387 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2023-12-03T11:37:52.257+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:37:52.387 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2023-12-03T11:37:52.257+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:37:52.387 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2023-12-03T11:37:52.257+0000 7f2ecc432640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:37:52.387 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2023-12-03T11:37:52.257+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:37:52.387 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2023-12-03T11:37:52.257+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:37:52.387 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2023-12-03T11:37:52.257+0000 7f2ecbc31640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:37:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2023-12-03T11:37:52.257+0000 7f2eccc33640 10 monclient(hunting): get_auth_request con 0x55c3ada05d40 auth_method 0 2023-12-03T11:37:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2023-12-03T11:37:52.257+0000 7f2eccc33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:37:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2023-12-03T11:37:52.257+0000 7f2eccc33640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:37:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2023-12-03T11:37:52.257+0000 7f2eccc33640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:37:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2023-12-03T11:37:52.257+0000 7f2ecc432640 10 monclient(hunting): handle_auth_done global_id 6516 payload 824 2023-12-03T11:37:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2023-12-03T11:37:52.257+0000 7f2ecc432640 10 monclient: _finish_hunting 0 2023-12-03T11:37:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2023-12-03T11:37:52.257+0000 7f2ecc432640 1 monclient: found mon.noname-a 2023-12-03T11:37:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2023-12-03T11:37:52.257+0000 7f2ecc432640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2023-12-03T11:37:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2023-12-03T11:37:52.257+0000 7f2e03fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:37:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2023-12-03T11:37:52.257+0000 7f2e03fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:37:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2023-12-03T11:37:52.257+0000 7f2e03fff640 10 monclient: dump: 2023-12-03T11:37:52.388 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:37:52.388 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:37:52.389 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.389 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.389 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:37:52.389 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:37:52.389 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:37:52.389 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:37:52.389 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:37:52.389 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.389 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2023-12-03T11:37:52.257+0000 7f2e03fff640 10 monclient: _finish_auth 0 2023-12-03T11:37:52.389 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2023-12-03T11:37:52.257+0000 7f2e03fff640 10 monclient: _check_auth_tickets 2023-12-03T11:37:52.389 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2023-12-03T11:37:52.257+0000 7f2e03fff640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:37:52.389 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2023-12-03T11:37:52.257+0000 7f2e03fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:37:52.389 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2023-12-03T11:37:52.257+0000 7f2e03fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:37:52.389 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2023-12-03T11:37:52.257+0000 7f2e03fff640 10 monclient: dump: 2023-12-03T11:37:52.389 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:37:52.390 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:37:52.390 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.390 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:37:52.390 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:37:52.390 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:37:52.390 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:37:52.390 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:37:52.390 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:37:52.390 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.390 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2023-12-03T11:37:52.257+0000 7f2ed072b800 5 monclient: authenticate success, global_id 6516 2023-12-03T11:37:52.390 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2023-12-03T11:37:52.257+0000 7f2ed072b800 10 monclient: _renew_subs 2023-12-03T11:37:52.390 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2023-12-03T11:37:52.257+0000 7f2e91fe3640 4 set_mon_vals no callback set 2023-12-03T11:37:52.390 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2023-12-03T11:37:52.257+0000 7f2ed072b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2023-12-03T11:37:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2023-12-03T11:37:52.257+0000 7f2ed072b800 10 monclient: _renew_subs 2023-12-03T11:37:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2023-12-03T11:37:52.257+0000 7f2ed072b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2023-12-03T11:37:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2023-12-03T11:37:52.257+0000 7f2ed072b800 1 librados: init done 2023-12-03T11:37:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2023-12-03T11:37:52.257+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command cr dump hook 0x55c3ad9db1e8 2023-12-03T11:37:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2023-12-03T11:37:52.259+0000 7f2e03fff640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:37:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2023-12-03T11:37:52.259+0000 7f2e03fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:37:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2023-12-03T11:37:52.259+0000 7f2e03fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:37:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2023-12-03T11:37:52.259+0000 7f2eccc33640 10 monclient: get_auth_request con 0x7f2e08069820 auth_method 0 2023-12-03T11:37:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2023-12-03T11:37:52.259+0000 7f2ed072b800 5 note: GC not initialized 2023-12-03T11:37:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2023-12-03T11:37:52.259+0000 7f2e017fa640 20 reqs_thread_entry: start 2023-12-03T11:37:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2023-12-03T11:37:52.259+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command sync trace show hook 0x7f2ec0004460 2023-12-03T11:37:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2023-12-03T11:37:52.259+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command sync trace history hook 0x7f2ec0004460 2023-12-03T11:37:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2023-12-03T11:37:52.259+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command sync trace active hook 0x7f2ec0004460 2023-12-03T11:37:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2023-12-03T11:37:52.259+0000 7f2ed072b800 5 asok(0x55c3ad761a10) register_command sync trace active_short hook 0x7f2ec0004460 2023-12-03T11:37:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2023-12-03T11:37:52.259+0000 7f2ed072b800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2023-12-03T11:37:52.259+0000 7f2ed072b800 20 Filter name: none 2023-12-03T11:37:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2023-12-03T11:37:52.259+0000 7f2dfaffd640 20 reqs_thread_entry: start 2023-12-03T11:37:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2023-12-03T11:37:52.259+0000 7f2ed072b800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2023-12-03T11:37:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2023-12-03T11:37:52.259+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2023-12-03T11:37:52.260+0000 7f2ed072b800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:37:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2023-12-03T11:37:52.260+0000 7f2ed072b800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2023-12-03T11:37:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2023-12-03T11:37:52.260+0000 7f2ed072b800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2023-12-03T11:37:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2023-12-03T11:37:52.260+0000 7f2ed072b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 : miss 2023-12-03T11:37:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2023-12-03T11:37:52.260+0000 7f2ed072b800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2023-12-03T11:37:52.260+0000 7f2ed072b800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:37:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2023-12-03T11:37:52.260+0000 7f2ed072b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 info.flags=0x17 2023-12-03T11:37:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2023-12-03T11:37:52.260+0000 7f2ed072b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 to cache LRU end 2023-12-03T11:37:52.393 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2023-12-03T11:37:52.260+0000 7f2ed072b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:37:52.393 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2023-12-03T11:37:52.260+0000 7f2ed072b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:37:52.393 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2023-12-03T11:37:52.261+0000 7f2ed072b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 2023-12-03T11:37:52.393 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2023-12-03T11:37:52.261+0000 7f2ecbc31640 10 monclient: get_auth_request con 0x55c3ada544b0 auth_method 0 2023-12-03T11:37:52.393 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2023-12-03T11:37:52.264+0000 7f2ed072b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2ed072b800 time 2023-12-03T11:37:52.264732+0000 2023-12-03T11:37:52.393 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:37:52.393 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.393 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:37:52.393 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2ed336eef8] 2023-12-03T11:37:52.393 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f2ed336f0b6] 2023-12-03T11:37:52.393 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c3acd39a71] 2023-12-03T11:37:52.393 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0x79787a) [0x55c3acd4187a] 2023-12-03T11:37:52.393 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55c3acd45e6b] 2023-12-03T11:37:52.394 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2023-12-03T11:37:52.394 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f2ed0c3feb0] 2023-12-03T11:37:52.394 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2023-12-03T11:37:52.394 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2023-12-03T11:37:52.394 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.394 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2023-12-03T11:37:52.265+0000 7f2ed072b800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:37:52.394 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f2ed072b800 thread_name:radosgw-admin 2023-12-03T11:37:52.394 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.394 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:37:52.394 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f2ed0c54db0] 2023-12-03T11:37:52.394 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f2ed0ca154c] 2023-12-03T11:37:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2023-12-03T11:37:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2023-12-03T11:37:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2ed336ef52] 2023-12-03T11:37:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f2ed336f0b6] 2023-12-03T11:37:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c3acd39a71] 2023-12-03T11:37:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0x79787a) [0x55c3acd4187a] 2023-12-03T11:37:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55c3acd45e6b] 2023-12-03T11:37:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2023-12-03T11:37:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f2ed0c3feb0] 2023-12-03T11:37:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2023-12-03T11:37:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2023-12-03T11:37:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:37:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.396 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2023-12-03T11:37:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2023-12-03T11:37:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2023-12-03T11:37:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2023-12-03T11:37:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2023-12-03T11:37:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2023-12-03T11:37:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2023-12-03T11:37:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2023-12-03T11:37:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2023-12-03T11:37:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2023-12-03T11:37:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2023-12-03T11:37:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2023-12-03T11:37:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2023-12-03T11:37:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2023-12-03T11:37:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2023-12-03T11:37:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2023-12-03T11:37:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2023-12-03T11:37:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2023-12-03T11:37:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2023-12-03T11:37:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2023-12-03T11:37:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2023-12-03T11:37:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2023-12-03T11:37:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2023-12-03T11:37:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:37:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2023-12-03T11:37:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2023-12-03T11:37:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2023-12-03T11:37:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2023-12-03T11:37:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2023-12-03T11:37:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2023-12-03T11:37:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2023-12-03T11:37:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2023-12-03T11:37:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2023-12-03T11:37:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2023-12-03T11:37:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2023-12-03T11:37:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2023-12-03T11:37:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2023-12-03T11:37:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2023-12-03T11:37:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2023-12-03T11:37:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2023-12-03T11:37:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2023-12-03T11:37:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2023-12-03T11:37:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2023-12-03T11:37:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2023-12-03T11:37:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2023-12-03T11:37:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:37:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2023-12-03T11:37:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2023-12-03T11:37:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2023-12-03T11:37:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2023-12-03T11:37:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2023-12-03T11:37:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2023-12-03T11:37:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2023-12-03T11:37:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2023-12-03T11:37:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2023-12-03T11:37:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2023-12-03T11:37:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2023-12-03T11:37:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2023-12-03T11:37:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2023-12-03T11:37:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2023-12-03T11:37:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2023-12-03T11:37:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2023-12-03T11:37:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2023-12-03T11:37:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2023-12-03T11:37:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:37:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2023-12-03T11:37:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:37:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2023-12-03T11:37:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2023-12-03T11:37:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2023-12-03T11:37:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2023-12-03T11:37:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2023-12-03T11:37:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2023-12-03T11:37:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:37:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2023-12-03T11:37:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2023-12-03T11:37:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:37:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2023-12-03T11:37:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2023-12-03T11:37:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2023-12-03T11:37:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2023-12-03T11:37:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2023-12-03T11:37:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2023-12-03T11:37:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2023-12-03T11:37:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2023-12-03T11:37:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2023-12-03T11:37:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2023-12-03T11:37:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2023-12-03T11:37:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2023-12-03T11:37:52.402 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:37:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2dfaffd640 / http_manager 2023-12-03T11:37:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2e017fa640 / http_manager 2023-12-03T11:37:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2e03fff640 / ms_dispatch 2023-12-03T11:37:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2e91fe3640 / io_context_pool 2023-12-03T11:37:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2e927e4640 / rgw_dt_lg_renew 2023-12-03T11:37:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2eb17fa640 / ms_dispatch 2023-12-03T11:37:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2eb2ffd640 / io_context_pool 2023-12-03T11:37:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2ec9c2d640 / ms_dispatch 2023-12-03T11:37:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2ecbc31640 / msgr-worker-2 2023-12-03T11:37:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2ecc432640 / msgr-worker-1 2023-12-03T11:37:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2eccc33640 / msgr-worker-0 2023-12-03T11:37:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2ed072b800 / radosgw-admin 2023-12-03T11:37:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2023-12-03T11:37:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2023-12-03T11:37:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/lib/ceph/crash/2023-12-03T11:37:52.266287Z_e07cd088-ce4d-4675-b382-9feb47a01b58/log 2023-12-03T11:37:52.403 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2023-12-03T11:37:52.403 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2023-12-03T11:37:52.409 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:52.409 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:52.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.313+0000 7f68648c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.314+0000 7f68648c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.315+0000 7f68648c0800 20 realm 2023-12-03T11:37:52.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.315+0000 7f68648c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.315+0000 7f68648c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.315+0000 7f68648c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:52.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.315+0000 7f68648c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.315+0000 7f68648c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.315+0000 7f68648c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.316+0000 7f68648c0800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:52.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.316+0000 7f68648c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.317+0000 7f68648c0800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:52.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.317+0000 7f68648c0800 20 searching for the correct realm 2023-12-03T11:37:52.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.326+0000 7f68623c7640 0 -- 172.21.15.44:0/3929101347 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x562b44ae19e0 msgr2=0x562b44ae3dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:52.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.327+0000 7f68648c0800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:52.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.327+0000 7f68648c0800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:52.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.327+0000 7f68648c0800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:52.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.327+0000 7f68648c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:52.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.327+0000 7f68648c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.328+0000 7f68648c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.328+0000 7f68648c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.328+0000 7f68648c0800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:52.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.328+0000 7f68648c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.328+0000 7f68648c0800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:52.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.328+0000 7f68648c0800 20 zone default found 2023-12-03T11:37:52.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.328+0000 7f68648c0800 4 Realm: () 2023-12-03T11:37:52.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.328+0000 7f68648c0800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:52.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.328+0000 7f68648c0800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:52.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.328+0000 7f68648c0800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:52.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.328+0000 7f68648c0800 20 zonegroup default 2023-12-03T11:37:52.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.328+0000 7f68648c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.411 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.328+0000 7f68648c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.328+0000 7f68648c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.329+0000 7f68648c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.329+0000 7f68648c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.329+0000 7f68648c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.329+0000 7f68648c0800 20 started sync module instance, tier type = 2023-12-03T11:37:52.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.329+0000 7f68648c0800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:52.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.335+0000 7f6862bc8640 0 -- 172.21.15.44:0/3929101347 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f68580609d0 msgr2=0x7f685806c8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:52.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.339+0000 7f68648c0800 20 add_watcher() i=0 2023-12-03T11:37:52.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.339+0000 7f68648c0800 20 add_watcher() i=1 2023-12-03T11:37:52.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.339+0000 7f68648c0800 20 add_watcher() i=2 2023-12-03T11:37:52.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.339+0000 7f68648c0800 20 add_watcher() i=3 2023-12-03T11:37:52.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.339+0000 7f68648c0800 20 add_watcher() i=4 2023-12-03T11:37:52.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.339+0000 7f68648c0800 20 add_watcher() i=5 2023-12-03T11:37:52.413 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.339+0000 7f68648c0800 20 add_watcher() i=6 2023-12-03T11:37:52.413 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.339+0000 7f68648c0800 20 add_watcher() i=7 2023-12-03T11:37:52.413 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.340+0000 7f68648c0800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:52.413 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.341+0000 7f6827fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:52.413 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.341+0000 7f68648c0800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:52.413 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.341+0000 7f68648c0800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:52.413 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.347+0000 7f68648c0800 5 note: GC not initialized 2023-12-03T11:37:52.413 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.347+0000 7f6796ffd640 20 reqs_thread_entry: start 2023-12-03T11:37:52.413 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.348+0000 7f68648c0800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:52.413 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.348+0000 7f68648c0800 20 Filter name: none 2023-12-03T11:37:52.413 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.348+0000 7f6794ff9640 20 reqs_thread_entry: start 2023-12-03T11:37:52.413 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.348+0000 7f68648c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.413 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.348+0000 7f68648c0800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:37:52.413 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.348+0000 7f68648c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.349+0000 7f68648c0800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:37:52.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.349+0000 7f68648c0800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:52.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.349+0000 7f68648c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.349+0000 7f68648c0800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:37:52.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.349+0000 7f68648c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.349+0000 7f68648c0800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:37:52.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.349+0000 7f68648c0800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:52.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.350+0000 7f68648c0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.350+0000 7f68648c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.351+0000 7f6827fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:52.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.353+0000 7f68648c0800 20 remove_watcher() i=0 2023-12-03T11:37:52.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.353+0000 7f68648c0800 2 removed watcher, disabling cache 2023-12-03T11:37:52.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.354+0000 7f68648c0800 20 remove_watcher() i=1 2023-12-03T11:37:52.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.355+0000 7f68648c0800 20 remove_watcher() i=2 2023-12-03T11:37:52.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.356+0000 7f68648c0800 20 remove_watcher() i=3 2023-12-03T11:37:52.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.357+0000 7f68648c0800 20 remove_watcher() i=4 2023-12-03T11:37:52.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.358+0000 7f68648c0800 20 remove_watcher() i=5 2023-12-03T11:37:52.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.359+0000 7f68648c0800 20 remove_watcher() i=6 2023-12-03T11:37:52.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.360+0000 7f68648c0800 20 remove_watcher() i=7 2023-12-03T11:37:52.415 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.415 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:37:52.415 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-set-target-layout id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:37:52.415 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:37:52.416 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:37:52.447 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:52.447 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:52.462 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.461+0000 7f78a91dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.464 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.462+0000 7f78a91dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.464 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.462+0000 7f78a91dc800 20 realm 2023-12-03T11:37:52.464 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.462+0000 7f78a91dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.464 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.463+0000 7f78a91dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.464 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.463+0000 7f78a91dc800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:52.464 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.463+0000 7f78a91dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.464 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.463+0000 7f78a91dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.465 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.463+0000 7f78a91dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.465 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.464+0000 7f78a91dc800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:52.465 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.464+0000 7f78a91dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.464+0000 7f78a91dc800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:52.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.464+0000 7f78a91dc800 20 searching for the correct realm 2023-12-03T11:37:52.475 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.474+0000 7f78a6ce3640 0 -- 172.21.15.44:0/733576153 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55ae3cf11c20 msgr2=0x55ae3cf14010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:52.476 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.475+0000 7f78a91dc800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:37:52.477 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.475+0000 7f78a91dc800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:37:52.477 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.475+0000 7f78a91dc800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:52.477 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.475+0000 7f78a91dc800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:52.477 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.475+0000 7f78a91dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.477 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.476+0000 7f78a91dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.477 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.476+0000 7f78a91dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.478 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.476+0000 7f78a91dc800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:52.478 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.476+0000 7f78a91dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.478 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.476+0000 7f78a91dc800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:52.478 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.476+0000 7f78a91dc800 20 zone default found 2023-12-03T11:37:52.478 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.476+0000 7f78a91dc800 4 Realm: () 2023-12-03T11:37:52.478 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.476+0000 7f78a91dc800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:37:52.479 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.476+0000 7f78a91dc800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:37:52.479 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.476+0000 7f78a91dc800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:52.479 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.476+0000 7f78a91dc800 20 zonegroup default 2023-12-03T11:37:52.479 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.476+0000 7f78a91dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.479 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.476+0000 7f78a91dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.479 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.477+0000 7f78a91dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.479 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.477+0000 7f78a91dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.479 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.477+0000 7f78a91dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.479 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.477+0000 7f78a91dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.479 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.477+0000 7f78a91dc800 20 started sync module instance, tier type = 2023-12-03T11:37:52.479 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.477+0000 7f78a91dc800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:37:52.485 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.484+0000 7f78a74e4640 0 -- 172.21.15.44:0/733576153 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f789c034b40 msgr2=0x7f789c04a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:52.487 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.486+0000 7f78a91dc800 20 add_watcher() i=0 2023-12-03T11:37:52.488 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.486+0000 7f78a91dc800 20 add_watcher() i=1 2023-12-03T11:37:52.488 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.486+0000 7f78a91dc800 20 add_watcher() i=2 2023-12-03T11:37:52.488 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.486+0000 7f78a91dc800 20 add_watcher() i=3 2023-12-03T11:37:52.488 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.486+0000 7f78a91dc800 20 add_watcher() i=4 2023-12-03T11:37:52.488 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.486+0000 7f78a91dc800 20 add_watcher() i=5 2023-12-03T11:37:52.488 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.486+0000 7f78a91dc800 20 add_watcher() i=6 2023-12-03T11:37:52.488 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.487+0000 7f78a91dc800 20 add_watcher() i=7 2023-12-03T11:37:52.488 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.487+0000 7f78a91dc800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:52.490 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.489+0000 7f77e7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:52.490 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.489+0000 7f78a91dc800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:52.490 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.489+0000 7f78a91dc800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:52.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.495+0000 7f78a91dc800 5 note: GC not initialized 2023-12-03T11:37:52.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.495+0000 7f77d6ffd640 20 reqs_thread_entry: start 2023-12-03T11:37:52.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.495+0000 7f78a91dc800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:52.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.495+0000 7f78a91dc800 20 Filter name: none 2023-12-03T11:37:52.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.495+0000 7f77d4ff9640 20 reqs_thread_entry: start 2023-12-03T11:37:52.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.495+0000 7f78a91dc800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2023-12-03T11:37:52.497 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.495+0000 7f78a91dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.496+0000 7f78a91dc800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:37:52.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.496+0000 7f78a91dc800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2023-12-03T11:37:52.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.496+0000 7f78a91dc800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2023-12-03T11:37:52.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.496+0000 7f78a91dc800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 : miss 2023-12-03T11:37:52.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.496+0000 7f78a91dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.497+0000 7f78a91dc800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:37:52.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.497+0000 7f78a91dc800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 info.flags=0x17 2023-12-03T11:37:52.498 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.497+0000 7f78a91dc800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 to cache LRU end 2023-12-03T11:37:52.499 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.497+0000 7f78a91dc800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:37:52.499 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.497+0000 7f78a91dc800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:37:52.499 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.497+0000 7f78a91dc800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 2023-12-03T11:37:52.499 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.498+0000 7f78a91dc800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 to be held by another RGW process; skipping for now 2023-12-03T11:37:52.500 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.499+0000 7f77e7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:52.502 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.501+0000 7f78a91dc800 20 remove_watcher() i=0 2023-12-03T11:37:52.502 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.501+0000 7f78a91dc800 2 removed watcher, disabling cache 2023-12-03T11:37:52.505 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.502+0000 7f78a91dc800 20 remove_watcher() i=1 2023-12-03T11:37:52.505 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.503+0000 7f78a91dc800 20 remove_watcher() i=2 2023-12-03T11:37:52.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.505+0000 7f78a91dc800 20 remove_watcher() i=3 2023-12-03T11:37:52.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.506+0000 7f78a91dc800 20 remove_watcher() i=4 2023-12-03T11:37:52.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.507+0000 7f78a91dc800 20 remove_watcher() i=5 2023-12-03T11:37:52.508 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.508+0000 7f78a91dc800 20 remove_watcher() i=6 2023-12-03T11:37:52.510 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:37:52.509+0000 7f78a91dc800 20 remove_watcher() i=7 2023-12-03T11:37:52.514 INFO:tasks.workunit.client.0.smithi044.stderr:waiting 30 seconds for reshard lock to expire... 2023-12-03T11:38:22.544 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:38:22.578 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:22.578 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:22.595 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.593+0000 7f3d64d35800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.595+0000 7f3d64d35800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:22.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.595+0000 7f3d64d35800 20 realm 2023-12-03T11:38:22.597 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.595+0000 7f3d64d35800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.598 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.595+0000 7f3d64d35800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:22.598 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.595+0000 7f3d64d35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:22.598 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.595+0000 7f3d64d35800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.598 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.595+0000 7f3d64d35800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:22.598 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.595+0000 7f3d64d35800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.598 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.596+0000 7f3d64d35800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:22.598 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.596+0000 7f3d64d35800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.597+0000 7f3d64d35800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:22.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.597+0000 7f3d64d35800 20 searching for the correct realm 2023-12-03T11:38:22.611 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.609+0000 7f3d60acd640 0 -- 172.21.15.44:0/1564588700 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55c0d650ab20 msgr2=0x55c0d650cf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:22.613 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.611+0000 7f3d64d35800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:22.613 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.611+0000 7f3d64d35800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:22.613 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.611+0000 7f3d64d35800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:22.613 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.611+0000 7f3d64d35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:22.613 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.611+0000 7f3d64d35800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.615 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.611+0000 7f3d64d35800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:22.615 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.611+0000 7f3d64d35800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.615 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.611+0000 7f3d64d35800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:22.615 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.611+0000 7f3d64d35800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.615 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.612+0000 7f3d64d35800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:22.615 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.612+0000 7f3d64d35800 20 zone default found 2023-12-03T11:38:22.615 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.612+0000 7f3d64d35800 4 Realm: () 2023-12-03T11:38:22.615 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.612+0000 7f3d64d35800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:22.615 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.612+0000 7f3d64d35800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:22.615 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.612+0000 7f3d64d35800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:22.616 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.612+0000 7f3d64d35800 20 zonegroup default 2023-12-03T11:38:22.616 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.612+0000 7f3d64d35800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.616 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.612+0000 7f3d64d35800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:22.616 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.612+0000 7f3d64d35800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.616 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.612+0000 7f3d64d35800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:22.616 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.612+0000 7f3d64d35800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.616 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.613+0000 7f3d64d35800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:22.616 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.613+0000 7f3d64d35800 20 started sync module instance, tier type = 2023-12-03T11:38:22.616 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.613+0000 7f3d64d35800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:22.621 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.619+0000 7f3d612ce640 0 -- 172.21.15.44:0/1564588700 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f3d54098320 msgr2=0x7f3d540b08a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:22.625 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.623+0000 7f3d64d35800 20 add_watcher() i=0 2023-12-03T11:38:22.625 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.623+0000 7f3d64d35800 20 add_watcher() i=1 2023-12-03T11:38:22.625 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.623+0000 7f3d64d35800 20 add_watcher() i=2 2023-12-03T11:38:22.625 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.623+0000 7f3d64d35800 20 add_watcher() i=3 2023-12-03T11:38:22.625 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.623+0000 7f3d64d35800 20 add_watcher() i=4 2023-12-03T11:38:22.626 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.623+0000 7f3d64d35800 20 add_watcher() i=5 2023-12-03T11:38:22.626 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.623+0000 7f3d64d35800 20 add_watcher() i=6 2023-12-03T11:38:22.626 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.624+0000 7f3d64d35800 20 add_watcher() i=7 2023-12-03T11:38:22.626 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.624+0000 7f3d64d35800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:22.628 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.626+0000 7f3d26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:22.628 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.626+0000 7f3d64d35800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:22.628 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.626+0000 7f3d64d35800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:22.635 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.632+0000 7f3d64d35800 5 note: GC not initialized 2023-12-03T11:38:22.635 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.633+0000 7f3c95ffb640 20 reqs_thread_entry: start 2023-12-03T11:38:22.635 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.633+0000 7f3d64d35800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:22.635 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.633+0000 7f3d64d35800 20 Filter name: none 2023-12-03T11:38:22.635 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.633+0000 7f3c877fe640 20 reqs_thread_entry: start 2023-12-03T11:38:22.635 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.633+0000 7f3d64d35800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2023-12-03T11:38:22.635 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.633+0000 7f3d64d35800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.636 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.634+0000 7f3d64d35800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:38:22.636 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.634+0000 7f3d64d35800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2023-12-03T11:38:22.637 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.634+0000 7f3d64d35800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2023-12-03T11:38:22.637 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.634+0000 7f3d64d35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 : miss 2023-12-03T11:38:22.637 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.634+0000 7f3d64d35800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.637 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.634+0000 7f3d64d35800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:38:22.637 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.634+0000 7f3d64d35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 info.flags=0x17 2023-12-03T11:38:22.637 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.634+0000 7f3d64d35800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 to cache LRU end 2023-12-03T11:38:22.637 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.634+0000 7f3d64d35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:38:22.637 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.634+0000 7f3d64d35800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:22.637 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.634+0000 7f3d64d35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 2023-12-03T11:38:22.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.638+0000 7f3d64d35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 info.flags=0x17 2023-12-03T11:38:22.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.638+0000 7f3d64d35800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 to cache LRU end 2023-12-03T11:38:22.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.638+0000 7f3d64d35800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:22.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.638+0000 7f3d64d35800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20, ofs0, ns] 2023-12-03T11:38:22.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.639+0000 7f3d477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693273 cookie 94286717755312 notifier 6573 bl.length()=887 2023-12-03T11:38:22.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.639+0000 7f3d477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 info.flags=0x17 2023-12-03T11:38:22.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.639+0000 7f3d477fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 to cache LRU end 2023-12-03T11:38:22.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.639+0000 7f3d477fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:22.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.639+0000 7f3d64d35800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20]): orig_sources= new_sources= 2023-12-03T11:38:22.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.639+0000 7f3d64d35800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20]): potential sources added=[] removed=[] 2023-12-03T11:38:22.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.639+0000 7f3d64d35800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20]): orig_dests= new_dests= 2023-12-03T11:38:22.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.639+0000 7f3d64d35800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20]): potential dests added=[] removed=[] 2023-12-03T11:38:22.643 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.640+0000 7f3d64d35800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20.1.0 2023-12-03T11:38:22.643 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.640+0000 7f3d64d35800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20.1.0 2023-12-03T11:38:22.643 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.640+0000 7f3d64d35800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20.1.1 2023-12-03T11:38:22.643 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.640+0000 7f3d64d35800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20.1.1 2023-12-03T11:38:22.643 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.640+0000 7f3d64d35800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20.0 2023-12-03T11:38:22.645 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.643+0000 7f3d64d35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 : hit (requested=0x17, cached=0x17) 2023-12-03T11:38:22.645 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.643+0000 7f3d64d35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 2023-12-03T11:38:22.647 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.644+0000 7f3d64d35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 info.flags=0x17 2023-12-03T11:38:22.647 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.644+0000 7f3d64d35800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 to cache LRU end 2023-12-03T11:38:22.647 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.644+0000 7f3d64d35800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:22.647 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.644+0000 7f3d64d35800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20, ofs0, ns] 2023-12-03T11:38:22.647 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.645+0000 7f3d46ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693274 cookie 94286717755312 notifier 6573 bl.length()=855 2023-12-03T11:38:22.647 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.645+0000 7f3d46ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 info.flags=0x17 2023-12-03T11:38:22.647 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.645+0000 7f3d46ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 to cache LRU end 2023-12-03T11:38:22.647 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.645+0000 7f3d46ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:22.648 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.645+0000 7f3d64d35800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20]): orig_sources= new_sources= 2023-12-03T11:38:22.648 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.645+0000 7f3d64d35800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20]): potential sources added=[] removed=[] 2023-12-03T11:38:22.648 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.645+0000 7f3d64d35800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20]): orig_dests= new_dests= 2023-12-03T11:38:22.648 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.645+0000 7f3d64d35800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20]): potential dests added=[] removed=[] 2023-12-03T11:38:22.648 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.646+0000 7f3d64d35800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" completed successfully 2023-12-03T11:38:22.651 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.649+0000 7f3d26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:22.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.651+0000 7f3d64d35800 20 remove_watcher() i=0 2023-12-03T11:38:22.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.651+0000 7f3d64d35800 2 removed watcher, disabling cache 2023-12-03T11:38:22.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.652+0000 7f3d64d35800 20 remove_watcher() i=1 2023-12-03T11:38:22.655 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.653+0000 7f3d64d35800 20 remove_watcher() i=2 2023-12-03T11:38:22.657 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.654+0000 7f3d64d35800 20 remove_watcher() i=3 2023-12-03T11:38:22.658 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.656+0000 7f3d64d35800 20 remove_watcher() i=4 2023-12-03T11:38:22.659 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.657+0000 7f3d64d35800 20 remove_watcher() i=5 2023-12-03T11:38:22.660 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.658+0000 7f3d64d35800 20 remove_watcher() i=6 2023-12-03T11:38:22.661 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.659+0000 7f3d64d35800 20 remove_watcher() i=7 2023-12-03T11:38:22.667 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2023-12-03T11:38:22.695 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:22.696 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:22.710 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.708+0000 7f5df8f37800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.712 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.710+0000 7f5df8f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:22.712 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.710+0000 7f5df8f37800 20 realm 2023-12-03T11:38:22.712 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.710+0000 7f5df8f37800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.712 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.710+0000 7f5df8f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:22.712 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.710+0000 7f5df8f37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:22.712 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.710+0000 7f5df8f37800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.712 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.710+0000 7f5df8f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:22.713 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.710+0000 7f5df8f37800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.713 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.711+0000 7f5df8f37800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:22.713 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.711+0000 7f5df8f37800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.714 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.712+0000 7f5df8f37800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:22.714 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.712+0000 7f5df8f37800 20 searching for the correct realm 2023-12-03T11:38:22.723 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.721+0000 7f5df4ccd640 0 -- 172.21.15.44:0/617574138 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55992dc8d8c0 msgr2=0x55992dc8fcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:22.725 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.723+0000 7f5df8f37800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:22.725 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.723+0000 7f5df8f37800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:22.725 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.723+0000 7f5df8f37800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:22.726 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.723+0000 7f5df8f37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:22.726 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.723+0000 7f5df8f37800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.726 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.723+0000 7f5df8f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:22.726 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.723+0000 7f5df8f37800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.724+0000 7f5df8f37800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:22.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.724+0000 7f5df8f37800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.724+0000 7f5df8f37800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:22.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.724+0000 7f5df8f37800 20 zone default found 2023-12-03T11:38:22.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.724+0000 7f5df8f37800 4 Realm: () 2023-12-03T11:38:22.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.724+0000 7f5df8f37800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:22.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.724+0000 7f5df8f37800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:22.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.724+0000 7f5df8f37800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:22.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.724+0000 7f5df8f37800 20 zonegroup default 2023-12-03T11:38:22.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.724+0000 7f5df8f37800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.725+0000 7f5df8f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:22.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.725+0000 7f5df8f37800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.725+0000 7f5df8f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:22.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.725+0000 7f5df8f37800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.725+0000 7f5df8f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:22.729 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.725+0000 7f5df8f37800 20 started sync module instance, tier type = 2023-12-03T11:38:22.729 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.725+0000 7f5df8f37800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:22.733 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.731+0000 7f5df54ce640 0 -- 172.21.15.44:0/617574138 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55992dc95910 msgr2=0x55992dc97dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:38:22.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.734+0000 7f5df8f37800 20 add_watcher() i=0 2023-12-03T11:38:22.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.734+0000 7f5df8f37800 20 add_watcher() i=1 2023-12-03T11:38:22.737 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.734+0000 7f5df8f37800 20 add_watcher() i=2 2023-12-03T11:38:22.737 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.734+0000 7f5df8f37800 20 add_watcher() i=3 2023-12-03T11:38:22.737 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.734+0000 7f5df8f37800 20 add_watcher() i=4 2023-12-03T11:38:22.737 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.734+0000 7f5df8f37800 20 add_watcher() i=5 2023-12-03T11:38:22.737 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.734+0000 7f5df8f37800 20 add_watcher() i=6 2023-12-03T11:38:22.737 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.735+0000 7f5df8f37800 20 add_watcher() i=7 2023-12-03T11:38:22.737 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.735+0000 7f5df8f37800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:22.739 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.737+0000 7f5dbafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:22.739 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.737+0000 7f5df8f37800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:22.739 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.737+0000 7f5df8f37800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:22.746 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.743+0000 7f5df8f37800 5 note: GC not initialized 2023-12-03T11:38:22.746 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.743+0000 7f5d29ffb640 20 reqs_thread_entry: start 2023-12-03T11:38:22.746 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.744+0000 7f5df8f37800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:22.746 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.744+0000 7f5df8f37800 20 Filter name: none 2023-12-03T11:38:22.746 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.744+0000 7f5d1b7fe640 20 reqs_thread_entry: start 2023-12-03T11:38:22.746 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.744+0000 7f5df8f37800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.746 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.744+0000 7f5df8f37800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:38:22.747 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.744+0000 7f5df8f37800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.747 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.745+0000 7f5df8f37800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:38:22.747 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.745+0000 7f5df8f37800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:22.747 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.745+0000 7f5df8f37800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.747 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.745+0000 7f5df8f37800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:38:22.748 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.745+0000 7f5df8f37800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.748 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.746+0000 7f5df8f37800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:38:22.748 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.746+0000 7f5df8f37800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:22.748 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.746+0000 7f5df8f37800 20 rados->read ofs=0 len=0 2023-12-03T11:38:22.749 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.746+0000 7f5df8f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:22.749 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.747+0000 7f5dbafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:22.751 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.749+0000 7f5df8f37800 20 remove_watcher() i=0 2023-12-03T11:38:22.751 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.749+0000 7f5df8f37800 2 removed watcher, disabling cache 2023-12-03T11:38:22.752 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.750+0000 7f5df8f37800 20 remove_watcher() i=1 2023-12-03T11:38:22.753 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.751+0000 7f5df8f37800 20 remove_watcher() i=2 2023-12-03T11:38:22.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.752+0000 7f5df8f37800 20 remove_watcher() i=3 2023-12-03T11:38:22.755 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.753+0000 7f5df8f37800 20 remove_watcher() i=4 2023-12-03T11:38:22.756 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.754+0000 7f5df8f37800 20 remove_watcher() i=5 2023-12-03T11:38:22.757 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.755+0000 7f5df8f37800 20 remove_watcher() i=6 2023-12-03T11:38:22.759 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:22.756+0000 7f5df8f37800 20 remove_watcher() i=7 2023-12-03T11:38:22.763 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:22.763 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:38:22.763 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-set-target-layout id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.20 num_objects: 19 size_kb: 1 num_shards: 2 2023-12-03T11:38:22.764 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:22.842 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with EIO injected at block_writes 2023-12-03T11:38:22.842 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:23.021 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2023-12-03T11:38:23.049 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:23.049 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:23.065 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.063+0000 7f62dee12800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.068 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.065+0000 7f62dee12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.068 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.065+0000 7f62dee12800 20 realm 2023-12-03T11:38:23.068 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.065+0000 7f62dee12800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.068 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.065+0000 7f62dee12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.068 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.065+0000 7f62dee12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:23.068 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.065+0000 7f62dee12800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.068 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.066+0000 7f62dee12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.068 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.066+0000 7f62dee12800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.068 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.066+0000 7f62dee12800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:23.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.066+0000 7f62dee12800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.067+0000 7f62dee12800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:23.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.067+0000 7f62dee12800 20 searching for the correct realm 2023-12-03T11:38:23.079 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.077+0000 7f62dac51640 0 -- 172.21.15.44:0/2508233867 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x5588d40a67f0 msgr2=0x5588d40a8cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:23.079 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.077+0000 7f62dee12800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:23.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.077+0000 7f62dee12800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:23.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.077+0000 7f62dee12800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:23.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.077+0000 7f62dee12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:23.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.077+0000 7f62dee12800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.078+0000 7f62dee12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.078+0000 7f62dee12800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.078+0000 7f62dee12800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:23.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.078+0000 7f62dee12800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.078+0000 7f62dee12800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:23.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.078+0000 7f62dee12800 20 zone default found 2023-12-03T11:38:23.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.078+0000 7f62dee12800 4 Realm: () 2023-12-03T11:38:23.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.078+0000 7f62dee12800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:23.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.078+0000 7f62dee12800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:23.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.078+0000 7f62dee12800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:23.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.078+0000 7f62dee12800 20 zonegroup default 2023-12-03T11:38:23.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.078+0000 7f62dee12800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.078+0000 7f62dee12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.078+0000 7f62dee12800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.079+0000 7f62dee12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.079+0000 7f62dee12800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.079+0000 7f62dee12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.079+0000 7f62dee12800 20 started sync module instance, tier type = 2023-12-03T11:38:23.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.079+0000 7f62dee12800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:23.087 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.085+0000 7f62dac51640 0 -- 172.21.15.44:0/2508233867 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x7f62b4079e40 msgr2=0x7f62b407c270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:38:23.090 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.088+0000 7f62dee12800 20 add_watcher() i=0 2023-12-03T11:38:23.090 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.088+0000 7f62dee12800 20 add_watcher() i=1 2023-12-03T11:38:23.090 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.088+0000 7f62dee12800 20 add_watcher() i=2 2023-12-03T11:38:23.090 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.088+0000 7f62dee12800 20 add_watcher() i=3 2023-12-03T11:38:23.090 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.088+0000 7f62dee12800 20 add_watcher() i=4 2023-12-03T11:38:23.090 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.088+0000 7f62dee12800 20 add_watcher() i=5 2023-12-03T11:38:23.090 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.088+0000 7f62dee12800 20 add_watcher() i=6 2023-12-03T11:38:23.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.089+0000 7f62dee12800 20 add_watcher() i=7 2023-12-03T11:38:23.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.089+0000 7f62dee12800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:23.093 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.091+0000 7f629ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:23.093 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.091+0000 7f62dee12800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:23.093 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.091+0000 7f62dee12800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:23.100 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.097+0000 7f62dee12800 5 note: GC not initialized 2023-12-03T11:38:23.100 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.097+0000 7f620effd640 20 reqs_thread_entry: start 2023-12-03T11:38:23.100 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.097+0000 7f62dee12800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:23.100 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.097+0000 7f62dee12800 20 Filter name: none 2023-12-03T11:38:23.100 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.097+0000 7f620cff9640 20 reqs_thread_entry: start 2023-12-03T11:38:23.100 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.097+0000 7f62dee12800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.101 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.098+0000 7f62dee12800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:38:23.101 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.098+0000 7f62dee12800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.101 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.099+0000 7f62dee12800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:38:23.101 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.099+0000 7f62dee12800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:23.101 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.099+0000 7f62dee12800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.102 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.099+0000 7f62dee12800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:38:23.102 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.099+0000 7f62dee12800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.102 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.099+0000 7f62dee12800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:38:23.102 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.099+0000 7f62dee12800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:23.102 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.100+0000 7f62dee12800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.102 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.100+0000 7f62dee12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.103 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.101+0000 7f629ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:23.105 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.103+0000 7f62dee12800 20 remove_watcher() i=0 2023-12-03T11:38:23.105 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.103+0000 7f62dee12800 2 removed watcher, disabling cache 2023-12-03T11:38:23.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.104+0000 7f62dee12800 20 remove_watcher() i=1 2023-12-03T11:38:23.107 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.105+0000 7f62dee12800 20 remove_watcher() i=2 2023-12-03T11:38:23.108 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.106+0000 7f62dee12800 20 remove_watcher() i=3 2023-12-03T11:38:23.109 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.107+0000 7f62dee12800 20 remove_watcher() i=4 2023-12-03T11:38:23.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.108+0000 7f62dee12800 20 remove_watcher() i=5 2023-12-03T11:38:23.111 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.109+0000 7f62dee12800 20 remove_watcher() i=6 2023-12-03T11:38:23.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.110+0000 7f62dee12800 20 remove_watcher() i=7 2023-12-03T11:38:23.117 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:23.117 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:38:23.117 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-block-writes id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:38:23.117 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:23.118 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2023-12-03T11:38:23.151 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:23.151 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:23.166 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.164+0000 7f860b52d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.166+0000 7f860b52d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.166+0000 7f860b52d800 20 realm 2023-12-03T11:38:23.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.166+0000 7f860b52d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.169 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.166+0000 7f860b52d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.169 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.166+0000 7f860b52d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:23.169 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.166+0000 7f860b52d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.169 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.166+0000 7f860b52d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.169 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.166+0000 7f860b52d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.170 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.167+0000 7f860b52d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:23.170 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.167+0000 7f860b52d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.170 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.168+0000 7f860b52d800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:23.170 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.168+0000 7f860b52d800 20 searching for the correct realm 2023-12-03T11:38:23.180 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.178+0000 7f8607268640 0 -- 172.21.15.44:0/3146720397 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55894d250700 msgr2=0x55894d252b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:23.181 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.178+0000 7f860b52d800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:23.181 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.178+0000 7f860b52d800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:23.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.178+0000 7f860b52d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:23.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.178+0000 7f860b52d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:23.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.178+0000 7f860b52d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.178+0000 7f860b52d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.178+0000 7f860b52d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.179+0000 7f860b52d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:23.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.179+0000 7f860b52d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.179+0000 7f860b52d800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:23.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.179+0000 7f860b52d800 20 zone default found 2023-12-03T11:38:23.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.179+0000 7f860b52d800 4 Realm: () 2023-12-03T11:38:23.183 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.179+0000 7f860b52d800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:23.183 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.179+0000 7f860b52d800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:23.183 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.179+0000 7f860b52d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:23.183 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.179+0000 7f860b52d800 20 zonegroup default 2023-12-03T11:38:23.183 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.179+0000 7f860b52d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.183 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.179+0000 7f860b52d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.183 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.179+0000 7f860b52d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.183 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.180+0000 7f860b52d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.183 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.180+0000 7f860b52d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.184 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.180+0000 7f860b52d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.184 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.180+0000 7f860b52d800 20 started sync module instance, tier type = 2023-12-03T11:38:23.184 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.180+0000 7f860b52d800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:23.189 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.187+0000 7f8607a69640 0 -- 172.21.15.44:0/3146720397 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55894d2587e0 msgr2=0x55894d25aca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:23.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.188+0000 7f860b52d800 20 add_watcher() i=0 2023-12-03T11:38:23.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.188+0000 7f860b52d800 20 add_watcher() i=1 2023-12-03T11:38:23.191 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.188+0000 7f860b52d800 20 add_watcher() i=2 2023-12-03T11:38:23.191 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.188+0000 7f860b52d800 20 add_watcher() i=3 2023-12-03T11:38:23.191 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.188+0000 7f860b52d800 20 add_watcher() i=4 2023-12-03T11:38:23.191 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.189+0000 7f860b52d800 20 add_watcher() i=5 2023-12-03T11:38:23.191 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.189+0000 7f860b52d800 20 add_watcher() i=6 2023-12-03T11:38:23.191 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.189+0000 7f860b52d800 20 add_watcher() i=7 2023-12-03T11:38:23.192 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.189+0000 7f860b52d800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:23.193 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.191+0000 7f85cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:23.194 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.192+0000 7f860b52d800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:23.194 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.192+0000 7f860b52d800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:23.201 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.198+0000 7f860b52d800 5 note: GC not initialized 2023-12-03T11:38:23.201 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.198+0000 7f853bfff640 20 reqs_thread_entry: start 2023-12-03T11:38:23.201 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.198+0000 7f860b52d800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:23.201 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.198+0000 7f860b52d800 20 Filter name: none 2023-12-03T11:38:23.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.198+0000 7f8539ffb640 20 reqs_thread_entry: start 2023-12-03T11:38:23.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.198+0000 7f860b52d800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2023-12-03T11:38:23.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.198+0000 7f860b52d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.199+0000 7f860b52d800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:38:23.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.199+0000 7f860b52d800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2023-12-03T11:38:23.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.199+0000 7f860b52d800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2023-12-03T11:38:23.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.199+0000 7f860b52d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 : miss 2023-12-03T11:38:23.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.199+0000 7f860b52d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.199+0000 7f860b52d800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:38:23.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.199+0000 7f860b52d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 info.flags=0x17 2023-12-03T11:38:23.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.199+0000 7f860b52d800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 to cache LRU end 2023-12-03T11:38:23.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.199+0000 7f860b52d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:38:23.203 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.199+0000 7f860b52d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:23.203 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.199+0000 7f860b52d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 2023-12-03T11:38:23.205 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.203+0000 7f860b52d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 info.flags=0x17 2023-12-03T11:38:23.205 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.203+0000 7f860b52d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 to cache LRU end 2023-12-03T11:38:23.205 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.203+0000 7f860b52d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:23.205 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.203+0000 7f860b52d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21, ofs0, ns] 2023-12-03T11:38:23.206 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.203+0000 7f85edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693204 cookie 94048193217328 notifier 6636 bl.length()=877 2023-12-03T11:38:23.206 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.204+0000 7f85edffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 info.flags=0x17 2023-12-03T11:38:23.206 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.204+0000 7f85edffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 to cache LRU end 2023-12-03T11:38:23.206 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.204+0000 7f85edffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:23.206 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.204+0000 7f860b52d800 20 handle_bi_update(): bucket=:error-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21]): orig_sources= new_sources= 2023-12-03T11:38:23.206 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.204+0000 7f860b52d800 20 handle_bi_update(): bucket=:error-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21]): potential sources added=[] removed=[] 2023-12-03T11:38:23.206 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.204+0000 7f860b52d800 20 handle_bi_update(): bucket=:error-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21]): orig_dests= new_dests= 2023-12-03T11:38:23.207 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.204+0000 7f860b52d800 20 handle_bi_update(): bucket=:error-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21]): potential dests added=[] removed=[] 2023-12-03T11:38:23.207 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.204+0000 7f860b52d800 -1 Injecting error=-5 at location=block_writes 2023-12-03T11:38:23.207 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.204+0000 7f860b52d800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2023-12-03T11:38:23.207 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.205+0000 7f860b52d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 : hit (requested=0x17, cached=0x17) 2023-12-03T11:38:23.207 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.205+0000 7f860b52d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 2023-12-03T11:38:23.208 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.206+0000 7f860b52d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 info.flags=0x17 2023-12-03T11:38:23.208 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.206+0000 7f860b52d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 to cache LRU end 2023-12-03T11:38:23.208 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.206+0000 7f860b52d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:23.208 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.206+0000 7f860b52d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21, ofs0, ns] 2023-12-03T11:38:23.209 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.207+0000 7f85ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693205 cookie 94048193217328 notifier 6636 bl.length()=845 2023-12-03T11:38:23.209 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.207+0000 7f85ed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 info.flags=0x17 2023-12-03T11:38:23.209 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.207+0000 7f85ed7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 to cache LRU end 2023-12-03T11:38:23.209 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.207+0000 7f85ed7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:23.209 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.207+0000 7f860b52d800 20 handle_bi_update(): bucket=:error-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21]): orig_sources= new_sources= 2023-12-03T11:38:23.209 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.207+0000 7f860b52d800 20 handle_bi_update(): bucket=:error-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21]): potential sources added=[] removed=[] 2023-12-03T11:38:23.210 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.207+0000 7f860b52d800 20 handle_bi_update(): bucket=:error-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21]): orig_dests= new_dests= 2023-12-03T11:38:23.210 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.207+0000 7f860b52d800 20 handle_bi_update(): bucket=:error-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21]): potential dests added=[] removed=[] 2023-12-03T11:38:23.211 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.209+0000 7f85cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:23.213 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.211+0000 7f860b52d800 20 remove_watcher() i=0 2023-12-03T11:38:23.213 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.211+0000 7f860b52d800 2 removed watcher, disabling cache 2023-12-03T11:38:23.213 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.212+0000 7f860b52d800 20 remove_watcher() i=1 2023-12-03T11:38:23.214 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.213+0000 7f860b52d800 20 remove_watcher() i=2 2023-12-03T11:38:23.215 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.214+0000 7f860b52d800 20 remove_watcher() i=3 2023-12-03T11:38:23.216 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.215+0000 7f860b52d800 20 remove_watcher() i=4 2023-12-03T11:38:23.217 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.216+0000 7f860b52d800 20 remove_watcher() i=5 2023-12-03T11:38:23.218 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.216+0000 7f860b52d800 20 remove_watcher() i=6 2023-12-03T11:38:23.219 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.217+0000 7f860b52d800 20 remove_watcher() i=7 2023-12-03T11:38:23.226 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2023-12-03T11:38:23.254 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:23.254 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:23.269 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.267+0000 7f516c60f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.268+0000 7f516c60f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.268+0000 7f516c60f800 20 realm 2023-12-03T11:38:23.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.268+0000 7f516c60f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.269+0000 7f516c60f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.269+0000 7f516c60f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:23.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.269+0000 7f516c60f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.269+0000 7f516c60f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.269+0000 7f516c60f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.272 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.270+0000 7f516c60f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:23.272 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.270+0000 7f516c60f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.272 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.270+0000 7f516c60f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:23.272 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.270+0000 7f516c60f800 20 searching for the correct realm 2023-12-03T11:38:23.281 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.279+0000 7f516a910640 0 -- 172.21.15.44:0/3952875928 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x5604ec544870 msgr2=0x5604ec546d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:38:23.283 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.281+0000 7f516c60f800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:23.283 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.281+0000 7f516c60f800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:23.283 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.281+0000 7f516c60f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:23.283 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.281+0000 7f516c60f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:23.283 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.281+0000 7f516c60f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.283 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.281+0000 7f516c60f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.284 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.281+0000 7f516c60f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.282+0000 7f516c60f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:23.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.282+0000 7f516c60f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.282+0000 7f516c60f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:23.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.282+0000 7f516c60f800 20 zone default found 2023-12-03T11:38:23.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.282+0000 7f516c60f800 4 Realm: () 2023-12-03T11:38:23.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.282+0000 7f516c60f800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:23.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.282+0000 7f516c60f800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:23.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.282+0000 7f516c60f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:23.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.282+0000 7f516c60f800 20 zonegroup default 2023-12-03T11:38:23.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.282+0000 7f516c60f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.282+0000 7f516c60f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.282+0000 7f516c60f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.282+0000 7f516c60f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.282+0000 7f516c60f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.283+0000 7f516c60f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.283+0000 7f516c60f800 20 started sync module instance, tier type = 2023-12-03T11:38:23.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.283+0000 7f516c60f800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:23.289 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.287+0000 7f516a10f640 0 -- 172.21.15.44:0/3952875928 >> [v2:172.21.15.91:6808/776869758,v1:172.21.15.91:6809/776869758] conn(0x7f5164007bd0 msgr2=0x7f516405c900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:23.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.292+0000 7f516c60f800 20 add_watcher() i=0 2023-12-03T11:38:23.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.292+0000 7f516c60f800 20 add_watcher() i=1 2023-12-03T11:38:23.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.292+0000 7f516c60f800 20 add_watcher() i=2 2023-12-03T11:38:23.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.292+0000 7f516c60f800 20 add_watcher() i=3 2023-12-03T11:38:23.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.292+0000 7f516c60f800 20 add_watcher() i=4 2023-12-03T11:38:23.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.292+0000 7f516c60f800 20 add_watcher() i=5 2023-12-03T11:38:23.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.292+0000 7f516c60f800 20 add_watcher() i=6 2023-12-03T11:38:23.295 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.293+0000 7f516c60f800 20 add_watcher() i=7 2023-12-03T11:38:23.295 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.293+0000 7f516c60f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:23.296 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.294+0000 7f512ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:23.296 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.294+0000 7f516c60f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:23.297 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.295+0000 7f516c60f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:23.303 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.301+0000 7f516c60f800 5 note: GC not initialized 2023-12-03T11:38:23.303 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.301+0000 7f509effd640 20 reqs_thread_entry: start 2023-12-03T11:38:23.303 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.301+0000 7f516c60f800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:23.303 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.301+0000 7f516c60f800 20 Filter name: none 2023-12-03T11:38:23.303 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.301+0000 7f509cff9640 20 reqs_thread_entry: start 2023-12-03T11:38:23.303 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.301+0000 7f516c60f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.302+0000 7f516c60f800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:38:23.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.302+0000 7f516c60f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.302+0000 7f516c60f800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:38:23.305 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.302+0000 7f516c60f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:23.305 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.302+0000 7f516c60f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.305 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.303+0000 7f516c60f800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:38:23.305 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.303+0000 7f516c60f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.305 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.303+0000 7f516c60f800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:38:23.305 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.303+0000 7f516c60f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:23.306 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.304+0000 7f516c60f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.306 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.304+0000 7f516c60f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.307 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.305+0000 7f512ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:23.309 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.307+0000 7f516c60f800 20 remove_watcher() i=0 2023-12-03T11:38:23.310 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.307+0000 7f516c60f800 2 removed watcher, disabling cache 2023-12-03T11:38:23.310 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.308+0000 7f516c60f800 20 remove_watcher() i=1 2023-12-03T11:38:23.311 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.310+0000 7f516c60f800 20 remove_watcher() i=2 2023-12-03T11:38:23.312 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.310+0000 7f516c60f800 20 remove_watcher() i=3 2023-12-03T11:38:23.313 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.311+0000 7f516c60f800 20 remove_watcher() i=4 2023-12-03T11:38:23.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.312+0000 7f516c60f800 20 remove_watcher() i=5 2023-12-03T11:38:23.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.313+0000 7f516c60f800 20 remove_watcher() i=6 2023-12-03T11:38:23.316 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.314+0000 7f516c60f800 20 remove_watcher() i=7 2023-12-03T11:38:23.321 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:23.321 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:38:23.321 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-block-writes id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:38:23.321 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:23.372 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:38:23.404 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:23.405 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:23.420 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.418+0000 7f7f5bb26800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.422 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.420+0000 7f7f5bb26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.422 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.420+0000 7f7f5bb26800 20 realm 2023-12-03T11:38:23.422 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.420+0000 7f7f5bb26800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.422 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.420+0000 7f7f5bb26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.420+0000 7f7f5bb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:23.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.420+0000 7f7f5bb26800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.420+0000 7f7f5bb26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.420+0000 7f7f5bb26800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.421+0000 7f7f5bb26800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:23.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.421+0000 7f7f5bb26800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.424 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.422+0000 7f7f5bb26800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:23.424 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.422+0000 7f7f5bb26800 20 searching for the correct realm 2023-12-03T11:38:23.433 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.431+0000 7f7f57084640 0 -- 172.21.15.44:0/3630126108 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x55698ea9fc50 msgr2=0x55698eaa2040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:23.434 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.432+0000 7f7f5bb26800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:23.434 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.432+0000 7f7f5bb26800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:23.435 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.432+0000 7f7f5bb26800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:23.435 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.432+0000 7f7f5bb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:23.435 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.432+0000 7f7f5bb26800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.435 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.432+0000 7f7f5bb26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.435 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.432+0000 7f7f5bb26800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.433+0000 7f7f5bb26800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:23.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.433+0000 7f7f5bb26800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.433+0000 7f7f5bb26800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:23.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.433+0000 7f7f5bb26800 20 zone default found 2023-12-03T11:38:23.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.433+0000 7f7f5bb26800 4 Realm: () 2023-12-03T11:38:23.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.433+0000 7f7f5bb26800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:23.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.433+0000 7f7f5bb26800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:23.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.433+0000 7f7f5bb26800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:23.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.433+0000 7f7f5bb26800 20 zonegroup default 2023-12-03T11:38:23.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.433+0000 7f7f5bb26800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.433+0000 7f7f5bb26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.433+0000 7f7f5bb26800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.434+0000 7f7f5bb26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.434+0000 7f7f5bb26800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.434+0000 7f7f5bb26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.434+0000 7f7f5bb26800 20 started sync module instance, tier type = 2023-12-03T11:38:23.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.434+0000 7f7f5bb26800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:23.441 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.439+0000 7f7f57084640 0 -- 172.21.15.44:0/3630126108 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x7f7f30079e10 msgr2=0x7f7f3007c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:23.445 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.443+0000 7f7f5bb26800 20 add_watcher() i=0 2023-12-03T11:38:23.445 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.443+0000 7f7f5bb26800 20 add_watcher() i=1 2023-12-03T11:38:23.445 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.443+0000 7f7f5bb26800 20 add_watcher() i=2 2023-12-03T11:38:23.445 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.443+0000 7f7f5bb26800 20 add_watcher() i=3 2023-12-03T11:38:23.446 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.443+0000 7f7f5bb26800 20 add_watcher() i=4 2023-12-03T11:38:23.446 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.443+0000 7f7f5bb26800 20 add_watcher() i=5 2023-12-03T11:38:23.446 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.443+0000 7f7f5bb26800 20 add_watcher() i=6 2023-12-03T11:38:23.446 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.444+0000 7f7f5bb26800 20 add_watcher() i=7 2023-12-03T11:38:23.447 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.444+0000 7f7f5bb26800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:23.447 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.445+0000 7f7f1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:23.448 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.446+0000 7f7f5bb26800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:23.448 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.446+0000 7f7f5bb26800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:23.454 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.451+0000 7f7f5bb26800 5 note: GC not initialized 2023-12-03T11:38:23.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.452+0000 7f7e94ff9640 20 reqs_thread_entry: start 2023-12-03T11:38:23.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.452+0000 7f7f5bb26800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:23.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.452+0000 7f7f5bb26800 20 Filter name: none 2023-12-03T11:38:23.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.452+0000 7f7e8a7fc640 20 reqs_thread_entry: start 2023-12-03T11:38:23.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.452+0000 7f7f5bb26800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2023-12-03T11:38:23.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.452+0000 7f7f5bb26800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.452+0000 7f7f5bb26800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:38:23.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.452+0000 7f7f5bb26800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2023-12-03T11:38:23.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.452+0000 7f7f5bb26800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2023-12-03T11:38:23.457 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.452+0000 7f7f5bb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 : miss 2023-12-03T11:38:23.458 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.452+0000 7f7f5bb26800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.458 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.453+0000 7f7f5bb26800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:38:23.458 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.453+0000 7f7f5bb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 info.flags=0x17 2023-12-03T11:38:23.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.453+0000 7f7f5bb26800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 to cache LRU end 2023-12-03T11:38:23.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.453+0000 7f7f5bb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:38:23.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.453+0000 7f7f5bb26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:23.459 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.453+0000 7f7f5bb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 2023-12-03T11:38:23.460 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.457+0000 7f7f5bb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 info.flags=0x17 2023-12-03T11:38:23.460 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.457+0000 7f7f5bb26800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 to cache LRU end 2023-12-03T11:38:23.460 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.457+0000 7f7f5bb26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:23.460 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.457+0000 7f7f5bb26800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21, ofs0, ns] 2023-12-03T11:38:23.460 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.457+0000 7f7f3e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693206 cookie 93911853475792 notifier 6678 bl.length()=877 2023-12-03T11:38:23.460 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.457+0000 7f7f3e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 info.flags=0x17 2023-12-03T11:38:23.460 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.457+0000 7f7f3e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 to cache LRU end 2023-12-03T11:38:23.460 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.457+0000 7f7f3e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:23.461 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.458+0000 7f7f5bb26800 20 handle_bi_update(): bucket=:error-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21]): orig_sources= new_sources= 2023-12-03T11:38:23.461 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.458+0000 7f7f5bb26800 20 handle_bi_update(): bucket=:error-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21]): potential sources added=[] removed=[] 2023-12-03T11:38:23.461 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.458+0000 7f7f5bb26800 20 handle_bi_update(): bucket=:error-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21]): orig_dests= new_dests= 2023-12-03T11:38:23.461 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.458+0000 7f7f5bb26800 20 handle_bi_update(): bucket=:error-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21]): potential dests added=[] removed=[] 2023-12-03T11:38:23.461 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.459+0000 7f7f5bb26800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21.1.0 2023-12-03T11:38:23.462 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.459+0000 7f7f5bb26800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21.1.0 2023-12-03T11:38:23.462 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.459+0000 7f7f5bb26800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21.1.1 2023-12-03T11:38:23.462 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.459+0000 7f7f5bb26800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21.1.1 2023-12-03T11:38:23.462 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.459+0000 7f7f5bb26800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21.0 2023-12-03T11:38:23.463 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.461+0000 7f7f5bb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 : hit (requested=0x17, cached=0x17) 2023-12-03T11:38:23.463 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.461+0000 7f7f5bb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 2023-12-03T11:38:23.465 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.462+0000 7f7f5bb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 info.flags=0x17 2023-12-03T11:38:23.465 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.462+0000 7f7f5bb26800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 to cache LRU end 2023-12-03T11:38:23.465 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.462+0000 7f7f5bb26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:23.465 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.462+0000 7f7f5bb26800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21, ofs0, ns] 2023-12-03T11:38:23.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.463+0000 7f7f3dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693207 cookie 93911853475792 notifier 6678 bl.length()=845 2023-12-03T11:38:23.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.463+0000 7f7f3dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 info.flags=0x17 2023-12-03T11:38:23.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.463+0000 7f7f3dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 to cache LRU end 2023-12-03T11:38:23.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.463+0000 7f7f3dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:23.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.463+0000 7f7f5bb26800 20 handle_bi_update(): bucket=:error-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21]): orig_sources= new_sources= 2023-12-03T11:38:23.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.463+0000 7f7f5bb26800 20 handle_bi_update(): bucket=:error-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21]): potential sources added=[] removed=[] 2023-12-03T11:38:23.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.463+0000 7f7f5bb26800 20 handle_bi_update(): bucket=:error-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21]): orig_dests= new_dests= 2023-12-03T11:38:23.466 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.463+0000 7f7f5bb26800 20 handle_bi_update(): bucket=:error-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21]): potential dests added=[] removed=[] 2023-12-03T11:38:23.467 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.464+0000 7f7f5bb26800 1 execute INFO: reshard of bucket "error-at-block-writes" completed successfully 2023-12-03T11:38:23.468 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.466+0000 7f7f1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:23.470 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.468+0000 7f7f5bb26800 20 remove_watcher() i=0 2023-12-03T11:38:23.470 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.468+0000 7f7f5bb26800 2 removed watcher, disabling cache 2023-12-03T11:38:23.471 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.469+0000 7f7f5bb26800 20 remove_watcher() i=1 2023-12-03T11:38:23.472 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.470+0000 7f7f5bb26800 20 remove_watcher() i=2 2023-12-03T11:38:23.473 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.471+0000 7f7f5bb26800 20 remove_watcher() i=3 2023-12-03T11:38:23.474 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.472+0000 7f7f5bb26800 20 remove_watcher() i=4 2023-12-03T11:38:23.475 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.473+0000 7f7f5bb26800 20 remove_watcher() i=5 2023-12-03T11:38:23.476 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.474+0000 7f7f5bb26800 20 remove_watcher() i=6 2023-12-03T11:38:23.477 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.475+0000 7f7f5bb26800 20 remove_watcher() i=7 2023-12-03T11:38:23.483 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2023-12-03T11:38:23.511 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:23.511 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:23.526 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.524+0000 7efc47213800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.528 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.525+0000 7efc47213800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.528 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.525+0000 7efc47213800 20 realm 2023-12-03T11:38:23.528 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.525+0000 7efc47213800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.528 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.526+0000 7efc47213800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.528 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.526+0000 7efc47213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:23.528 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.526+0000 7efc47213800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.528 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.526+0000 7efc47213800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.528 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.526+0000 7efc47213800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.529 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.527+0000 7efc47213800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:23.529 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.527+0000 7efc47213800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.529 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.527+0000 7efc47213800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:23.530 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.527+0000 7efc47213800 20 searching for the correct realm 2023-12-03T11:38:23.538 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.536+0000 7efc4551b640 0 -- 172.21.15.44:0/4175104197 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55b3dc9e2ae0 msgr2=0x55b3dc9e4fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:38:23.540 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.538+0000 7efc47213800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:23.540 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.538+0000 7efc47213800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:23.540 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.538+0000 7efc47213800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:23.540 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.538+0000 7efc47213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:23.541 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.538+0000 7efc47213800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.541 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.539+0000 7efc47213800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.541 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.539+0000 7efc47213800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.541 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.539+0000 7efc47213800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:23.541 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.539+0000 7efc47213800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.542 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.539+0000 7efc47213800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:23.542 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.540+0000 7efc47213800 20 zone default found 2023-12-03T11:38:23.542 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.540+0000 7efc47213800 4 Realm: () 2023-12-03T11:38:23.542 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.540+0000 7efc47213800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:23.542 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.540+0000 7efc47213800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:23.542 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.540+0000 7efc47213800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:23.542 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.540+0000 7efc47213800 20 zonegroup default 2023-12-03T11:38:23.543 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.540+0000 7efc47213800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.543 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.540+0000 7efc47213800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.543 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.540+0000 7efc47213800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.543 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.540+0000 7efc47213800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.543 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.540+0000 7efc47213800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.543 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.540+0000 7efc47213800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.543 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.540+0000 7efc47213800 20 started sync module instance, tier type = 2023-12-03T11:38:23.543 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.540+0000 7efc47213800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:23.547 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.545+0000 7efc44519640 0 -- 172.21.15.44:0/4175104197 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x55b3dc9de220 msgr2=0x55b3dc9e0610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:23.551 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.549+0000 7efc47213800 20 add_watcher() i=0 2023-12-03T11:38:23.551 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.549+0000 7efc47213800 20 add_watcher() i=1 2023-12-03T11:38:23.552 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.549+0000 7efc47213800 20 add_watcher() i=2 2023-12-03T11:38:23.552 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.549+0000 7efc47213800 20 add_watcher() i=3 2023-12-03T11:38:23.552 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.549+0000 7efc47213800 20 add_watcher() i=4 2023-12-03T11:38:23.552 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.549+0000 7efc47213800 20 add_watcher() i=5 2023-12-03T11:38:23.552 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.549+0000 7efc47213800 20 add_watcher() i=6 2023-12-03T11:38:23.552 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.550+0000 7efc47213800 20 add_watcher() i=7 2023-12-03T11:38:23.552 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.550+0000 7efc47213800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:23.554 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.552+0000 7efc0afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:23.554 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.553+0000 7efc47213800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:23.555 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.553+0000 7efc47213800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:23.560 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.558+0000 7efc47213800 5 note: GC not initialized 2023-12-03T11:38:23.561 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.559+0000 7efb79ffb640 20 reqs_thread_entry: start 2023-12-03T11:38:23.561 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.559+0000 7efc47213800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:23.561 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.559+0000 7efc47213800 20 Filter name: none 2023-12-03T11:38:23.561 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.559+0000 7efb6b7fe640 20 reqs_thread_entry: start 2023-12-03T11:38:23.562 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.559+0000 7efc47213800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.562 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.560+0000 7efc47213800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:38:23.562 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.560+0000 7efc47213800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.563 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.560+0000 7efc47213800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:38:23.563 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.560+0000 7efc47213800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:23.563 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.560+0000 7efc47213800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.563 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.561+0000 7efc47213800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:38:23.563 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.561+0000 7efc47213800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.563 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.561+0000 7efc47213800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:38:23.563 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.561+0000 7efc47213800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:23.563 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.561+0000 7efc47213800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.564 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.562+0000 7efc47213800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.564 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.562+0000 7efc0afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:23.566 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.565+0000 7efc47213800 20 remove_watcher() i=0 2023-12-03T11:38:23.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.565+0000 7efc47213800 2 removed watcher, disabling cache 2023-12-03T11:38:23.567 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.565+0000 7efc47213800 20 remove_watcher() i=1 2023-12-03T11:38:23.568 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.566+0000 7efc47213800 20 remove_watcher() i=2 2023-12-03T11:38:23.570 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.568+0000 7efc47213800 20 remove_watcher() i=3 2023-12-03T11:38:23.571 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.569+0000 7efc47213800 20 remove_watcher() i=4 2023-12-03T11:38:23.572 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.570+0000 7efc47213800 20 remove_watcher() i=5 2023-12-03T11:38:23.573 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.571+0000 7efc47213800 20 remove_watcher() i=6 2023-12-03T11:38:23.574 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.572+0000 7efc47213800 20 remove_watcher() i=7 2023-12-03T11:38:23.579 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:23.579 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:38:23.579 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-block-writes id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.21 num_objects: 19 size_kb: 1 num_shards: 2 2023-12-03T11:38:23.579 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:23.658 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with abort at block_writes 2023-12-03T11:38:23.658 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:23.839 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2023-12-03T11:38:23.866 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:23.866 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:23.881 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.879+0000 7f033480f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.880+0000 7f033480f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.880+0000 7f033480f800 20 realm 2023-12-03T11:38:23.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.880+0000 7f033480f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.881+0000 7f033480f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.881+0000 7f033480f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:23.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.881+0000 7f033480f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.881+0000 7f033480f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.881+0000 7f033480f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.882+0000 7f033480f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:23.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.882+0000 7f033480f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.882+0000 7f033480f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:23.885 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.882+0000 7f033480f800 20 searching for the correct realm 2023-12-03T11:38:23.892 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.890+0000 7f033061b640 0 -- 172.21.15.44:0/2514219776 >> [v2:172.21.15.44:6808/1530174506,v1:172.21.15.44:6809/1530174506] conn(0x55c3529690f0 msgr2=0x55c35296b4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:23.895 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.893+0000 7f032fe1a640 0 -- 172.21.15.44:0/2514219776 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x7f0324060a20 msgr2=0x7f0308081490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:23.896 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.894+0000 7f033480f800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:23.897 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.894+0000 7f033480f800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:23.897 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.894+0000 7f033480f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:23.897 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.894+0000 7f033480f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:23.897 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.894+0000 7f033480f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.897 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.894+0000 7f033480f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.897 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.894+0000 7f033480f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.898 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.895+0000 7f033480f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:23.898 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.895+0000 7f033480f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.898 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.895+0000 7f033480f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:23.898 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.895+0000 7f033480f800 20 zone default found 2023-12-03T11:38:23.898 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.895+0000 7f033480f800 4 Realm: () 2023-12-03T11:38:23.898 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.895+0000 7f033480f800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:23.899 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.895+0000 7f033480f800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:23.899 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.895+0000 7f033480f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:23.899 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.895+0000 7f033480f800 20 zonegroup default 2023-12-03T11:38:23.899 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.895+0000 7f033480f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.899 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.896+0000 7f033480f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.899 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.896+0000 7f033480f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.899 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.896+0000 7f033480f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.899 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.896+0000 7f033480f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.899 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.896+0000 7f033480f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.899 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.896+0000 7f033480f800 20 started sync module instance, tier type = 2023-12-03T11:38:23.899 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.896+0000 7f033480f800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:23.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.905+0000 7f033480f800 20 add_watcher() i=0 2023-12-03T11:38:23.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.905+0000 7f033480f800 20 add_watcher() i=1 2023-12-03T11:38:23.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.905+0000 7f033480f800 20 add_watcher() i=2 2023-12-03T11:38:23.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.905+0000 7f033480f800 20 add_watcher() i=3 2023-12-03T11:38:23.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.905+0000 7f033480f800 20 add_watcher() i=4 2023-12-03T11:38:23.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.905+0000 7f033480f800 20 add_watcher() i=5 2023-12-03T11:38:23.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.906+0000 7f033480f800 20 add_watcher() i=6 2023-12-03T11:38:23.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.906+0000 7f033480f800 20 add_watcher() i=7 2023-12-03T11:38:23.908 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.906+0000 7f033480f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:23.910 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.908+0000 7f02f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:23.910 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.908+0000 7f033480f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:23.910 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.908+0000 7f033480f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:23.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.915+0000 7f033480f800 5 note: GC not initialized 2023-12-03T11:38:23.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.915+0000 7f026cff9640 20 reqs_thread_entry: start 2023-12-03T11:38:23.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.915+0000 7f033480f800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:23.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.915+0000 7f033480f800 20 Filter name: none 2023-12-03T11:38:23.918 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.915+0000 7f02627fc640 20 reqs_thread_entry: start 2023-12-03T11:38:23.918 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.915+0000 7f033480f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.916+0000 7f033480f800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:38:23.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.916+0000 7f033480f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.916+0000 7f033480f800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:38:23.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.916+0000 7f033480f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:23.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.916+0000 7f033480f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.916+0000 7f033480f800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:38:23.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.916+0000 7f033480f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.917+0000 7f033480f800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:38:23.919 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.917+0000 7f033480f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:23.920 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.917+0000 7f033480f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.920 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.918+0000 7f033480f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.920 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.918+0000 7f02f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:23.923 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.921+0000 7f033480f800 20 remove_watcher() i=0 2023-12-03T11:38:23.923 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.921+0000 7f033480f800 2 removed watcher, disabling cache 2023-12-03T11:38:23.923 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.921+0000 7f033480f800 20 remove_watcher() i=1 2023-12-03T11:38:23.924 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.923+0000 7f033480f800 20 remove_watcher() i=2 2023-12-03T11:38:23.925 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.924+0000 7f033480f800 20 remove_watcher() i=3 2023-12-03T11:38:23.927 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.925+0000 7f033480f800 20 remove_watcher() i=4 2023-12-03T11:38:23.928 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.926+0000 7f033480f800 20 remove_watcher() i=5 2023-12-03T11:38:23.929 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.927+0000 7f033480f800 20 remove_watcher() i=6 2023-12-03T11:38:23.930 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.928+0000 7f033480f800 20 remove_watcher() i=7 2023-12-03T11:38:23.934 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:23.935 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:38:23.935 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-block-writes id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:38:23.935 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:23.936 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2023-12-03T11:38:23.969 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:23.969 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:23.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.981+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.983+0000 7fe7ae931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.983+0000 7fe7ae931800 20 realm 2023-12-03T11:38:23.986 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.983+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.986 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.983+0000 7fe7ae931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.986 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.983+0000 7fe7ae931800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:23.986 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.983+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.986 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.983+0000 7fe7ae931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.986 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.983+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.986 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.984+0000 7fe7ae931800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:23.986 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.984+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.985+0000 7fe7ae931800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:23.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.985+0000 7fe7ae931800 20 searching for the correct realm 2023-12-03T11:38:23.996 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.994+0000 7fe7aa57e640 0 -- 172.21.15.44:0/2550213081 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55af404badc0 msgr2=0x55af404bd1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:23.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.995+0000 7fe7ae931800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:23.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.995+0000 7fe7ae931800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:23.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.995+0000 7fe7ae931800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:23.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.995+0000 7fe7ae931800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:23.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.995+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:23.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:23.999 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:23.999 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:24.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.996+0000 7fe7ae931800 20 zone default found 2023-12-03T11:38:24.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.996+0000 7fe7ae931800 4 Realm: () 2023-12-03T11:38:24.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.996+0000 7fe7ae931800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:24.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.996+0000 7fe7ae931800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:24.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.996+0000 7fe7ae931800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:24.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.996+0000 7fe7ae931800 20 zonegroup default 2023-12-03T11:38:24.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.001 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.001 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.997+0000 7fe7ae931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.001 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.997+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.001 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.997+0000 7fe7ae931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.001 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.997+0000 7fe7ae931800 20 started sync module instance, tier type = 2023-12-03T11:38:24.001 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:23.997+0000 7fe7ae931800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:24.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.003+0000 7fe7aad7f640 0 -- 172.21.15.44:0/2550213081 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55af404c2d80 msgr2=0x55af404c5240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:24.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.006+0000 7fe7ae931800 20 add_watcher() i=0 2023-12-03T11:38:24.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.006+0000 7fe7ae931800 20 add_watcher() i=1 2023-12-03T11:38:24.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.006+0000 7fe7ae931800 20 add_watcher() i=2 2023-12-03T11:38:24.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.006+0000 7fe7ae931800 20 add_watcher() i=3 2023-12-03T11:38:24.008 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.006+0000 7fe7ae931800 20 add_watcher() i=4 2023-12-03T11:38:24.009 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.006+0000 7fe7ae931800 20 add_watcher() i=5 2023-12-03T11:38:24.009 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.006+0000 7fe7ae931800 20 add_watcher() i=6 2023-12-03T11:38:24.009 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.007+0000 7fe7ae931800 20 add_watcher() i=7 2023-12-03T11:38:24.009 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.007+0000 7fe7ae931800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:24.010 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.009+0000 7fe76ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:24.011 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.009+0000 7fe7ae931800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:24.011 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.009+0000 7fe7ae931800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:24.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.015+0000 7fe7ae931800 5 note: GC not initialized 2023-12-03T11:38:24.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.015+0000 7fe6deffd640 20 reqs_thread_entry: start 2023-12-03T11:38:24.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.015+0000 7fe7ae931800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:24.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.015+0000 7fe7ae931800 20 Filter name: none 2023-12-03T11:38:24.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.016+0000 7fe6dcff9640 20 reqs_thread_entry: start 2023-12-03T11:38:24.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.016+0000 7fe7ae931800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2023-12-03T11:38:24.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.016+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.019 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.016+0000 7fe7ae931800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:38:24.019 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.016+0000 7fe7ae931800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2023-12-03T11:38:24.019 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.016+0000 7fe7ae931800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2023-12-03T11:38:24.019 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.016+0000 7fe7ae931800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 : miss 2023-12-03T11:38:24.019 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.016+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.019 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.017+0000 7fe7ae931800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:38:24.019 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.017+0000 7fe7ae931800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 info.flags=0x17 2023-12-03T11:38:24.019 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.017+0000 7fe7ae931800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 to cache LRU end 2023-12-03T11:38:24.019 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.017+0000 7fe7ae931800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:38:24.020 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.017+0000 7fe7ae931800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:24.020 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.017+0000 7fe7ae931800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 2023-12-03T11:38:24.023 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.021+0000 7fe7ae931800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 info.flags=0x17 2023-12-03T11:38:24.023 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.021+0000 7fe7ae931800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 to cache LRU end 2023-12-03T11:38:24.024 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.021+0000 7fe7ae931800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:24.024 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.021+0000 7fe7ae931800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22, ofs0, ns] 2023-12-03T11:38:24.024 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.022+0000 7fe798ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693277 cookie 94211186373040 notifier 6395 bl.length()=877 2023-12-03T11:38:24.024 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.022+0000 7fe798ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 info.flags=0x17 2023-12-03T11:38:24.024 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.022+0000 7fe798ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 to cache LRU end 2023-12-03T11:38:24.024 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.022+0000 7fe798ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:24.025 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.022+0000 7fe7ae931800 20 handle_bi_update(): bucket=:abort-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22]): orig_sources= new_sources= 2023-12-03T11:38:24.025 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.022+0000 7fe7ae931800 20 handle_bi_update(): bucket=:abort-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22]): potential sources added=[] removed=[] 2023-12-03T11:38:24.025 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.022+0000 7fe7ae931800 20 handle_bi_update(): bucket=:abort-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22]): orig_dests= new_dests= 2023-12-03T11:38:24.025 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.022+0000 7fe7ae931800 20 handle_bi_update(): bucket=:abort-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22]): potential dests added=[] removed=[] 2023-12-03T11:38:24.025 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe7ae931800 time 2023-12-03T11:38:24.024323+0000 2023-12-03T11:38:24.025 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:38:24.025 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:38:24.025 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe7b156eef8] 2023-12-03T11:38:24.026 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7fe7b156f0b6] 2023-12-03T11:38:24.026 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af3ebbca71] 2023-12-03T11:38:24.026 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55af3ebc8ec4] 2023-12-03T11:38:24.026 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2023-12-03T11:38:24.026 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fe7aec3feb0] 2023-12-03T11:38:24.026 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2023-12-03T11:38:24.026 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2023-12-03T11:38:24.026 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.023+0000 7fe7ae931800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe7ae931800 time 2023-12-03T11:38:24.024323+0000 2023-12-03T11:38:24.026 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:38:24.027 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.027 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:38:24.027 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe7b156eef8] 2023-12-03T11:38:24.027 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7fe7b156f0b6] 2023-12-03T11:38:24.027 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af3ebbca71] 2023-12-03T11:38:24.027 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55af3ebc8ec4] 2023-12-03T11:38:24.027 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2023-12-03T11:38:24.027 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fe7aec3feb0] 2023-12-03T11:38:24.027 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2023-12-03T11:38:24.028 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2023-12-03T11:38:24.028 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.028 INFO:tasks.workunit.client.0.smithi044.stderr:*** Caught signal (Aborted) ** 2023-12-03T11:38:24.028 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7fe7ae931800 thread_name:radosgw-admin 2023-12-03T11:38:24.046 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:38:24.047 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fe7aec54db0] 2023-12-03T11:38:24.047 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fe7aeca154c] 2023-12-03T11:38:24.047 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2023-12-03T11:38:24.047 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2023-12-03T11:38:24.047 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe7b156ef52] 2023-12-03T11:38:24.047 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7fe7b156f0b6] 2023-12-03T11:38:24.047 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af3ebbca71] 2023-12-03T11:38:24.047 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55af3ebc8ec4] 2023-12-03T11:38:24.047 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2023-12-03T11:38:24.047 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fe7aec3feb0] 2023-12-03T11:38:24.047 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2023-12-03T11:38:24.047 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2023-12-03T11:38:24.047 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.023+0000 7fe7ae931800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:38:24.048 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7fe7ae931800 thread_name:radosgw-admin 2023-12-03T11:38:24.048 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.048 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:38:24.048 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fe7aec54db0] 2023-12-03T11:38:24.048 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fe7aeca154c] 2023-12-03T11:38:24.048 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2023-12-03T11:38:24.048 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2023-12-03T11:38:24.048 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe7b156ef52] 2023-12-03T11:38:24.048 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7fe7b156f0b6] 2023-12-03T11:38:24.048 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af3ebbca71] 2023-12-03T11:38:24.048 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55af3ebc8ec4] 2023-12-03T11:38:24.048 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2023-12-03T11:38:24.048 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fe7aec3feb0] 2023-12-03T11:38:24.048 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2023-12-03T11:38:24.049 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2023-12-03T11:38:24.049 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:38:24.049 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.049 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2023-12-03T11:38:24.049 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2023-12-03T11:38:23.976+0000 7fe7ae931800 10 monclient: _renew_subs 2023-12-03T11:38:24.049 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2023-12-03T11:38:23.976+0000 7fe7ae931800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2023-12-03T11:38:24.049 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2023-12-03T11:38:23.976+0000 7fe7ae931800 1 librados: init done 2023-12-03T11:38:24.049 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2023-12-03T11:38:23.976+0000 7fe7ae931800 10 monclient: get_monmap_and_config 2023-12-03T11:38:24.049 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2023-12-03T11:38:23.976+0000 7fe7ae931800 10 monclient: build_initial_monmap 2023-12-03T11:38:24.049 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2023-12-03T11:38:23.976+0000 7fe7ae931800 1 build_initial for_mkfs: 0 2023-12-03T11:38:24.049 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2023-12-03T11:38:23.976+0000 7fe7ae931800 10 monclient: monmap: 2023-12-03T11:38:24.049 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:38:24.049 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:38:24.049 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:38:24.049 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:38:24.049 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:38:24.050 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.050 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:38:24.050 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:38:24.050 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:38:24.050 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.050 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding auth protocol: cephx 2023-12-03T11:38:24.050 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding auth protocol: cephx 2023-12-03T11:38:24.050 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding auth protocol: cephx 2023-12-03T11:38:24.050 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: secure 2023-12-03T11:38:24.050 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: crc 2023-12-03T11:38:24.050 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: secure 2023-12-03T11:38:24.050 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: crc 2023-12-03T11:38:24.050 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: secure 2023-12-03T11:38:24.050 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: crc 2023-12-03T11:38:24.050 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: crc 2023-12-03T11:38:24.051 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: secure 2023-12-03T11:38:24.051 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: crc 2023-12-03T11:38:24.051 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: secure 2023-12-03T11:38:24.051 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: crc 2023-12-03T11:38:24.051 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: secure 2023-12-03T11:38:24.051 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2023-12-03T11:38:23.977+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.051 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2023-12-03T11:38:23.977+0000 7fe7ae931800 10 monclient: init 2023-12-03T11:38:24.051 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding auth protocol: cephx 2023-12-03T11:38:24.051 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding auth protocol: cephx 2023-12-03T11:38:24.051 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding auth protocol: cephx 2023-12-03T11:38:24.051 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: secure 2023-12-03T11:38:24.051 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: crc 2023-12-03T11:38:24.051 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: secure 2023-12-03T11:38:24.051 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: crc 2023-12-03T11:38:24.051 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: secure 2023-12-03T11:38:24.051 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: crc 2023-12-03T11:38:24.052 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: crc 2023-12-03T11:38:24.052 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: secure 2023-12-03T11:38:24.052 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: crc 2023-12-03T11:38:24.052 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: secure 2023-12-03T11:38:24.052 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: crc 2023-12-03T11:38:24.052 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: secure 2023-12-03T11:38:24.052 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2023-12-03T11:38:23.977+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.052 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2023-12-03T11:38:23.977+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.052 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command rotate-key cmddesc rotate-key hook 0x7ffe0e0b1a88 EEXIST 2023-12-03T11:38:24.052 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2023-12-03T11:38:23.977+0000 7fe7ae931800 10 monclient: _reopen_session rank -1 2023-12-03T11:38:24.052 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2023-12-03T11:38:23.977+0000 7fe7ae931800 10 monclient: _add_conns ranks=[0,2,1] 2023-12-03T11:38:24.052 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2023-12-03T11:38:23.977+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-a con 0x55af40490bf0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:38:24.052 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2023-12-03T11:38:23.977+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-c con 0x55af40491510 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:38:24.052 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2023-12-03T11:38:23.977+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-b con 0x55af4049b820 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:38:24.053 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2023-12-03T11:38:23.977+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.053 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2023-12-03T11:38:23.977+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.053 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2023-12-03T11:38:23.977+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.053 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2023-12-03T11:38:23.977+0000 7fe7ae931800 10 monclient(hunting): _renew_subs 2023-12-03T11:38:24.053 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2023-12-03T11:38:23.977+0000 7fe7ae931800 10 monclient(hunting): authenticate will time out at 1583.204391s 2023-12-03T11:38:24.053 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2023-12-03T11:38:23.977+0000 7fe7aa57e640 10 monclient(hunting): get_auth_request con 0x55af40491510 auth_method 0 2023-12-03T11:38:24.053 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2023-12-03T11:38:23.977+0000 7fe7aa57e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.053 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2023-12-03T11:38:23.977+0000 7fe7aa57e640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.053 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2023-12-03T11:38:23.977+0000 7fe7aa57e640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.053 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2023-12-03T11:38:23.977+0000 7fe7aad7f640 10 monclient(hunting): get_auth_request con 0x55af40490bf0 auth_method 0 2023-12-03T11:38:24.053 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2023-12-03T11:38:23.977+0000 7fe7aad7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.053 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2023-12-03T11:38:23.977+0000 7fe7aad7f640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.053 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2023-12-03T11:38:23.977+0000 7fe7aad7f640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.053 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2023-12-03T11:38:23.977+0000 7fe7a9d7d640 10 monclient(hunting): get_auth_request con 0x55af4049b820 auth_method 0 2023-12-03T11:38:24.053 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2023-12-03T11:38:23.977+0000 7fe7a9d7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.054 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2023-12-03T11:38:23.977+0000 7fe7a9d7d640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.054 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2023-12-03T11:38:23.977+0000 7fe7a9d7d640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.054 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2023-12-03T11:38:23.977+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.054 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2023-12-03T11:38:23.977+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.054 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2023-12-03T11:38:23.977+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.054 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2023-12-03T11:38:23.977+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.054 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2023-12-03T11:38:23.977+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.054 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2023-12-03T11:38:23.977+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.054 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2023-12-03T11:38:23.977+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.054 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2023-12-03T11:38:23.977+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.054 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2023-12-03T11:38:23.978+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.054 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2023-12-03T11:38:23.978+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_done global_id 6392 payload 274 2023-12-03T11:38:24.054 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2023-12-03T11:38:23.978+0000 7fe7aa57e640 10 monclient: _finish_hunting 0 2023-12-03T11:38:24.054 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2023-12-03T11:38:23.978+0000 7fe7aa57e640 1 monclient: found mon.noname-c 2023-12-03T11:38:24.055 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2023-12-03T11:38:23.978+0000 7fe7aa57e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2023-12-03T11:38:24.055 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2023-12-03T11:38:23.978+0000 7fe79b7fe640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:38:24.055 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2023-12-03T11:38:23.978+0000 7fe79b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:24.055 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2023-12-03T11:38:23.978+0000 7fe79b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:24.055 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2023-12-03T11:38:23.978+0000 7fe7aad7f640 10 monclient: get_auth_request con 0x7fe78c069820 auth_method 0 2023-12-03T11:38:24.055 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2023-12-03T11:38:23.978+0000 7fe798ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:24.055 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2023-12-03T11:38:23.978+0000 7fe798ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:38:24.055 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2023-12-03T11:38:23.978+0000 7fe798ff9640 10 monclient: dump: 2023-12-03T11:38:24.055 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:24.055 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:24.055 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.055 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.055 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:24.055 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.055 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:24.055 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:24.056 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:24.056 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.056 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2023-12-03T11:38:23.978+0000 7fe798ff9640 10 monclient: _finish_auth 0 2023-12-03T11:38:24.056 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2023-12-03T11:38:23.978+0000 7fe798ff9640 10 monclient: _check_auth_tickets 2023-12-03T11:38:24.056 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2023-12-03T11:38:23.978+0000 7fe798ff9640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:38:24.056 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2023-12-03T11:38:23.978+0000 7fe798ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:24.056 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2023-12-03T11:38:23.978+0000 7fe798ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:38:24.056 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2023-12-03T11:38:23.978+0000 7fe798ff9640 10 monclient: dump: 2023-12-03T11:38:24.056 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:24.056 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:24.056 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.056 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.056 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:24.056 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.056 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:24.056 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:24.057 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:24.057 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.057 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2023-12-03T11:38:23.978+0000 7fe7ae931800 5 monclient: authenticate success, global_id 6392 2023-12-03T11:38:24.057 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2023-12-03T11:38:23.978+0000 7fe7ae931800 10 monclient: get_monmap_and_config success 2023-12-03T11:38:24.057 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2023-12-03T11:38:23.978+0000 7fe7ae931800 4 set_mon_vals no callback set 2023-12-03T11:38:24.057 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2023-12-03T11:38:23.979+0000 7fe7ae931800 10 monclient: shutdown 2023-12-03T11:38:24.057 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2023-12-03T11:38:23.979+0000 7fe7ae931800 10 monclient: build_initial_monmap 2023-12-03T11:38:24.057 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2023-12-03T11:38:23.979+0000 7fe7ae931800 1 build_initial for_mkfs: 0 2023-12-03T11:38:24.057 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2023-12-03T11:38:23.979+0000 7fe7ae931800 10 monclient: monmap: 2023-12-03T11:38:24.057 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:38:24.057 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:38:24.057 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:38:24.057 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:38:24.057 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:38:24.057 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.057 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:38:24.058 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:38:24.058 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:38:24.058 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.058 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding auth protocol: cephx 2023-12-03T11:38:24.058 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding auth protocol: cephx 2023-12-03T11:38:24.058 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding auth protocol: cephx 2023-12-03T11:38:24.058 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: secure 2023-12-03T11:38:24.058 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: crc 2023-12-03T11:38:24.058 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: secure 2023-12-03T11:38:24.058 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: crc 2023-12-03T11:38:24.058 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: secure 2023-12-03T11:38:24.058 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: crc 2023-12-03T11:38:24.058 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: crc 2023-12-03T11:38:24.058 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: secure 2023-12-03T11:38:24.058 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: crc 2023-12-03T11:38:24.059 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: secure 2023-12-03T11:38:24.059 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: crc 2023-12-03T11:38:24.059 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: secure 2023-12-03T11:38:24.059 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2023-12-03T11:38:23.979+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.059 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2023-12-03T11:38:23.979+0000 7fe7ae931800 1 librados: starting msgr at 2023-12-03T11:38:24.059 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2023-12-03T11:38:23.979+0000 7fe7ae931800 1 librados: starting objecter 2023-12-03T11:38:24.059 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command objecter_requests cmddesc objecter_requests hook 0x55af4046b5b0 EEXIST 2023-12-03T11:38:24.059 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2023-12-03T11:38:23.979+0000 7fe7ae931800 1 librados: setting wanted keys 2023-12-03T11:38:24.059 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2023-12-03T11:38:23.979+0000 7fe7ae931800 1 librados: calling monclient init 2023-12-03T11:38:24.059 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2023-12-03T11:38:23.979+0000 7fe7ae931800 10 monclient: init 2023-12-03T11:38:24.059 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding auth protocol: cephx 2023-12-03T11:38:24.059 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding auth protocol: cephx 2023-12-03T11:38:24.059 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding auth protocol: cephx 2023-12-03T11:38:24.059 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: secure 2023-12-03T11:38:24.059 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: crc 2023-12-03T11:38:24.060 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: secure 2023-12-03T11:38:24.060 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: crc 2023-12-03T11:38:24.060 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: secure 2023-12-03T11:38:24.060 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: crc 2023-12-03T11:38:24.060 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: crc 2023-12-03T11:38:24.060 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: secure 2023-12-03T11:38:24.060 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: crc 2023-12-03T11:38:24.060 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: secure 2023-12-03T11:38:24.060 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: crc 2023-12-03T11:38:24.060 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: secure 2023-12-03T11:38:24.060 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2023-12-03T11:38:23.979+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.060 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2023-12-03T11:38:23.980+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.060 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2023-12-03T11:38:23.980+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command rotate-key cmddesc rotate-key hook 0x55af404683f0 EEXIST 2023-12-03T11:38:24.060 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient: _reopen_session rank -1 2023-12-03T11:38:24.060 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient: _add_conns ranks=[0,2,1] 2023-12-03T11:38:24.061 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-a con 0x55af40490bf0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:38:24.061 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-c con 0x55af4049b820 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:38:24.061 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-b con 0x55af40491d60 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:38:24.061 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.061 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.061 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.061 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient(hunting): _renew_subs 2023-12-03T11:38:24.061 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient(hunting): authenticate will time out at 1583.206808s 2023-12-03T11:38:24.061 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2023-12-03T11:38:23.980+0000 7fe7aa57e640 10 monclient(hunting): get_auth_request con 0x55af40490bf0 auth_method 0 2023-12-03T11:38:24.061 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2023-12-03T11:38:23.980+0000 7fe7aa57e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.061 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2023-12-03T11:38:23.980+0000 7fe7aa57e640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.061 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2023-12-03T11:38:23.980+0000 7fe7aa57e640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.061 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2023-12-03T11:38:23.980+0000 7fe7a9d7d640 10 monclient(hunting): get_auth_request con 0x55af4049b820 auth_method 0 2023-12-03T11:38:24.061 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2023-12-03T11:38:23.980+0000 7fe7a9d7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.061 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2023-12-03T11:38:23.980+0000 7fe7a9d7d640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.062 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2023-12-03T11:38:23.980+0000 7fe7a9d7d640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.062 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2023-12-03T11:38:23.980+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.062 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2023-12-03T11:38:23.980+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.062 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2023-12-03T11:38:23.980+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.062 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2023-12-03T11:38:23.980+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.062 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2023-12-03T11:38:23.980+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.062 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2023-12-03T11:38:23.980+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.062 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2023-12-03T11:38:23.980+0000 7fe7aad7f640 10 monclient(hunting): get_auth_request con 0x55af40491d60 auth_method 0 2023-12-03T11:38:24.062 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2023-12-03T11:38:23.980+0000 7fe7aad7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.062 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2023-12-03T11:38:23.980+0000 7fe7aad7f640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.062 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2023-12-03T11:38:23.980+0000 7fe7aad7f640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.062 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2023-12-03T11:38:23.980+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.062 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2023-12-03T11:38:23.980+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.062 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2023-12-03T11:38:23.980+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.062 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2023-12-03T11:38:23.980+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_done global_id 6395 payload 824 2023-12-03T11:38:24.063 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2023-12-03T11:38:23.980+0000 7fe7a9d7d640 10 monclient: _finish_hunting 0 2023-12-03T11:38:24.063 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2023-12-03T11:38:23.980+0000 7fe7a9d7d640 1 monclient: found mon.noname-c 2023-12-03T11:38:24.063 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2023-12-03T11:38:23.980+0000 7fe7a9d7d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2023-12-03T11:38:24.063 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2023-12-03T11:38:23.980+0000 7fe78affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:24.063 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2023-12-03T11:38:23.980+0000 7fe78affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:38:24.063 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2023-12-03T11:38:23.980+0000 7fe78affd640 10 monclient: dump: 2023-12-03T11:38:24.063 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:24.063 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:24.063 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.063 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.063 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:24.063 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.063 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:24.063 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:24.063 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:24.064 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.064 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2023-12-03T11:38:23.980+0000 7fe78affd640 10 monclient: _finish_auth 0 2023-12-03T11:38:24.064 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2023-12-03T11:38:23.980+0000 7fe78affd640 10 monclient: _check_auth_tickets 2023-12-03T11:38:24.064 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2023-12-03T11:38:23.980+0000 7fe78affd640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:38:24.064 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2023-12-03T11:38:23.980+0000 7fe78affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:24.064 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2023-12-03T11:38:23.980+0000 7fe78affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:38:24.064 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2023-12-03T11:38:23.980+0000 7fe78affd640 10 monclient: dump: 2023-12-03T11:38:24.064 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:24.064 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:24.064 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.064 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.064 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:24.064 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.064 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:24.064 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:24.064 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:24.064 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.065 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2023-12-03T11:38:23.980+0000 7fe7ae931800 5 monclient: authenticate success, global_id 6395 2023-12-03T11:38:24.065 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2023-12-03T11:38:23.980+0000 7fe798ff9640 4 set_mon_vals no callback set 2023-12-03T11:38:24.065 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient: _renew_subs 2023-12-03T11:38:24.065 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:38:24.065 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient: _renew_subs 2023-12-03T11:38:24.065 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:38:24.065 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2023-12-03T11:38:23.980+0000 7fe7ae931800 1 librados: init done 2023-12-03T11:38:24.065 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2023-12-03T11:38:23.981+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.065 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2023-12-03T11:38:23.982+0000 7fe78affd640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:38:24.065 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2023-12-03T11:38:23.982+0000 7fe78affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:24.065 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2023-12-03T11:38:23.982+0000 7fe78affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:24.065 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2023-12-03T11:38:23.982+0000 7fe7aa57e640 10 monclient: get_auth_request con 0x7fe784069820 auth_method 0 2023-12-03T11:38:24.065 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2023-12-03T11:38:23.983+0000 7fe7aad7f640 10 monclient: get_auth_request con 0x55af404b6fa0 auth_method 0 2023-12-03T11:38:24.066 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2023-12-03T11:38:23.983+0000 7fe7ae931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.066 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2023-12-03T11:38:23.983+0000 7fe7ae931800 20 realm 2023-12-03T11:38:24.066 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2023-12-03T11:38:23.983+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.066 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2023-12-03T11:38:23.983+0000 7fe7ae931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.066 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2023-12-03T11:38:23.983+0000 7fe7ae931800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:24.066 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2023-12-03T11:38:23.983+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.066 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2023-12-03T11:38:23.983+0000 7fe7ae931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.066 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2023-12-03T11:38:23.983+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.066 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2023-12-03T11:38:23.984+0000 7fe7aa57e640 10 monclient: get_auth_request con 0x55af404badc0 auth_method 0 2023-12-03T11:38:24.066 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2023-12-03T11:38:23.984+0000 7fe7ae931800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:24.066 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2023-12-03T11:38:23.984+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.066 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2023-12-03T11:38:23.984+0000 7fe7a9d7d640 10 monclient: get_auth_request con 0x55af404be540 auth_method 0 2023-12-03T11:38:24.066 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2023-12-03T11:38:23.985+0000 7fe7ae931800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:24.066 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2023-12-03T11:38:23.985+0000 7fe7ae931800 20 searching for the correct realm 2023-12-03T11:38:24.066 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2023-12-03T11:38:23.985+0000 7fe7aad7f640 10 monclient: get_auth_request con 0x55af404c2d80 auth_method 0 2023-12-03T11:38:24.067 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2023-12-03T11:38:23.986+0000 7fe7aa57e640 10 monclient: get_auth_request con 0x7fe7a405e040 auth_method 0 2023-12-03T11:38:24.067 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2023-12-03T11:38:23.987+0000 7fe7a9d7d640 10 monclient: get_auth_request con 0x7fe7a00571f0 auth_method 0 2023-12-03T11:38:24.067 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2023-12-03T11:38:23.989+0000 7fe7aad7f640 10 monclient: get_auth_request con 0x7fe7a0056480 auth_method 0 2023-12-03T11:38:24.067 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2023-12-03T11:38:23.991+0000 7fe7aa57e640 10 monclient: get_auth_request con 0x7fe7a005ed50 auth_method 0 2023-12-03T11:38:24.067 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2023-12-03T11:38:23.994+0000 7fe7aa57e640 0 -- 172.21.15.44:0/2550213081 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55af404badc0 msgr2=0x55af404bd1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:24.067 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2023-12-03T11:38:23.994+0000 7fe78affd640 1 client.6395.objecter ms_handle_reset 0x55af404badc0 session 0x55af40228320 osd.5 2023-12-03T11:38:24.067 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2023-12-03T11:38:23.994+0000 7fe78affd640 10 monclient: _renew_subs 2023-12-03T11:38:24.067 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2023-12-03T11:38:23.994+0000 7fe78affd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:38:24.067 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2023-12-03T11:38:23.995+0000 7fe7aa57e640 10 monclient: get_auth_request con 0x7fe784079e10 auth_method 0 2023-12-03T11:38:24.067 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2023-12-03T11:38:23.995+0000 7fe7ae931800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:24.067 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2023-12-03T11:38:23.995+0000 7fe7ae931800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:24.067 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2023-12-03T11:38:23.995+0000 7fe7ae931800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:24.067 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2023-12-03T11:38:23.995+0000 7fe7ae931800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:24.067 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2023-12-03T11:38:23.995+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.067 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.067 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.068 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:24.068 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.068 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:24.068 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2023-12-03T11:38:23.996+0000 7fe7ae931800 20 zone default found 2023-12-03T11:38:24.068 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2023-12-03T11:38:23.996+0000 7fe7ae931800 4 Realm: () 2023-12-03T11:38:24.068 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2023-12-03T11:38:23.996+0000 7fe7ae931800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:24.068 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2023-12-03T11:38:23.996+0000 7fe7ae931800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:24.068 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2023-12-03T11:38:23.996+0000 7fe7ae931800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:24.068 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2023-12-03T11:38:23.996+0000 7fe7ae931800 20 zonegroup default 2023-12-03T11:38:24.068 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.068 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.068 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.068 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2023-12-03T11:38:23.997+0000 7fe7ae931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.068 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2023-12-03T11:38:23.997+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.068 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2023-12-03T11:38:23.997+0000 7fe7ae931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.069 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2023-12-03T11:38:23.997+0000 7fe7ae931800 20 started sync module instance, tier type = 2023-12-03T11:38:24.069 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2023-12-03T11:38:23.997+0000 7fe7ae931800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:24.069 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2023-12-03T11:38:24.003+0000 7fe7aad7f640 0 -- 172.21.15.44:0/2550213081 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55af404c2d80 msgr2=0x55af404c5240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:24.069 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2023-12-03T11:38:24.003+0000 7fe78affd640 1 client.6395.objecter ms_handle_reset 0x55af404c2d80 session 0x55af404c2700 osd.3 2023-12-03T11:38:24.069 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2023-12-03T11:38:24.003+0000 7fe7aad7f640 10 monclient: get_auth_request con 0x55af404badc0 auth_method 0 2023-12-03T11:38:24.069 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2023-12-03T11:38:24.006+0000 7fe7ae931800 20 add_watcher() i=0 2023-12-03T11:38:24.069 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2023-12-03T11:38:24.006+0000 7fe7ae931800 20 add_watcher() i=1 2023-12-03T11:38:24.069 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2023-12-03T11:38:24.006+0000 7fe7ae931800 20 add_watcher() i=2 2023-12-03T11:38:24.069 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2023-12-03T11:38:24.006+0000 7fe7ae931800 20 add_watcher() i=3 2023-12-03T11:38:24.069 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2023-12-03T11:38:24.006+0000 7fe7ae931800 20 add_watcher() i=4 2023-12-03T11:38:24.069 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2023-12-03T11:38:24.006+0000 7fe7ae931800 20 add_watcher() i=5 2023-12-03T11:38:24.069 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2023-12-03T11:38:24.006+0000 7fe7ae931800 20 add_watcher() i=6 2023-12-03T11:38:24.069 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2023-12-03T11:38:24.007+0000 7fe7ae931800 20 add_watcher() i=7 2023-12-03T11:38:24.069 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2023-12-03T11:38:24.007+0000 7fe7ae931800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:24.069 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding auth protocol: cephx 2023-12-03T11:38:24.070 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding auth protocol: cephx 2023-12-03T11:38:24.070 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding auth protocol: cephx 2023-12-03T11:38:24.070 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: secure 2023-12-03T11:38:24.070 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: crc 2023-12-03T11:38:24.070 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: secure 2023-12-03T11:38:24.070 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: crc 2023-12-03T11:38:24.070 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: secure 2023-12-03T11:38:24.070 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: crc 2023-12-03T11:38:24.070 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: crc 2023-12-03T11:38:24.070 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: secure 2023-12-03T11:38:24.070 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: crc 2023-12-03T11:38:24.070 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: secure 2023-12-03T11:38:24.070 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2023-12-03T11:38:24.009+0000 7fe76ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:24.070 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: crc 2023-12-03T11:38:24.071 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: secure 2023-12-03T11:38:24.071 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2023-12-03T11:38:24.009+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.071 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2023-12-03T11:38:24.009+0000 7fe7ae931800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:24.071 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2023-12-03T11:38:24.009+0000 7fe7ae931800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:24.071 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command cache list hook 0x55af403adf10 2023-12-03T11:38:24.071 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command cache inspect hook 0x55af403adf10 2023-12-03T11:38:24.071 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command cache erase hook 0x55af403adf10 2023-12-03T11:38:24.071 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command cache zap hook 0x55af403adf10 2023-12-03T11:38:24.071 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2023-12-03T11:38:24.009+0000 7fe7ae931800 10 monclient: get_monmap_and_config 2023-12-03T11:38:24.071 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2023-12-03T11:38:24.009+0000 7fe7ae931800 10 monclient: build_initial_monmap 2023-12-03T11:38:24.071 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2023-12-03T11:38:24.009+0000 7fe7ae931800 1 build_initial for_mkfs: 0 2023-12-03T11:38:24.071 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2023-12-03T11:38:24.009+0000 7fe7ae931800 10 monclient: monmap: 2023-12-03T11:38:24.071 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:38:24.071 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:38:24.071 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:38:24.072 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:38:24.072 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:38:24.072 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.072 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:38:24.072 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:38:24.072 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:38:24.072 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.072 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding auth protocol: cephx 2023-12-03T11:38:24.072 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding auth protocol: cephx 2023-12-03T11:38:24.072 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding auth protocol: cephx 2023-12-03T11:38:24.072 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: secure 2023-12-03T11:38:24.072 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: crc 2023-12-03T11:38:24.072 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: secure 2023-12-03T11:38:24.072 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: crc 2023-12-03T11:38:24.072 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: secure 2023-12-03T11:38:24.072 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: crc 2023-12-03T11:38:24.072 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: crc 2023-12-03T11:38:24.073 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: secure 2023-12-03T11:38:24.073 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: crc 2023-12-03T11:38:24.073 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: secure 2023-12-03T11:38:24.073 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: crc 2023-12-03T11:38:24.073 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: secure 2023-12-03T11:38:24.073 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2023-12-03T11:38:24.009+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.073 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2023-12-03T11:38:24.009+0000 7fe7ae931800 10 monclient: init 2023-12-03T11:38:24.073 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding auth protocol: cephx 2023-12-03T11:38:24.073 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding auth protocol: cephx 2023-12-03T11:38:24.073 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding auth protocol: cephx 2023-12-03T11:38:24.073 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: secure 2023-12-03T11:38:24.073 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: crc 2023-12-03T11:38:24.073 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: secure 2023-12-03T11:38:24.073 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: crc 2023-12-03T11:38:24.073 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: secure 2023-12-03T11:38:24.073 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: crc 2023-12-03T11:38:24.074 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: crc 2023-12-03T11:38:24.074 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: secure 2023-12-03T11:38:24.074 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: crc 2023-12-03T11:38:24.074 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: secure 2023-12-03T11:38:24.074 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: crc 2023-12-03T11:38:24.074 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: secure 2023-12-03T11:38:24.074 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2023-12-03T11:38:24.010+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.074 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2023-12-03T11:38:24.010+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.074 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2023-12-03T11:38:24.010+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command rotate-key cmddesc rotate-key hook 0x7ffe0e0b2008 EEXIST 2023-12-03T11:38:24.074 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2023-12-03T11:38:24.010+0000 7fe7ae931800 10 monclient: _reopen_session rank -1 2023-12-03T11:38:24.074 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2023-12-03T11:38:24.010+0000 7fe7ae931800 10 monclient: _add_conns ranks=[1,2,0] 2023-12-03T11:38:24.074 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2023-12-03T11:38:24.010+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-b con 0x55af404f2b20 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:38:24.074 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2023-12-03T11:38:24.010+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-c con 0x55af404f8770 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:38:24.074 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2023-12-03T11:38:24.010+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-a con 0x55af404fed10 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:38:24.074 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2023-12-03T11:38:24.010+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.075 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2023-12-03T11:38:24.010+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.075 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2023-12-03T11:38:24.010+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.075 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2023-12-03T11:38:24.010+0000 7fe7ae931800 10 monclient(hunting): _renew_subs 2023-12-03T11:38:24.075 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2023-12-03T11:38:24.010+0000 7fe7ae931800 10 monclient(hunting): authenticate will time out at 1583.237062s 2023-12-03T11:38:24.075 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2023-12-03T11:38:24.010+0000 7fe7a9d7d640 10 monclient(hunting): get_auth_request con 0x55af404fed10 auth_method 0 2023-12-03T11:38:24.075 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2023-12-03T11:38:24.010+0000 7fe7a9d7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.075 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2023-12-03T11:38:24.010+0000 7fe7a9d7d640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.075 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2023-12-03T11:38:24.010+0000 7fe7a9d7d640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.075 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2023-12-03T11:38:24.010+0000 7fe7aa57e640 10 monclient(hunting): get_auth_request con 0x55af404f8770 auth_method 0 2023-12-03T11:38:24.075 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2023-12-03T11:38:24.010+0000 7fe7aa57e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.075 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2023-12-03T11:38:24.010+0000 7fe7aa57e640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.075 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2023-12-03T11:38:24.010+0000 7fe7aa57e640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.075 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2023-12-03T11:38:24.010+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.075 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2023-12-03T11:38:24.010+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.075 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2023-12-03T11:38:24.010+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.075 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2023-12-03T11:38:24.010+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.076 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2023-12-03T11:38:24.010+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.076 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2023-12-03T11:38:24.010+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.076 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2023-12-03T11:38:24.010+0000 7fe7aad7f640 10 monclient(hunting): get_auth_request con 0x55af404f2b20 auth_method 0 2023-12-03T11:38:24.076 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2023-12-03T11:38:24.010+0000 7fe7aad7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.076 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2023-12-03T11:38:24.010+0000 7fe7aad7f640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.076 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2023-12-03T11:38:24.010+0000 7fe7aad7f640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.076 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2023-12-03T11:38:24.010+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.076 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2023-12-03T11:38:24.010+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.076 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2023-12-03T11:38:24.010+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.076 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2023-12-03T11:38:24.010+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_done global_id 6398 payload 274 2023-12-03T11:38:24.076 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2023-12-03T11:38:24.010+0000 7fe7aa57e640 10 monclient: _finish_hunting 0 2023-12-03T11:38:24.076 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2023-12-03T11:38:24.010+0000 7fe7aa57e640 1 monclient: found mon.noname-c 2023-12-03T11:38:24.076 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2023-12-03T11:38:24.010+0000 7fe7aa57e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2023-12-03T11:38:24.076 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2023-12-03T11:38:24.011+0000 7fe76f7e6640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:24.076 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2023-12-03T11:38:24.011+0000 7fe76f7e6640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:38:24.076 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2023-12-03T11:38:24.011+0000 7fe76f7e6640 10 monclient: dump: 2023-12-03T11:38:24.077 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:24.077 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:24.077 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.077 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.077 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:24.077 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.077 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:24.077 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:24.077 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:24.077 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.077 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2023-12-03T11:38:24.011+0000 7fe76f7e6640 10 monclient: _finish_auth 0 2023-12-03T11:38:24.077 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2023-12-03T11:38:24.011+0000 7fe76f7e6640 10 monclient: _check_auth_tickets 2023-12-03T11:38:24.077 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2023-12-03T11:38:24.011+0000 7fe76f7e6640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:38:24.077 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2023-12-03T11:38:24.011+0000 7fe76f7e6640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:24.077 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2023-12-03T11:38:24.011+0000 7fe76f7e6640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:38:24.078 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2023-12-03T11:38:24.011+0000 7fe76f7e6640 10 monclient: dump: 2023-12-03T11:38:24.078 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:24.078 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:24.078 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.078 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.078 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:24.078 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.078 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:24.078 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:24.078 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:24.078 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.078 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 monclient: authenticate success, global_id 6398 2023-12-03T11:38:24.078 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2023-12-03T11:38:24.011+0000 7fe7ae931800 10 monclient: get_monmap_and_config success 2023-12-03T11:38:24.078 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2023-12-03T11:38:24.011+0000 7fe7ae931800 4 set_mon_vals no callback set 2023-12-03T11:38:24.079 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2023-12-03T11:38:24.011+0000 7fe7ae931800 10 monclient: shutdown 2023-12-03T11:38:24.079 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2023-12-03T11:38:24.011+0000 7fe7ae931800 10 monclient: build_initial_monmap 2023-12-03T11:38:24.079 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2023-12-03T11:38:24.011+0000 7fe7ae931800 1 build_initial for_mkfs: 0 2023-12-03T11:38:24.079 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2023-12-03T11:38:24.011+0000 7fe7ae931800 10 monclient: monmap: 2023-12-03T11:38:24.079 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:38:24.079 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:38:24.079 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:38:24.079 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:38:24.079 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:38:24.079 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.079 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:38:24.079 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:38:24.079 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:38:24.079 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.079 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding auth protocol: cephx 2023-12-03T11:38:24.080 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding auth protocol: cephx 2023-12-03T11:38:24.080 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding auth protocol: cephx 2023-12-03T11:38:24.080 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: secure 2023-12-03T11:38:24.080 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: crc 2023-12-03T11:38:24.080 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: secure 2023-12-03T11:38:24.080 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: crc 2023-12-03T11:38:24.080 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: secure 2023-12-03T11:38:24.080 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: crc 2023-12-03T11:38:24.080 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: crc 2023-12-03T11:38:24.080 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: secure 2023-12-03T11:38:24.080 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: crc 2023-12-03T11:38:24.080 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: secure 2023-12-03T11:38:24.080 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: crc 2023-12-03T11:38:24.080 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: secure 2023-12-03T11:38:24.080 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2023-12-03T11:38:24.012+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.081 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2023-12-03T11:38:24.012+0000 7fe7ae931800 1 librados: starting msgr at 2023-12-03T11:38:24.081 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2023-12-03T11:38:24.012+0000 7fe7ae931800 1 librados: starting objecter 2023-12-03T11:38:24.081 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command objecter_requests cmddesc objecter_requests hook 0x55af404ff0f0 EEXIST 2023-12-03T11:38:24.081 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2023-12-03T11:38:24.012+0000 7fe7ae931800 1 librados: setting wanted keys 2023-12-03T11:38:24.081 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2023-12-03T11:38:24.012+0000 7fe7ae931800 1 librados: calling monclient init 2023-12-03T11:38:24.081 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2023-12-03T11:38:24.012+0000 7fe7ae931800 10 monclient: init 2023-12-03T11:38:24.081 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding auth protocol: cephx 2023-12-03T11:38:24.081 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding auth protocol: cephx 2023-12-03T11:38:24.081 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding auth protocol: cephx 2023-12-03T11:38:24.081 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: secure 2023-12-03T11:38:24.081 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: crc 2023-12-03T11:38:24.081 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: secure 2023-12-03T11:38:24.081 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: crc 2023-12-03T11:38:24.081 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: secure 2023-12-03T11:38:24.081 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: crc 2023-12-03T11:38:24.082 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: crc 2023-12-03T11:38:24.082 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: secure 2023-12-03T11:38:24.082 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: crc 2023-12-03T11:38:24.082 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: secure 2023-12-03T11:38:24.082 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: crc 2023-12-03T11:38:24.082 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: secure 2023-12-03T11:38:24.082 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2023-12-03T11:38:24.012+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.082 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2023-12-03T11:38:24.012+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.082 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command rotate-key cmddesc rotate-key hook 0x55af404ff8d0 EEXIST 2023-12-03T11:38:24.082 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2023-12-03T11:38:24.012+0000 7fe7ae931800 10 monclient: _reopen_session rank -1 2023-12-03T11:38:24.082 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2023-12-03T11:38:24.012+0000 7fe7ae931800 10 monclient: _add_conns ranks=[2,1,0] 2023-12-03T11:38:24.082 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2023-12-03T11:38:24.012+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-c con 0x55af404f2b20 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:38:24.082 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2023-12-03T11:38:24.012+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-b con 0x55af404f8770 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:38:24.082 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2023-12-03T11:38:24.012+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-a con 0x55af404fed10 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:38:24.083 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2023-12-03T11:38:24.012+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.083 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2023-12-03T11:38:24.012+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.083 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2023-12-03T11:38:24.012+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.083 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2023-12-03T11:38:24.012+0000 7fe7ae931800 10 monclient(hunting): _renew_subs 2023-12-03T11:38:24.083 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2023-12-03T11:38:24.012+0000 7fe7ae931800 10 monclient(hunting): authenticate will time out at 1583.239557s 2023-12-03T11:38:24.083 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2023-12-03T11:38:24.012+0000 7fe7aad7f640 10 monclient(hunting): get_auth_request con 0x55af404f2b20 auth_method 0 2023-12-03T11:38:24.083 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2023-12-03T11:38:24.012+0000 7fe7aad7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.083 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2023-12-03T11:38:24.012+0000 7fe7aad7f640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.083 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2023-12-03T11:38:24.012+0000 7fe7aad7f640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.083 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2023-12-03T11:38:24.013+0000 7fe7a9d7d640 10 monclient(hunting): get_auth_request con 0x55af404fed10 auth_method 0 2023-12-03T11:38:24.083 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2023-12-03T11:38:24.013+0000 7fe7a9d7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.083 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2023-12-03T11:38:24.013+0000 7fe7a9d7d640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.083 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2023-12-03T11:38:24.013+0000 7fe7a9d7d640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.083 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2023-12-03T11:38:24.013+0000 7fe7aa57e640 10 monclient(hunting): get_auth_request con 0x55af404f8770 auth_method 0 2023-12-03T11:38:24.083 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2023-12-03T11:38:24.013+0000 7fe7aa57e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.084 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2023-12-03T11:38:24.013+0000 7fe7aa57e640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.084 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2023-12-03T11:38:24.013+0000 7fe7aa57e640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.084 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2023-12-03T11:38:24.013+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.084 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2023-12-03T11:38:24.013+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.084 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2023-12-03T11:38:24.013+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.084 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2023-12-03T11:38:24.013+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.084 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2023-12-03T11:38:24.013+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.084 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2023-12-03T11:38:24.013+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.084 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2023-12-03T11:38:24.013+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.084 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2023-12-03T11:38:24.013+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.084 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2023-12-03T11:38:24.013+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.084 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2023-12-03T11:38:24.013+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_done global_id 6401 payload 824 2023-12-03T11:38:24.084 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2023-12-03T11:38:24.013+0000 7fe7aad7f640 10 monclient: _finish_hunting 0 2023-12-03T11:38:24.084 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2023-12-03T11:38:24.013+0000 7fe7aad7f640 1 monclient: found mon.noname-c 2023-12-03T11:38:24.084 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2023-12-03T11:38:24.013+0000 7fe7aad7f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2023-12-03T11:38:24.085 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2023-12-03T11:38:24.013+0000 7fe76dfe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:24.085 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2023-12-03T11:38:24.013+0000 7fe76dfe3640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:38:24.085 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2023-12-03T11:38:24.013+0000 7fe76dfe3640 10 monclient: dump: 2023-12-03T11:38:24.085 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:24.085 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:24.085 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.085 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.085 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:24.085 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.085 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:24.085 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:24.085 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:24.085 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.085 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2023-12-03T11:38:24.013+0000 7fe76dfe3640 10 monclient: _finish_auth 0 2023-12-03T11:38:24.085 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2023-12-03T11:38:24.013+0000 7fe76dfe3640 10 monclient: _check_auth_tickets 2023-12-03T11:38:24.085 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2023-12-03T11:38:24.013+0000 7fe76dfe3640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:38:24.085 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2023-12-03T11:38:24.013+0000 7fe76dfe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:24.085 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2023-12-03T11:38:24.013+0000 7fe76dfe3640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:38:24.086 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2023-12-03T11:38:24.013+0000 7fe76dfe3640 10 monclient: dump: 2023-12-03T11:38:24.086 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:24.086 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:24.086 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.086 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.086 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:24.086 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.086 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:24.086 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:24.086 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:24.086 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.086 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2023-12-03T11:38:24.013+0000 7fe76f7e6640 4 set_mon_vals no callback set 2023-12-03T11:38:24.086 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2023-12-03T11:38:24.013+0000 7fe7ae931800 5 monclient: authenticate success, global_id 6401 2023-12-03T11:38:24.086 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2023-12-03T11:38:24.013+0000 7fe7ae931800 10 monclient: _renew_subs 2023-12-03T11:38:24.087 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2023-12-03T11:38:24.013+0000 7fe7ae931800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:38:24.087 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2023-12-03T11:38:24.013+0000 7fe7ae931800 10 monclient: _renew_subs 2023-12-03T11:38:24.087 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2023-12-03T11:38:24.013+0000 7fe7ae931800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:38:24.087 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2023-12-03T11:38:24.013+0000 7fe7ae931800 1 librados: init done 2023-12-03T11:38:24.087 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2023-12-03T11:38:24.013+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command cr dump hook 0x55af40511078 2023-12-03T11:38:24.087 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2023-12-03T11:38:24.015+0000 7fe76dfe3640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:38:24.087 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2023-12-03T11:38:24.015+0000 7fe76dfe3640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:24.087 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2023-12-03T11:38:24.015+0000 7fe76dfe3640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:24.087 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2023-12-03T11:38:24.015+0000 7fe7aa57e640 10 monclient: get_auth_request con 0x7fe6e4069850 auth_method 0 2023-12-03T11:38:24.087 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2023-12-03T11:38:24.015+0000 7fe7ae931800 5 note: GC not initialized 2023-12-03T11:38:24.087 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2023-12-03T11:38:24.015+0000 7fe6deffd640 20 reqs_thread_entry: start 2023-12-03T11:38:24.087 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2023-12-03T11:38:24.015+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command sync trace show hook 0x7fe7a4004720 2023-12-03T11:38:24.087 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2023-12-03T11:38:24.015+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command sync trace history hook 0x7fe7a4004720 2023-12-03T11:38:24.087 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2023-12-03T11:38:24.015+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command sync trace active hook 0x7fe7a4004720 2023-12-03T11:38:24.087 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2023-12-03T11:38:24.015+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command sync trace active_short hook 0x7fe7a4004720 2023-12-03T11:38:24.087 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2023-12-03T11:38:24.015+0000 7fe7ae931800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:24.087 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2023-12-03T11:38:24.015+0000 7fe7ae931800 20 Filter name: none 2023-12-03T11:38:24.087 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2023-12-03T11:38:24.016+0000 7fe6dcff9640 20 reqs_thread_entry: start 2023-12-03T11:38:24.088 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2023-12-03T11:38:24.016+0000 7fe7ae931800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2023-12-03T11:38:24.088 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2023-12-03T11:38:24.016+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.088 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2023-12-03T11:38:24.016+0000 7fe7ae931800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:38:24.088 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2023-12-03T11:38:24.016+0000 7fe7ae931800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2023-12-03T11:38:24.088 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2023-12-03T11:38:24.016+0000 7fe7ae931800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2023-12-03T11:38:24.088 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2023-12-03T11:38:24.016+0000 7fe7ae931800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 : miss 2023-12-03T11:38:24.088 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2023-12-03T11:38:24.016+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.088 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2023-12-03T11:38:24.017+0000 7fe7ae931800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:38:24.088 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2023-12-03T11:38:24.017+0000 7fe7ae931800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 info.flags=0x17 2023-12-03T11:38:24.088 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2023-12-03T11:38:24.017+0000 7fe7ae931800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 to cache LRU end 2023-12-03T11:38:24.088 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2023-12-03T11:38:24.017+0000 7fe7ae931800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:38:24.088 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2023-12-03T11:38:24.017+0000 7fe7ae931800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:24.088 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2023-12-03T11:38:24.017+0000 7fe7ae931800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 2023-12-03T11:38:24.088 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2023-12-03T11:38:24.017+0000 7fe7a9d7d640 10 monclient: get_auth_request con 0x55af4054ccb0 auth_method 0 2023-12-03T11:38:24.088 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2023-12-03T11:38:24.021+0000 7fe7ae931800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 info.flags=0x17 2023-12-03T11:38:24.089 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2023-12-03T11:38:24.021+0000 7fe7ae931800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 to cache LRU end 2023-12-03T11:38:24.089 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2023-12-03T11:38:24.021+0000 7fe7ae931800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:24.089 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2023-12-03T11:38:24.021+0000 7fe7ae931800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22, ofs0, ns] 2023-12-03T11:38:24.089 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2023-12-03T11:38:24.022+0000 7fe798ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693277 cookie 94211186373040 notifier 6395 bl.length()=877 2023-12-03T11:38:24.089 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2023-12-03T11:38:24.022+0000 7fe798ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 info.flags=0x17 2023-12-03T11:38:24.089 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2023-12-03T11:38:24.022+0000 7fe798ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 to cache LRU end 2023-12-03T11:38:24.089 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2023-12-03T11:38:24.022+0000 7fe798ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:24.089 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2023-12-03T11:38:24.022+0000 7fe7ae931800 20 handle_bi_update(): bucket=:abort-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22]): orig_sources= new_sources= 2023-12-03T11:38:24.089 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2023-12-03T11:38:24.022+0000 7fe7ae931800 20 handle_bi_update(): bucket=:abort-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22]): potential sources added=[] removed=[] 2023-12-03T11:38:24.089 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2023-12-03T11:38:24.022+0000 7fe7ae931800 20 handle_bi_update(): bucket=:abort-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22]): orig_dests= new_dests= 2023-12-03T11:38:24.089 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2023-12-03T11:38:24.022+0000 7fe7ae931800 20 handle_bi_update(): bucket=:abort-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22]): potential dests added=[] removed=[] 2023-12-03T11:38:24.089 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2023-12-03T11:38:24.023+0000 7fe7ae931800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe7ae931800 time 2023-12-03T11:38:24.024323+0000 2023-12-03T11:38:24.089 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:38:24.090 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.090 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:38:24.090 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe7b156eef8] 2023-12-03T11:38:24.090 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7fe7b156f0b6] 2023-12-03T11:38:24.090 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af3ebbca71] 2023-12-03T11:38:24.090 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55af3ebc8ec4] 2023-12-03T11:38:24.090 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2023-12-03T11:38:24.090 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fe7aec3feb0] 2023-12-03T11:38:24.090 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2023-12-03T11:38:24.090 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2023-12-03T11:38:24.090 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.090 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2023-12-03T11:38:24.023+0000 7fe7ae931800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:38:24.091 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7fe7ae931800 thread_name:radosgw-admin 2023-12-03T11:38:24.091 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.091 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:38:24.091 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fe7aec54db0] 2023-12-03T11:38:24.091 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fe7aeca154c] 2023-12-03T11:38:24.091 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2023-12-03T11:38:24.091 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2023-12-03T11:38:24.091 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe7b156ef52] 2023-12-03T11:38:24.091 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7fe7b156f0b6] 2023-12-03T11:38:24.091 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af3ebbca71] 2023-12-03T11:38:24.091 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55af3ebc8ec4] 2023-12-03T11:38:24.091 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2023-12-03T11:38:24.092 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fe7aec3feb0] 2023-12-03T11:38:24.092 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2023-12-03T11:38:24.092 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2023-12-03T11:38:24.092 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:38:24.092 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.092 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2023-12-03T11:38:24.092 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2023-12-03T11:38:24.092 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2023-12-03T11:38:24.092 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2023-12-03T11:38:24.092 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2023-12-03T11:38:24.092 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2023-12-03T11:38:24.092 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2023-12-03T11:38:24.092 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2023-12-03T11:38:24.092 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2023-12-03T11:38:24.092 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2023-12-03T11:38:24.092 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2023-12-03T11:38:24.093 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2023-12-03T11:38:24.093 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2023-12-03T11:38:24.093 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2023-12-03T11:38:24.093 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2023-12-03T11:38:24.093 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2023-12-03T11:38:24.093 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2023-12-03T11:38:24.093 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2023-12-03T11:38:24.093 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2023-12-03T11:38:24.093 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2023-12-03T11:38:24.093 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2023-12-03T11:38:24.093 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2023-12-03T11:38:24.093 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2023-12-03T11:38:24.093 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:38:24.093 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2023-12-03T11:38:24.093 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2023-12-03T11:38:24.093 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2023-12-03T11:38:24.094 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2023-12-03T11:38:24.094 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2023-12-03T11:38:24.094 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2023-12-03T11:38:24.094 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2023-12-03T11:38:24.094 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2023-12-03T11:38:24.094 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2023-12-03T11:38:24.094 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2023-12-03T11:38:24.094 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2023-12-03T11:38:24.094 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2023-12-03T11:38:24.094 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2023-12-03T11:38:24.094 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2023-12-03T11:38:24.094 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2023-12-03T11:38:24.094 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2023-12-03T11:38:24.094 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2023-12-03T11:38:24.094 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2023-12-03T11:38:24.095 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2023-12-03T11:38:24.095 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2023-12-03T11:38:24.095 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2023-12-03T11:38:24.095 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:38:24.095 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2023-12-03T11:38:24.095 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2023-12-03T11:38:24.095 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2023-12-03T11:38:24.095 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2023-12-03T11:38:24.095 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2023-12-03T11:38:24.095 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2023-12-03T11:38:24.095 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2023-12-03T11:38:24.095 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2023-12-03T11:38:24.095 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2023-12-03T11:38:24.095 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2023-12-03T11:38:24.096 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2023-12-03T11:38:24.096 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2023-12-03T11:38:24.096 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2023-12-03T11:38:24.096 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2023-12-03T11:38:24.096 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2023-12-03T11:38:24.096 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2023-12-03T11:38:24.096 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2023-12-03T11:38:24.096 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2023-12-03T11:38:24.096 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:38:24.096 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2023-12-03T11:38:24.096 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:38:24.096 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2023-12-03T11:38:24.096 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2023-12-03T11:38:24.096 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2023-12-03T11:38:24.096 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2023-12-03T11:38:24.096 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2023-12-03T11:38:24.097 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2023-12-03T11:38:24.097 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:38:24.097 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2023-12-03T11:38:24.097 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2023-12-03T11:38:24.097 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:38:24.097 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2023-12-03T11:38:24.097 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2023-12-03T11:38:24.097 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2023-12-03T11:38:24.097 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2023-12-03T11:38:24.097 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2023-12-03T11:38:24.097 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2023-12-03T11:38:24.097 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2023-12-03T11:38:24.098 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2023-12-03T11:38:24.098 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2023-12-03T11:38:24.098 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2023-12-03T11:38:24.098 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2023-12-03T11:38:24.098 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2023-12-03T11:38:24.098 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:38:24.098 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe6dcff9640 / http_manager 2023-12-03T11:38:24.098 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe6deffd640 / http_manager 2023-12-03T11:38:24.098 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe76dfe3640 / ms_dispatch 2023-12-03T11:38:24.098 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe76f7e6640 / io_context_pool 2023-12-03T11:38:24.098 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe76ffe7640 / rgw_dt_lg_renew 2023-12-03T11:38:24.098 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe78affd640 / ms_dispatch 2023-12-03T11:38:24.098 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe798ff9640 / io_context_pool 2023-12-03T11:38:24.098 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe79b7fe640 / ms_dispatch 2023-12-03T11:38:24.099 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe7a9d7d640 / msgr-worker-2 2023-12-03T11:38:24.099 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe7aa57e640 / msgr-worker-1 2023-12-03T11:38:24.099 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe7aad7f640 / msgr-worker-0 2023-12-03T11:38:24.099 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe7ae931800 / radosgw-admin 2023-12-03T11:38:24.099 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2023-12-03T11:38:24.099 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2023-12-03T11:38:24.099 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/log/ceph/ceph-client.admin.102667.log 2023-12-03T11:38:24.099 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2023-12-03T11:38:24.099 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2023-12-03T11:38:24.099 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2023-12-03T11:38:23.976+0000 7fe7ae931800 10 monclient: _renew_subs 2023-12-03T11:38:24.099 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2023-12-03T11:38:23.976+0000 7fe7ae931800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2023-12-03T11:38:24.099 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2023-12-03T11:38:23.976+0000 7fe7ae931800 1 librados: init done 2023-12-03T11:38:24.099 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2023-12-03T11:38:23.976+0000 7fe7ae931800 10 monclient: get_monmap_and_config 2023-12-03T11:38:24.099 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2023-12-03T11:38:23.976+0000 7fe7ae931800 10 monclient: build_initial_monmap 2023-12-03T11:38:24.099 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2023-12-03T11:38:23.976+0000 7fe7ae931800 1 build_initial for_mkfs: 0 2023-12-03T11:38:24.099 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2023-12-03T11:38:23.976+0000 7fe7ae931800 10 monclient: monmap: 2023-12-03T11:38:24.100 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:38:24.100 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:38:24.100 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:38:24.100 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:38:24.100 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:38:24.100 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.100 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:38:24.100 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:38:24.100 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:38:24.100 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.100 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding auth protocol: cephx 2023-12-03T11:38:24.100 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding auth protocol: cephx 2023-12-03T11:38:24.100 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding auth protocol: cephx 2023-12-03T11:38:24.100 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: secure 2023-12-03T11:38:24.100 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: crc 2023-12-03T11:38:24.100 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: secure 2023-12-03T11:38:24.100 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: crc 2023-12-03T11:38:24.101 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: secure 2023-12-03T11:38:24.101 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: crc 2023-12-03T11:38:24.101 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: crc 2023-12-03T11:38:24.101 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: secure 2023-12-03T11:38:24.101 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: crc 2023-12-03T11:38:24.101 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: secure 2023-12-03T11:38:24.101 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: crc 2023-12-03T11:38:24.101 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2023-12-03T11:38:23.976+0000 7fe7ae931800 5 AuthRegistry(0x55af40469fa0) adding con mode: secure 2023-12-03T11:38:24.101 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2023-12-03T11:38:23.977+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.101 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2023-12-03T11:38:23.977+0000 7fe7ae931800 10 monclient: init 2023-12-03T11:38:24.101 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding auth protocol: cephx 2023-12-03T11:38:24.101 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding auth protocol: cephx 2023-12-03T11:38:24.101 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding auth protocol: cephx 2023-12-03T11:38:24.101 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: secure 2023-12-03T11:38:24.101 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: crc 2023-12-03T11:38:24.102 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: secure 2023-12-03T11:38:24.102 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: crc 2023-12-03T11:38:24.102 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: secure 2023-12-03T11:38:24.102 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: crc 2023-12-03T11:38:24.102 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: crc 2023-12-03T11:38:24.102 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: secure 2023-12-03T11:38:24.102 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: crc 2023-12-03T11:38:24.102 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: secure 2023-12-03T11:38:24.102 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: crc 2023-12-03T11:38:24.102 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1940) adding con mode: secure 2023-12-03T11:38:24.102 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2023-12-03T11:38:23.977+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.102 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2023-12-03T11:38:23.977+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.102 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2023-12-03T11:38:23.977+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command rotate-key cmddesc rotate-key hook 0x7ffe0e0b1a88 EEXIST 2023-12-03T11:38:24.102 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2023-12-03T11:38:23.977+0000 7fe7ae931800 10 monclient: _reopen_session rank -1 2023-12-03T11:38:24.103 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2023-12-03T11:38:23.977+0000 7fe7ae931800 10 monclient: _add_conns ranks=[0,2,1] 2023-12-03T11:38:24.103 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2023-12-03T11:38:23.977+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-a con 0x55af40490bf0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:38:24.103 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2023-12-03T11:38:23.977+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-c con 0x55af40491510 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:38:24.103 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2023-12-03T11:38:23.977+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-b con 0x55af4049b820 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:38:24.103 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2023-12-03T11:38:23.977+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.103 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2023-12-03T11:38:23.977+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.103 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2023-12-03T11:38:23.977+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.103 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2023-12-03T11:38:23.977+0000 7fe7ae931800 10 monclient(hunting): _renew_subs 2023-12-03T11:38:24.103 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2023-12-03T11:38:23.977+0000 7fe7ae931800 10 monclient(hunting): authenticate will time out at 1583.204391s 2023-12-03T11:38:24.103 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2023-12-03T11:38:23.977+0000 7fe7aa57e640 10 monclient(hunting): get_auth_request con 0x55af40491510 auth_method 0 2023-12-03T11:38:24.103 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2023-12-03T11:38:23.977+0000 7fe7aa57e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.103 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2023-12-03T11:38:23.977+0000 7fe7aa57e640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.103 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2023-12-03T11:38:23.977+0000 7fe7aa57e640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.104 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2023-12-03T11:38:23.977+0000 7fe7aad7f640 10 monclient(hunting): get_auth_request con 0x55af40490bf0 auth_method 0 2023-12-03T11:38:24.104 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2023-12-03T11:38:23.977+0000 7fe7aad7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.104 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2023-12-03T11:38:23.977+0000 7fe7aad7f640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.104 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2023-12-03T11:38:23.977+0000 7fe7aad7f640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.104 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2023-12-03T11:38:23.977+0000 7fe7a9d7d640 10 monclient(hunting): get_auth_request con 0x55af4049b820 auth_method 0 2023-12-03T11:38:24.104 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2023-12-03T11:38:23.977+0000 7fe7a9d7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.104 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2023-12-03T11:38:23.977+0000 7fe7a9d7d640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.104 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2023-12-03T11:38:23.977+0000 7fe7a9d7d640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.104 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2023-12-03T11:38:23.977+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.104 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2023-12-03T11:38:23.977+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.104 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2023-12-03T11:38:23.977+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.104 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2023-12-03T11:38:23.977+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.104 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2023-12-03T11:38:23.977+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.104 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2023-12-03T11:38:23.977+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.104 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2023-12-03T11:38:23.977+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.104 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2023-12-03T11:38:23.977+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.105 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2023-12-03T11:38:23.978+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.105 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2023-12-03T11:38:23.978+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_done global_id 6392 payload 274 2023-12-03T11:38:24.105 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2023-12-03T11:38:23.978+0000 7fe7aa57e640 10 monclient: _finish_hunting 0 2023-12-03T11:38:24.105 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2023-12-03T11:38:23.978+0000 7fe7aa57e640 1 monclient: found mon.noname-c 2023-12-03T11:38:24.105 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2023-12-03T11:38:23.978+0000 7fe7aa57e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2023-12-03T11:38:24.105 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2023-12-03T11:38:23.978+0000 7fe79b7fe640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:38:24.105 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2023-12-03T11:38:23.978+0000 7fe79b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:24.105 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2023-12-03T11:38:23.978+0000 7fe79b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:24.105 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2023-12-03T11:38:23.978+0000 7fe7aad7f640 10 monclient: get_auth_request con 0x7fe78c069820 auth_method 0 2023-12-03T11:38:24.105 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2023-12-03T11:38:23.978+0000 7fe798ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:24.105 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2023-12-03T11:38:23.978+0000 7fe798ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:38:24.105 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2023-12-03T11:38:23.978+0000 7fe798ff9640 10 monclient: dump: 2023-12-03T11:38:24.105 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:24.105 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:24.105 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.105 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.106 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:24.106 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.106 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:24.106 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:24.106 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:24.106 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.106 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2023-12-03T11:38:23.978+0000 7fe798ff9640 10 monclient: _finish_auth 0 2023-12-03T11:38:24.106 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2023-12-03T11:38:23.978+0000 7fe798ff9640 10 monclient: _check_auth_tickets 2023-12-03T11:38:24.106 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2023-12-03T11:38:23.978+0000 7fe798ff9640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:38:24.106 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2023-12-03T11:38:23.978+0000 7fe798ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:24.106 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2023-12-03T11:38:23.978+0000 7fe798ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:38:24.106 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2023-12-03T11:38:23.978+0000 7fe798ff9640 10 monclient: dump: 2023-12-03T11:38:24.106 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:24.106 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:24.107 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.107 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.107 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:24.107 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.107 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:24.107 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:24.107 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:24.107 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.107 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2023-12-03T11:38:23.978+0000 7fe7ae931800 5 monclient: authenticate success, global_id 6392 2023-12-03T11:38:24.107 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2023-12-03T11:38:23.978+0000 7fe7ae931800 10 monclient: get_monmap_and_config success 2023-12-03T11:38:24.107 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2023-12-03T11:38:23.978+0000 7fe7ae931800 4 set_mon_vals no callback set 2023-12-03T11:38:24.107 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2023-12-03T11:38:23.979+0000 7fe7ae931800 10 monclient: shutdown 2023-12-03T11:38:24.107 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2023-12-03T11:38:23.979+0000 7fe7ae931800 10 monclient: build_initial_monmap 2023-12-03T11:38:24.107 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2023-12-03T11:38:23.979+0000 7fe7ae931800 1 build_initial for_mkfs: 0 2023-12-03T11:38:24.107 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2023-12-03T11:38:23.979+0000 7fe7ae931800 10 monclient: monmap: 2023-12-03T11:38:24.107 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:38:24.107 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:38:24.108 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:38:24.108 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:38:24.108 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:38:24.108 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.108 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:38:24.108 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:38:24.108 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:38:24.108 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.108 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding auth protocol: cephx 2023-12-03T11:38:24.108 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding auth protocol: cephx 2023-12-03T11:38:24.108 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding auth protocol: cephx 2023-12-03T11:38:24.108 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: secure 2023-12-03T11:38:24.108 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: crc 2023-12-03T11:38:24.108 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: secure 2023-12-03T11:38:24.108 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: crc 2023-12-03T11:38:24.108 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: secure 2023-12-03T11:38:24.109 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: crc 2023-12-03T11:38:24.109 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: crc 2023-12-03T11:38:24.109 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: secure 2023-12-03T11:38:24.109 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: crc 2023-12-03T11:38:24.109 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: secure 2023-12-03T11:38:24.109 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: crc 2023-12-03T11:38:24.109 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af40469e70) adding con mode: secure 2023-12-03T11:38:24.109 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2023-12-03T11:38:23.979+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.109 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2023-12-03T11:38:23.979+0000 7fe7ae931800 1 librados: starting msgr at 2023-12-03T11:38:24.109 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2023-12-03T11:38:23.979+0000 7fe7ae931800 1 librados: starting objecter 2023-12-03T11:38:24.109 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command objecter_requests cmddesc objecter_requests hook 0x55af4046b5b0 EEXIST 2023-12-03T11:38:24.109 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2023-12-03T11:38:23.979+0000 7fe7ae931800 1 librados: setting wanted keys 2023-12-03T11:38:24.109 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2023-12-03T11:38:23.979+0000 7fe7ae931800 1 librados: calling monclient init 2023-12-03T11:38:24.109 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2023-12-03T11:38:23.979+0000 7fe7ae931800 10 monclient: init 2023-12-03T11:38:24.110 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding auth protocol: cephx 2023-12-03T11:38:24.110 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding auth protocol: cephx 2023-12-03T11:38:24.110 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding auth protocol: cephx 2023-12-03T11:38:24.110 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: secure 2023-12-03T11:38:24.110 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: crc 2023-12-03T11:38:24.110 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: secure 2023-12-03T11:38:24.110 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: crc 2023-12-03T11:38:24.110 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: secure 2023-12-03T11:38:24.110 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: crc 2023-12-03T11:38:24.110 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: crc 2023-12-03T11:38:24.110 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: secure 2023-12-03T11:38:24.110 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: crc 2023-12-03T11:38:24.110 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: secure 2023-12-03T11:38:24.110 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: crc 2023-12-03T11:38:24.111 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2023-12-03T11:38:23.979+0000 7fe7ae931800 5 AuthRegistry(0x55af404682a8) adding con mode: secure 2023-12-03T11:38:24.111 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2023-12-03T11:38:23.979+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.111 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2023-12-03T11:38:23.980+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.111 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2023-12-03T11:38:23.980+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command rotate-key cmddesc rotate-key hook 0x55af404683f0 EEXIST 2023-12-03T11:38:24.111 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient: _reopen_session rank -1 2023-12-03T11:38:24.111 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient: _add_conns ranks=[0,2,1] 2023-12-03T11:38:24.111 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-a con 0x55af40490bf0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:38:24.111 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-c con 0x55af4049b820 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:38:24.111 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-b con 0x55af40491d60 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:38:24.111 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.111 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.111 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.111 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient(hunting): _renew_subs 2023-12-03T11:38:24.112 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient(hunting): authenticate will time out at 1583.206808s 2023-12-03T11:38:24.112 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2023-12-03T11:38:23.980+0000 7fe7aa57e640 10 monclient(hunting): get_auth_request con 0x55af40490bf0 auth_method 0 2023-12-03T11:38:24.112 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2023-12-03T11:38:23.980+0000 7fe7aa57e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.112 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2023-12-03T11:38:23.980+0000 7fe7aa57e640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.112 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2023-12-03T11:38:23.980+0000 7fe7aa57e640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.112 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2023-12-03T11:38:23.980+0000 7fe7a9d7d640 10 monclient(hunting): get_auth_request con 0x55af4049b820 auth_method 0 2023-12-03T11:38:24.112 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2023-12-03T11:38:23.980+0000 7fe7a9d7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.112 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2023-12-03T11:38:23.980+0000 7fe7a9d7d640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.112 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2023-12-03T11:38:23.980+0000 7fe7a9d7d640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.112 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2023-12-03T11:38:23.980+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.112 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2023-12-03T11:38:23.980+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.112 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2023-12-03T11:38:23.980+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.112 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2023-12-03T11:38:23.980+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.112 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2023-12-03T11:38:23.980+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.112 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2023-12-03T11:38:23.980+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.112 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2023-12-03T11:38:23.980+0000 7fe7aad7f640 10 monclient(hunting): get_auth_request con 0x55af40491d60 auth_method 0 2023-12-03T11:38:24.112 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2023-12-03T11:38:23.980+0000 7fe7aad7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.113 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2023-12-03T11:38:23.980+0000 7fe7aad7f640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.113 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2023-12-03T11:38:23.980+0000 7fe7aad7f640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.113 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2023-12-03T11:38:23.980+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.113 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2023-12-03T11:38:23.980+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.113 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2023-12-03T11:38:23.980+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.113 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2023-12-03T11:38:23.980+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_done global_id 6395 payload 824 2023-12-03T11:38:24.113 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2023-12-03T11:38:23.980+0000 7fe7a9d7d640 10 monclient: _finish_hunting 0 2023-12-03T11:38:24.113 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2023-12-03T11:38:23.980+0000 7fe7a9d7d640 1 monclient: found mon.noname-c 2023-12-03T11:38:24.113 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2023-12-03T11:38:23.980+0000 7fe7a9d7d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2023-12-03T11:38:24.113 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2023-12-03T11:38:23.980+0000 7fe78affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:24.113 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2023-12-03T11:38:23.980+0000 7fe78affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:38:24.113 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2023-12-03T11:38:23.980+0000 7fe78affd640 10 monclient: dump: 2023-12-03T11:38:24.113 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:24.113 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:24.113 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.113 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.113 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:24.114 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.114 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:24.114 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:24.114 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:24.114 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.114 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2023-12-03T11:38:23.980+0000 7fe78affd640 10 monclient: _finish_auth 0 2023-12-03T11:38:24.114 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2023-12-03T11:38:23.980+0000 7fe78affd640 10 monclient: _check_auth_tickets 2023-12-03T11:38:24.114 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2023-12-03T11:38:23.980+0000 7fe78affd640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:38:24.114 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2023-12-03T11:38:23.980+0000 7fe78affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:24.114 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2023-12-03T11:38:23.980+0000 7fe78affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:38:24.114 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2023-12-03T11:38:23.980+0000 7fe78affd640 10 monclient: dump: 2023-12-03T11:38:24.114 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:24.114 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:24.114 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.114 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.114 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:24.115 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.115 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:24.115 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:24.115 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:24.115 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.115 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2023-12-03T11:38:23.980+0000 7fe7ae931800 5 monclient: authenticate success, global_id 6395 2023-12-03T11:38:24.115 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2023-12-03T11:38:23.980+0000 7fe798ff9640 4 set_mon_vals no callback set 2023-12-03T11:38:24.115 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient: _renew_subs 2023-12-03T11:38:24.115 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:38:24.115 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient: _renew_subs 2023-12-03T11:38:24.115 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2023-12-03T11:38:23.980+0000 7fe7ae931800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:38:24.115 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2023-12-03T11:38:23.980+0000 7fe7ae931800 1 librados: init done 2023-12-03T11:38:24.115 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2023-12-03T11:38:23.981+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.115 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2023-12-03T11:38:23.982+0000 7fe78affd640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:38:24.115 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2023-12-03T11:38:23.982+0000 7fe78affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:24.115 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2023-12-03T11:38:23.982+0000 7fe78affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:24.115 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2023-12-03T11:38:23.982+0000 7fe7aa57e640 10 monclient: get_auth_request con 0x7fe784069820 auth_method 0 2023-12-03T11:38:24.116 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2023-12-03T11:38:23.983+0000 7fe7aad7f640 10 monclient: get_auth_request con 0x55af404b6fa0 auth_method 0 2023-12-03T11:38:24.116 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2023-12-03T11:38:23.983+0000 7fe7ae931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.116 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2023-12-03T11:38:23.983+0000 7fe7ae931800 20 realm 2023-12-03T11:38:24.116 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2023-12-03T11:38:23.983+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.116 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2023-12-03T11:38:23.983+0000 7fe7ae931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.116 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2023-12-03T11:38:23.983+0000 7fe7ae931800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:24.116 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2023-12-03T11:38:23.983+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.116 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2023-12-03T11:38:23.983+0000 7fe7ae931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.116 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2023-12-03T11:38:23.983+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.116 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2023-12-03T11:38:23.984+0000 7fe7aa57e640 10 monclient: get_auth_request con 0x55af404badc0 auth_method 0 2023-12-03T11:38:24.116 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2023-12-03T11:38:23.984+0000 7fe7ae931800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:24.116 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2023-12-03T11:38:23.984+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.116 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2023-12-03T11:38:23.984+0000 7fe7a9d7d640 10 monclient: get_auth_request con 0x55af404be540 auth_method 0 2023-12-03T11:38:24.116 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2023-12-03T11:38:23.985+0000 7fe7ae931800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:24.116 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2023-12-03T11:38:23.985+0000 7fe7ae931800 20 searching for the correct realm 2023-12-03T11:38:24.117 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2023-12-03T11:38:23.985+0000 7fe7aad7f640 10 monclient: get_auth_request con 0x55af404c2d80 auth_method 0 2023-12-03T11:38:24.117 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2023-12-03T11:38:23.986+0000 7fe7aa57e640 10 monclient: get_auth_request con 0x7fe7a405e040 auth_method 0 2023-12-03T11:38:24.117 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2023-12-03T11:38:23.987+0000 7fe7a9d7d640 10 monclient: get_auth_request con 0x7fe7a00571f0 auth_method 0 2023-12-03T11:38:24.117 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2023-12-03T11:38:23.989+0000 7fe7aad7f640 10 monclient: get_auth_request con 0x7fe7a0056480 auth_method 0 2023-12-03T11:38:24.117 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2023-12-03T11:38:23.991+0000 7fe7aa57e640 10 monclient: get_auth_request con 0x7fe7a005ed50 auth_method 0 2023-12-03T11:38:24.117 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2023-12-03T11:38:23.994+0000 7fe7aa57e640 0 -- 172.21.15.44:0/2550213081 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55af404badc0 msgr2=0x55af404bd1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:24.117 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2023-12-03T11:38:23.994+0000 7fe78affd640 1 client.6395.objecter ms_handle_reset 0x55af404badc0 session 0x55af40228320 osd.5 2023-12-03T11:38:24.117 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2023-12-03T11:38:23.994+0000 7fe78affd640 10 monclient: _renew_subs 2023-12-03T11:38:24.117 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2023-12-03T11:38:23.994+0000 7fe78affd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:38:24.117 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2023-12-03T11:38:23.995+0000 7fe7aa57e640 10 monclient: get_auth_request con 0x7fe784079e10 auth_method 0 2023-12-03T11:38:24.117 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2023-12-03T11:38:23.995+0000 7fe7ae931800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:24.117 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2023-12-03T11:38:23.995+0000 7fe7ae931800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:24.117 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2023-12-03T11:38:23.995+0000 7fe7ae931800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:24.117 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2023-12-03T11:38:23.995+0000 7fe7ae931800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:24.117 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2023-12-03T11:38:23.995+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.117 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.117 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.118 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:24.118 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.118 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:24.118 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2023-12-03T11:38:23.996+0000 7fe7ae931800 20 zone default found 2023-12-03T11:38:24.118 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2023-12-03T11:38:23.996+0000 7fe7ae931800 4 Realm: () 2023-12-03T11:38:24.118 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2023-12-03T11:38:23.996+0000 7fe7ae931800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:24.118 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2023-12-03T11:38:23.996+0000 7fe7ae931800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:24.118 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2023-12-03T11:38:23.996+0000 7fe7ae931800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:24.118 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2023-12-03T11:38:23.996+0000 7fe7ae931800 20 zonegroup default 2023-12-03T11:38:24.118 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.118 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.118 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2023-12-03T11:38:23.996+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.118 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2023-12-03T11:38:23.997+0000 7fe7ae931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.118 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2023-12-03T11:38:23.997+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.118 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2023-12-03T11:38:23.997+0000 7fe7ae931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.118 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2023-12-03T11:38:23.997+0000 7fe7ae931800 20 started sync module instance, tier type = 2023-12-03T11:38:24.119 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2023-12-03T11:38:23.997+0000 7fe7ae931800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:24.119 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2023-12-03T11:38:24.003+0000 7fe7aad7f640 0 -- 172.21.15.44:0/2550213081 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55af404c2d80 msgr2=0x55af404c5240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:24.119 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2023-12-03T11:38:24.003+0000 7fe78affd640 1 client.6395.objecter ms_handle_reset 0x55af404c2d80 session 0x55af404c2700 osd.3 2023-12-03T11:38:24.119 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2023-12-03T11:38:24.003+0000 7fe7aad7f640 10 monclient: get_auth_request con 0x55af404badc0 auth_method 0 2023-12-03T11:38:24.119 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2023-12-03T11:38:24.006+0000 7fe7ae931800 20 add_watcher() i=0 2023-12-03T11:38:24.119 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2023-12-03T11:38:24.006+0000 7fe7ae931800 20 add_watcher() i=1 2023-12-03T11:38:24.119 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2023-12-03T11:38:24.006+0000 7fe7ae931800 20 add_watcher() i=2 2023-12-03T11:38:24.119 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2023-12-03T11:38:24.006+0000 7fe7ae931800 20 add_watcher() i=3 2023-12-03T11:38:24.119 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2023-12-03T11:38:24.006+0000 7fe7ae931800 20 add_watcher() i=4 2023-12-03T11:38:24.119 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2023-12-03T11:38:24.006+0000 7fe7ae931800 20 add_watcher() i=5 2023-12-03T11:38:24.119 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2023-12-03T11:38:24.006+0000 7fe7ae931800 20 add_watcher() i=6 2023-12-03T11:38:24.119 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2023-12-03T11:38:24.007+0000 7fe7ae931800 20 add_watcher() i=7 2023-12-03T11:38:24.119 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2023-12-03T11:38:24.007+0000 7fe7ae931800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:24.119 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding auth protocol: cephx 2023-12-03T11:38:24.119 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding auth protocol: cephx 2023-12-03T11:38:24.119 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding auth protocol: cephx 2023-12-03T11:38:24.120 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: secure 2023-12-03T11:38:24.120 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: crc 2023-12-03T11:38:24.120 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: secure 2023-12-03T11:38:24.120 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: crc 2023-12-03T11:38:24.120 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: secure 2023-12-03T11:38:24.120 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: crc 2023-12-03T11:38:24.120 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: crc 2023-12-03T11:38:24.120 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: secure 2023-12-03T11:38:24.120 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: crc 2023-12-03T11:38:24.120 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: secure 2023-12-03T11:38:24.120 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2023-12-03T11:38:24.009+0000 7fe76ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:24.120 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: crc 2023-12-03T11:38:24.120 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b2370) adding con mode: secure 2023-12-03T11:38:24.120 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2023-12-03T11:38:24.009+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.120 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2023-12-03T11:38:24.009+0000 7fe7ae931800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:24.120 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2023-12-03T11:38:24.009+0000 7fe7ae931800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:24.120 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command cache list hook 0x55af403adf10 2023-12-03T11:38:24.121 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command cache inspect hook 0x55af403adf10 2023-12-03T11:38:24.121 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command cache erase hook 0x55af403adf10 2023-12-03T11:38:24.121 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command cache zap hook 0x55af403adf10 2023-12-03T11:38:24.121 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2023-12-03T11:38:24.009+0000 7fe7ae931800 10 monclient: get_monmap_and_config 2023-12-03T11:38:24.121 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2023-12-03T11:38:24.009+0000 7fe7ae931800 10 monclient: build_initial_monmap 2023-12-03T11:38:24.121 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2023-12-03T11:38:24.009+0000 7fe7ae931800 1 build_initial for_mkfs: 0 2023-12-03T11:38:24.121 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2023-12-03T11:38:24.009+0000 7fe7ae931800 10 monclient: monmap: 2023-12-03T11:38:24.121 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:38:24.121 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:38:24.121 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:38:24.121 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:38:24.121 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:38:24.121 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.121 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:38:24.121 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:38:24.121 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:38:24.121 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.122 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding auth protocol: cephx 2023-12-03T11:38:24.122 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding auth protocol: cephx 2023-12-03T11:38:24.122 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding auth protocol: cephx 2023-12-03T11:38:24.122 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: secure 2023-12-03T11:38:24.122 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: crc 2023-12-03T11:38:24.122 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: secure 2023-12-03T11:38:24.122 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: crc 2023-12-03T11:38:24.122 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: secure 2023-12-03T11:38:24.122 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: crc 2023-12-03T11:38:24.122 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: crc 2023-12-03T11:38:24.122 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: secure 2023-12-03T11:38:24.122 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: crc 2023-12-03T11:38:24.122 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: secure 2023-12-03T11:38:24.122 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: crc 2023-12-03T11:38:24.122 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x55af404fc270) adding con mode: secure 2023-12-03T11:38:24.122 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2023-12-03T11:38:24.009+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.123 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2023-12-03T11:38:24.009+0000 7fe7ae931800 10 monclient: init 2023-12-03T11:38:24.123 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding auth protocol: cephx 2023-12-03T11:38:24.123 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding auth protocol: cephx 2023-12-03T11:38:24.123 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding auth protocol: cephx 2023-12-03T11:38:24.123 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: secure 2023-12-03T11:38:24.123 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: crc 2023-12-03T11:38:24.123 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: secure 2023-12-03T11:38:24.123 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: crc 2023-12-03T11:38:24.123 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: secure 2023-12-03T11:38:24.123 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: crc 2023-12-03T11:38:24.123 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: crc 2023-12-03T11:38:24.123 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: secure 2023-12-03T11:38:24.123 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: crc 2023-12-03T11:38:24.123 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: secure 2023-12-03T11:38:24.123 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: crc 2023-12-03T11:38:24.123 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2023-12-03T11:38:24.009+0000 7fe7ae931800 5 AuthRegistry(0x7ffe0e0b1ec0) adding con mode: secure 2023-12-03T11:38:24.124 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2023-12-03T11:38:24.010+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.124 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2023-12-03T11:38:24.010+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.124 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2023-12-03T11:38:24.010+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command rotate-key cmddesc rotate-key hook 0x7ffe0e0b2008 EEXIST 2023-12-03T11:38:24.124 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2023-12-03T11:38:24.010+0000 7fe7ae931800 10 monclient: _reopen_session rank -1 2023-12-03T11:38:24.124 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2023-12-03T11:38:24.010+0000 7fe7ae931800 10 monclient: _add_conns ranks=[1,2,0] 2023-12-03T11:38:24.124 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2023-12-03T11:38:24.010+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-b con 0x55af404f2b20 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:38:24.124 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2023-12-03T11:38:24.010+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-c con 0x55af404f8770 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:38:24.124 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2023-12-03T11:38:24.010+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-a con 0x55af404fed10 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:38:24.124 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2023-12-03T11:38:24.010+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.124 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2023-12-03T11:38:24.010+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.124 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2023-12-03T11:38:24.010+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.124 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2023-12-03T11:38:24.010+0000 7fe7ae931800 10 monclient(hunting): _renew_subs 2023-12-03T11:38:24.124 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2023-12-03T11:38:24.010+0000 7fe7ae931800 10 monclient(hunting): authenticate will time out at 1583.237062s 2023-12-03T11:38:24.124 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2023-12-03T11:38:24.010+0000 7fe7a9d7d640 10 monclient(hunting): get_auth_request con 0x55af404fed10 auth_method 0 2023-12-03T11:38:24.124 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2023-12-03T11:38:24.010+0000 7fe7a9d7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.124 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2023-12-03T11:38:24.010+0000 7fe7a9d7d640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.124 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2023-12-03T11:38:24.010+0000 7fe7a9d7d640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.124 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2023-12-03T11:38:24.010+0000 7fe7aa57e640 10 monclient(hunting): get_auth_request con 0x55af404f8770 auth_method 0 2023-12-03T11:38:24.125 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2023-12-03T11:38:24.010+0000 7fe7aa57e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.125 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2023-12-03T11:38:24.010+0000 7fe7aa57e640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.125 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2023-12-03T11:38:24.010+0000 7fe7aa57e640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.125 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2023-12-03T11:38:24.010+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.125 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2023-12-03T11:38:24.010+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.125 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2023-12-03T11:38:24.010+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.125 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2023-12-03T11:38:24.010+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.125 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2023-12-03T11:38:24.010+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.125 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2023-12-03T11:38:24.010+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.125 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2023-12-03T11:38:24.010+0000 7fe7aad7f640 10 monclient(hunting): get_auth_request con 0x55af404f2b20 auth_method 0 2023-12-03T11:38:24.125 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2023-12-03T11:38:24.010+0000 7fe7aad7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.125 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2023-12-03T11:38:24.010+0000 7fe7aad7f640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.125 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2023-12-03T11:38:24.010+0000 7fe7aad7f640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.125 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2023-12-03T11:38:24.010+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.125 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2023-12-03T11:38:24.010+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.125 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2023-12-03T11:38:24.010+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.125 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2023-12-03T11:38:24.010+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_done global_id 6398 payload 274 2023-12-03T11:38:24.125 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2023-12-03T11:38:24.010+0000 7fe7aa57e640 10 monclient: _finish_hunting 0 2023-12-03T11:38:24.126 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2023-12-03T11:38:24.010+0000 7fe7aa57e640 1 monclient: found mon.noname-c 2023-12-03T11:38:24.126 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2023-12-03T11:38:24.010+0000 7fe7aa57e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2023-12-03T11:38:24.126 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2023-12-03T11:38:24.011+0000 7fe76f7e6640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:24.126 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2023-12-03T11:38:24.011+0000 7fe76f7e6640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:38:24.126 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2023-12-03T11:38:24.011+0000 7fe76f7e6640 10 monclient: dump: 2023-12-03T11:38:24.126 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:24.126 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:24.126 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.126 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.126 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:24.126 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.126 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:24.126 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:24.126 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:24.127 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.127 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2023-12-03T11:38:24.011+0000 7fe76f7e6640 10 monclient: _finish_auth 0 2023-12-03T11:38:24.127 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2023-12-03T11:38:24.011+0000 7fe76f7e6640 10 monclient: _check_auth_tickets 2023-12-03T11:38:24.127 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2023-12-03T11:38:24.011+0000 7fe76f7e6640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:38:24.127 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2023-12-03T11:38:24.011+0000 7fe76f7e6640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:24.127 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2023-12-03T11:38:24.011+0000 7fe76f7e6640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:38:24.127 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2023-12-03T11:38:24.011+0000 7fe76f7e6640 10 monclient: dump: 2023-12-03T11:38:24.127 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:24.127 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:24.127 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.127 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.127 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:24.127 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.127 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:24.127 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:24.127 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:24.128 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.128 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 monclient: authenticate success, global_id 6398 2023-12-03T11:38:24.128 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2023-12-03T11:38:24.011+0000 7fe7ae931800 10 monclient: get_monmap_and_config success 2023-12-03T11:38:24.128 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2023-12-03T11:38:24.011+0000 7fe7ae931800 4 set_mon_vals no callback set 2023-12-03T11:38:24.128 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2023-12-03T11:38:24.011+0000 7fe7ae931800 10 monclient: shutdown 2023-12-03T11:38:24.128 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2023-12-03T11:38:24.011+0000 7fe7ae931800 10 monclient: build_initial_monmap 2023-12-03T11:38:24.128 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2023-12-03T11:38:24.011+0000 7fe7ae931800 1 build_initial for_mkfs: 0 2023-12-03T11:38:24.128 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2023-12-03T11:38:24.011+0000 7fe7ae931800 10 monclient: monmap: 2023-12-03T11:38:24.128 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:38:24.128 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:38:24.128 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:38:24.128 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:38:24.128 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:38:24.128 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.128 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:38:24.129 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:38:24.129 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:38:24.129 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.129 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding auth protocol: cephx 2023-12-03T11:38:24.129 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding auth protocol: cephx 2023-12-03T11:38:24.129 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding auth protocol: cephx 2023-12-03T11:38:24.129 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: secure 2023-12-03T11:38:24.129 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: crc 2023-12-03T11:38:24.129 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: secure 2023-12-03T11:38:24.129 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: crc 2023-12-03T11:38:24.129 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: secure 2023-12-03T11:38:24.129 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: crc 2023-12-03T11:38:24.129 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: crc 2023-12-03T11:38:24.129 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: secure 2023-12-03T11:38:24.129 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: crc 2023-12-03T11:38:24.129 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: secure 2023-12-03T11:38:24.129 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: crc 2023-12-03T11:38:24.130 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2023-12-03T11:38:24.011+0000 7fe7ae931800 5 AuthRegistry(0x55af404f1780) adding con mode: secure 2023-12-03T11:38:24.130 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2023-12-03T11:38:24.012+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.130 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2023-12-03T11:38:24.012+0000 7fe7ae931800 1 librados: starting msgr at 2023-12-03T11:38:24.130 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2023-12-03T11:38:24.012+0000 7fe7ae931800 1 librados: starting objecter 2023-12-03T11:38:24.130 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command objecter_requests cmddesc objecter_requests hook 0x55af404ff0f0 EEXIST 2023-12-03T11:38:24.130 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2023-12-03T11:38:24.012+0000 7fe7ae931800 1 librados: setting wanted keys 2023-12-03T11:38:24.130 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2023-12-03T11:38:24.012+0000 7fe7ae931800 1 librados: calling monclient init 2023-12-03T11:38:24.130 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2023-12-03T11:38:24.012+0000 7fe7ae931800 10 monclient: init 2023-12-03T11:38:24.130 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding auth protocol: cephx 2023-12-03T11:38:24.130 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding auth protocol: cephx 2023-12-03T11:38:24.130 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding auth protocol: cephx 2023-12-03T11:38:24.130 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: secure 2023-12-03T11:38:24.130 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: crc 2023-12-03T11:38:24.130 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: secure 2023-12-03T11:38:24.130 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: crc 2023-12-03T11:38:24.130 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: secure 2023-12-03T11:38:24.130 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: crc 2023-12-03T11:38:24.131 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: crc 2023-12-03T11:38:24.131 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: secure 2023-12-03T11:38:24.131 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: crc 2023-12-03T11:38:24.131 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: secure 2023-12-03T11:38:24.131 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: crc 2023-12-03T11:38:24.131 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 AuthRegistry(0x55af404ff788) adding con mode: secure 2023-12-03T11:38:24.131 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2023-12-03T11:38:24.012+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.131 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2023-12-03T11:38:24.012+0000 7fe7ae931800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:24.131 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2023-12-03T11:38:24.012+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command rotate-key cmddesc rotate-key hook 0x55af404ff8d0 EEXIST 2023-12-03T11:38:24.131 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2023-12-03T11:38:24.012+0000 7fe7ae931800 10 monclient: _reopen_session rank -1 2023-12-03T11:38:24.131 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2023-12-03T11:38:24.012+0000 7fe7ae931800 10 monclient: _add_conns ranks=[2,1,0] 2023-12-03T11:38:24.131 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2023-12-03T11:38:24.012+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-c con 0x55af404f2b20 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:38:24.131 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2023-12-03T11:38:24.012+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-b con 0x55af404f8770 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:38:24.131 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2023-12-03T11:38:24.012+0000 7fe7ae931800 10 monclient(hunting): picked mon.noname-a con 0x55af404fed10 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:38:24.131 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2023-12-03T11:38:24.012+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.131 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2023-12-03T11:38:24.012+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.131 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2023-12-03T11:38:24.012+0000 7fe7ae931800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:24.132 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2023-12-03T11:38:24.012+0000 7fe7ae931800 10 monclient(hunting): _renew_subs 2023-12-03T11:38:24.132 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2023-12-03T11:38:24.012+0000 7fe7ae931800 10 monclient(hunting): authenticate will time out at 1583.239557s 2023-12-03T11:38:24.132 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2023-12-03T11:38:24.012+0000 7fe7aad7f640 10 monclient(hunting): get_auth_request con 0x55af404f2b20 auth_method 0 2023-12-03T11:38:24.132 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2023-12-03T11:38:24.012+0000 7fe7aad7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.132 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2023-12-03T11:38:24.012+0000 7fe7aad7f640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.132 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2023-12-03T11:38:24.012+0000 7fe7aad7f640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.132 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2023-12-03T11:38:24.013+0000 7fe7a9d7d640 10 monclient(hunting): get_auth_request con 0x55af404fed10 auth_method 0 2023-12-03T11:38:24.132 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2023-12-03T11:38:24.013+0000 7fe7a9d7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.132 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2023-12-03T11:38:24.013+0000 7fe7a9d7d640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.132 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2023-12-03T11:38:24.013+0000 7fe7a9d7d640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.132 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2023-12-03T11:38:24.013+0000 7fe7aa57e640 10 monclient(hunting): get_auth_request con 0x55af404f8770 auth_method 0 2023-12-03T11:38:24.132 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2023-12-03T11:38:24.013+0000 7fe7aa57e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:24.132 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2023-12-03T11:38:24.013+0000 7fe7aa57e640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:24.132 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2023-12-03T11:38:24.013+0000 7fe7aa57e640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:24.132 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2023-12-03T11:38:24.013+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.132 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2023-12-03T11:38:24.013+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.132 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2023-12-03T11:38:24.013+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.132 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2023-12-03T11:38:24.013+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.133 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2023-12-03T11:38:24.013+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.133 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2023-12-03T11:38:24.013+0000 7fe7a9d7d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.133 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2023-12-03T11:38:24.013+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:24.133 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2023-12-03T11:38:24.013+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:24.133 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2023-12-03T11:38:24.013+0000 7fe7aa57e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:24.133 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2023-12-03T11:38:24.013+0000 7fe7aad7f640 10 monclient(hunting): handle_auth_done global_id 6401 payload 824 2023-12-03T11:38:24.133 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2023-12-03T11:38:24.013+0000 7fe7aad7f640 10 monclient: _finish_hunting 0 2023-12-03T11:38:24.133 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2023-12-03T11:38:24.013+0000 7fe7aad7f640 1 monclient: found mon.noname-c 2023-12-03T11:38:24.133 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2023-12-03T11:38:24.013+0000 7fe7aad7f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2023-12-03T11:38:24.133 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2023-12-03T11:38:24.013+0000 7fe76dfe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:24.133 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2023-12-03T11:38:24.013+0000 7fe76dfe3640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:38:24.133 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2023-12-03T11:38:24.013+0000 7fe76dfe3640 10 monclient: dump: 2023-12-03T11:38:24.133 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:24.133 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:24.133 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.133 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.133 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:24.134 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.134 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:24.134 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:24.134 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:24.134 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.134 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2023-12-03T11:38:24.013+0000 7fe76dfe3640 10 monclient: _finish_auth 0 2023-12-03T11:38:24.134 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2023-12-03T11:38:24.013+0000 7fe76dfe3640 10 monclient: _check_auth_tickets 2023-12-03T11:38:24.134 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2023-12-03T11:38:24.013+0000 7fe76dfe3640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:38:24.134 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2023-12-03T11:38:24.013+0000 7fe76dfe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:24.134 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2023-12-03T11:38:24.013+0000 7fe76dfe3640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:38:24.134 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2023-12-03T11:38:24.013+0000 7fe76dfe3640 10 monclient: dump: 2023-12-03T11:38:24.134 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:24.134 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:24.134 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.134 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:24.135 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:24.135 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:24.135 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:24.135 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:24.135 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:24.135 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.135 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2023-12-03T11:38:24.013+0000 7fe76f7e6640 4 set_mon_vals no callback set 2023-12-03T11:38:24.135 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2023-12-03T11:38:24.013+0000 7fe7ae931800 5 monclient: authenticate success, global_id 6401 2023-12-03T11:38:24.135 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2023-12-03T11:38:24.013+0000 7fe7ae931800 10 monclient: _renew_subs 2023-12-03T11:38:24.135 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2023-12-03T11:38:24.013+0000 7fe7ae931800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:38:24.135 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2023-12-03T11:38:24.013+0000 7fe7ae931800 10 monclient: _renew_subs 2023-12-03T11:38:24.135 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2023-12-03T11:38:24.013+0000 7fe7ae931800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:38:24.135 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2023-12-03T11:38:24.013+0000 7fe7ae931800 1 librados: init done 2023-12-03T11:38:24.135 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2023-12-03T11:38:24.013+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command cr dump hook 0x55af40511078 2023-12-03T11:38:24.135 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2023-12-03T11:38:24.015+0000 7fe76dfe3640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:38:24.135 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2023-12-03T11:38:24.015+0000 7fe76dfe3640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:24.135 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2023-12-03T11:38:24.015+0000 7fe76dfe3640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:24.136 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2023-12-03T11:38:24.015+0000 7fe7aa57e640 10 monclient: get_auth_request con 0x7fe6e4069850 auth_method 0 2023-12-03T11:38:24.136 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2023-12-03T11:38:24.015+0000 7fe7ae931800 5 note: GC not initialized 2023-12-03T11:38:24.136 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2023-12-03T11:38:24.015+0000 7fe6deffd640 20 reqs_thread_entry: start 2023-12-03T11:38:24.136 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2023-12-03T11:38:24.015+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command sync trace show hook 0x7fe7a4004720 2023-12-03T11:38:24.136 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2023-12-03T11:38:24.015+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command sync trace history hook 0x7fe7a4004720 2023-12-03T11:38:24.136 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2023-12-03T11:38:24.015+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command sync trace active hook 0x7fe7a4004720 2023-12-03T11:38:24.136 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2023-12-03T11:38:24.015+0000 7fe7ae931800 5 asok(0x55af4025fa10) register_command sync trace active_short hook 0x7fe7a4004720 2023-12-03T11:38:24.136 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2023-12-03T11:38:24.015+0000 7fe7ae931800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:24.136 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2023-12-03T11:38:24.015+0000 7fe7ae931800 20 Filter name: none 2023-12-03T11:38:24.136 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2023-12-03T11:38:24.016+0000 7fe6dcff9640 20 reqs_thread_entry: start 2023-12-03T11:38:24.136 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2023-12-03T11:38:24.016+0000 7fe7ae931800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2023-12-03T11:38:24.136 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2023-12-03T11:38:24.016+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.136 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2023-12-03T11:38:24.016+0000 7fe7ae931800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:38:24.136 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2023-12-03T11:38:24.016+0000 7fe7ae931800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2023-12-03T11:38:24.136 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2023-12-03T11:38:24.016+0000 7fe7ae931800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2023-12-03T11:38:24.136 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2023-12-03T11:38:24.016+0000 7fe7ae931800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 : miss 2023-12-03T11:38:24.136 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2023-12-03T11:38:24.016+0000 7fe7ae931800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.137 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2023-12-03T11:38:24.017+0000 7fe7ae931800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:38:24.137 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2023-12-03T11:38:24.017+0000 7fe7ae931800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 info.flags=0x17 2023-12-03T11:38:24.137 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2023-12-03T11:38:24.017+0000 7fe7ae931800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 to cache LRU end 2023-12-03T11:38:24.137 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2023-12-03T11:38:24.017+0000 7fe7ae931800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:38:24.137 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2023-12-03T11:38:24.017+0000 7fe7ae931800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:24.137 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2023-12-03T11:38:24.017+0000 7fe7ae931800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 2023-12-03T11:38:24.137 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2023-12-03T11:38:24.017+0000 7fe7a9d7d640 10 monclient: get_auth_request con 0x55af4054ccb0 auth_method 0 2023-12-03T11:38:24.137 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2023-12-03T11:38:24.021+0000 7fe7ae931800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 info.flags=0x17 2023-12-03T11:38:24.137 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2023-12-03T11:38:24.021+0000 7fe7ae931800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 to cache LRU end 2023-12-03T11:38:24.137 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2023-12-03T11:38:24.021+0000 7fe7ae931800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:24.137 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2023-12-03T11:38:24.021+0000 7fe7ae931800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22, ofs0, ns] 2023-12-03T11:38:24.137 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2023-12-03T11:38:24.022+0000 7fe798ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693277 cookie 94211186373040 notifier 6395 bl.length()=877 2023-12-03T11:38:24.137 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2023-12-03T11:38:24.022+0000 7fe798ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 info.flags=0x17 2023-12-03T11:38:24.137 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2023-12-03T11:38:24.022+0000 7fe798ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 to cache LRU end 2023-12-03T11:38:24.137 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2023-12-03T11:38:24.022+0000 7fe798ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:24.137 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2023-12-03T11:38:24.022+0000 7fe7ae931800 20 handle_bi_update(): bucket=:abort-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22]): orig_sources= new_sources= 2023-12-03T11:38:24.138 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2023-12-03T11:38:24.022+0000 7fe7ae931800 20 handle_bi_update(): bucket=:abort-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22]): potential sources added=[] removed=[] 2023-12-03T11:38:24.138 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2023-12-03T11:38:24.022+0000 7fe7ae931800 20 handle_bi_update(): bucket=:abort-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22]): orig_dests= new_dests= 2023-12-03T11:38:24.138 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2023-12-03T11:38:24.022+0000 7fe7ae931800 20 handle_bi_update(): bucket=:abort-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22]): potential dests added=[] removed=[] 2023-12-03T11:38:24.138 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2023-12-03T11:38:24.023+0000 7fe7ae931800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe7ae931800 time 2023-12-03T11:38:24.024323+0000 2023-12-03T11:38:24.138 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:38:24.138 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.138 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:38:24.138 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe7b156eef8] 2023-12-03T11:38:24.138 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7fe7b156f0b6] 2023-12-03T11:38:24.138 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af3ebbca71] 2023-12-03T11:38:24.138 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55af3ebc8ec4] 2023-12-03T11:38:24.138 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2023-12-03T11:38:24.138 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fe7aec3feb0] 2023-12-03T11:38:24.138 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2023-12-03T11:38:24.138 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2023-12-03T11:38:24.139 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.139 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2023-12-03T11:38:24.023+0000 7fe7ae931800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:38:24.139 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7fe7ae931800 thread_name:radosgw-admin 2023-12-03T11:38:24.139 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.139 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:38:24.139 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fe7aec54db0] 2023-12-03T11:38:24.139 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fe7aeca154c] 2023-12-03T11:38:24.139 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2023-12-03T11:38:24.139 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2023-12-03T11:38:24.139 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe7b156ef52] 2023-12-03T11:38:24.139 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7fe7b156f0b6] 2023-12-03T11:38:24.139 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af3ebbca71] 2023-12-03T11:38:24.139 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55af3ebc8ec4] 2023-12-03T11:38:24.139 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2023-12-03T11:38:24.139 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fe7aec3feb0] 2023-12-03T11:38:24.139 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2023-12-03T11:38:24.140 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2023-12-03T11:38:24.140 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:38:24.140 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.140 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2023-12-03T11:38:24.140 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2023-12-03T11:38:24.140 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2023-12-03T11:38:24.140 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2023-12-03T11:38:24.140 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2023-12-03T11:38:24.140 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2023-12-03T11:38:24.140 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2023-12-03T11:38:24.140 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2023-12-03T11:38:24.140 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2023-12-03T11:38:24.140 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2023-12-03T11:38:24.140 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2023-12-03T11:38:24.140 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2023-12-03T11:38:24.140 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2023-12-03T11:38:24.140 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2023-12-03T11:38:24.140 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2023-12-03T11:38:24.141 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2023-12-03T11:38:24.141 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2023-12-03T11:38:24.141 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2023-12-03T11:38:24.141 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2023-12-03T11:38:24.141 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2023-12-03T11:38:24.141 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2023-12-03T11:38:24.141 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2023-12-03T11:38:24.141 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2023-12-03T11:38:24.141 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:38:24.141 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2023-12-03T11:38:24.141 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2023-12-03T11:38:24.141 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2023-12-03T11:38:24.141 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2023-12-03T11:38:24.141 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2023-12-03T11:38:24.141 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2023-12-03T11:38:24.141 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2023-12-03T11:38:24.141 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2023-12-03T11:38:24.141 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2023-12-03T11:38:24.142 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2023-12-03T11:38:24.142 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2023-12-03T11:38:24.142 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2023-12-03T11:38:24.142 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2023-12-03T11:38:24.142 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2023-12-03T11:38:24.142 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2023-12-03T11:38:24.142 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2023-12-03T11:38:24.142 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2023-12-03T11:38:24.142 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2023-12-03T11:38:24.142 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2023-12-03T11:38:24.142 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2023-12-03T11:38:24.142 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2023-12-03T11:38:24.142 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:38:24.142 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2023-12-03T11:38:24.142 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2023-12-03T11:38:24.142 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2023-12-03T11:38:24.142 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2023-12-03T11:38:24.143 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2023-12-03T11:38:24.143 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2023-12-03T11:38:24.143 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2023-12-03T11:38:24.143 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2023-12-03T11:38:24.143 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2023-12-03T11:38:24.143 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2023-12-03T11:38:24.143 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2023-12-03T11:38:24.143 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2023-12-03T11:38:24.143 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2023-12-03T11:38:24.143 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2023-12-03T11:38:24.143 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2023-12-03T11:38:24.143 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2023-12-03T11:38:24.143 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2023-12-03T11:38:24.143 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2023-12-03T11:38:24.143 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:38:24.143 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2023-12-03T11:38:24.143 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:38:24.143 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2023-12-03T11:38:24.144 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2023-12-03T11:38:24.144 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2023-12-03T11:38:24.144 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2023-12-03T11:38:24.144 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2023-12-03T11:38:24.144 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2023-12-03T11:38:24.144 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:38:24.144 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2023-12-03T11:38:24.144 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2023-12-03T11:38:24.144 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:38:24.144 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2023-12-03T11:38:24.144 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2023-12-03T11:38:24.144 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2023-12-03T11:38:24.144 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2023-12-03T11:38:24.144 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2023-12-03T11:38:24.144 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2023-12-03T11:38:24.144 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2023-12-03T11:38:24.144 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2023-12-03T11:38:24.145 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2023-12-03T11:38:24.145 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2023-12-03T11:38:24.145 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2023-12-03T11:38:24.145 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2023-12-03T11:38:24.145 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:38:24.145 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe6dcff9640 / http_manager 2023-12-03T11:38:24.145 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe6deffd640 / http_manager 2023-12-03T11:38:24.145 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe76dfe3640 / ms_dispatch 2023-12-03T11:38:24.145 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe76f7e6640 / io_context_pool 2023-12-03T11:38:24.145 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe76ffe7640 / rgw_dt_lg_renew 2023-12-03T11:38:24.145 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe78affd640 / ms_dispatch 2023-12-03T11:38:24.145 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe798ff9640 / io_context_pool 2023-12-03T11:38:24.145 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe79b7fe640 / ms_dispatch 2023-12-03T11:38:24.145 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe7a9d7d640 / msgr-worker-2 2023-12-03T11:38:24.145 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe7aa57e640 / msgr-worker-1 2023-12-03T11:38:24.145 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe7aad7f640 / msgr-worker-0 2023-12-03T11:38:24.145 INFO:tasks.workunit.client.0.smithi044.stderr: 7fe7ae931800 / radosgw-admin 2023-12-03T11:38:24.146 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2023-12-03T11:38:24.146 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2023-12-03T11:38:24.146 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/lib/ceph/crash/2023-12-03T11:38:24.025678Z_bab91c1b-4001-4407-a2a9-2fef981b3952/log 2023-12-03T11:38:24.146 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2023-12-03T11:38:24.146 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2023-12-03T11:38:24.150 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:24.151 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:24.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.074+0000 7fc79e52c800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.076+0000 7fc79e52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.076+0000 7fc79e52c800 20 realm 2023-12-03T11:38:24.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.076+0000 7fc79e52c800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.076+0000 7fc79e52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.076+0000 7fc79e52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:24.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.076+0000 7fc79e52c800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.076+0000 7fc79e52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.076+0000 7fc79e52c800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.077+0000 7fc79e52c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:24.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.077+0000 7fc79e52c800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.078+0000 7fc79e52c800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:24.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.078+0000 7fc79e52c800 20 searching for the correct realm 2023-12-03T11:38:24.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.087+0000 7fc791af6640 0 -- 172.21.15.44:0/2587860905 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x560e56c8cec0 msgr2=0x560e56c8f2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:24.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.088+0000 7fc79e52c800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:24.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.088+0000 7fc79e52c800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:24.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.088+0000 7fc79e52c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:24.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.088+0000 7fc79e52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:24.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.088+0000 7fc79e52c800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.088+0000 7fc79e52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.088+0000 7fc79e52c800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.089+0000 7fc79e52c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:24.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.089+0000 7fc79e52c800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.089+0000 7fc79e52c800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:24.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.089+0000 7fc79e52c800 20 zone default found 2023-12-03T11:38:24.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.089+0000 7fc79e52c800 4 Realm: () 2023-12-03T11:38:24.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.089+0000 7fc79e52c800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:24.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.089+0000 7fc79e52c800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:24.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.089+0000 7fc79e52c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:24.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.089+0000 7fc79e52c800 20 zonegroup default 2023-12-03T11:38:24.152 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.089+0000 7fc79e52c800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.153 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.089+0000 7fc79e52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.153 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.089+0000 7fc79e52c800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.153 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.090+0000 7fc79e52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.153 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.090+0000 7fc79e52c800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.153 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.090+0000 7fc79e52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.153 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.090+0000 7fc79e52c800 20 started sync module instance, tier type = 2023-12-03T11:38:24.153 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.090+0000 7fc79e52c800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:24.153 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.095+0000 7fc791af6640 0 -- 172.21.15.44:0/2587860905 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x7fc774079e10 msgr2=0x7fc77407c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:24.153 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.099+0000 7fc79e52c800 20 add_watcher() i=0 2023-12-03T11:38:24.153 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.099+0000 7fc79e52c800 20 add_watcher() i=1 2023-12-03T11:38:24.153 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.099+0000 7fc79e52c800 20 add_watcher() i=2 2023-12-03T11:38:24.153 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.099+0000 7fc79e52c800 20 add_watcher() i=3 2023-12-03T11:38:24.153 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.099+0000 7fc79e52c800 20 add_watcher() i=4 2023-12-03T11:38:24.153 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.099+0000 7fc79e52c800 20 add_watcher() i=5 2023-12-03T11:38:24.153 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.099+0000 7fc79e52c800 20 add_watcher() i=6 2023-12-03T11:38:24.153 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.100+0000 7fc79e52c800 20 add_watcher() i=7 2023-12-03T11:38:24.153 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.100+0000 7fc79e52c800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:24.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.101+0000 7fc75ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:24.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.102+0000 7fc79e52c800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:24.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.102+0000 7fc79e52c800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:24.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.107+0000 7fc79e52c800 5 note: GC not initialized 2023-12-03T11:38:24.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.108+0000 7fc6ceffd640 20 reqs_thread_entry: start 2023-12-03T11:38:24.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.108+0000 7fc79e52c800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:24.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.108+0000 7fc79e52c800 20 Filter name: none 2023-12-03T11:38:24.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.108+0000 7fc6ccff9640 20 reqs_thread_entry: start 2023-12-03T11:38:24.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.108+0000 7fc79e52c800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.108+0000 7fc79e52c800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:38:24.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.108+0000 7fc79e52c800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.109+0000 7fc79e52c800 20 rados_obj.operate() r=0 bl.length=405 2023-12-03T11:38:24.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.109+0000 7fc79e52c800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:24.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.109+0000 7fc79e52c800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.109+0000 7fc79e52c800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:38:24.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.109+0000 7fc79e52c800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.109+0000 7fc79e52c800 20 rados_obj.operate() r=0 bl.length=405 2023-12-03T11:38:24.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.109+0000 7fc79e52c800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:24.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.110+0000 7fc79e52c800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.110+0000 7fc79e52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.111+0000 7fc75ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:24.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.113+0000 7fc79e52c800 20 remove_watcher() i=0 2023-12-03T11:38:24.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.113+0000 7fc79e52c800 2 removed watcher, disabling cache 2023-12-03T11:38:24.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.114+0000 7fc79e52c800 20 remove_watcher() i=1 2023-12-03T11:38:24.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.115+0000 7fc79e52c800 20 remove_watcher() i=2 2023-12-03T11:38:24.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.116+0000 7fc79e52c800 20 remove_watcher() i=3 2023-12-03T11:38:24.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.117+0000 7fc79e52c800 20 remove_watcher() i=4 2023-12-03T11:38:24.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.118+0000 7fc79e52c800 20 remove_watcher() i=5 2023-12-03T11:38:24.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.119+0000 7fc79e52c800 20 remove_watcher() i=6 2023-12-03T11:38:24.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.120+0000 7fc79e52c800 20 remove_watcher() i=7 2023-12-03T11:38:24.155 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.155 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:38:24.155 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-block-writes id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:38:24.155 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:24.178 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:38:24.210 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:24.210 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:24.224 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.222+0000 7fb08e522800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.226 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.224+0000 7fb08e522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.226 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.224+0000 7fb08e522800 20 realm 2023-12-03T11:38:24.226 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.224+0000 7fb08e522800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.226 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.224+0000 7fb08e522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.227 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.224+0000 7fb08e522800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:24.227 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.224+0000 7fb08e522800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.227 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.224+0000 7fb08e522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.227 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.224+0000 7fb08e522800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.227 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.225+0000 7fb08e522800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:24.227 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.225+0000 7fb08e522800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.228 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.226+0000 7fb08e522800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:24.228 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.226+0000 7fb08e522800 20 searching for the correct realm 2023-12-03T11:38:24.238 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.236+0000 7fb08a971640 0 -- 172.21.15.44:0/2911290284 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x557535117810 msgr2=0x557535119cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:24.239 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.236+0000 7fb08e522800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:24.239 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.236+0000 7fb08e522800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:24.239 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.236+0000 7fb08e522800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:24.239 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.236+0000 7fb08e522800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:24.239 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.236+0000 7fb08e522800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.239 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.237+0000 7fb08e522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.239 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.237+0000 7fb08e522800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.239 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.237+0000 7fb08e522800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:24.239 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.237+0000 7fb08e522800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.240 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.237+0000 7fb08e522800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:24.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.237+0000 7fb08e522800 20 zone default found 2023-12-03T11:38:24.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.237+0000 7fb08e522800 4 Realm: () 2023-12-03T11:38:24.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.237+0000 7fb08e522800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:24.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.237+0000 7fb08e522800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:24.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.237+0000 7fb08e522800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:24.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.237+0000 7fb08e522800 20 zonegroup default 2023-12-03T11:38:24.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.237+0000 7fb08e522800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.237+0000 7fb08e522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.237+0000 7fb08e522800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.238+0000 7fb08e522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.238+0000 7fb08e522800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.238+0000 7fb08e522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:24.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.238+0000 7fb08e522800 20 started sync module instance, tier type = 2023-12-03T11:38:24.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.238+0000 7fb08e522800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:24.247 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.245+0000 7fb08a971640 0 -- 172.21.15.44:0/2911290284 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7fb07403e450 msgr2=0x7fb07403e8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:24.249 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.247+0000 7fb08e522800 20 add_watcher() i=0 2023-12-03T11:38:24.249 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.247+0000 7fb08e522800 20 add_watcher() i=1 2023-12-03T11:38:24.249 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.247+0000 7fb08e522800 20 add_watcher() i=2 2023-12-03T11:38:24.249 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.247+0000 7fb08e522800 20 add_watcher() i=3 2023-12-03T11:38:24.249 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.247+0000 7fb08e522800 20 add_watcher() i=4 2023-12-03T11:38:24.249 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.247+0000 7fb08e522800 20 add_watcher() i=5 2023-12-03T11:38:24.249 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.247+0000 7fb08e522800 20 add_watcher() i=6 2023-12-03T11:38:24.250 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.248+0000 7fb08e522800 20 add_watcher() i=7 2023-12-03T11:38:24.250 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.248+0000 7fb08e522800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:24.251 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.249+0000 7fb04ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:24.251 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.249+0000 7fb08e522800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:24.251 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.249+0000 7fb08e522800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:24.258 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.255+0000 7fb08e522800 5 note: GC not initialized 2023-12-03T11:38:24.258 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.256+0000 7fafbeffd640 20 reqs_thread_entry: start 2023-12-03T11:38:24.258 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.256+0000 7fb08e522800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:24.258 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.256+0000 7fb08e522800 20 Filter name: none 2023-12-03T11:38:24.258 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.256+0000 7fafbcff9640 20 reqs_thread_entry: start 2023-12-03T11:38:24.258 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.256+0000 7fb08e522800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2023-12-03T11:38:24.258 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.256+0000 7fb08e522800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.259 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.256+0000 7fb08e522800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:38:24.259 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.256+0000 7fb08e522800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2023-12-03T11:38:24.260 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.256+0000 7fb08e522800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2023-12-03T11:38:24.260 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.256+0000 7fb08e522800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 : miss 2023-12-03T11:38:24.260 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.256+0000 7fb08e522800 20 rados->read ofs=0 len=0 2023-12-03T11:38:24.260 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.257+0000 7fb08e522800 20 rados_obj.operate() r=0 bl.length=405 2023-12-03T11:38:24.260 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.257+0000 7fb08e522800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 info.flags=0x17 2023-12-03T11:38:24.260 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.257+0000 7fb08e522800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 to cache LRU end 2023-12-03T11:38:24.260 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.257+0000 7fb08e522800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:38:24.260 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.257+0000 7fb08e522800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:24.260 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.257+0000 7fb08e522800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 2023-12-03T11:38:24.260 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.258+0000 7fb08e522800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 to be held by another RGW process; skipping for now 2023-12-03T11:38:24.261 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.259+0000 7fb04ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:24.263 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.261+0000 7fb08e522800 20 remove_watcher() i=0 2023-12-03T11:38:24.263 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.261+0000 7fb08e522800 2 removed watcher, disabling cache 2023-12-03T11:38:24.264 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.262+0000 7fb08e522800 20 remove_watcher() i=1 2023-12-03T11:38:24.265 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.263+0000 7fb08e522800 20 remove_watcher() i=2 2023-12-03T11:38:24.266 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.264+0000 7fb08e522800 20 remove_watcher() i=3 2023-12-03T11:38:24.268 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.266+0000 7fb08e522800 20 remove_watcher() i=4 2023-12-03T11:38:24.269 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.267+0000 7fb08e522800 20 remove_watcher() i=5 2023-12-03T11:38:24.270 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.268+0000 7fb08e522800 20 remove_watcher() i=6 2023-12-03T11:38:24.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:24.269+0000 7fb08e522800 20 remove_watcher() i=7 2023-12-03T11:38:24.275 INFO:tasks.workunit.client.0.smithi044.stderr:waiting 30 seconds for reshard lock to expire... 2023-12-03T11:38:54.308 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:38:54.343 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:54.343 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:54.360 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.359+0000 7fbc74d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.362 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.361+0000 7fbc74d32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.362 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.361+0000 7fbc74d32800 20 realm 2023-12-03T11:38:54.362 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.361+0000 7fbc74d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.362 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.361+0000 7fbc74d32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.363 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.361+0000 7fbc74d32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:54.363 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.361+0000 7fbc74d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.363 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.361+0000 7fbc74d32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.363 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.361+0000 7fbc74d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.363 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.362+0000 7fbc74d32800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:54.363 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.362+0000 7fbc74d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.364 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.363+0000 7fbc74d32800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:54.364 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.363+0000 7fbc74d32800 20 searching for the correct realm 2023-12-03T11:38:54.375 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.374+0000 7fbc7095b640 0 -- 172.21.15.44:0/3342513636 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55d9b80c5230 msgr2=0x55d9b80c7620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:54.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.376+0000 7fbc74d32800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:54.377 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.376+0000 7fbc74d32800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:54.378 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.376+0000 7fbc74d32800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:54.378 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.376+0000 7fbc74d32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:54.378 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.376+0000 7fbc74d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.378 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.376+0000 7fbc74d32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.378 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.376+0000 7fbc74d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.379 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.377+0000 7fbc74d32800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:54.379 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.377+0000 7fbc74d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.379 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.377+0000 7fbc74d32800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:54.379 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.377+0000 7fbc74d32800 20 zone default found 2023-12-03T11:38:54.379 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.377+0000 7fbc74d32800 4 Realm: () 2023-12-03T11:38:54.379 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.377+0000 7fbc74d32800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:54.380 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.377+0000 7fbc74d32800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:54.380 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.377+0000 7fbc74d32800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:54.380 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.377+0000 7fbc74d32800 20 zonegroup default 2023-12-03T11:38:54.380 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.377+0000 7fbc74d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.380 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.377+0000 7fbc74d32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.380 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.377+0000 7fbc74d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.380 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.378+0000 7fbc74d32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.380 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.378+0000 7fbc74d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.380 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.378+0000 7fbc74d32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.380 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.378+0000 7fbc74d32800 20 started sync module instance, tier type = 2023-12-03T11:38:54.380 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.378+0000 7fbc74d32800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:54.387 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.386+0000 7fbc7115c640 0 -- 172.21.15.44:0/3342513636 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55d9b80cd0b0 msgr2=0x55d9b80cf570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:54.390 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.389+0000 7fbc74d32800 20 add_watcher() i=0 2023-12-03T11:38:54.390 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.389+0000 7fbc74d32800 20 add_watcher() i=1 2023-12-03T11:38:54.390 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.389+0000 7fbc74d32800 20 add_watcher() i=2 2023-12-03T11:38:54.390 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.389+0000 7fbc74d32800 20 add_watcher() i=3 2023-12-03T11:38:54.390 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.389+0000 7fbc74d32800 20 add_watcher() i=4 2023-12-03T11:38:54.390 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.389+0000 7fbc74d32800 20 add_watcher() i=5 2023-12-03T11:38:54.391 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.389+0000 7fbc74d32800 20 add_watcher() i=6 2023-12-03T11:38:54.391 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.390+0000 7fbc74d32800 20 add_watcher() i=7 2023-12-03T11:38:54.391 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.390+0000 7fbc74d32800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:54.393 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.392+0000 7fbc36fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:54.394 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.393+0000 7fbc74d32800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:54.394 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.393+0000 7fbc74d32800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:54.400 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.399+0000 7fbc74d32800 5 note: GC not initialized 2023-12-03T11:38:54.401 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.399+0000 7fbba5ffb640 20 reqs_thread_entry: start 2023-12-03T11:38:54.401 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.400+0000 7fbc74d32800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:54.401 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.400+0000 7fbc74d32800 20 Filter name: none 2023-12-03T11:38:54.401 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.400+0000 7fbb977fe640 20 reqs_thread_entry: start 2023-12-03T11:38:54.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.400+0000 7fbc74d32800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2023-12-03T11:38:54.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.400+0000 7fbc74d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.400+0000 7fbc74d32800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:38:54.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.400+0000 7fbc74d32800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2023-12-03T11:38:54.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.400+0000 7fbc74d32800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2023-12-03T11:38:54.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.400+0000 7fbc74d32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 : miss 2023-12-03T11:38:54.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.400+0000 7fbc74d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.401+0000 7fbc74d32800 20 rados_obj.operate() r=0 bl.length=405 2023-12-03T11:38:54.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.401+0000 7fbc74d32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 info.flags=0x17 2023-12-03T11:38:54.403 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.401+0000 7fbc74d32800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 to cache LRU end 2023-12-03T11:38:54.403 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.401+0000 7fbc74d32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:38:54.403 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.401+0000 7fbc74d32800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:54.403 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.401+0000 7fbc74d32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 2023-12-03T11:38:54.403 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.403+0000 7fbc74d32800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2023-12-03T11:38:54.408 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.406+0000 7fbc74d32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 info.flags=0x17 2023-12-03T11:38:54.408 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.406+0000 7fbc74d32800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 to cache LRU end 2023-12-03T11:38:54.408 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.406+0000 7fbc74d32800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:54.408 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.406+0000 7fbc74d32800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22, ofs0, ns] 2023-12-03T11:38:54.408 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.407+0000 7fbc577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693278 cookie 94393584137248 notifier 6455 bl.length()=877 2023-12-03T11:38:54.408 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.407+0000 7fbc577fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 info.flags=0x17 2023-12-03T11:38:54.408 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.407+0000 7fbc577fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 to cache LRU end 2023-12-03T11:38:54.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.407+0000 7fbc577fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:54.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.407+0000 7fbc74d32800 20 handle_bi_update(): bucket=:abort-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22]): orig_sources= new_sources= 2023-12-03T11:38:54.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.407+0000 7fbc74d32800 20 handle_bi_update(): bucket=:abort-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22]): potential sources added=[] removed=[] 2023-12-03T11:38:54.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.407+0000 7fbc74d32800 20 handle_bi_update(): bucket=:abort-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22]): orig_dests= new_dests= 2023-12-03T11:38:54.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.407+0000 7fbc74d32800 20 handle_bi_update(): bucket=:abort-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22]): potential dests added=[] removed=[] 2023-12-03T11:38:54.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.409+0000 7fbc74d32800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22.2.0 2023-12-03T11:38:54.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.409+0000 7fbc74d32800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22.2.0 2023-12-03T11:38:54.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.409+0000 7fbc74d32800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22.2.1 2023-12-03T11:38:54.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.409+0000 7fbc74d32800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22.2.1 2023-12-03T11:38:54.410 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.409+0000 7fbc74d32800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22.0 2023-12-03T11:38:54.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.411+0000 7fbc74d32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 : hit (requested=0x17, cached=0x17) 2023-12-03T11:38:54.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.411+0000 7fbc74d32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 2023-12-03T11:38:54.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.412+0000 7fbc74d32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 info.flags=0x17 2023-12-03T11:38:54.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.412+0000 7fbc74d32800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 to cache LRU end 2023-12-03T11:38:54.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.412+0000 7fbc74d32800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:54.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.412+0000 7fbc74d32800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22, ofs0, ns] 2023-12-03T11:38:54.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.413+0000 7fbc577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693279 cookie 94393584137248 notifier 6455 bl.length()=845 2023-12-03T11:38:54.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.413+0000 7fbc577fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 info.flags=0x17 2023-12-03T11:38:54.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.413+0000 7fbc577fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 to cache LRU end 2023-12-03T11:38:54.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.413+0000 7fbc577fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:54.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.413+0000 7fbc74d32800 20 handle_bi_update(): bucket=:abort-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22]): orig_sources= new_sources= 2023-12-03T11:38:54.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.413+0000 7fbc74d32800 20 handle_bi_update(): bucket=:abort-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22]): potential sources added=[] removed=[] 2023-12-03T11:38:54.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.413+0000 7fbc74d32800 20 handle_bi_update(): bucket=:abort-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22]): orig_dests= new_dests= 2023-12-03T11:38:54.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.413+0000 7fbc74d32800 20 handle_bi_update(): bucket=:abort-at-block-writes[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22]): potential dests added=[] removed=[] 2023-12-03T11:38:54.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.414+0000 7fbc74d32800 1 execute INFO: reshard of bucket "abort-at-block-writes" completed successfully 2023-12-03T11:38:54.418 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.417+0000 7fbc36fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:54.420 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.419+0000 7fbc74d32800 20 remove_watcher() i=0 2023-12-03T11:38:54.420 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.419+0000 7fbc74d32800 2 removed watcher, disabling cache 2023-12-03T11:38:54.421 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.420+0000 7fbc74d32800 20 remove_watcher() i=1 2023-12-03T11:38:54.422 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.421+0000 7fbc74d32800 20 remove_watcher() i=2 2023-12-03T11:38:54.423 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.422+0000 7fbc74d32800 20 remove_watcher() i=3 2023-12-03T11:38:54.424 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.424+0000 7fbc74d32800 20 remove_watcher() i=4 2023-12-03T11:38:54.425 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.425+0000 7fbc74d32800 20 remove_watcher() i=5 2023-12-03T11:38:54.426 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.426+0000 7fbc74d32800 20 remove_watcher() i=6 2023-12-03T11:38:54.428 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.427+0000 7fbc74d32800 20 remove_watcher() i=7 2023-12-03T11:38:54.434 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2023-12-03T11:38:54.463 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:54.463 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:54.478 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.477+0000 7f32b6b39800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.480 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.478+0000 7f32b6b39800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.480 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.478+0000 7f32b6b39800 20 realm 2023-12-03T11:38:54.480 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.478+0000 7f32b6b39800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.480 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.479+0000 7f32b6b39800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.480 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.479+0000 7f32b6b39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:54.480 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.479+0000 7f32b6b39800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.480 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.479+0000 7f32b6b39800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.480 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.479+0000 7f32b6b39800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.481 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.480+0000 7f32b6b39800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:54.481 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.480+0000 7f32b6b39800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.482 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.481+0000 7f32b6b39800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:54.482 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.481+0000 7f32b6b39800 20 searching for the correct realm 2023-12-03T11:38:54.492 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.491+0000 7f32b2840640 0 -- 172.21.15.44:0/1519653278 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55dd04363130 msgr2=0x55dd04365520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:54.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.492+0000 7f32b6b39800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:54.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.492+0000 7f32b6b39800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:54.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.492+0000 7f32b6b39800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:54.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.492+0000 7f32b6b39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:54.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.492+0000 7f32b6b39800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.492+0000 7f32b6b39800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.492+0000 7f32b6b39800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.494 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.492+0000 7f32b6b39800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:54.494 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.492+0000 7f32b6b39800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.495 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.493+0000 7f32b6b39800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:54.495 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.493+0000 7f32b6b39800 20 zone default found 2023-12-03T11:38:54.495 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.493+0000 7f32b6b39800 4 Realm: () 2023-12-03T11:38:54.495 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.493+0000 7f32b6b39800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:54.495 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.493+0000 7f32b6b39800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:54.495 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.493+0000 7f32b6b39800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:54.495 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.493+0000 7f32b6b39800 20 zonegroup default 2023-12-03T11:38:54.495 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.493+0000 7f32b6b39800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.495 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.493+0000 7f32b6b39800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.495 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.493+0000 7f32b6b39800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.495 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.493+0000 7f32b6b39800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.493+0000 7f32b6b39800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.493+0000 7f32b6b39800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.493+0000 7f32b6b39800 20 started sync module instance, tier type = 2023-12-03T11:38:54.496 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.493+0000 7f32b6b39800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:54.501 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.500+0000 7f32b3041640 0 -- 172.21.15.44:0/1519653278 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55dd0436af20 msgr2=0x55dd0436d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:54.504 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.503+0000 7f32b6b39800 20 add_watcher() i=0 2023-12-03T11:38:54.504 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.503+0000 7f32b6b39800 20 add_watcher() i=1 2023-12-03T11:38:54.504 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.503+0000 7f32b6b39800 20 add_watcher() i=2 2023-12-03T11:38:54.504 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.503+0000 7f32b6b39800 20 add_watcher() i=3 2023-12-03T11:38:54.504 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.503+0000 7f32b6b39800 20 add_watcher() i=4 2023-12-03T11:38:54.504 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.503+0000 7f32b6b39800 20 add_watcher() i=5 2023-12-03T11:38:54.504 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.503+0000 7f32b6b39800 20 add_watcher() i=6 2023-12-03T11:38:54.504 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.504+0000 7f32b6b39800 20 add_watcher() i=7 2023-12-03T11:38:54.505 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.504+0000 7f32b6b39800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:54.507 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.506+0000 7f31f3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:54.507 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.506+0000 7f32b6b39800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:54.507 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.506+0000 7f32b6b39800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:54.513 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.512+0000 7f32b6b39800 5 note: GC not initialized 2023-12-03T11:38:54.513 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.512+0000 7f31e2ffd640 20 reqs_thread_entry: start 2023-12-03T11:38:54.513 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.512+0000 7f32b6b39800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:54.514 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.512+0000 7f32b6b39800 20 Filter name: none 2023-12-03T11:38:54.514 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.512+0000 7f31e0ff9640 20 reqs_thread_entry: start 2023-12-03T11:38:54.514 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.512+0000 7f32b6b39800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.514 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.513+0000 7f32b6b39800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:38:54.514 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.513+0000 7f32b6b39800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.513+0000 7f32b6b39800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:38:54.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.513+0000 7f32b6b39800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:54.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.513+0000 7f32b6b39800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.514+0000 7f32b6b39800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:38:54.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.514+0000 7f32b6b39800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.514+0000 7f32b6b39800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:38:54.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.514+0000 7f32b6b39800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:54.516 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.515+0000 7f32b6b39800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.516 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.515+0000 7f32b6b39800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.517 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.516+0000 7f31f3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:54.519 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.518+0000 7f32b6b39800 20 remove_watcher() i=0 2023-12-03T11:38:54.519 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.518+0000 7f32b6b39800 2 removed watcher, disabling cache 2023-12-03T11:38:54.520 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.519+0000 7f32b6b39800 20 remove_watcher() i=1 2023-12-03T11:38:54.521 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.520+0000 7f32b6b39800 20 remove_watcher() i=2 2023-12-03T11:38:54.522 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.522+0000 7f32b6b39800 20 remove_watcher() i=3 2023-12-03T11:38:54.523 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.523+0000 7f32b6b39800 20 remove_watcher() i=4 2023-12-03T11:38:54.525 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.524+0000 7f32b6b39800 20 remove_watcher() i=5 2023-12-03T11:38:54.525 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.525+0000 7f32b6b39800 20 remove_watcher() i=6 2023-12-03T11:38:54.526 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.526+0000 7f32b6b39800 20 remove_watcher() i=7 2023-12-03T11:38:54.531 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:54.531 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:38:54.532 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-block-writes id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.22 num_objects: 19 size_kb: 1 num_shards: 2 2023-12-03T11:38:54.532 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:54.618 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2023-12-03T11:38:54.618 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:54.801 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2023-12-03T11:38:54.829 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:54.829 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:54.843 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.842+0000 7f3380d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.845 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.843+0000 7f3380d3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.845 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.843+0000 7f3380d3a800 20 realm 2023-12-03T11:38:54.845 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.843+0000 7f3380d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.845 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.844+0000 7f3380d3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.845 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.844+0000 7f3380d3a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:54.845 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.844+0000 7f3380d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.845 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.844+0000 7f3380d3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.845 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.844+0000 7f3380d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.846 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.845+0000 7f3380d3a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:54.846 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.845+0000 7f3380d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.846 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.845+0000 7f3380d3a800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:54.846 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.845+0000 7f3380d3a800 20 searching for the correct realm 2023-12-03T11:38:54.857 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.856+0000 7f337ca06640 0 -- 172.21.15.44:0/1200204825 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55e543f4ccf0 msgr2=0x55e543f4f0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:54.858 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.856+0000 7f3380d3a800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:54.858 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.856+0000 7f3380d3a800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:54.858 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.856+0000 7f3380d3a800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:54.858 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.856+0000 7f3380d3a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:54.858 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.856+0000 7f3380d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.858 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.856+0000 7f3380d3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.858 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.856+0000 7f3380d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.858 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.857+0000 7f3380d3a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:54.858 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.857+0000 7f3380d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.860 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.857+0000 7f3380d3a800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:54.860 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.857+0000 7f3380d3a800 20 zone default found 2023-12-03T11:38:54.860 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.857+0000 7f3380d3a800 4 Realm: () 2023-12-03T11:38:54.860 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.857+0000 7f3380d3a800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:54.860 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.857+0000 7f3380d3a800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:54.860 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.857+0000 7f3380d3a800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:54.860 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.857+0000 7f3380d3a800 20 zonegroup default 2023-12-03T11:38:54.860 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.857+0000 7f3380d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.860 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.857+0000 7f3380d3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.857+0000 7f3380d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.858+0000 7f3380d3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.858+0000 7f3380d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.858+0000 7f3380d3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.858+0000 7f3380d3a800 20 started sync module instance, tier type = 2023-12-03T11:38:54.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.858+0000 7f3380d3a800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:54.866 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.865+0000 7f337d207640 0 -- 172.21.15.44:0/1200204825 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55e543f54ba0 msgr2=0x55e543f57040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:54.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.867+0000 7f3380d3a800 20 add_watcher() i=0 2023-12-03T11:38:54.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.867+0000 7f3380d3a800 20 add_watcher() i=1 2023-12-03T11:38:54.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.867+0000 7f3380d3a800 20 add_watcher() i=2 2023-12-03T11:38:54.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.867+0000 7f3380d3a800 20 add_watcher() i=3 2023-12-03T11:38:54.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.867+0000 7f3380d3a800 20 add_watcher() i=4 2023-12-03T11:38:54.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.867+0000 7f3380d3a800 20 add_watcher() i=5 2023-12-03T11:38:54.869 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.867+0000 7f3380d3a800 20 add_watcher() i=6 2023-12-03T11:38:54.869 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.868+0000 7f3380d3a800 20 add_watcher() i=7 2023-12-03T11:38:54.869 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.868+0000 7f3380d3a800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:54.870 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.869+0000 7f3342fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:54.871 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.870+0000 7f3380d3a800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:54.871 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.870+0000 7f3380d3a800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:54.877 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.876+0000 7f3380d3a800 5 note: GC not initialized 2023-12-03T11:38:54.877 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.876+0000 7f32b1ffb640 20 reqs_thread_entry: start 2023-12-03T11:38:54.877 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.876+0000 7f3380d3a800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:54.877 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.876+0000 7f3380d3a800 20 Filter name: none 2023-12-03T11:38:54.878 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.876+0000 7f32a37fe640 20 reqs_thread_entry: start 2023-12-03T11:38:54.878 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.876+0000 7f3380d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.878 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.877+0000 7f3380d3a800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:38:54.879 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.877+0000 7f3380d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.879 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.877+0000 7f3380d3a800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:38:54.879 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.877+0000 7f3380d3a800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:54.879 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.877+0000 7f3380d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.879 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.878+0000 7f3380d3a800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:38:54.879 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.878+0000 7f3380d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.879 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.878+0000 7f3380d3a800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:38:54.880 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.878+0000 7f3380d3a800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:54.880 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.878+0000 7f3380d3a800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.880 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.879+0000 7f3380d3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.880 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.879+0000 7f3342fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:54.882 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.881+0000 7f3380d3a800 20 remove_watcher() i=0 2023-12-03T11:38:54.882 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.881+0000 7f3380d3a800 2 removed watcher, disabling cache 2023-12-03T11:38:54.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.882+0000 7f3380d3a800 20 remove_watcher() i=1 2023-12-03T11:38:54.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.883+0000 7f3380d3a800 20 remove_watcher() i=2 2023-12-03T11:38:54.885 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.884+0000 7f3380d3a800 20 remove_watcher() i=3 2023-12-03T11:38:54.886 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.885+0000 7f3380d3a800 20 remove_watcher() i=4 2023-12-03T11:38:54.887 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.886+0000 7f3380d3a800 20 remove_watcher() i=5 2023-12-03T11:38:54.888 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.887+0000 7f3380d3a800 20 remove_watcher() i=6 2023-12-03T11:38:54.890 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.888+0000 7f3380d3a800 20 remove_watcher() i=7 2023-12-03T11:38:54.894 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:54.894 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:38:54.894 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-commit-target-layout id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:38:54.894 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:54.896 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2023-12-03T11:38:54.929 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:54.929 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:54.943 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.942+0000 7fc2f0212800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.945 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.944+0000 7fc2f0212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.945 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.944+0000 7fc2f0212800 20 realm 2023-12-03T11:38:54.945 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.944+0000 7fc2f0212800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.945 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.944+0000 7fc2f0212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.945 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.944+0000 7fc2f0212800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:54.945 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.944+0000 7fc2f0212800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.945 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.944+0000 7fc2f0212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.945 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.944+0000 7fc2f0212800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.945+0000 7fc2f0212800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:54.946 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.945+0000 7fc2f0212800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.946+0000 7fc2f0212800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:54.947 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.946+0000 7fc2f0212800 20 searching for the correct realm 2023-12-03T11:38:54.956 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.954+0000 7fc2e304f640 0 -- 172.21.15.44:0/1571678945 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x5599df3e82d0 msgr2=0x5599df3ea6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:54.957 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.956+0000 7fc2f0212800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:54.957 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.956+0000 7fc2f0212800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:54.957 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.956+0000 7fc2f0212800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:54.957 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.956+0000 7fc2f0212800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:54.957 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.956+0000 7fc2f0212800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.957 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.956+0000 7fc2f0212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.956+0000 7fc2f0212800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.959 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.956+0000 7fc2f0212800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:54.959 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.957+0000 7fc2f0212800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.959 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.957+0000 7fc2f0212800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:54.959 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.957+0000 7fc2f0212800 20 zone default found 2023-12-03T11:38:54.959 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.957+0000 7fc2f0212800 4 Realm: () 2023-12-03T11:38:54.959 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.957+0000 7fc2f0212800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:54.959 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.957+0000 7fc2f0212800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:54.959 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.957+0000 7fc2f0212800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:54.959 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.957+0000 7fc2f0212800 20 zonegroup default 2023-12-03T11:38:54.959 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.957+0000 7fc2f0212800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.959 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.957+0000 7fc2f0212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.957+0000 7fc2f0212800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.957+0000 7fc2f0212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.957+0000 7fc2f0212800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.958+0000 7fc2f0212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:54.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.958+0000 7fc2f0212800 20 started sync module instance, tier type = 2023-12-03T11:38:54.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.958+0000 7fc2f0212800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:54.964 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.963+0000 7fc2ec051640 0 -- 172.21.15.44:0/1571678945 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7fc2d4022a10 msgr2=0x7fc2d40173f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:54.967 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.966+0000 7fc2f0212800 20 add_watcher() i=0 2023-12-03T11:38:54.967 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.966+0000 7fc2f0212800 20 add_watcher() i=1 2023-12-03T11:38:54.967 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.966+0000 7fc2f0212800 20 add_watcher() i=2 2023-12-03T11:38:54.968 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.966+0000 7fc2f0212800 20 add_watcher() i=3 2023-12-03T11:38:54.968 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.966+0000 7fc2f0212800 20 add_watcher() i=4 2023-12-03T11:38:54.968 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.966+0000 7fc2f0212800 20 add_watcher() i=5 2023-12-03T11:38:54.968 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.967+0000 7fc2f0212800 20 add_watcher() i=6 2023-12-03T11:38:54.968 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.967+0000 7fc2f0212800 20 add_watcher() i=7 2023-12-03T11:38:54.968 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.967+0000 7fc2f0212800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:54.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.969+0000 7fc2b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:54.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.969+0000 7fc2f0212800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:54.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.969+0000 7fc2f0212800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:54.977 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.975+0000 7fc2f0212800 5 note: GC not initialized 2023-12-03T11:38:54.977 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.976+0000 7fc228ff9640 20 reqs_thread_entry: start 2023-12-03T11:38:54.977 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.976+0000 7fc2f0212800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:54.977 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.976+0000 7fc2f0212800 20 Filter name: none 2023-12-03T11:38:54.977 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.976+0000 7fc21e7fc640 20 reqs_thread_entry: start 2023-12-03T11:38:54.977 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.976+0000 7fc2f0212800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2023-12-03T11:38:54.977 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.976+0000 7fc2f0212800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.976+0000 7fc2f0212800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:38:54.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.976+0000 7fc2f0212800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2023-12-03T11:38:54.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.976+0000 7fc2f0212800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2023-12-03T11:38:54.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.976+0000 7fc2f0212800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 : miss 2023-12-03T11:38:54.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.976+0000 7fc2f0212800 20 rados->read ofs=0 len=0 2023-12-03T11:38:54.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.977+0000 7fc2f0212800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:38:54.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.977+0000 7fc2f0212800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 info.flags=0x17 2023-12-03T11:38:54.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.977+0000 7fc2f0212800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 to cache LRU end 2023-12-03T11:38:54.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.977+0000 7fc2f0212800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:38:54.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.977+0000 7fc2f0212800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:54.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.977+0000 7fc2f0212800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 2023-12-03T11:38:54.982 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.981+0000 7fc2f0212800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 info.flags=0x17 2023-12-03T11:38:54.982 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.981+0000 7fc2f0212800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 to cache LRU end 2023-12-03T11:38:54.982 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.981+0000 7fc2f0212800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:54.982 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.981+0000 7fc2f0212800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23, ofs0, ns] 2023-12-03T11:38:54.982 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.981+0000 7fc2e204d640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693209 cookie 94119363809840 notifier 6870 bl.length()=893 2023-12-03T11:38:54.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.981+0000 7fc2e204d640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 info.flags=0x17 2023-12-03T11:38:54.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.981+0000 7fc2e204d640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 to cache LRU end 2023-12-03T11:38:54.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.981+0000 7fc2e204d640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:54.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.981+0000 7fc2f0212800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23]): orig_sources= new_sources= 2023-12-03T11:38:54.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.981+0000 7fc2f0212800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23]): potential sources added=[] removed=[] 2023-12-03T11:38:54.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.981+0000 7fc2f0212800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23]): orig_dests= new_dests= 2023-12-03T11:38:54.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.981+0000 7fc2f0212800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23]): potential dests added=[] removed=[] 2023-12-03T11:38:54.984 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.983+0000 7fc2f0212800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23.1.0 2023-12-03T11:38:54.984 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.983+0000 7fc2f0212800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23.1.0 2023-12-03T11:38:54.984 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.983+0000 7fc2f0212800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23.1.1 2023-12-03T11:38:54.984 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.983+0000 7fc2f0212800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23.1.1 2023-12-03T11:38:54.984 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.983+0000 7fc2f0212800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23.0 2023-12-03T11:38:54.986 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.985+0000 7fc2f0212800 -1 Injecting error=-5 at location=commit_target_layout 2023-12-03T11:38:54.986 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.985+0000 7fc2f0212800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2023-12-03T11:38:54.989 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.988+0000 7fc2b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:54.991 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.990+0000 7fc2f0212800 20 remove_watcher() i=0 2023-12-03T11:38:54.991 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.990+0000 7fc2f0212800 2 removed watcher, disabling cache 2023-12-03T11:38:54.991 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.991+0000 7fc2f0212800 20 remove_watcher() i=1 2023-12-03T11:38:54.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.992+0000 7fc2f0212800 20 remove_watcher() i=2 2023-12-03T11:38:54.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.993+0000 7fc2f0212800 20 remove_watcher() i=3 2023-12-03T11:38:54.994 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.994+0000 7fc2f0212800 20 remove_watcher() i=4 2023-12-03T11:38:54.995 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.995+0000 7fc2f0212800 20 remove_watcher() i=5 2023-12-03T11:38:54.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.996+0000 7fc2f0212800 20 remove_watcher() i=6 2023-12-03T11:38:54.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:54.997+0000 7fc2f0212800 20 remove_watcher() i=7 2023-12-03T11:38:55.004 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2023-12-03T11:38:55.032 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:55.032 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:55.047 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.046+0000 7fc78e721800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.049 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.048+0000 7fc78e721800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.049 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.048+0000 7fc78e721800 20 realm 2023-12-03T11:38:55.049 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.048+0000 7fc78e721800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.049 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.048+0000 7fc78e721800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.049 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.048+0000 7fc78e721800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:55.049 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.048+0000 7fc78e721800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.049 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.048+0000 7fc78e721800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.049 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.048+0000 7fc78e721800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.050 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.049+0000 7fc78e721800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:55.050 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.049+0000 7fc78e721800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.050+0000 7fc78e721800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:55.051 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.050+0000 7fc78e721800 20 searching for the correct realm 2023-12-03T11:38:55.262 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.260+0000 7fc78a4b8640 0 -- 172.21.15.44:0/2124373150 >> [v2:172.21.15.44:6800/4244511941,v1:172.21.15.44:6801/4244511941] conn(0x7fc77409d8f0 msgr2=0x7fc77409adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:55.264 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.262+0000 7fc78e721800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:55.264 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.262+0000 7fc78e721800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:55.264 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.262+0000 7fc78e721800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:55.264 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.262+0000 7fc78e721800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:55.264 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.262+0000 7fc78e721800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.264 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.263+0000 7fc78e721800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.264 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.263+0000 7fc78e721800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.265 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.263+0000 7fc78e721800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:55.265 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.263+0000 7fc78e721800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.266 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.263+0000 7fc78e721800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:55.266 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.263+0000 7fc78e721800 20 zone default found 2023-12-03T11:38:55.266 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.263+0000 7fc78e721800 4 Realm: () 2023-12-03T11:38:55.266 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.263+0000 7fc78e721800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:55.266 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.263+0000 7fc78e721800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:55.266 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.263+0000 7fc78e721800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:55.266 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.263+0000 7fc78e721800 20 zonegroup default 2023-12-03T11:38:55.266 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.263+0000 7fc78e721800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.266 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.264+0000 7fc78e721800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.266 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.264+0000 7fc78e721800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.266 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.264+0000 7fc78e721800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.266 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.264+0000 7fc78e721800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.266 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.264+0000 7fc78e721800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.266 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.264+0000 7fc78e721800 20 started sync module instance, tier type = 2023-12-03T11:38:55.267 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.264+0000 7fc78e721800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:55.270 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.269+0000 7fc789cb7640 0 -- 172.21.15.44:0/2124373150 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x560f4833d590 msgr2=0x560f4833f980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:55.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.274+0000 7fc78e721800 20 add_watcher() i=0 2023-12-03T11:38:55.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.274+0000 7fc78e721800 20 add_watcher() i=1 2023-12-03T11:38:55.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.274+0000 7fc78e721800 20 add_watcher() i=2 2023-12-03T11:38:55.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.274+0000 7fc78e721800 20 add_watcher() i=3 2023-12-03T11:38:55.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.274+0000 7fc78e721800 20 add_watcher() i=4 2023-12-03T11:38:55.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.274+0000 7fc78e721800 20 add_watcher() i=5 2023-12-03T11:38:55.276 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.274+0000 7fc78e721800 20 add_watcher() i=6 2023-12-03T11:38:55.276 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.275+0000 7fc78e721800 20 add_watcher() i=7 2023-12-03T11:38:55.276 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.275+0000 7fc78e721800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:55.277 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.277+0000 7fc74ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:55.278 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.277+0000 7fc78e721800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:55.278 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.277+0000 7fc78e721800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:55.284 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.283+0000 7fc78e721800 5 note: GC not initialized 2023-12-03T11:38:55.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.283+0000 7fc6beffd640 20 reqs_thread_entry: start 2023-12-03T11:38:55.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.283+0000 7fc78e721800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:55.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.283+0000 7fc78e721800 20 Filter name: none 2023-12-03T11:38:55.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.284+0000 7fc6bcff9640 20 reqs_thread_entry: start 2023-12-03T11:38:55.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.284+0000 7fc78e721800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.284+0000 7fc78e721800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:38:55.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.284+0000 7fc78e721800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.285+0000 7fc78e721800 20 rados_obj.operate() r=0 bl.length=413 2023-12-03T11:38:55.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.285+0000 7fc78e721800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:55.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.285+0000 7fc78e721800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.285+0000 7fc78e721800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:38:55.287 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.285+0000 7fc78e721800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.287 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.286+0000 7fc78e721800 20 rados_obj.operate() r=0 bl.length=413 2023-12-03T11:38:55.287 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.286+0000 7fc78e721800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:55.287 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.286+0000 7fc78e721800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.287 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.286+0000 7fc78e721800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.287+0000 7fc74ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:55.290 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.289+0000 7fc78e721800 20 remove_watcher() i=0 2023-12-03T11:38:55.290 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.289+0000 7fc78e721800 2 removed watcher, disabling cache 2023-12-03T11:38:55.291 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.290+0000 7fc78e721800 20 remove_watcher() i=1 2023-12-03T11:38:55.292 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.291+0000 7fc78e721800 20 remove_watcher() i=2 2023-12-03T11:38:55.293 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.293+0000 7fc78e721800 20 remove_watcher() i=3 2023-12-03T11:38:55.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.294+0000 7fc78e721800 20 remove_watcher() i=4 2023-12-03T11:38:55.295 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.295+0000 7fc78e721800 20 remove_watcher() i=5 2023-12-03T11:38:55.297 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.296+0000 7fc78e721800 20 remove_watcher() i=6 2023-12-03T11:38:55.297 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.297+0000 7fc78e721800 20 remove_watcher() i=7 2023-12-03T11:38:55.302 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:55.302 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:38:55.302 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-commit-target-layout id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:38:55.303 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:55.354 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:38:55.384 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:55.385 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:55.399 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.398+0000 7efd6d42d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.401 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.400+0000 7efd6d42d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.401 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.400+0000 7efd6d42d800 20 realm 2023-12-03T11:38:55.401 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.400+0000 7efd6d42d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.400+0000 7efd6d42d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.400+0000 7efd6d42d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:55.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.400+0000 7efd6d42d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.400+0000 7efd6d42d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.400+0000 7efd6d42d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.401+0000 7efd6d42d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:55.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.401+0000 7efd6d42d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.403 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.402+0000 7efd6d42d800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:55.403 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.402+0000 7efd6d42d800 20 searching for the correct realm 2023-12-03T11:38:55.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.411+0000 7efd68e1b640 0 -- 172.21.15.44:0/738506345 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x562a069edd20 msgr2=0x562a069f01e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:55.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.412+0000 7efd6d42d800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:55.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.412+0000 7efd6d42d800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:55.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.412+0000 7efd6d42d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:55.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.412+0000 7efd6d42d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:55.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.412+0000 7efd6d42d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.413+0000 7efd6d42d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.413+0000 7efd6d42d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.413+0000 7efd6d42d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:55.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.413+0000 7efd6d42d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.413+0000 7efd6d42d800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:55.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.413+0000 7efd6d42d800 20 zone default found 2023-12-03T11:38:55.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.413+0000 7efd6d42d800 4 Realm: () 2023-12-03T11:38:55.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.413+0000 7efd6d42d800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:55.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.413+0000 7efd6d42d800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:55.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.413+0000 7efd6d42d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:55.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.413+0000 7efd6d42d800 20 zonegroup default 2023-12-03T11:38:55.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.413+0000 7efd6d42d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.413+0000 7efd6d42d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.413+0000 7efd6d42d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.414+0000 7efd6d42d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.414+0000 7efd6d42d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.414+0000 7efd6d42d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.414+0000 7efd6d42d800 20 started sync module instance, tier type = 2023-12-03T11:38:55.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.414+0000 7efd6d42d800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:55.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.416+0000 7efd6861a640 0 -- 172.21.15.44:0/738506345 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x562a069edd20 msgr2=0x7efd4407eb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:55.424 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.422+0000 7efd6d42d800 20 add_watcher() i=0 2023-12-03T11:38:55.620 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.619+0000 7efd6d42d800 20 add_watcher() i=1 2023-12-03T11:38:55.620 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.619+0000 7efd6d42d800 20 add_watcher() i=2 2023-12-03T11:38:55.620 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.619+0000 7efd6d42d800 20 add_watcher() i=3 2023-12-03T11:38:55.620 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.619+0000 7efd6d42d800 20 add_watcher() i=4 2023-12-03T11:38:55.620 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.619+0000 7efd6d42d800 20 add_watcher() i=5 2023-12-03T11:38:55.620 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.619+0000 7efd6d42d800 20 add_watcher() i=6 2023-12-03T11:38:55.620 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.619+0000 7efd6d42d800 20 add_watcher() i=7 2023-12-03T11:38:55.620 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.619+0000 7efd6d42d800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:55.622 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.621+0000 7efd2e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:55.622 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.621+0000 7efd6d42d800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:55.622 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.621+0000 7efd6d42d800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:55.629 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.627+0000 7efd6d42d800 5 note: GC not initialized 2023-12-03T11:38:55.629 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.627+0000 7efc9d7fa640 20 reqs_thread_entry: start 2023-12-03T11:38:55.629 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.628+0000 7efd6d42d800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:55.629 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.628+0000 7efd6d42d800 20 Filter name: none 2023-12-03T11:38:55.629 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.628+0000 7efc96ffd640 20 reqs_thread_entry: start 2023-12-03T11:38:55.630 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.628+0000 7efd6d42d800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2023-12-03T11:38:55.630 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.628+0000 7efd6d42d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.630 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.629+0000 7efd6d42d800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:38:55.631 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.629+0000 7efd6d42d800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2023-12-03T11:38:55.631 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.629+0000 7efd6d42d800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2023-12-03T11:38:55.631 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.629+0000 7efd6d42d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 : miss 2023-12-03T11:38:55.631 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.629+0000 7efd6d42d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.631 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.629+0000 7efd6d42d800 20 rados_obj.operate() r=0 bl.length=413 2023-12-03T11:38:55.631 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.629+0000 7efd6d42d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 info.flags=0x17 2023-12-03T11:38:55.631 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.629+0000 7efd6d42d800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 to cache LRU end 2023-12-03T11:38:55.631 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.629+0000 7efd6d42d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:38:55.631 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.629+0000 7efd6d42d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:55.631 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.629+0000 7efd6d42d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 2023-12-03T11:38:55.632 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.631+0000 7efd6d42d800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2023-12-03T11:38:55.635 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.634+0000 7efd6d42d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 info.flags=0x17 2023-12-03T11:38:55.635 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.634+0000 7efd6d42d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 to cache LRU end 2023-12-03T11:38:55.635 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.634+0000 7efd6d42d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:55.635 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.634+0000 7efd6d42d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23, ofs0, ns] 2023-12-03T11:38:55.636 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.635+0000 7efd4e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693210 cookie 94738499703120 notifier 6551 bl.length()=893 2023-12-03T11:38:55.636 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.635+0000 7efd4e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 info.flags=0x17 2023-12-03T11:38:55.636 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.635+0000 7efd4e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 to cache LRU end 2023-12-03T11:38:55.636 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.635+0000 7efd4e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:55.636 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.635+0000 7efd6d42d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23]): orig_sources= new_sources= 2023-12-03T11:38:55.636 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.635+0000 7efd6d42d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23]): potential sources added=[] removed=[] 2023-12-03T11:38:55.636 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.635+0000 7efd6d42d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23]): orig_dests= new_dests= 2023-12-03T11:38:55.636 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.635+0000 7efd6d42d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23]): potential dests added=[] removed=[] 2023-12-03T11:38:55.638 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.637+0000 7efd6d42d800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23.2.0 2023-12-03T11:38:55.638 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.637+0000 7efd6d42d800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23.2.0 2023-12-03T11:38:55.638 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.637+0000 7efd6d42d800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23.2.1 2023-12-03T11:38:55.638 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.637+0000 7efd6d42d800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23.2.1 2023-12-03T11:38:55.638 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.637+0000 7efd6d42d800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23.0 2023-12-03T11:38:55.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.639+0000 7efd6d42d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 : hit (requested=0x17, cached=0x17) 2023-12-03T11:38:55.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.639+0000 7efd6d42d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 2023-12-03T11:38:55.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.640+0000 7efd6d42d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 info.flags=0x17 2023-12-03T11:38:55.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.640+0000 7efd6d42d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 to cache LRU end 2023-12-03T11:38:55.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.640+0000 7efd6d42d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:55.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.640+0000 7efd6d42d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23, ofs0, ns] 2023-12-03T11:38:55.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.640+0000 7efd4effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693211 cookie 94738499703120 notifier 6551 bl.length()=861 2023-12-03T11:38:55.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.640+0000 7efd4effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 info.flags=0x17 2023-12-03T11:38:55.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.640+0000 7efd4effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 to cache LRU end 2023-12-03T11:38:55.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.640+0000 7efd4effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:55.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.641+0000 7efd6d42d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23]): orig_sources= new_sources= 2023-12-03T11:38:55.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.641+0000 7efd6d42d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23]): potential sources added=[] removed=[] 2023-12-03T11:38:55.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.641+0000 7efd6d42d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23]): orig_dests= new_dests= 2023-12-03T11:38:55.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.641+0000 7efd6d42d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23]): potential dests added=[] removed=[] 2023-12-03T11:38:55.643 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.642+0000 7efd6d42d800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2023-12-03T11:38:55.644 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.643+0000 7efd2e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:55.646 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.646+0000 7efd6d42d800 20 remove_watcher() i=0 2023-12-03T11:38:55.647 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.646+0000 7efd6d42d800 2 removed watcher, disabling cache 2023-12-03T11:38:55.648 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.647+0000 7efd6d42d800 20 remove_watcher() i=1 2023-12-03T11:38:55.649 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.648+0000 7efd6d42d800 20 remove_watcher() i=2 2023-12-03T11:38:55.650 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.649+0000 7efd6d42d800 20 remove_watcher() i=3 2023-12-03T11:38:55.651 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.650+0000 7efd6d42d800 20 remove_watcher() i=4 2023-12-03T11:38:55.652 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.651+0000 7efd6d42d800 20 remove_watcher() i=5 2023-12-03T11:38:55.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.652+0000 7efd6d42d800 20 remove_watcher() i=6 2023-12-03T11:38:55.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.653+0000 7efd6d42d800 20 remove_watcher() i=7 2023-12-03T11:38:55.660 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2023-12-03T11:38:55.688 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:55.688 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:55.702 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.702+0000 7fb626520800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.703+0000 7fb626520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.703+0000 7fb626520800 20 realm 2023-12-03T11:38:55.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.703+0000 7fb626520800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.704+0000 7fb626520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.704+0000 7fb626520800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:55.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.704+0000 7fb626520800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.704+0000 7fb626520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.704+0000 7fb626520800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.706 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.705+0000 7fb626520800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:55.706 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.705+0000 7fb626520800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.706 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.705+0000 7fb626520800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:55.707 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.705+0000 7fb626520800 20 searching for the correct realm 2023-12-03T11:38:55.715 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.714+0000 7fb6219a5640 0 -- 172.21.15.44:0/3067637356 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x55c4b2033120 msgr2=0x55c4b2035510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:55.717 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.716+0000 7fb626520800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:55.717 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.716+0000 7fb626520800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:55.717 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.716+0000 7fb626520800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:55.717 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.716+0000 7fb626520800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:55.717 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.716+0000 7fb626520800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.717 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.716+0000 7fb626520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.717 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.716+0000 7fb626520800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.716+0000 7fb626520800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:55.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.716+0000 7fb626520800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.716+0000 7fb626520800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:55.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.716+0000 7fb626520800 20 zone default found 2023-12-03T11:38:55.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.716+0000 7fb626520800 4 Realm: () 2023-12-03T11:38:55.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.716+0000 7fb626520800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:55.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.716+0000 7fb626520800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:55.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.716+0000 7fb626520800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:55.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.716+0000 7fb626520800 20 zonegroup default 2023-12-03T11:38:55.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.716+0000 7fb626520800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.717+0000 7fb626520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.717+0000 7fb626520800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.717+0000 7fb626520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.717+0000 7fb626520800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.717+0000 7fb626520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.717+0000 7fb626520800 20 started sync module instance, tier type = 2023-12-03T11:38:55.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.717+0000 7fb626520800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:55.724 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.723+0000 7fb6219a5640 0 -- 172.21.15.44:0/3067637356 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x7fb5fc079e10 msgr2=0x7fb5fc07c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:55.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.726+0000 7fb626520800 20 add_watcher() i=0 2023-12-03T11:38:55.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.726+0000 7fb626520800 20 add_watcher() i=1 2023-12-03T11:38:55.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.726+0000 7fb626520800 20 add_watcher() i=2 2023-12-03T11:38:55.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.726+0000 7fb626520800 20 add_watcher() i=3 2023-12-03T11:38:55.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.726+0000 7fb626520800 20 add_watcher() i=4 2023-12-03T11:38:55.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.726+0000 7fb626520800 20 add_watcher() i=5 2023-12-03T11:38:55.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.726+0000 7fb626520800 20 add_watcher() i=6 2023-12-03T11:38:55.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.727+0000 7fb626520800 20 add_watcher() i=7 2023-12-03T11:38:55.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.727+0000 7fb626520800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:55.729 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.728+0000 7fb5e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:55.730 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.729+0000 7fb626520800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:55.730 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.729+0000 7fb626520800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:55.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.735+0000 7fb626520800 5 note: GC not initialized 2023-12-03T11:38:55.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.735+0000 7fb556ffd640 20 reqs_thread_entry: start 2023-12-03T11:38:55.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.735+0000 7fb626520800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:55.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.735+0000 7fb626520800 20 Filter name: none 2023-12-03T11:38:55.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.735+0000 7fb554ff9640 20 reqs_thread_entry: start 2023-12-03T11:38:55.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.735+0000 7fb626520800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.737 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.736+0000 7fb626520800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:38:55.737 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.736+0000 7fb626520800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.738 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.736+0000 7fb626520800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:38:55.738 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.736+0000 7fb626520800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:55.738 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.736+0000 7fb626520800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.738 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.737+0000 7fb626520800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:38:55.738 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.737+0000 7fb626520800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.738 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.737+0000 7fb626520800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:38:55.739 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.737+0000 7fb626520800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:55.739 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.737+0000 7fb626520800 20 rados->read ofs=0 len=0 2023-12-03T11:38:55.739 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.738+0000 7fb626520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:55.739 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.738+0000 7fb5e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:55.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.740+0000 7fb626520800 20 remove_watcher() i=0 2023-12-03T11:38:55.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.740+0000 7fb626520800 2 removed watcher, disabling cache 2023-12-03T11:38:55.743 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.742+0000 7fb626520800 20 remove_watcher() i=1 2023-12-03T11:38:55.744 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.743+0000 7fb626520800 20 remove_watcher() i=2 2023-12-03T11:38:55.745 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.744+0000 7fb626520800 20 remove_watcher() i=3 2023-12-03T11:38:55.746 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.745+0000 7fb626520800 20 remove_watcher() i=4 2023-12-03T11:38:55.747 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.746+0000 7fb626520800 20 remove_watcher() i=5 2023-12-03T11:38:55.748 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.747+0000 7fb626520800 20 remove_watcher() i=6 2023-12-03T11:38:55.749 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:55.748+0000 7fb626520800 20 remove_watcher() i=7 2023-12-03T11:38:55.754 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:55.754 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:38:55.754 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-commit-target-layout id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.23 num_objects: 19 size_kb: 1 num_shards: 2 2023-12-03T11:38:55.754 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:55.840 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2023-12-03T11:38:55.840 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.014 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2023-12-03T11:38:56.041 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:56.041 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:56.055 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.054+0000 7f69d11af800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.057 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.056+0000 7f69d11af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.056+0000 7f69d11af800 20 realm 2023-12-03T11:38:56.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.056+0000 7f69d11af800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.056+0000 7f69d11af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.056+0000 7f69d11af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:56.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.056+0000 7f69d11af800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.056+0000 7f69d11af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.056+0000 7f69d11af800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.058+0000 7f69d11af800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:56.059 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.058+0000 7f69d11af800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.059 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.058+0000 7f69d11af800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:56.059 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.058+0000 7f69d11af800 20 searching for the correct realm 2023-12-03T11:38:56.070 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.069+0000 7f69cecaf640 0 -- 172.21.15.44:0/1540664125 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x56538dc63a70 msgr2=0x56538dc65ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:38:56.072 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.070+0000 7f69d11af800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:56.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.070+0000 7f69d11af800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:56.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.070+0000 7f69d11af800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:56.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.070+0000 7f69d11af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:56.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.070+0000 7f69d11af800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.071+0000 7f69d11af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.071+0000 7f69d11af800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.071+0000 7f69d11af800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:56.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.071+0000 7f69d11af800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.071+0000 7f69d11af800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:56.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.071+0000 7f69d11af800 20 zone default found 2023-12-03T11:38:56.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.071+0000 7f69d11af800 4 Realm: () 2023-12-03T11:38:56.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.071+0000 7f69d11af800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:56.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.071+0000 7f69d11af800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:56.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.071+0000 7f69d11af800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:56.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.071+0000 7f69d11af800 20 zonegroup default 2023-12-03T11:38:56.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.071+0000 7f69d11af800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.071+0000 7f69d11af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.071+0000 7f69d11af800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.072+0000 7f69d11af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.072+0000 7f69d11af800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.072+0000 7f69d11af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.072+0000 7f69d11af800 20 started sync module instance, tier type = 2023-12-03T11:38:56.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.072+0000 7f69d11af800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:56.079 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.078+0000 7f69cf4b0640 0 -- 172.21.15.44:0/1540664125 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x56538dc6bbe0 msgr2=0x56538dc6e080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:56.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.081+0000 7f69d11af800 20 add_watcher() i=0 2023-12-03T11:38:56.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.081+0000 7f69d11af800 20 add_watcher() i=1 2023-12-03T11:38:56.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.081+0000 7f69d11af800 20 add_watcher() i=2 2023-12-03T11:38:56.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.081+0000 7f69d11af800 20 add_watcher() i=3 2023-12-03T11:38:56.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.081+0000 7f69d11af800 20 add_watcher() i=4 2023-12-03T11:38:56.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.081+0000 7f69d11af800 20 add_watcher() i=5 2023-12-03T11:38:56.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.081+0000 7f69d11af800 20 add_watcher() i=6 2023-12-03T11:38:56.083 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.082+0000 7f69d11af800 20 add_watcher() i=7 2023-12-03T11:38:56.083 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.082+0000 7f69d11af800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:56.084 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.083+0000 7f690ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:56.084 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.083+0000 7f69d11af800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:56.084 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.083+0000 7f69d11af800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:56.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.089+0000 7f69d11af800 5 note: GC not initialized 2023-12-03T11:38:56.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.090+0000 7f68feffd640 20 reqs_thread_entry: start 2023-12-03T11:38:56.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.090+0000 7f69d11af800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:56.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.090+0000 7f69d11af800 20 Filter name: none 2023-12-03T11:38:56.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.090+0000 7f68fcff9640 20 reqs_thread_entry: start 2023-12-03T11:38:56.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.090+0000 7f69d11af800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.092 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.091+0000 7f69d11af800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:38:56.092 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.091+0000 7f69d11af800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.092 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.091+0000 7f69d11af800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:38:56.092 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.091+0000 7f69d11af800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:56.092 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.091+0000 7f69d11af800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.093 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.092+0000 7f69d11af800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:38:56.093 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.092+0000 7f69d11af800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.093 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.092+0000 7f69d11af800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:38:56.093 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.092+0000 7f69d11af800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:56.094 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.093+0000 7f69d11af800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.094 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.093+0000 7f69d11af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.094 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.094+0000 7f690ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:56.097 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.096+0000 7f69d11af800 20 remove_watcher() i=0 2023-12-03T11:38:56.097 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.096+0000 7f69d11af800 2 removed watcher, disabling cache 2023-12-03T11:38:56.098 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.097+0000 7f69d11af800 20 remove_watcher() i=1 2023-12-03T11:38:56.099 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.098+0000 7f69d11af800 20 remove_watcher() i=2 2023-12-03T11:38:56.100 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.099+0000 7f69d11af800 20 remove_watcher() i=3 2023-12-03T11:38:56.101 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.100+0000 7f69d11af800 20 remove_watcher() i=4 2023-12-03T11:38:56.102 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.101+0000 7f69d11af800 20 remove_watcher() i=5 2023-12-03T11:38:56.103 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.102+0000 7f69d11af800 20 remove_watcher() i=6 2023-12-03T11:38:56.104 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.103+0000 7f69d11af800 20 remove_watcher() i=7 2023-12-03T11:38:56.108 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.109 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:38:56.109 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-commit-target-layout id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:38:56.109 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.110 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2023-12-03T11:38:56.145 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:56.145 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:56.160 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.159+0000 7fda5492d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.162 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.160+0000 7fda5492d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.162 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.160+0000 7fda5492d800 20 realm 2023-12-03T11:38:56.162 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.160+0000 7fda5492d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.162 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.161+0000 7fda5492d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.162 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.161+0000 7fda5492d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:56.162 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.161+0000 7fda5492d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.162 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.161+0000 7fda5492d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.162 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.161+0000 7fda5492d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.163 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.162+0000 7fda5492d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:56.163 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.162+0000 7fda5492d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.163 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.162+0000 7fda5492d800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:56.163 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.162+0000 7fda5492d800 20 searching for the correct realm 2023-12-03T11:38:56.172 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.171+0000 7fda4fdd6640 0 -- 172.21.15.44:0/794085548 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x55b2f517d680 msgr2=0x55b2f517fa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:56.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.172+0000 7fda5492d800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:56.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.172+0000 7fda5492d800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:56.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.172+0000 7fda5492d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:56.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.172+0000 7fda5492d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:56.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.172+0000 7fda5492d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.173+0000 7fda5492d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.173+0000 7fda5492d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.173+0000 7fda5492d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:56.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.173+0000 7fda5492d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.175 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.173+0000 7fda5492d800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:56.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.173+0000 7fda5492d800 20 zone default found 2023-12-03T11:38:56.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.173+0000 7fda5492d800 4 Realm: () 2023-12-03T11:38:56.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.173+0000 7fda5492d800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:56.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.173+0000 7fda5492d800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:56.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.173+0000 7fda5492d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:56.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.173+0000 7fda5492d800 20 zonegroup default 2023-12-03T11:38:56.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.173+0000 7fda5492d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.173+0000 7fda5492d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.173+0000 7fda5492d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.174+0000 7fda5492d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.174+0000 7fda5492d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.174+0000 7fda5492d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.174+0000 7fda5492d800 20 started sync module instance, tier type = 2023-12-03T11:38:56.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.174+0000 7fda5492d800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:56.180 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.179+0000 7fda50dd8640 0 -- 172.21.15.44:0/794085548 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7fda4404f910 msgr2=0x7fda4406a3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:56.184 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.183+0000 7fda5492d800 20 add_watcher() i=0 2023-12-03T11:38:56.184 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.183+0000 7fda5492d800 20 add_watcher() i=1 2023-12-03T11:38:56.184 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.183+0000 7fda5492d800 20 add_watcher() i=2 2023-12-03T11:38:56.185 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.183+0000 7fda5492d800 20 add_watcher() i=3 2023-12-03T11:38:56.185 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.183+0000 7fda5492d800 20 add_watcher() i=4 2023-12-03T11:38:56.185 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.183+0000 7fda5492d800 20 add_watcher() i=5 2023-12-03T11:38:56.185 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.183+0000 7fda5492d800 20 add_watcher() i=6 2023-12-03T11:38:56.185 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.184+0000 7fda5492d800 20 add_watcher() i=7 2023-12-03T11:38:56.185 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.184+0000 7fda5492d800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:56.187 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.186+0000 7fda167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:56.187 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.186+0000 7fda5492d800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:56.187 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.186+0000 7fda5492d800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:56.193 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.192+0000 7fda5492d800 5 note: GC not initialized 2023-12-03T11:38:56.194 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.192+0000 7fd9857fa640 20 reqs_thread_entry: start 2023-12-03T11:38:56.194 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.192+0000 7fda5492d800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:56.194 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.193+0000 7fda5492d800 20 Filter name: none 2023-12-03T11:38:56.194 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.193+0000 7fd97effd640 20 reqs_thread_entry: start 2023-12-03T11:38:56.194 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.193+0000 7fda5492d800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2023-12-03T11:38:56.194 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.193+0000 7fda5492d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.195 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.193+0000 7fda5492d800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:38:56.195 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.193+0000 7fda5492d800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2023-12-03T11:38:56.195 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.193+0000 7fda5492d800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2023-12-03T11:38:56.195 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.193+0000 7fda5492d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24 : miss 2023-12-03T11:38:56.196 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.193+0000 7fda5492d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.196 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.194+0000 7fda5492d800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:38:56.196 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.194+0000 7fda5492d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24 info.flags=0x17 2023-12-03T11:38:56.196 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.194+0000 7fda5492d800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24 to cache LRU end 2023-12-03T11:38:56.196 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.194+0000 7fda5492d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:38:56.196 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.194+0000 7fda5492d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:56.196 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.194+0000 7fda5492d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24 2023-12-03T11:38:56.200 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.198+0000 7fda5492d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24 info.flags=0x17 2023-12-03T11:38:56.200 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.198+0000 7fda5492d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24 to cache LRU end 2023-12-03T11:38:56.200 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.198+0000 7fda5492d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:56.200 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.198+0000 7fda5492d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24, ofs0, ns] 2023-12-03T11:38:56.200 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.199+0000 7fda36ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693214 cookie 94227104555648 notifier 6984 bl.length()=893 2023-12-03T11:38:56.200 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.199+0000 7fda36ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24 info.flags=0x17 2023-12-03T11:38:56.201 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.199+0000 7fda36ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24 to cache LRU end 2023-12-03T11:38:56.201 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.199+0000 7fda36ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:56.201 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.199+0000 7fda5492d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24]): orig_sources= new_sources= 2023-12-03T11:38:56.201 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.199+0000 7fda5492d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24]): potential sources added=[] removed=[] 2023-12-03T11:38:56.201 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.199+0000 7fda5492d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24]): orig_dests= new_dests= 2023-12-03T11:38:56.201 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.199+0000 7fda5492d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24]): potential dests added=[] removed=[] 2023-12-03T11:38:56.201 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.200+0000 7fda5492d800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24.1.0 2023-12-03T11:38:56.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.200+0000 7fda5492d800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24.1.0 2023-12-03T11:38:56.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.200+0000 7fda5492d800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24.1.1 2023-12-03T11:38:56.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.200+0000 7fda5492d800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24.1.1 2023-12-03T11:38:56.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.200+0000 7fda5492d800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24.0 2023-12-03T11:38:56.203 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.202+0000 7fda5492d800 -1 Injecting error=-125 at location=commit_target_layout 2023-12-03T11:38:56.204 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.202+0000 7fda5492d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24 : hit (requested=0x17, cached=0x17) 2023-12-03T11:38:56.204 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.202+0000 7fda5492d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24 2023-12-03T11:38:56.207 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.206+0000 7fda5492d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24 info.flags=0x17 2023-12-03T11:38:56.207 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.206+0000 7fda5492d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24 to cache LRU end 2023-12-03T11:38:56.207 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.206+0000 7fda5492d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:56.207 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.206+0000 7fda5492d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24, ofs0, ns] 2023-12-03T11:38:56.207 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.206+0000 7fda367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693215 cookie 94227104555648 notifier 6984 bl.length()=861 2023-12-03T11:38:56.207 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.206+0000 7fda367fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24 info.flags=0x17 2023-12-03T11:38:56.207 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.206+0000 7fda367fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24 to cache LRU end 2023-12-03T11:38:56.207 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.206+0000 7fda367fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:56.208 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.206+0000 7fda5492d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24]): orig_sources= new_sources= 2023-12-03T11:38:56.208 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.206+0000 7fda5492d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24]): potential sources added=[] removed=[] 2023-12-03T11:38:56.208 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.206+0000 7fda5492d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24]): orig_dests= new_dests= 2023-12-03T11:38:56.208 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.206+0000 7fda5492d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24]): potential dests added=[] removed=[] 2023-12-03T11:38:56.208 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.207+0000 7fda5492d800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2023-12-03T11:38:56.210 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.209+0000 7fda167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:56.212 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.211+0000 7fda5492d800 20 remove_watcher() i=0 2023-12-03T11:38:56.212 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.211+0000 7fda5492d800 2 removed watcher, disabling cache 2023-12-03T11:38:56.213 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.212+0000 7fda5492d800 20 remove_watcher() i=1 2023-12-03T11:38:56.214 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.213+0000 7fda5492d800 20 remove_watcher() i=2 2023-12-03T11:38:56.215 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.214+0000 7fda5492d800 20 remove_watcher() i=3 2023-12-03T11:38:56.216 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.215+0000 7fda5492d800 20 remove_watcher() i=4 2023-12-03T11:38:56.217 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.216+0000 7fda5492d800 20 remove_watcher() i=5 2023-12-03T11:38:56.218 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.217+0000 7fda5492d800 20 remove_watcher() i=6 2023-12-03T11:38:56.219 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.218+0000 7fda5492d800 20 remove_watcher() i=7 2023-12-03T11:38:56.225 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2023-12-03T11:38:56.253 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:56.253 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:56.268 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.267+0000 7f3475d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.270 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.269+0000 7f3475d32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.270 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.269+0000 7f3475d32800 20 realm 2023-12-03T11:38:56.270 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.269+0000 7f3475d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.270 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.269+0000 7f3475d32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.270 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.269+0000 7f3475d32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:56.270 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.269+0000 7f3475d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.269+0000 7f3475d32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.269+0000 7f3475d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.270+0000 7f3475d32800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:56.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.270+0000 7f3475d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.272 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.271+0000 7f3475d32800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:56.272 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.271+0000 7f3475d32800 20 searching for the correct realm 2023-12-03T11:38:56.280 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.279+0000 7f3471962640 0 -- 172.21.15.44:0/2005569196 >> [v2:172.21.15.44:6800/4244511941,v1:172.21.15.44:6801/4244511941] conn(0x7f346803f440 msgr2=0x7f346803f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:56.282 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.281+0000 7f3475d32800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:56.282 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.281+0000 7f3475d32800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:56.282 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.281+0000 7f3475d32800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:56.283 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.281+0000 7f3475d32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:56.283 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.281+0000 7f3475d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.283 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.281+0000 7f3475d32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.283 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.281+0000 7f3475d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.284 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.282+0000 7f3475d32800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:56.284 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.282+0000 7f3475d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.284 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.282+0000 7f3475d32800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:56.284 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.282+0000 7f3475d32800 20 zone default found 2023-12-03T11:38:56.284 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.282+0000 7f3475d32800 4 Realm: () 2023-12-03T11:38:56.284 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.282+0000 7f3475d32800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:56.284 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.282+0000 7f3475d32800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:56.284 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.282+0000 7f3475d32800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:56.284 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.282+0000 7f3475d32800 20 zonegroup default 2023-12-03T11:38:56.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.282+0000 7f3475d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.282+0000 7f3475d32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.282+0000 7f3475d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.283+0000 7f3475d32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.283+0000 7f3475d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.283+0000 7f3475d32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.283+0000 7f3475d32800 20 started sync module instance, tier type = 2023-12-03T11:38:56.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.283+0000 7f3475d32800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:56.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.287+0000 7f3471962640 0 -- 172.21.15.44:0/2005569196 >> [v2:172.21.15.91:6808/776869758,v1:172.21.15.91:6809/776869758] conn(0x7f346c07c9e0 msgr2=0x7f346c07c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:56.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.292+0000 7f3475d32800 20 add_watcher() i=0 2023-12-03T11:38:56.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.292+0000 7f3475d32800 20 add_watcher() i=1 2023-12-03T11:38:56.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.292+0000 7f3475d32800 20 add_watcher() i=2 2023-12-03T11:38:56.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.292+0000 7f3475d32800 20 add_watcher() i=3 2023-12-03T11:38:56.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.292+0000 7f3475d32800 20 add_watcher() i=4 2023-12-03T11:38:56.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.292+0000 7f3475d32800 20 add_watcher() i=5 2023-12-03T11:38:56.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.292+0000 7f3475d32800 20 add_watcher() i=6 2023-12-03T11:38:56.295 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.293+0000 7f3475d32800 20 add_watcher() i=7 2023-12-03T11:38:56.295 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.293+0000 7f3475d32800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:56.296 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.295+0000 7f34377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:56.296 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.295+0000 7f3475d32800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:56.296 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.295+0000 7f3475d32800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:56.302 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.301+0000 7f3475d32800 5 note: GC not initialized 2023-12-03T11:38:56.303 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.301+0000 7f33a67fc640 20 reqs_thread_entry: start 2023-12-03T11:38:56.303 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.301+0000 7f3475d32800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:56.303 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.301+0000 7f3475d32800 20 Filter name: none 2023-12-03T11:38:56.303 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.301+0000 7f3397fff640 20 reqs_thread_entry: start 2023-12-03T11:38:56.303 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.301+0000 7f3475d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.302+0000 7f3475d32800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:38:56.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.302+0000 7f3475d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.302+0000 7f3475d32800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:38:56.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.302+0000 7f3475d32800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:56.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.302+0000 7f3475d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.303+0000 7f3475d32800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:38:56.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.303+0000 7f3475d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.303+0000 7f3475d32800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:38:56.304 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.303+0000 7f3475d32800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:56.305 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.304+0000 7f3475d32800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.305 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.304+0000 7f3475d32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.305 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.304+0000 7f34377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:56.308 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.307+0000 7f3475d32800 20 remove_watcher() i=0 2023-12-03T11:38:56.308 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.307+0000 7f3475d32800 2 removed watcher, disabling cache 2023-12-03T11:38:56.309 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.308+0000 7f3475d32800 20 remove_watcher() i=1 2023-12-03T11:38:56.310 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.309+0000 7f3475d32800 20 remove_watcher() i=2 2023-12-03T11:38:56.311 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.310+0000 7f3475d32800 20 remove_watcher() i=3 2023-12-03T11:38:56.312 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.311+0000 7f3475d32800 20 remove_watcher() i=4 2023-12-03T11:38:56.313 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.312+0000 7f3475d32800 20 remove_watcher() i=5 2023-12-03T11:38:56.314 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.313+0000 7f3475d32800 20 remove_watcher() i=6 2023-12-03T11:38:56.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.314+0000 7f3475d32800 20 remove_watcher() i=7 2023-12-03T11:38:56.320 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.320 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:38:56.320 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-commit-target-layout id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.24 num_objects: 20 size_kb: 1 num_shards: 2 2023-12-03T11:38:56.320 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.381 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with abort at commit_target_layout 2023-12-03T11:38:56.381 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.596 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2023-12-03T11:38:56.623 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:56.624 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:56.638 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.637+0000 7f7056137800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.638+0000 7f7056137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.638+0000 7f7056137800 20 realm 2023-12-03T11:38:56.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.638+0000 7f7056137800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.638+0000 7f7056137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.638+0000 7f7056137800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:56.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.638+0000 7f7056137800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.639+0000 7f7056137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.639+0000 7f7056137800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.640+0000 7f7056137800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:56.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.640+0000 7f7056137800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.640+0000 7f7056137800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:56.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.640+0000 7f7056137800 20 searching for the correct realm 2023-12-03T11:38:56.651 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.650+0000 7f7051ecd640 0 -- 172.21.15.44:0/3631054976 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55d45d291050 msgr2=0x55d45d293440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:56.652 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.650+0000 7f7056137800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:56.652 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.650+0000 7f7056137800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:56.652 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.650+0000 7f7056137800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:56.652 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.650+0000 7f7056137800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:56.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.650+0000 7f7056137800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.651+0000 7f7056137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.651+0000 7f7056137800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.651+0000 7f7056137800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:56.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.651+0000 7f7056137800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.651+0000 7f7056137800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:56.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.651+0000 7f7056137800 20 zone default found 2023-12-03T11:38:56.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.651+0000 7f7056137800 4 Realm: () 2023-12-03T11:38:56.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.651+0000 7f7056137800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:56.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.651+0000 7f7056137800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:56.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.651+0000 7f7056137800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:56.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.651+0000 7f7056137800 20 zonegroup default 2023-12-03T11:38:56.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.651+0000 7f7056137800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.651+0000 7f7056137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.651+0000 7f7056137800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.652+0000 7f7056137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.652+0000 7f7056137800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.652+0000 7f7056137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.652+0000 7f7056137800 20 started sync module instance, tier type = 2023-12-03T11:38:56.654 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.652+0000 7f7056137800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:56.660 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.659+0000 7f70526ce640 0 -- 172.21.15.44:0/3631054976 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55d45d299130 msgr2=0x55d45d29b5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:38:56.661 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.661+0000 7f7056137800 20 add_watcher() i=0 2023-12-03T11:38:56.662 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.661+0000 7f7056137800 20 add_watcher() i=1 2023-12-03T11:38:56.662 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.661+0000 7f7056137800 20 add_watcher() i=2 2023-12-03T11:38:56.662 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.661+0000 7f7056137800 20 add_watcher() i=3 2023-12-03T11:38:56.662 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.661+0000 7f7056137800 20 add_watcher() i=4 2023-12-03T11:38:56.662 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.661+0000 7f7056137800 20 add_watcher() i=5 2023-12-03T11:38:56.662 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.661+0000 7f7056137800 20 add_watcher() i=6 2023-12-03T11:38:56.663 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.662+0000 7f7056137800 20 add_watcher() i=7 2023-12-03T11:38:56.663 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.662+0000 7f7056137800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:56.664 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.663+0000 7f70177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:56.664 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.664+0000 7f7056137800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:56.665 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.664+0000 7f7056137800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:56.671 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.670+0000 7f7056137800 5 note: GC not initialized 2023-12-03T11:38:56.671 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.670+0000 7f6f867fc640 20 reqs_thread_entry: start 2023-12-03T11:38:56.671 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.670+0000 7f7056137800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:56.671 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.670+0000 7f7056137800 20 Filter name: none 2023-12-03T11:38:56.671 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.670+0000 7f6f77fff640 20 reqs_thread_entry: start 2023-12-03T11:38:56.671 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.670+0000 7f7056137800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.673 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.671+0000 7f7056137800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:38:56.673 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.671+0000 7f7056137800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.673 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.671+0000 7f7056137800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:38:56.673 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.671+0000 7f7056137800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:56.673 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.671+0000 7f7056137800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.673 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.672+0000 7f7056137800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:38:56.673 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.672+0000 7f7056137800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.674 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.672+0000 7f7056137800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:38:56.674 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.672+0000 7f7056137800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:56.674 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.672+0000 7f7056137800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.674 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.673+0000 7f7056137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.674 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.674+0000 7f70177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:56.677 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.676+0000 7f7056137800 20 remove_watcher() i=0 2023-12-03T11:38:56.677 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.676+0000 7f7056137800 2 removed watcher, disabling cache 2023-12-03T11:38:56.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.677+0000 7f7056137800 20 remove_watcher() i=1 2023-12-03T11:38:56.679 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.678+0000 7f7056137800 20 remove_watcher() i=2 2023-12-03T11:38:56.680 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.679+0000 7f7056137800 20 remove_watcher() i=3 2023-12-03T11:38:56.681 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.680+0000 7f7056137800 20 remove_watcher() i=4 2023-12-03T11:38:56.682 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.681+0000 7f7056137800 20 remove_watcher() i=5 2023-12-03T11:38:56.683 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.682+0000 7f7056137800 20 remove_watcher() i=6 2023-12-03T11:38:56.684 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.683+0000 7f7056137800 20 remove_watcher() i=7 2023-12-03T11:38:56.689 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.689 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:38:56.689 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-commit-target-layout id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:38:56.689 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.690 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2023-12-03T11:38:56.724 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:56.724 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:56.739 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.737+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.740 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.739+0000 7f3b89433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.740 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.739+0000 7f3b89433800 20 realm 2023-12-03T11:38:56.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.739+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.739+0000 7f3b89433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.739+0000 7f3b89433800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:56.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.739+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.740+0000 7f3b89433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.740+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.740+0000 7f3b89433800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:56.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.740+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.742 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.741+0000 7f3b89433800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:56.742 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.741+0000 7f3b89433800 20 searching for the correct realm 2023-12-03T11:38:56.751 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.750+0000 7f3b86f33640 0 -- 172.21.15.44:0/1223299604 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x564db28fc0e0 msgr2=0x564db28fe4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:56.753 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.752+0000 7f3b89433800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:56.753 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.752+0000 7f3b89433800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:56.753 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.752+0000 7f3b89433800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:56.753 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.752+0000 7f3b89433800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:56.753 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.752+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.753 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.752+0000 7f3b89433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.753 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.752+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.752+0000 7f3b89433800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:56.754 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.752+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.755 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.752+0000 7f3b89433800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:56.755 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.752+0000 7f3b89433800 20 zone default found 2023-12-03T11:38:56.755 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.752+0000 7f3b89433800 4 Realm: () 2023-12-03T11:38:56.755 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.752+0000 7f3b89433800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:56.755 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.752+0000 7f3b89433800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:56.755 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.752+0000 7f3b89433800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:56.755 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.752+0000 7f3b89433800 20 zonegroup default 2023-12-03T11:38:56.755 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.752+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.755 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.753+0000 7f3b89433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.755 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.753+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.755 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.753+0000 7f3b89433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.755 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.753+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.756 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.753+0000 7f3b89433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.756 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.753+0000 7f3b89433800 20 started sync module instance, tier type = 2023-12-03T11:38:56.756 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.753+0000 7f3b89433800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:56.760 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.759+0000 7f3b87734640 0 -- 172.21.15.44:0/1223299604 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x564db29041a0 msgr2=0x564db2906660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:38:56.763 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.762+0000 7f3b89433800 20 add_watcher() i=0 2023-12-03T11:38:56.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.762+0000 7f3b89433800 20 add_watcher() i=1 2023-12-03T11:38:56.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.762+0000 7f3b89433800 20 add_watcher() i=2 2023-12-03T11:38:56.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.762+0000 7f3b89433800 20 add_watcher() i=3 2023-12-03T11:38:56.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.762+0000 7f3b89433800 20 add_watcher() i=4 2023-12-03T11:38:56.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.762+0000 7f3b89433800 20 add_watcher() i=5 2023-12-03T11:38:56.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.762+0000 7f3b89433800 20 add_watcher() i=6 2023-12-03T11:38:56.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.763+0000 7f3b89433800 20 add_watcher() i=7 2023-12-03T11:38:56.764 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.763+0000 7f3b89433800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:56.766 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.765+0000 7f3ac7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:56.766 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.765+0000 7f3b89433800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:56.766 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.765+0000 7f3b89433800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:56.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.771+0000 7f3b89433800 5 note: GC not initialized 2023-12-03T11:38:56.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.771+0000 7f3ab6ffd640 20 reqs_thread_entry: start 2023-12-03T11:38:56.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.772+0000 7f3b89433800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:56.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.772+0000 7f3b89433800 20 Filter name: none 2023-12-03T11:38:56.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.772+0000 7f3ab4ff9640 20 reqs_thread_entry: start 2023-12-03T11:38:56.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.772+0000 7f3b89433800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2023-12-03T11:38:56.773 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.772+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.774 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.772+0000 7f3b89433800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:38:56.774 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.772+0000 7f3b89433800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2023-12-03T11:38:56.774 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.772+0000 7f3b89433800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2023-12-03T11:38:56.774 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.772+0000 7f3b89433800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 : miss 2023-12-03T11:38:56.775 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.772+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.775 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.773+0000 7f3b89433800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:38:56.775 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.773+0000 7f3b89433800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 info.flags=0x17 2023-12-03T11:38:56.775 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.773+0000 7f3b89433800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 to cache LRU end 2023-12-03T11:38:56.775 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.773+0000 7f3b89433800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:38:56.775 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.773+0000 7f3b89433800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:56.775 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.773+0000 7f3b89433800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 2023-12-03T11:38:56.778 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.777+0000 7f3b89433800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 info.flags=0x17 2023-12-03T11:38:56.778 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.777+0000 7f3b89433800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 to cache LRU end 2023-12-03T11:38:56.778 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.777+0000 7f3b89433800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:56.778 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.777+0000 7f3b89433800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25, ofs0, ns] 2023-12-03T11:38:56.778 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.777+0000 7f3b7d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693259 cookie 94891708241568 notifier 6671 bl.length()=893 2023-12-03T11:38:56.778 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.777+0000 7f3b7d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 info.flags=0x17 2023-12-03T11:38:56.778 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.777+0000 7f3b7d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 to cache LRU end 2023-12-03T11:38:56.778 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.777+0000 7f3b7d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:56.779 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.777+0000 7f3b89433800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25]): orig_sources= new_sources= 2023-12-03T11:38:56.779 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.777+0000 7f3b89433800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25]): potential sources added=[] removed=[] 2023-12-03T11:38:56.779 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.777+0000 7f3b89433800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25]): orig_dests= new_dests= 2023-12-03T11:38:56.779 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.777+0000 7f3b89433800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25]): potential dests added=[] removed=[] 2023-12-03T11:38:56.779 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.778+0000 7f3b89433800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25.1.0 2023-12-03T11:38:56.780 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.778+0000 7f3b89433800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25.1.0 2023-12-03T11:38:56.780 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.778+0000 7f3b89433800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25.1.1 2023-12-03T11:38:56.780 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.778+0000 7f3b89433800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25.1.1 2023-12-03T11:38:56.780 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.778+0000 7f3b89433800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25.0 2023-12-03T11:38:56.782 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3b89433800 time 2023-12-03T11:38:56.781777+0000 2023-12-03T11:38:56.782 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:38:56.782 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:38:56.783 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3b8dd6eef8] 2023-12-03T11:38:56.783 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f3b8dd6f0b6] 2023-12-03T11:38:56.783 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564db00e9a71] 2023-12-03T11:38:56.783 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x564db00f61d8] 2023-12-03T11:38:56.783 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2023-12-03T11:38:56.783 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f3b8b63feb0] 2023-12-03T11:38:56.783 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2023-12-03T11:38:56.784 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2023-12-03T11:38:56.784 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.781+0000 7f3b89433800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3b89433800 time 2023-12-03T11:38:56.781777+0000 2023-12-03T11:38:56.784 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:38:56.784 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.784 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:38:56.784 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3b8dd6eef8] 2023-12-03T11:38:56.784 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f3b8dd6f0b6] 2023-12-03T11:38:56.785 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564db00e9a71] 2023-12-03T11:38:56.785 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x564db00f61d8] 2023-12-03T11:38:56.785 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2023-12-03T11:38:56.785 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f3b8b63feb0] 2023-12-03T11:38:56.785 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2023-12-03T11:38:56.785 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2023-12-03T11:38:56.785 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.785 INFO:tasks.workunit.client.0.smithi044.stderr:*** Caught signal (Aborted) ** 2023-12-03T11:38:56.785 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f3b89433800 thread_name:radosgw-admin 2023-12-03T11:38:56.803 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:38:56.803 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f3b8b654db0] 2023-12-03T11:38:56.803 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f3b8b6a154c] 2023-12-03T11:38:56.804 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2023-12-03T11:38:56.804 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2023-12-03T11:38:56.804 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3b8dd6ef52] 2023-12-03T11:38:56.804 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f3b8dd6f0b6] 2023-12-03T11:38:56.804 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564db00e9a71] 2023-12-03T11:38:56.804 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x564db00f61d8] 2023-12-03T11:38:56.804 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2023-12-03T11:38:56.804 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f3b8b63feb0] 2023-12-03T11:38:56.804 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2023-12-03T11:38:56.804 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2023-12-03T11:38:56.804 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.782+0000 7f3b89433800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:38:56.804 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f3b89433800 thread_name:radosgw-admin 2023-12-03T11:38:56.804 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.804 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:38:56.804 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f3b8b654db0] 2023-12-03T11:38:56.805 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f3b8b6a154c] 2023-12-03T11:38:56.805 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2023-12-03T11:38:56.805 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2023-12-03T11:38:56.805 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3b8dd6ef52] 2023-12-03T11:38:56.805 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f3b8dd6f0b6] 2023-12-03T11:38:56.805 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564db00e9a71] 2023-12-03T11:38:56.805 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x564db00f61d8] 2023-12-03T11:38:56.805 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2023-12-03T11:38:56.805 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f3b8b63feb0] 2023-12-03T11:38:56.805 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2023-12-03T11:38:56.805 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2023-12-03T11:38:56.805 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:38:56.805 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.805 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2023-12-03T11:38:56.806 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2023-12-03T11:38:56.731+0000 7f3b89433800 1 librados: init done 2023-12-03T11:38:56.806 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2023-12-03T11:38:56.732+0000 7f3b89433800 10 monclient: get_monmap_and_config 2023-12-03T11:38:56.806 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2023-12-03T11:38:56.732+0000 7f3b89433800 10 monclient: build_initial_monmap 2023-12-03T11:38:56.806 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2023-12-03T11:38:56.732+0000 7f3b89433800 1 build_initial for_mkfs: 0 2023-12-03T11:38:56.806 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2023-12-03T11:38:56.732+0000 7f3b89433800 10 monclient: monmap: 2023-12-03T11:38:56.806 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:38:56.806 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:38:56.806 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:38:56.806 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:38:56.806 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:38:56.806 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.806 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:38:56.806 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:38:56.806 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:38:56.806 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.807 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding auth protocol: cephx 2023-12-03T11:38:56.807 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding auth protocol: cephx 2023-12-03T11:38:56.807 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding auth protocol: cephx 2023-12-03T11:38:56.807 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: secure 2023-12-03T11:38:56.807 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: crc 2023-12-03T11:38:56.807 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: secure 2023-12-03T11:38:56.807 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: crc 2023-12-03T11:38:56.807 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: secure 2023-12-03T11:38:56.807 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: crc 2023-12-03T11:38:56.807 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: crc 2023-12-03T11:38:56.807 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: secure 2023-12-03T11:38:56.807 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: crc 2023-12-03T11:38:56.807 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: secure 2023-12-03T11:38:56.807 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: crc 2023-12-03T11:38:56.808 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: secure 2023-12-03T11:38:56.808 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2023-12-03T11:38:56.732+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.808 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2023-12-03T11:38:56.733+0000 7f3b89433800 10 monclient: init 2023-12-03T11:38:56.808 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding auth protocol: cephx 2023-12-03T11:38:56.808 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding auth protocol: cephx 2023-12-03T11:38:56.808 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding auth protocol: cephx 2023-12-03T11:38:56.808 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: secure 2023-12-03T11:38:56.808 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: crc 2023-12-03T11:38:56.808 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: secure 2023-12-03T11:38:56.808 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: crc 2023-12-03T11:38:56.808 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: secure 2023-12-03T11:38:56.808 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: crc 2023-12-03T11:38:56.808 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: crc 2023-12-03T11:38:56.808 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: secure 2023-12-03T11:38:56.808 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: crc 2023-12-03T11:38:56.808 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: secure 2023-12-03T11:38:56.809 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: crc 2023-12-03T11:38:56.809 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: secure 2023-12-03T11:38:56.809 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2023-12-03T11:38:56.733+0000 7f3b7ffff640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:38:56.809 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2023-12-03T11:38:56.733+0000 7f3b7ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:56.809 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2023-12-03T11:38:56.733+0000 7f3b7ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:56.809 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2023-12-03T11:38:56.733+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.809 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2023-12-03T11:38:56.733+0000 7f3b86732640 10 monclient: get_auth_request con 0x7f3b68069820 auth_method 0 2023-12-03T11:38:56.809 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2023-12-03T11:38:56.733+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.809 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command rotate-key cmddesc rotate-key hook 0x7ffe3614f098 EEXIST 2023-12-03T11:38:56.809 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2023-12-03T11:38:56.733+0000 7f3b89433800 10 monclient: _reopen_session rank -1 2023-12-03T11:38:56.809 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2023-12-03T11:38:56.733+0000 7f3b89433800 10 monclient: _add_conns ranks=[1,2,0] 2023-12-03T11:38:56.809 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2023-12-03T11:38:56.733+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-b con 0x564db28d9c00 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:38:56.809 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2023-12-03T11:38:56.733+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-c con 0x564db28d9fe0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:38:56.809 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2023-12-03T11:38:56.733+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-a con 0x564db28dca00 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:38:56.809 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2023-12-03T11:38:56.733+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.809 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2023-12-03T11:38:56.733+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.810 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2023-12-03T11:38:56.733+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.810 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2023-12-03T11:38:56.733+0000 7f3b89433800 10 monclient(hunting): _renew_subs 2023-12-03T11:38:56.810 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2023-12-03T11:38:56.733+0000 7f3b89433800 10 monclient(hunting): authenticate will time out at 1615.959563s 2023-12-03T11:38:56.810 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2023-12-03T11:38:56.734+0000 7f3b87734640 10 monclient(hunting): get_auth_request con 0x564db28dca00 auth_method 0 2023-12-03T11:38:56.810 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2023-12-03T11:38:56.734+0000 7f3b87734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.810 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2023-12-03T11:38:56.734+0000 7f3b87734640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.810 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2023-12-03T11:38:56.734+0000 7f3b87734640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.810 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2023-12-03T11:38:56.734+0000 7f3b86f33640 10 monclient(hunting): get_auth_request con 0x564db28d9c00 auth_method 0 2023-12-03T11:38:56.810 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2023-12-03T11:38:56.734+0000 7f3b86f33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.810 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2023-12-03T11:38:56.734+0000 7f3b86f33640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.810 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2023-12-03T11:38:56.734+0000 7f3b86f33640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.810 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2023-12-03T11:38:56.734+0000 7f3b86732640 10 monclient(hunting): get_auth_request con 0x564db28d9fe0 auth_method 0 2023-12-03T11:38:56.810 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2023-12-03T11:38:56.734+0000 7f3b86732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.810 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2023-12-03T11:38:56.734+0000 7f3b86732640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.811 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2023-12-03T11:38:56.734+0000 7f3b86732640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.811 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2023-12-03T11:38:56.734+0000 7f3b87734640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:56.811 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2023-12-03T11:38:56.734+0000 7f3b87734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:56.811 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2023-12-03T11:38:56.734+0000 7f3b87734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:56.811 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2023-12-03T11:38:56.734+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:56.811 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2023-12-03T11:38:56.734+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:56.811 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2023-12-03T11:38:56.734+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:56.811 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2023-12-03T11:38:56.734+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:56.811 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2023-12-03T11:38:56.734+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:56.811 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2023-12-03T11:38:56.734+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:56.811 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2023-12-03T11:38:56.734+0000 7f3b87734640 10 monclient(hunting): handle_auth_done global_id 7047 payload 274 2023-12-03T11:38:56.811 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2023-12-03T11:38:56.734+0000 7f3b87734640 10 monclient: _finish_hunting 0 2023-12-03T11:38:56.811 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2023-12-03T11:38:56.734+0000 7f3b87734640 1 monclient: found mon.noname-a 2023-12-03T11:38:56.811 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2023-12-03T11:38:56.734+0000 7f3b87734640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2023-12-03T11:38:56.811 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2023-12-03T11:38:56.734+0000 7f3b7d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:56.812 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2023-12-03T11:38:56.734+0000 7f3b7d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:38:56.812 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2023-12-03T11:38:56.734+0000 7f3b7d7fa640 10 monclient: dump: 2023-12-03T11:38:56.812 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:56.812 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:56.812 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.812 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.812 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:56.812 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.812 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:56.812 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:56.812 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:56.812 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.812 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2023-12-03T11:38:56.734+0000 7f3b7d7fa640 10 monclient: _finish_auth 0 2023-12-03T11:38:56.812 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2023-12-03T11:38:56.734+0000 7f3b7d7fa640 10 monclient: _check_auth_tickets 2023-12-03T11:38:56.812 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2023-12-03T11:38:56.734+0000 7f3b7d7fa640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:38:56.812 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2023-12-03T11:38:56.734+0000 7f3b7d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:56.813 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2023-12-03T11:38:56.734+0000 7f3b7d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:38:56.813 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2023-12-03T11:38:56.734+0000 7f3b7d7fa640 10 monclient: dump: 2023-12-03T11:38:56.813 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:56.813 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:56.813 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.813 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.813 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:56.813 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.813 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:56.813 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:56.813 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:56.813 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.813 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2023-12-03T11:38:56.734+0000 7f3b89433800 5 monclient: authenticate success, global_id 7047 2023-12-03T11:38:56.813 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2023-12-03T11:38:56.734+0000 7f3b89433800 10 monclient: get_monmap_and_config success 2023-12-03T11:38:56.814 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2023-12-03T11:38:56.734+0000 7f3b89433800 4 set_mon_vals no callback set 2023-12-03T11:38:56.814 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2023-12-03T11:38:56.734+0000 7f3b89433800 10 monclient: shutdown 2023-12-03T11:38:56.814 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2023-12-03T11:38:56.735+0000 7f3b89433800 10 monclient: build_initial_monmap 2023-12-03T11:38:56.814 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2023-12-03T11:38:56.735+0000 7f3b89433800 1 build_initial for_mkfs: 0 2023-12-03T11:38:56.814 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2023-12-03T11:38:56.735+0000 7f3b89433800 10 monclient: monmap: 2023-12-03T11:38:56.814 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:38:56.814 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:38:56.814 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:38:56.814 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:38:56.814 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:38:56.814 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.814 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:38:56.814 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:38:56.814 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:38:56.814 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.815 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding auth protocol: cephx 2023-12-03T11:38:56.815 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding auth protocol: cephx 2023-12-03T11:38:56.815 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding auth protocol: cephx 2023-12-03T11:38:56.815 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: secure 2023-12-03T11:38:56.815 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: crc 2023-12-03T11:38:56.815 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: secure 2023-12-03T11:38:56.815 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: crc 2023-12-03T11:38:56.815 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: secure 2023-12-03T11:38:56.815 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: crc 2023-12-03T11:38:56.815 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: crc 2023-12-03T11:38:56.815 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: secure 2023-12-03T11:38:56.815 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: crc 2023-12-03T11:38:56.815 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: secure 2023-12-03T11:38:56.815 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: crc 2023-12-03T11:38:56.816 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: secure 2023-12-03T11:38:56.816 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2023-12-03T11:38:56.735+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.816 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2023-12-03T11:38:56.735+0000 7f3b89433800 1 librados: starting msgr at 2023-12-03T11:38:56.816 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2023-12-03T11:38:56.735+0000 7f3b89433800 1 librados: starting objecter 2023-12-03T11:38:56.816 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command objecter_requests cmddesc objecter_requests hook 0x564db28e5890 EEXIST 2023-12-03T11:38:56.816 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2023-12-03T11:38:56.735+0000 7f3b89433800 1 librados: setting wanted keys 2023-12-03T11:38:56.816 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2023-12-03T11:38:56.735+0000 7f3b89433800 1 librados: calling monclient init 2023-12-03T11:38:56.816 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2023-12-03T11:38:56.735+0000 7f3b89433800 10 monclient: init 2023-12-03T11:38:56.816 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding auth protocol: cephx 2023-12-03T11:38:56.816 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding auth protocol: cephx 2023-12-03T11:38:56.816 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding auth protocol: cephx 2023-12-03T11:38:56.816 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: secure 2023-12-03T11:38:56.816 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: crc 2023-12-03T11:38:56.816 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: secure 2023-12-03T11:38:56.817 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: crc 2023-12-03T11:38:56.817 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: secure 2023-12-03T11:38:56.817 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: crc 2023-12-03T11:38:56.817 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: crc 2023-12-03T11:38:56.817 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: secure 2023-12-03T11:38:56.817 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: crc 2023-12-03T11:38:56.817 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: secure 2023-12-03T11:38:56.817 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: crc 2023-12-03T11:38:56.817 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: secure 2023-12-03T11:38:56.817 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2023-12-03T11:38:56.735+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.817 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2023-12-03T11:38:56.736+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.817 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2023-12-03T11:38:56.736+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command rotate-key cmddesc rotate-key hook 0x564db28a9360 EEXIST 2023-12-03T11:38:56.817 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient: _reopen_session rank -1 2023-12-03T11:38:56.817 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient: _add_conns ranks=[2,0,1] 2023-12-03T11:38:56.818 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-c con 0x564db28d9c00 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:38:56.818 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-a con 0x564db28dca00 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:38:56.818 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-b con 0x564db28de500 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:38:56.818 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.818 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.818 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.818 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient(hunting): _renew_subs 2023-12-03T11:38:56.818 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient(hunting): authenticate will time out at 1615.961777s 2023-12-03T11:38:56.818 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2023-12-03T11:38:56.736+0000 7f3b86f33640 10 monclient(hunting): get_auth_request con 0x564db28d9c00 auth_method 0 2023-12-03T11:38:56.818 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2023-12-03T11:38:56.736+0000 7f3b86f33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.818 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2023-12-03T11:38:56.736+0000 7f3b86f33640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.818 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2023-12-03T11:38:56.736+0000 7f3b86f33640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.818 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2023-12-03T11:38:56.736+0000 7f3b86732640 10 monclient(hunting): get_auth_request con 0x564db28dca00 auth_method 0 2023-12-03T11:38:56.818 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2023-12-03T11:38:56.736+0000 7f3b86732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.818 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2023-12-03T11:38:56.736+0000 7f3b86732640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.819 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2023-12-03T11:38:56.736+0000 7f3b86732640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.819 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2023-12-03T11:38:56.736+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:56.819 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2023-12-03T11:38:56.736+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:56.819 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2023-12-03T11:38:56.736+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:56.819 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2023-12-03T11:38:56.736+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:56.819 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2023-12-03T11:38:56.736+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:56.819 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2023-12-03T11:38:56.736+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:56.819 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2023-12-03T11:38:56.736+0000 7f3b87734640 10 monclient(hunting): get_auth_request con 0x564db28de500 auth_method 0 2023-12-03T11:38:56.819 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2023-12-03T11:38:56.736+0000 7f3b87734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.819 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2023-12-03T11:38:56.736+0000 7f3b87734640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.819 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2023-12-03T11:38:56.736+0000 7f3b87734640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.819 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2023-12-03T11:38:56.736+0000 7f3b86f33640 10 monclient(hunting): handle_auth_done global_id 6671 payload 824 2023-12-03T11:38:56.819 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2023-12-03T11:38:56.736+0000 7f3b86f33640 10 monclient: _finish_hunting 0 2023-12-03T11:38:56.819 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2023-12-03T11:38:56.736+0000 7f3b86f33640 1 monclient: found mon.noname-c 2023-12-03T11:38:56.820 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2023-12-03T11:38:56.736+0000 7f3b86f33640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2023-12-03T11:38:56.820 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2023-12-03T11:38:56.736+0000 7f3b677fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:56.820 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2023-12-03T11:38:56.736+0000 7f3b677fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:38:56.820 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2023-12-03T11:38:56.736+0000 7f3b677fe640 10 monclient: dump: 2023-12-03T11:38:56.820 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:56.820 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:56.820 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.820 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.820 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:56.820 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.820 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:56.820 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:56.820 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:56.820 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.820 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2023-12-03T11:38:56.736+0000 7f3b677fe640 10 monclient: _finish_auth 0 2023-12-03T11:38:56.820 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2023-12-03T11:38:56.736+0000 7f3b677fe640 10 monclient: _check_auth_tickets 2023-12-03T11:38:56.821 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2023-12-03T11:38:56.736+0000 7f3b677fe640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:38:56.821 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2023-12-03T11:38:56.736+0000 7f3b677fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:56.821 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2023-12-03T11:38:56.736+0000 7f3b677fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:38:56.821 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2023-12-03T11:38:56.736+0000 7f3b677fe640 10 monclient: dump: 2023-12-03T11:38:56.821 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:56.821 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:56.821 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.821 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.821 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:56.821 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.821 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:56.821 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:56.821 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:56.821 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.821 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2023-12-03T11:38:56.736+0000 7f3b89433800 5 monclient: authenticate success, global_id 6671 2023-12-03T11:38:56.822 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2023-12-03T11:38:56.736+0000 7f3b7d7fa640 4 set_mon_vals no callback set 2023-12-03T11:38:56.822 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient: _renew_subs 2023-12-03T11:38:56.822 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:38:56.822 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient: _renew_subs 2023-12-03T11:38:56.822 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:38:56.822 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2023-12-03T11:38:56.736+0000 7f3b89433800 1 librados: init done 2023-12-03T11:38:56.822 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2023-12-03T11:38:56.737+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.822 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2023-12-03T11:38:56.738+0000 7f3b677fe640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:38:56.822 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2023-12-03T11:38:56.738+0000 7f3b677fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:56.822 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2023-12-03T11:38:56.738+0000 7f3b677fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:56.822 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2023-12-03T11:38:56.738+0000 7f3b86732640 10 monclient: get_auth_request con 0x7f3b60069820 auth_method 0 2023-12-03T11:38:56.822 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2023-12-03T11:38:56.739+0000 7f3b87734640 10 monclient: get_auth_request con 0x564db28f8180 auth_method 0 2023-12-03T11:38:56.822 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2023-12-03T11:38:56.739+0000 7f3b89433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.822 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2023-12-03T11:38:56.739+0000 7f3b89433800 20 realm 2023-12-03T11:38:56.823 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2023-12-03T11:38:56.739+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.823 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2023-12-03T11:38:56.739+0000 7f3b89433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.823 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2023-12-03T11:38:56.739+0000 7f3b89433800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:56.823 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2023-12-03T11:38:56.739+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.823 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2023-12-03T11:38:56.740+0000 7f3b89433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.823 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2023-12-03T11:38:56.740+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.823 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2023-12-03T11:38:56.740+0000 7f3b86f33640 10 monclient: get_auth_request con 0x564db28fc0e0 auth_method 0 2023-12-03T11:38:56.823 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2023-12-03T11:38:56.740+0000 7f3b89433800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:56.823 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2023-12-03T11:38:56.740+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.823 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2023-12-03T11:38:56.741+0000 7f3b86732640 10 monclient: get_auth_request con 0x564db28ff840 auth_method 0 2023-12-03T11:38:56.823 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2023-12-03T11:38:56.741+0000 7f3b89433800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:56.823 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2023-12-03T11:38:56.741+0000 7f3b89433800 20 searching for the correct realm 2023-12-03T11:38:56.823 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2023-12-03T11:38:56.741+0000 7f3b87734640 10 monclient: get_auth_request con 0x564db29041a0 auth_method 0 2023-12-03T11:38:56.823 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2023-12-03T11:38:56.742+0000 7f3b86f33640 10 monclient: get_auth_request con 0x7f3b80017030 auth_method 0 2023-12-03T11:38:56.823 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2023-12-03T11:38:56.743+0000 7f3b86732640 10 monclient: get_auth_request con 0x7f3b70039a10 auth_method 0 2023-12-03T11:38:56.823 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2023-12-03T11:38:56.745+0000 7f3b87734640 10 monclient: get_auth_request con 0x7f3b70047950 auth_method 0 2023-12-03T11:38:56.824 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2023-12-03T11:38:56.747+0000 7f3b86f33640 10 monclient: get_auth_request con 0x7f3b70019410 auth_method 0 2023-12-03T11:38:56.824 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2023-12-03T11:38:56.750+0000 7f3b86f33640 0 -- 172.21.15.44:0/1223299604 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x564db28fc0e0 msgr2=0x564db28fe4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:56.824 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2023-12-03T11:38:56.750+0000 7f3b677fe640 1 client.6671.objecter ms_handle_reset 0x564db28fc0e0 session 0x564db2669320 osd.5 2023-12-03T11:38:56.824 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2023-12-03T11:38:56.750+0000 7f3b677fe640 10 monclient: _renew_subs 2023-12-03T11:38:56.824 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2023-12-03T11:38:56.750+0000 7f3b677fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:38:56.824 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2023-12-03T11:38:56.750+0000 7f3b86f33640 10 monclient: get_auth_request con 0x7f3b60079e10 auth_method 0 2023-12-03T11:38:56.824 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:56.824 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:56.824 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:56.824 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:56.824 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.824 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.824 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.824 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:56.825 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.825 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:56.825 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 zone default found 2023-12-03T11:38:56.825 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2023-12-03T11:38:56.752+0000 7f3b89433800 4 Realm: () 2023-12-03T11:38:56.825 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2023-12-03T11:38:56.752+0000 7f3b89433800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:56.825 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2023-12-03T11:38:56.752+0000 7f3b89433800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:56.825 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2023-12-03T11:38:56.752+0000 7f3b89433800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:56.825 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 zonegroup default 2023-12-03T11:38:56.825 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.825 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2023-12-03T11:38:56.753+0000 7f3b89433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.825 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2023-12-03T11:38:56.753+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.825 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2023-12-03T11:38:56.753+0000 7f3b89433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.825 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2023-12-03T11:38:56.753+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.825 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2023-12-03T11:38:56.753+0000 7f3b89433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.825 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2023-12-03T11:38:56.753+0000 7f3b89433800 20 started sync module instance, tier type = 2023-12-03T11:38:56.825 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2023-12-03T11:38:56.753+0000 7f3b89433800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:56.826 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2023-12-03T11:38:56.759+0000 7f3b87734640 0 -- 172.21.15.44:0/1223299604 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x564db29041a0 msgr2=0x564db2906660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:38:56.826 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2023-12-03T11:38:56.759+0000 7f3b677fe640 1 client.6671.objecter ms_handle_reset 0x564db29041a0 session 0x564db2903b20 osd.3 2023-12-03T11:38:56.826 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2023-12-03T11:38:56.759+0000 7f3b87734640 10 monclient: get_auth_request con 0x564db28fc0e0 auth_method 0 2023-12-03T11:38:56.826 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2023-12-03T11:38:56.762+0000 7f3b89433800 20 add_watcher() i=0 2023-12-03T11:38:56.826 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2023-12-03T11:38:56.762+0000 7f3b89433800 20 add_watcher() i=1 2023-12-03T11:38:56.826 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2023-12-03T11:38:56.762+0000 7f3b89433800 20 add_watcher() i=2 2023-12-03T11:38:56.826 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2023-12-03T11:38:56.762+0000 7f3b89433800 20 add_watcher() i=3 2023-12-03T11:38:56.826 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2023-12-03T11:38:56.762+0000 7f3b89433800 20 add_watcher() i=4 2023-12-03T11:38:56.826 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2023-12-03T11:38:56.762+0000 7f3b89433800 20 add_watcher() i=5 2023-12-03T11:38:56.826 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2023-12-03T11:38:56.762+0000 7f3b89433800 20 add_watcher() i=6 2023-12-03T11:38:56.826 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2023-12-03T11:38:56.763+0000 7f3b89433800 20 add_watcher() i=7 2023-12-03T11:38:56.826 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2023-12-03T11:38:56.763+0000 7f3b89433800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:56.826 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding auth protocol: cephx 2023-12-03T11:38:56.827 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding auth protocol: cephx 2023-12-03T11:38:56.827 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding auth protocol: cephx 2023-12-03T11:38:56.827 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: secure 2023-12-03T11:38:56.827 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: crc 2023-12-03T11:38:56.827 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: secure 2023-12-03T11:38:56.827 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: crc 2023-12-03T11:38:56.827 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: secure 2023-12-03T11:38:56.827 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: crc 2023-12-03T11:38:56.827 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: crc 2023-12-03T11:38:56.827 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: secure 2023-12-03T11:38:56.827 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: crc 2023-12-03T11:38:56.827 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: secure 2023-12-03T11:38:56.827 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2023-12-03T11:38:56.765+0000 7f3ac7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:56.827 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: crc 2023-12-03T11:38:56.827 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: secure 2023-12-03T11:38:56.828 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2023-12-03T11:38:56.765+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.828 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2023-12-03T11:38:56.765+0000 7f3b89433800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:56.828 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2023-12-03T11:38:56.765+0000 7f3b89433800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:56.828 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command cache list hook 0x564db2890d50 2023-12-03T11:38:56.828 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command cache inspect hook 0x564db2890d50 2023-12-03T11:38:56.828 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command cache erase hook 0x564db2890d50 2023-12-03T11:38:56.828 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command cache zap hook 0x564db2890d50 2023-12-03T11:38:56.828 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2023-12-03T11:38:56.765+0000 7f3b89433800 10 monclient: get_monmap_and_config 2023-12-03T11:38:56.828 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2023-12-03T11:38:56.765+0000 7f3b89433800 10 monclient: build_initial_monmap 2023-12-03T11:38:56.828 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2023-12-03T11:38:56.765+0000 7f3b89433800 1 build_initial for_mkfs: 0 2023-12-03T11:38:56.828 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2023-12-03T11:38:56.765+0000 7f3b89433800 10 monclient: monmap: 2023-12-03T11:38:56.828 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:38:56.828 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:38:56.828 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:38:56.828 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:38:56.829 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:38:56.829 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.829 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:38:56.829 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:38:56.829 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:38:56.829 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.829 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding auth protocol: cephx 2023-12-03T11:38:56.829 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding auth protocol: cephx 2023-12-03T11:38:56.829 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding auth protocol: cephx 2023-12-03T11:38:56.829 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: secure 2023-12-03T11:38:56.829 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: crc 2023-12-03T11:38:56.829 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: secure 2023-12-03T11:38:56.829 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: crc 2023-12-03T11:38:56.829 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: secure 2023-12-03T11:38:56.829 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: crc 2023-12-03T11:38:56.830 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: crc 2023-12-03T11:38:56.830 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: secure 2023-12-03T11:38:56.830 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: crc 2023-12-03T11:38:56.830 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: secure 2023-12-03T11:38:56.830 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: crc 2023-12-03T11:38:56.830 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: secure 2023-12-03T11:38:56.830 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2023-12-03T11:38:56.766+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.830 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2023-12-03T11:38:56.766+0000 7f3b89433800 10 monclient: init 2023-12-03T11:38:56.830 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding auth protocol: cephx 2023-12-03T11:38:56.830 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding auth protocol: cephx 2023-12-03T11:38:56.830 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding auth protocol: cephx 2023-12-03T11:38:56.830 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: secure 2023-12-03T11:38:56.830 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: crc 2023-12-03T11:38:56.830 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: secure 2023-12-03T11:38:56.831 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: crc 2023-12-03T11:38:56.831 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: secure 2023-12-03T11:38:56.831 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: crc 2023-12-03T11:38:56.831 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: crc 2023-12-03T11:38:56.831 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: secure 2023-12-03T11:38:56.831 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: crc 2023-12-03T11:38:56.831 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: secure 2023-12-03T11:38:56.831 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: crc 2023-12-03T11:38:56.831 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: secure 2023-12-03T11:38:56.831 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2023-12-03T11:38:56.766+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.831 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2023-12-03T11:38:56.766+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.831 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command rotate-key cmddesc rotate-key hook 0x7ffe3614f618 EEXIST 2023-12-03T11:38:56.831 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2023-12-03T11:38:56.766+0000 7f3b89433800 10 monclient: _reopen_session rank -1 2023-12-03T11:38:56.831 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2023-12-03T11:38:56.766+0000 7f3b89433800 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:38:56.831 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2023-12-03T11:38:56.766+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-b con 0x564db293b5b0 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:38:56.832 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2023-12-03T11:38:56.766+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-a con 0x564db2933930 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:38:56.832 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2023-12-03T11:38:56.766+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-c con 0x564db29325d0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:38:56.832 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2023-12-03T11:38:56.766+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.832 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2023-12-03T11:38:56.766+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.832 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2023-12-03T11:38:56.766+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.832 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2023-12-03T11:38:56.766+0000 7f3b89433800 10 monclient(hunting): _renew_subs 2023-12-03T11:38:56.832 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2023-12-03T11:38:56.766+0000 7f3b89433800 10 monclient(hunting): authenticate will time out at 1615.992405s 2023-12-03T11:38:56.832 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2023-12-03T11:38:56.766+0000 7f3b86f33640 10 monclient(hunting): get_auth_request con 0x564db2933930 auth_method 0 2023-12-03T11:38:56.832 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2023-12-03T11:38:56.766+0000 7f3b86f33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.832 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2023-12-03T11:38:56.766+0000 7f3b86f33640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.832 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2023-12-03T11:38:56.766+0000 7f3b86f33640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.832 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2023-12-03T11:38:56.766+0000 7f3b86732640 10 monclient(hunting): get_auth_request con 0x564db29325d0 auth_method 0 2023-12-03T11:38:56.832 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2023-12-03T11:38:56.766+0000 7f3b86732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.832 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2023-12-03T11:38:56.766+0000 7f3b86732640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.832 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2023-12-03T11:38:56.766+0000 7f3b86732640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.832 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2023-12-03T11:38:56.766+0000 7f3b87734640 10 monclient(hunting): get_auth_request con 0x564db293b5b0 auth_method 0 2023-12-03T11:38:56.833 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2023-12-03T11:38:56.766+0000 7f3b87734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.833 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2023-12-03T11:38:56.766+0000 7f3b87734640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.833 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2023-12-03T11:38:56.766+0000 7f3b87734640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.833 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2023-12-03T11:38:56.766+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:56.833 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2023-12-03T11:38:56.766+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:56.833 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2023-12-03T11:38:56.766+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:56.833 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2023-12-03T11:38:56.766+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:56.833 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2023-12-03T11:38:56.766+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:56.833 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2023-12-03T11:38:56.766+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:56.833 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2023-12-03T11:38:56.767+0000 7f3b87734640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:56.833 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2023-12-03T11:38:56.767+0000 7f3b87734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:56.833 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2023-12-03T11:38:56.767+0000 7f3b87734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:56.833 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2023-12-03T11:38:56.767+0000 7f3b86f33640 10 monclient(hunting): handle_auth_done global_id 7053 payload 274 2023-12-03T11:38:56.833 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2023-12-03T11:38:56.767+0000 7f3b86f33640 10 monclient: _finish_hunting 0 2023-12-03T11:38:56.834 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2023-12-03T11:38:56.767+0000 7f3b86f33640 1 monclient: found mon.noname-a 2023-12-03T11:38:56.834 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2023-12-03T11:38:56.767+0000 7f3b86f33640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2023-12-03T11:38:56.834 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2023-12-03T11:38:56.767+0000 7f3ac77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:56.834 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2023-12-03T11:38:56.767+0000 7f3ac77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:38:56.834 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2023-12-03T11:38:56.767+0000 7f3ac77fe640 10 monclient: dump: 2023-12-03T11:38:56.834 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:56.834 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:56.834 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.834 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.834 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:56.834 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.834 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:56.834 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:56.835 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:56.835 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.835 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2023-12-03T11:38:56.767+0000 7f3ac77fe640 10 monclient: _finish_auth 0 2023-12-03T11:38:56.835 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2023-12-03T11:38:56.767+0000 7f3ac77fe640 10 monclient: _check_auth_tickets 2023-12-03T11:38:56.837 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2023-12-03T11:38:56.767+0000 7f3ac77fe640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:38:56.837 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2023-12-03T11:38:56.767+0000 7f3b89433800 5 monclient: authenticate success, global_id 7053 2023-12-03T11:38:56.837 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2023-12-03T11:38:56.767+0000 7f3b89433800 10 monclient: get_monmap_and_config success 2023-12-03T11:38:56.837 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2023-12-03T11:38:56.767+0000 7f3ac77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:56.837 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2023-12-03T11:38:56.767+0000 7f3b89433800 4 set_mon_vals no callback set 2023-12-03T11:38:56.837 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2023-12-03T11:38:56.767+0000 7f3ac77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:38:56.837 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2023-12-03T11:38:56.767+0000 7f3ac77fe640 10 monclient: dump: 2023-12-03T11:38:56.838 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:56.838 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:56.838 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.838 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.838 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:56.838 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.838 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:56.838 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:56.838 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:56.838 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.838 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2023-12-03T11:38:56.768+0000 7f3b89433800 10 monclient: shutdown 2023-12-03T11:38:56.838 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2023-12-03T11:38:56.768+0000 7f3b89433800 10 monclient: build_initial_monmap 2023-12-03T11:38:56.838 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2023-12-03T11:38:56.768+0000 7f3b89433800 1 build_initial for_mkfs: 0 2023-12-03T11:38:56.838 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2023-12-03T11:38:56.768+0000 7f3b89433800 10 monclient: monmap: 2023-12-03T11:38:56.839 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:38:56.839 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:38:56.839 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:38:56.839 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:38:56.839 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:38:56.839 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.839 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:38:56.839 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:38:56.839 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:38:56.839 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.839 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding auth protocol: cephx 2023-12-03T11:38:56.839 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding auth protocol: cephx 2023-12-03T11:38:56.839 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding auth protocol: cephx 2023-12-03T11:38:56.839 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: secure 2023-12-03T11:38:56.839 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: crc 2023-12-03T11:38:56.840 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: secure 2023-12-03T11:38:56.840 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: crc 2023-12-03T11:38:56.840 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: secure 2023-12-03T11:38:56.840 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: crc 2023-12-03T11:38:56.840 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: crc 2023-12-03T11:38:56.840 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: secure 2023-12-03T11:38:56.840 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: crc 2023-12-03T11:38:56.840 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: secure 2023-12-03T11:38:56.840 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: crc 2023-12-03T11:38:56.840 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: secure 2023-12-03T11:38:56.840 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2023-12-03T11:38:56.768+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.840 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2023-12-03T11:38:56.768+0000 7f3b89433800 1 librados: starting msgr at 2023-12-03T11:38:56.840 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2023-12-03T11:38:56.768+0000 7f3b89433800 1 librados: starting objecter 2023-12-03T11:38:56.840 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command objecter_requests cmddesc objecter_requests hook 0x564db2911cc0 EEXIST 2023-12-03T11:38:56.840 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2023-12-03T11:38:56.768+0000 7f3b89433800 1 librados: setting wanted keys 2023-12-03T11:38:56.840 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2023-12-03T11:38:56.768+0000 7f3b89433800 1 librados: calling monclient init 2023-12-03T11:38:56.840 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2023-12-03T11:38:56.768+0000 7f3b89433800 10 monclient: init 2023-12-03T11:38:56.841 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding auth protocol: cephx 2023-12-03T11:38:56.841 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding auth protocol: cephx 2023-12-03T11:38:56.841 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding auth protocol: cephx 2023-12-03T11:38:56.841 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: secure 2023-12-03T11:38:56.841 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: crc 2023-12-03T11:38:56.841 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: secure 2023-12-03T11:38:56.841 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: crc 2023-12-03T11:38:56.841 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: secure 2023-12-03T11:38:56.841 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: crc 2023-12-03T11:38:56.841 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: crc 2023-12-03T11:38:56.841 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: secure 2023-12-03T11:38:56.841 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: crc 2023-12-03T11:38:56.841 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: secure 2023-12-03T11:38:56.841 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: crc 2023-12-03T11:38:56.841 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: secure 2023-12-03T11:38:56.841 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2023-12-03T11:38:56.768+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.842 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2023-12-03T11:38:56.769+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.842 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2023-12-03T11:38:56.769+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command rotate-key cmddesc rotate-key hook 0x564db29404d0 EEXIST 2023-12-03T11:38:56.842 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2023-12-03T11:38:56.769+0000 7f3b89433800 10 monclient: _reopen_session rank -1 2023-12-03T11:38:56.842 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2023-12-03T11:38:56.769+0000 7f3b89433800 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:38:56.842 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2023-12-03T11:38:56.769+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-b con 0x564db29325d0 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:38:56.842 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2023-12-03T11:38:56.769+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-a con 0x564db2933930 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:38:56.842 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2023-12-03T11:38:56.769+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-c con 0x564db293b5b0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:38:56.842 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2023-12-03T11:38:56.769+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.842 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2023-12-03T11:38:56.769+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.842 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2023-12-03T11:38:56.769+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.842 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2023-12-03T11:38:56.769+0000 7f3b89433800 10 monclient(hunting): _renew_subs 2023-12-03T11:38:56.842 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2023-12-03T11:38:56.769+0000 7f3b89433800 10 monclient(hunting): authenticate will time out at 1615.994969s 2023-12-03T11:38:56.842 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2023-12-03T11:38:56.769+0000 7f3b86f33640 10 monclient(hunting): get_auth_request con 0x564db2933930 auth_method 0 2023-12-03T11:38:56.842 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2023-12-03T11:38:56.769+0000 7f3b86f33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.843 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2023-12-03T11:38:56.769+0000 7f3b86f33640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.843 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2023-12-03T11:38:56.769+0000 7f3b86f33640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.843 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2023-12-03T11:38:56.769+0000 7f3b86732640 10 monclient(hunting): get_auth_request con 0x564db293b5b0 auth_method 0 2023-12-03T11:38:56.843 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2023-12-03T11:38:56.769+0000 7f3b86732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.843 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2023-12-03T11:38:56.769+0000 7f3b86732640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.843 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2023-12-03T11:38:56.769+0000 7f3b86732640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.843 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2023-12-03T11:38:56.769+0000 7f3b87734640 10 monclient(hunting): get_auth_request con 0x564db29325d0 auth_method 0 2023-12-03T11:38:56.843 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2023-12-03T11:38:56.769+0000 7f3b87734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.843 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2023-12-03T11:38:56.769+0000 7f3b87734640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.843 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2023-12-03T11:38:56.769+0000 7f3b87734640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.843 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2023-12-03T11:38:56.769+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:56.843 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2023-12-03T11:38:56.769+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:56.843 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2023-12-03T11:38:56.769+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:56.843 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2023-12-03T11:38:56.769+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:56.843 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2023-12-03T11:38:56.769+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:56.843 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2023-12-03T11:38:56.769+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:56.844 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2023-12-03T11:38:56.769+0000 7f3b87734640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:56.844 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2023-12-03T11:38:56.769+0000 7f3b87734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:56.844 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2023-12-03T11:38:56.769+0000 7f3b87734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:56.844 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2023-12-03T11:38:56.769+0000 7f3b86f33640 10 monclient(hunting): handle_auth_done global_id 7056 payload 824 2023-12-03T11:38:56.844 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2023-12-03T11:38:56.769+0000 7f3b86f33640 10 monclient: _finish_hunting 0 2023-12-03T11:38:56.844 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2023-12-03T11:38:56.769+0000 7f3b86f33640 1 monclient: found mon.noname-a 2023-12-03T11:38:56.844 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2023-12-03T11:38:56.769+0000 7f3b86f33640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2023-12-03T11:38:56.844 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2023-12-03T11:38:56.769+0000 7f3ac5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:56.844 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2023-12-03T11:38:56.769+0000 7f3ac5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:38:56.844 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2023-12-03T11:38:56.769+0000 7f3ac5ffb640 10 monclient: dump: 2023-12-03T11:38:56.844 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:56.844 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:56.844 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.844 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.844 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:56.845 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.845 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:56.845 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:56.845 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:56.845 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.845 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2023-12-03T11:38:56.769+0000 7f3ac5ffb640 10 monclient: _finish_auth 0 2023-12-03T11:38:56.845 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2023-12-03T11:38:56.769+0000 7f3ac5ffb640 10 monclient: _check_auth_tickets 2023-12-03T11:38:56.845 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2023-12-03T11:38:56.769+0000 7f3ac5ffb640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:38:56.845 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2023-12-03T11:38:56.769+0000 7f3ac5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:56.845 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2023-12-03T11:38:56.769+0000 7f3ac5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:38:56.845 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2023-12-03T11:38:56.769+0000 7f3ac5ffb640 10 monclient: dump: 2023-12-03T11:38:56.845 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:56.845 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:56.845 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.846 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.846 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:56.846 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.846 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:56.846 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:56.846 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:56.846 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.846 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2023-12-03T11:38:56.769+0000 7f3ac77fe640 4 set_mon_vals no callback set 2023-12-03T11:38:56.846 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2023-12-03T11:38:56.770+0000 7f3b89433800 5 monclient: authenticate success, global_id 7056 2023-12-03T11:38:56.846 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2023-12-03T11:38:56.770+0000 7f3b89433800 10 monclient: _renew_subs 2023-12-03T11:38:56.846 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2023-12-03T11:38:56.770+0000 7f3b89433800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2023-12-03T11:38:56.846 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2023-12-03T11:38:56.770+0000 7f3b89433800 10 monclient: _renew_subs 2023-12-03T11:38:56.846 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2023-12-03T11:38:56.770+0000 7f3b89433800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2023-12-03T11:38:56.847 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2023-12-03T11:38:56.770+0000 7f3b89433800 1 librados: init done 2023-12-03T11:38:56.847 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2023-12-03T11:38:56.770+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command cr dump hook 0x564db2935d48 2023-12-03T11:38:56.847 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2023-12-03T11:38:56.771+0000 7f3ac5ffb640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:38:56.847 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2023-12-03T11:38:56.771+0000 7f3ac5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:56.847 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2023-12-03T11:38:56.771+0000 7f3ac5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:56.847 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2023-12-03T11:38:56.771+0000 7f3b87734640 10 monclient: get_auth_request con 0x7f3ab8069820 auth_method 0 2023-12-03T11:38:56.847 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2023-12-03T11:38:56.771+0000 7f3b89433800 5 note: GC not initialized 2023-12-03T11:38:56.847 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2023-12-03T11:38:56.771+0000 7f3ab6ffd640 20 reqs_thread_entry: start 2023-12-03T11:38:56.847 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2023-12-03T11:38:56.772+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command sync trace show hook 0x7f3b780047e0 2023-12-03T11:38:56.847 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2023-12-03T11:38:56.772+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command sync trace history hook 0x7f3b780047e0 2023-12-03T11:38:56.847 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2023-12-03T11:38:56.772+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command sync trace active hook 0x7f3b780047e0 2023-12-03T11:38:56.847 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2023-12-03T11:38:56.772+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command sync trace active_short hook 0x7f3b780047e0 2023-12-03T11:38:56.847 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2023-12-03T11:38:56.772+0000 7f3b89433800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:56.847 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2023-12-03T11:38:56.772+0000 7f3b89433800 20 Filter name: none 2023-12-03T11:38:56.848 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2023-12-03T11:38:56.772+0000 7f3ab4ff9640 20 reqs_thread_entry: start 2023-12-03T11:38:56.848 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2023-12-03T11:38:56.772+0000 7f3b89433800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2023-12-03T11:38:56.848 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2023-12-03T11:38:56.772+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.848 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2023-12-03T11:38:56.772+0000 7f3b89433800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:38:56.848 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2023-12-03T11:38:56.772+0000 7f3b89433800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2023-12-03T11:38:56.848 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2023-12-03T11:38:56.772+0000 7f3b89433800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2023-12-03T11:38:56.848 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2023-12-03T11:38:56.772+0000 7f3b89433800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 : miss 2023-12-03T11:38:56.848 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2023-12-03T11:38:56.772+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.848 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2023-12-03T11:38:56.773+0000 7f3b89433800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:38:56.848 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2023-12-03T11:38:56.773+0000 7f3b89433800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 info.flags=0x17 2023-12-03T11:38:56.848 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2023-12-03T11:38:56.773+0000 7f3b89433800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 to cache LRU end 2023-12-03T11:38:56.848 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2023-12-03T11:38:56.773+0000 7f3b89433800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:38:56.848 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2023-12-03T11:38:56.773+0000 7f3b89433800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:56.848 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2023-12-03T11:38:56.773+0000 7f3b89433800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 2023-12-03T11:38:56.849 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2023-12-03T11:38:56.773+0000 7f3b86732640 10 monclient: get_auth_request con 0x564db298d020 auth_method 0 2023-12-03T11:38:56.849 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2023-12-03T11:38:56.777+0000 7f3b89433800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 info.flags=0x17 2023-12-03T11:38:56.849 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2023-12-03T11:38:56.777+0000 7f3b89433800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 to cache LRU end 2023-12-03T11:38:56.849 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2023-12-03T11:38:56.777+0000 7f3b89433800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:56.849 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2023-12-03T11:38:56.777+0000 7f3b89433800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25, ofs0, ns] 2023-12-03T11:38:56.849 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2023-12-03T11:38:56.777+0000 7f3b7d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693259 cookie 94891708241568 notifier 6671 bl.length()=893 2023-12-03T11:38:56.849 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2023-12-03T11:38:56.777+0000 7f3b7d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 info.flags=0x17 2023-12-03T11:38:56.849 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2023-12-03T11:38:56.777+0000 7f3b7d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 to cache LRU end 2023-12-03T11:38:56.849 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2023-12-03T11:38:56.777+0000 7f3b7d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:56.849 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2023-12-03T11:38:56.777+0000 7f3b89433800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25]): orig_sources= new_sources= 2023-12-03T11:38:56.849 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2023-12-03T11:38:56.777+0000 7f3b89433800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25]): potential sources added=[] removed=[] 2023-12-03T11:38:56.849 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2023-12-03T11:38:56.777+0000 7f3b89433800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25]): orig_dests= new_dests= 2023-12-03T11:38:56.849 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2023-12-03T11:38:56.777+0000 7f3b89433800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25]): potential dests added=[] removed=[] 2023-12-03T11:38:56.849 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2023-12-03T11:38:56.778+0000 7f3b89433800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25.1.0 2023-12-03T11:38:56.849 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2023-12-03T11:38:56.778+0000 7f3b89433800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25.1.0 2023-12-03T11:38:56.850 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2023-12-03T11:38:56.778+0000 7f3b89433800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25.1.1 2023-12-03T11:38:56.850 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2023-12-03T11:38:56.778+0000 7f3b89433800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25.1.1 2023-12-03T11:38:56.850 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2023-12-03T11:38:56.778+0000 7f3b89433800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25.0 2023-12-03T11:38:56.850 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2023-12-03T11:38:56.781+0000 7f3b89433800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3b89433800 time 2023-12-03T11:38:56.781777+0000 2023-12-03T11:38:56.850 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:38:56.850 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.850 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:38:56.850 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3b8dd6eef8] 2023-12-03T11:38:56.850 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f3b8dd6f0b6] 2023-12-03T11:38:56.850 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564db00e9a71] 2023-12-03T11:38:56.850 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x564db00f61d8] 2023-12-03T11:38:56.850 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2023-12-03T11:38:56.850 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f3b8b63feb0] 2023-12-03T11:38:56.850 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2023-12-03T11:38:56.851 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2023-12-03T11:38:56.851 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.851 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2023-12-03T11:38:56.782+0000 7f3b89433800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:38:56.851 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f3b89433800 thread_name:radosgw-admin 2023-12-03T11:38:56.851 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.851 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:38:56.851 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f3b8b654db0] 2023-12-03T11:38:56.851 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f3b8b6a154c] 2023-12-03T11:38:56.851 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2023-12-03T11:38:56.851 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2023-12-03T11:38:56.851 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3b8dd6ef52] 2023-12-03T11:38:56.851 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f3b8dd6f0b6] 2023-12-03T11:38:56.851 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564db00e9a71] 2023-12-03T11:38:56.851 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x564db00f61d8] 2023-12-03T11:38:56.851 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2023-12-03T11:38:56.852 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f3b8b63feb0] 2023-12-03T11:38:56.852 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2023-12-03T11:38:56.852 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2023-12-03T11:38:56.852 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:38:56.852 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.852 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2023-12-03T11:38:56.852 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2023-12-03T11:38:56.852 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2023-12-03T11:38:56.852 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2023-12-03T11:38:56.852 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2023-12-03T11:38:56.852 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2023-12-03T11:38:56.852 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2023-12-03T11:38:56.852 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2023-12-03T11:38:56.852 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2023-12-03T11:38:56.852 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2023-12-03T11:38:56.852 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2023-12-03T11:38:56.853 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2023-12-03T11:38:56.853 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2023-12-03T11:38:56.853 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2023-12-03T11:38:56.853 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2023-12-03T11:38:56.853 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2023-12-03T11:38:56.853 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2023-12-03T11:38:56.853 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2023-12-03T11:38:56.853 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2023-12-03T11:38:56.853 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2023-12-03T11:38:56.853 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2023-12-03T11:38:56.853 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2023-12-03T11:38:56.853 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2023-12-03T11:38:56.853 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:38:56.853 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2023-12-03T11:38:56.853 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2023-12-03T11:38:56.853 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2023-12-03T11:38:56.853 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2023-12-03T11:38:56.853 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2023-12-03T11:38:56.854 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2023-12-03T11:38:56.854 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2023-12-03T11:38:56.854 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2023-12-03T11:38:56.854 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2023-12-03T11:38:56.854 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2023-12-03T11:38:56.854 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2023-12-03T11:38:56.854 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2023-12-03T11:38:56.854 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2023-12-03T11:38:56.854 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2023-12-03T11:38:56.854 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2023-12-03T11:38:56.854 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2023-12-03T11:38:56.854 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2023-12-03T11:38:56.854 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2023-12-03T11:38:56.854 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2023-12-03T11:38:56.854 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2023-12-03T11:38:56.854 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2023-12-03T11:38:56.855 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:38:56.855 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2023-12-03T11:38:56.855 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2023-12-03T11:38:56.855 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2023-12-03T11:38:56.855 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2023-12-03T11:38:56.855 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2023-12-03T11:38:56.855 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2023-12-03T11:38:56.855 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2023-12-03T11:38:56.855 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2023-12-03T11:38:56.855 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2023-12-03T11:38:56.855 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2023-12-03T11:38:56.855 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2023-12-03T11:38:56.855 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2023-12-03T11:38:56.855 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2023-12-03T11:38:56.855 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2023-12-03T11:38:56.855 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2023-12-03T11:38:56.856 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2023-12-03T11:38:56.856 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2023-12-03T11:38:56.856 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2023-12-03T11:38:56.856 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:38:56.856 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2023-12-03T11:38:56.856 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:38:56.856 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2023-12-03T11:38:56.856 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2023-12-03T11:38:56.856 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2023-12-03T11:38:56.856 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2023-12-03T11:38:56.856 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2023-12-03T11:38:56.856 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2023-12-03T11:38:56.856 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:38:56.856 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2023-12-03T11:38:56.856 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2023-12-03T11:38:56.856 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:38:56.857 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2023-12-03T11:38:56.857 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2023-12-03T11:38:56.857 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2023-12-03T11:38:56.857 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2023-12-03T11:38:56.857 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2023-12-03T11:38:56.857 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2023-12-03T11:38:56.857 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2023-12-03T11:38:56.857 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2023-12-03T11:38:56.857 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2023-12-03T11:38:56.857 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2023-12-03T11:38:56.857 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2023-12-03T11:38:56.857 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2023-12-03T11:38:56.857 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:38:56.858 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3ab4ff9640 / http_manager 2023-12-03T11:38:56.858 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3ab6ffd640 / http_manager 2023-12-03T11:38:56.858 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3ac5ffb640 / ms_dispatch 2023-12-03T11:38:56.858 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3ac77fe640 / io_context_pool 2023-12-03T11:38:56.858 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3ac7fff640 / rgw_dt_lg_renew 2023-12-03T11:38:56.858 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3b677fe640 / ms_dispatch 2023-12-03T11:38:56.858 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3b7d7fa640 / io_context_pool 2023-12-03T11:38:56.858 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3b7ffff640 / ms_dispatch 2023-12-03T11:38:56.858 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3b86732640 / msgr-worker-2 2023-12-03T11:38:56.858 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3b86f33640 / msgr-worker-1 2023-12-03T11:38:56.858 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3b87734640 / msgr-worker-0 2023-12-03T11:38:56.858 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3b89433800 / radosgw-admin 2023-12-03T11:38:56.858 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2023-12-03T11:38:56.858 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2023-12-03T11:38:56.858 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/log/ceph/ceph-client.admin.103815.log 2023-12-03T11:38:56.859 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2023-12-03T11:38:56.859 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2023-12-03T11:38:56.859 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2023-12-03T11:38:56.731+0000 7f3b89433800 1 librados: init done 2023-12-03T11:38:56.859 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2023-12-03T11:38:56.732+0000 7f3b89433800 10 monclient: get_monmap_and_config 2023-12-03T11:38:56.859 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2023-12-03T11:38:56.732+0000 7f3b89433800 10 monclient: build_initial_monmap 2023-12-03T11:38:56.859 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2023-12-03T11:38:56.732+0000 7f3b89433800 1 build_initial for_mkfs: 0 2023-12-03T11:38:56.859 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2023-12-03T11:38:56.732+0000 7f3b89433800 10 monclient: monmap: 2023-12-03T11:38:56.859 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:38:56.859 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:38:56.859 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:38:56.859 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:38:56.859 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:38:56.859 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.859 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:38:56.860 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:38:56.860 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:38:56.860 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.860 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding auth protocol: cephx 2023-12-03T11:38:56.860 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding auth protocol: cephx 2023-12-03T11:38:56.860 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding auth protocol: cephx 2023-12-03T11:38:56.860 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: secure 2023-12-03T11:38:56.860 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: crc 2023-12-03T11:38:56.860 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: secure 2023-12-03T11:38:56.860 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: crc 2023-12-03T11:38:56.860 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: secure 2023-12-03T11:38:56.860 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: crc 2023-12-03T11:38:56.860 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: crc 2023-12-03T11:38:56.860 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: secure 2023-12-03T11:38:56.860 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: crc 2023-12-03T11:38:56.861 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: secure 2023-12-03T11:38:56.861 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: crc 2023-12-03T11:38:56.861 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2023-12-03T11:38:56.732+0000 7f3b89433800 5 AuthRegistry(0x564db28ab170) adding con mode: secure 2023-12-03T11:38:56.861 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2023-12-03T11:38:56.732+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.861 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2023-12-03T11:38:56.733+0000 7f3b89433800 10 monclient: init 2023-12-03T11:38:56.861 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding auth protocol: cephx 2023-12-03T11:38:56.861 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding auth protocol: cephx 2023-12-03T11:38:56.861 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding auth protocol: cephx 2023-12-03T11:38:56.861 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: secure 2023-12-03T11:38:56.861 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: crc 2023-12-03T11:38:56.861 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: secure 2023-12-03T11:38:56.861 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: crc 2023-12-03T11:38:56.861 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: secure 2023-12-03T11:38:56.861 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: crc 2023-12-03T11:38:56.861 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: crc 2023-12-03T11:38:56.861 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: secure 2023-12-03T11:38:56.862 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: crc 2023-12-03T11:38:56.862 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: secure 2023-12-03T11:38:56.862 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: crc 2023-12-03T11:38:56.862 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614ef50) adding con mode: secure 2023-12-03T11:38:56.862 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2023-12-03T11:38:56.733+0000 7f3b7ffff640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:38:56.862 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2023-12-03T11:38:56.733+0000 7f3b7ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:56.862 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2023-12-03T11:38:56.733+0000 7f3b7ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:56.862 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2023-12-03T11:38:56.733+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.862 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2023-12-03T11:38:56.733+0000 7f3b86732640 10 monclient: get_auth_request con 0x7f3b68069820 auth_method 0 2023-12-03T11:38:56.862 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2023-12-03T11:38:56.733+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.862 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2023-12-03T11:38:56.733+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command rotate-key cmddesc rotate-key hook 0x7ffe3614f098 EEXIST 2023-12-03T11:38:56.862 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2023-12-03T11:38:56.733+0000 7f3b89433800 10 monclient: _reopen_session rank -1 2023-12-03T11:38:56.862 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2023-12-03T11:38:56.733+0000 7f3b89433800 10 monclient: _add_conns ranks=[1,2,0] 2023-12-03T11:38:56.862 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2023-12-03T11:38:56.733+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-b con 0x564db28d9c00 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:38:56.862 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2023-12-03T11:38:56.733+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-c con 0x564db28d9fe0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:38:56.863 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2023-12-03T11:38:56.733+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-a con 0x564db28dca00 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:38:56.863 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2023-12-03T11:38:56.733+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.863 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2023-12-03T11:38:56.733+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.863 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2023-12-03T11:38:56.733+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.863 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2023-12-03T11:38:56.733+0000 7f3b89433800 10 monclient(hunting): _renew_subs 2023-12-03T11:38:56.863 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2023-12-03T11:38:56.733+0000 7f3b89433800 10 monclient(hunting): authenticate will time out at 1615.959563s 2023-12-03T11:38:56.863 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2023-12-03T11:38:56.734+0000 7f3b87734640 10 monclient(hunting): get_auth_request con 0x564db28dca00 auth_method 0 2023-12-03T11:38:56.863 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2023-12-03T11:38:56.734+0000 7f3b87734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.863 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2023-12-03T11:38:56.734+0000 7f3b87734640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.863 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2023-12-03T11:38:56.734+0000 7f3b87734640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.863 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2023-12-03T11:38:56.734+0000 7f3b86f33640 10 monclient(hunting): get_auth_request con 0x564db28d9c00 auth_method 0 2023-12-03T11:38:56.863 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2023-12-03T11:38:56.734+0000 7f3b86f33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.863 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2023-12-03T11:38:56.734+0000 7f3b86f33640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.863 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2023-12-03T11:38:56.734+0000 7f3b86f33640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.863 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2023-12-03T11:38:56.734+0000 7f3b86732640 10 monclient(hunting): get_auth_request con 0x564db28d9fe0 auth_method 0 2023-12-03T11:38:56.863 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2023-12-03T11:38:56.734+0000 7f3b86732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.864 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2023-12-03T11:38:56.734+0000 7f3b86732640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.864 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2023-12-03T11:38:56.734+0000 7f3b86732640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.864 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2023-12-03T11:38:56.734+0000 7f3b87734640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:56.864 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2023-12-03T11:38:56.734+0000 7f3b87734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:56.864 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2023-12-03T11:38:56.734+0000 7f3b87734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:56.864 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2023-12-03T11:38:56.734+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:56.864 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2023-12-03T11:38:56.734+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:56.864 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2023-12-03T11:38:56.734+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:56.864 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2023-12-03T11:38:56.734+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:56.864 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2023-12-03T11:38:56.734+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:56.864 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2023-12-03T11:38:56.734+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:56.864 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2023-12-03T11:38:56.734+0000 7f3b87734640 10 monclient(hunting): handle_auth_done global_id 7047 payload 274 2023-12-03T11:38:56.864 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2023-12-03T11:38:56.734+0000 7f3b87734640 10 monclient: _finish_hunting 0 2023-12-03T11:38:56.864 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2023-12-03T11:38:56.734+0000 7f3b87734640 1 monclient: found mon.noname-a 2023-12-03T11:38:56.864 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2023-12-03T11:38:56.734+0000 7f3b87734640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2023-12-03T11:38:56.864 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2023-12-03T11:38:56.734+0000 7f3b7d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:56.865 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2023-12-03T11:38:56.734+0000 7f3b7d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:38:56.865 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2023-12-03T11:38:56.734+0000 7f3b7d7fa640 10 monclient: dump: 2023-12-03T11:38:56.865 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:56.865 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:56.865 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.865 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.865 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:56.865 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.865 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:56.865 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:56.865 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:56.865 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.865 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2023-12-03T11:38:56.734+0000 7f3b7d7fa640 10 monclient: _finish_auth 0 2023-12-03T11:38:56.866 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2023-12-03T11:38:56.734+0000 7f3b7d7fa640 10 monclient: _check_auth_tickets 2023-12-03T11:38:56.866 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2023-12-03T11:38:56.734+0000 7f3b7d7fa640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:38:56.866 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2023-12-03T11:38:56.734+0000 7f3b7d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:56.866 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2023-12-03T11:38:56.734+0000 7f3b7d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:38:56.866 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2023-12-03T11:38:56.734+0000 7f3b7d7fa640 10 monclient: dump: 2023-12-03T11:38:56.866 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:56.866 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:56.866 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.866 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.866 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:56.866 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.866 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:56.866 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:56.866 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:56.867 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.867 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2023-12-03T11:38:56.734+0000 7f3b89433800 5 monclient: authenticate success, global_id 7047 2023-12-03T11:38:56.867 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2023-12-03T11:38:56.734+0000 7f3b89433800 10 monclient: get_monmap_and_config success 2023-12-03T11:38:56.867 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2023-12-03T11:38:56.734+0000 7f3b89433800 4 set_mon_vals no callback set 2023-12-03T11:38:56.867 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2023-12-03T11:38:56.734+0000 7f3b89433800 10 monclient: shutdown 2023-12-03T11:38:56.867 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2023-12-03T11:38:56.735+0000 7f3b89433800 10 monclient: build_initial_monmap 2023-12-03T11:38:56.867 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2023-12-03T11:38:56.735+0000 7f3b89433800 1 build_initial for_mkfs: 0 2023-12-03T11:38:56.867 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2023-12-03T11:38:56.735+0000 7f3b89433800 10 monclient: monmap: 2023-12-03T11:38:56.867 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:38:56.867 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:38:56.867 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:38:56.867 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:38:56.867 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:38:56.867 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.867 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:38:56.868 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:38:56.868 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:38:56.868 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.868 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding auth protocol: cephx 2023-12-03T11:38:56.868 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding auth protocol: cephx 2023-12-03T11:38:56.868 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding auth protocol: cephx 2023-12-03T11:38:56.868 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: secure 2023-12-03T11:38:56.868 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: crc 2023-12-03T11:38:56.868 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: secure 2023-12-03T11:38:56.868 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: crc 2023-12-03T11:38:56.868 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: secure 2023-12-03T11:38:56.868 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: crc 2023-12-03T11:38:56.868 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: crc 2023-12-03T11:38:56.868 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: secure 2023-12-03T11:38:56.869 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: crc 2023-12-03T11:38:56.869 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: secure 2023-12-03T11:38:56.869 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: crc 2023-12-03T11:38:56.869 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28e4b70) adding con mode: secure 2023-12-03T11:38:56.869 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2023-12-03T11:38:56.735+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.869 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2023-12-03T11:38:56.735+0000 7f3b89433800 1 librados: starting msgr at 2023-12-03T11:38:56.869 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2023-12-03T11:38:56.735+0000 7f3b89433800 1 librados: starting objecter 2023-12-03T11:38:56.869 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command objecter_requests cmddesc objecter_requests hook 0x564db28e5890 EEXIST 2023-12-03T11:38:56.869 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2023-12-03T11:38:56.735+0000 7f3b89433800 1 librados: setting wanted keys 2023-12-03T11:38:56.869 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2023-12-03T11:38:56.735+0000 7f3b89433800 1 librados: calling monclient init 2023-12-03T11:38:56.869 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2023-12-03T11:38:56.735+0000 7f3b89433800 10 monclient: init 2023-12-03T11:38:56.869 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding auth protocol: cephx 2023-12-03T11:38:56.869 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding auth protocol: cephx 2023-12-03T11:38:56.869 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding auth protocol: cephx 2023-12-03T11:38:56.869 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: secure 2023-12-03T11:38:56.869 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: crc 2023-12-03T11:38:56.870 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: secure 2023-12-03T11:38:56.870 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: crc 2023-12-03T11:38:56.870 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: secure 2023-12-03T11:38:56.870 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: crc 2023-12-03T11:38:56.870 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: crc 2023-12-03T11:38:56.870 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: secure 2023-12-03T11:38:56.870 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: crc 2023-12-03T11:38:56.870 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: secure 2023-12-03T11:38:56.870 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: crc 2023-12-03T11:38:56.870 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2023-12-03T11:38:56.735+0000 7f3b89433800 5 AuthRegistry(0x564db28a9218) adding con mode: secure 2023-12-03T11:38:56.870 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2023-12-03T11:38:56.735+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.870 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2023-12-03T11:38:56.736+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.870 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2023-12-03T11:38:56.736+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command rotate-key cmddesc rotate-key hook 0x564db28a9360 EEXIST 2023-12-03T11:38:56.870 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient: _reopen_session rank -1 2023-12-03T11:38:56.871 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient: _add_conns ranks=[2,0,1] 2023-12-03T11:38:56.871 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-c con 0x564db28d9c00 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:38:56.871 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-a con 0x564db28dca00 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:38:56.871 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-b con 0x564db28de500 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:38:56.871 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.871 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.871 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.871 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient(hunting): _renew_subs 2023-12-03T11:38:56.871 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient(hunting): authenticate will time out at 1615.961777s 2023-12-03T11:38:56.871 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2023-12-03T11:38:56.736+0000 7f3b86f33640 10 monclient(hunting): get_auth_request con 0x564db28d9c00 auth_method 0 2023-12-03T11:38:56.871 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2023-12-03T11:38:56.736+0000 7f3b86f33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.871 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2023-12-03T11:38:56.736+0000 7f3b86f33640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.871 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2023-12-03T11:38:56.736+0000 7f3b86f33640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.871 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2023-12-03T11:38:56.736+0000 7f3b86732640 10 monclient(hunting): get_auth_request con 0x564db28dca00 auth_method 0 2023-12-03T11:38:56.872 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2023-12-03T11:38:56.736+0000 7f3b86732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.872 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2023-12-03T11:38:56.736+0000 7f3b86732640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.872 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2023-12-03T11:38:56.736+0000 7f3b86732640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.872 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2023-12-03T11:38:56.736+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:56.872 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2023-12-03T11:38:56.736+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:56.872 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2023-12-03T11:38:56.736+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:56.872 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2023-12-03T11:38:56.736+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:56.872 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2023-12-03T11:38:56.736+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:56.872 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2023-12-03T11:38:56.736+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:56.872 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2023-12-03T11:38:56.736+0000 7f3b87734640 10 monclient(hunting): get_auth_request con 0x564db28de500 auth_method 0 2023-12-03T11:38:56.872 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2023-12-03T11:38:56.736+0000 7f3b87734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.872 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2023-12-03T11:38:56.736+0000 7f3b87734640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.872 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2023-12-03T11:38:56.736+0000 7f3b87734640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.872 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2023-12-03T11:38:56.736+0000 7f3b86f33640 10 monclient(hunting): handle_auth_done global_id 6671 payload 824 2023-12-03T11:38:56.872 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2023-12-03T11:38:56.736+0000 7f3b86f33640 10 monclient: _finish_hunting 0 2023-12-03T11:38:56.873 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2023-12-03T11:38:56.736+0000 7f3b86f33640 1 monclient: found mon.noname-c 2023-12-03T11:38:56.873 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2023-12-03T11:38:56.736+0000 7f3b86f33640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2023-12-03T11:38:56.873 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2023-12-03T11:38:56.736+0000 7f3b677fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:56.873 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2023-12-03T11:38:56.736+0000 7f3b677fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:38:56.873 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2023-12-03T11:38:56.736+0000 7f3b677fe640 10 monclient: dump: 2023-12-03T11:38:56.873 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:56.873 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:56.873 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.873 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.873 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:56.873 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.873 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:56.873 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:56.874 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:56.874 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.874 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2023-12-03T11:38:56.736+0000 7f3b677fe640 10 monclient: _finish_auth 0 2023-12-03T11:38:56.874 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2023-12-03T11:38:56.736+0000 7f3b677fe640 10 monclient: _check_auth_tickets 2023-12-03T11:38:56.874 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2023-12-03T11:38:56.736+0000 7f3b677fe640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:38:56.874 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2023-12-03T11:38:56.736+0000 7f3b677fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:56.874 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2023-12-03T11:38:56.736+0000 7f3b677fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:38:56.874 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2023-12-03T11:38:56.736+0000 7f3b677fe640 10 monclient: dump: 2023-12-03T11:38:56.874 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:56.874 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:56.874 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.874 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.875 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:56.875 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.875 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:56.875 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:56.875 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:56.875 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.875 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2023-12-03T11:38:56.736+0000 7f3b89433800 5 monclient: authenticate success, global_id 6671 2023-12-03T11:38:56.875 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2023-12-03T11:38:56.736+0000 7f3b7d7fa640 4 set_mon_vals no callback set 2023-12-03T11:38:56.875 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient: _renew_subs 2023-12-03T11:38:56.875 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:38:56.875 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient: _renew_subs 2023-12-03T11:38:56.875 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2023-12-03T11:38:56.736+0000 7f3b89433800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:38:56.875 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2023-12-03T11:38:56.736+0000 7f3b89433800 1 librados: init done 2023-12-03T11:38:56.876 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2023-12-03T11:38:56.737+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.876 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2023-12-03T11:38:56.738+0000 7f3b677fe640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:38:56.876 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2023-12-03T11:38:56.738+0000 7f3b677fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:56.876 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2023-12-03T11:38:56.738+0000 7f3b677fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:56.876 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2023-12-03T11:38:56.738+0000 7f3b86732640 10 monclient: get_auth_request con 0x7f3b60069820 auth_method 0 2023-12-03T11:38:56.876 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2023-12-03T11:38:56.739+0000 7f3b87734640 10 monclient: get_auth_request con 0x564db28f8180 auth_method 0 2023-12-03T11:38:56.876 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2023-12-03T11:38:56.739+0000 7f3b89433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.876 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2023-12-03T11:38:56.739+0000 7f3b89433800 20 realm 2023-12-03T11:38:56.876 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2023-12-03T11:38:56.739+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.876 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2023-12-03T11:38:56.739+0000 7f3b89433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.876 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2023-12-03T11:38:56.739+0000 7f3b89433800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:56.876 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2023-12-03T11:38:56.739+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.876 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2023-12-03T11:38:56.740+0000 7f3b89433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.876 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2023-12-03T11:38:56.740+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.876 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2023-12-03T11:38:56.740+0000 7f3b86f33640 10 monclient: get_auth_request con 0x564db28fc0e0 auth_method 0 2023-12-03T11:38:56.877 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2023-12-03T11:38:56.740+0000 7f3b89433800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:56.877 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2023-12-03T11:38:56.740+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.877 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2023-12-03T11:38:56.741+0000 7f3b86732640 10 monclient: get_auth_request con 0x564db28ff840 auth_method 0 2023-12-03T11:38:56.877 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2023-12-03T11:38:56.741+0000 7f3b89433800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:56.877 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2023-12-03T11:38:56.741+0000 7f3b89433800 20 searching for the correct realm 2023-12-03T11:38:56.877 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2023-12-03T11:38:56.741+0000 7f3b87734640 10 monclient: get_auth_request con 0x564db29041a0 auth_method 0 2023-12-03T11:38:56.877 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2023-12-03T11:38:56.742+0000 7f3b86f33640 10 monclient: get_auth_request con 0x7f3b80017030 auth_method 0 2023-12-03T11:38:56.877 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2023-12-03T11:38:56.743+0000 7f3b86732640 10 monclient: get_auth_request con 0x7f3b70039a10 auth_method 0 2023-12-03T11:38:56.877 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2023-12-03T11:38:56.745+0000 7f3b87734640 10 monclient: get_auth_request con 0x7f3b70047950 auth_method 0 2023-12-03T11:38:56.877 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2023-12-03T11:38:56.747+0000 7f3b86f33640 10 monclient: get_auth_request con 0x7f3b70019410 auth_method 0 2023-12-03T11:38:56.877 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2023-12-03T11:38:56.750+0000 7f3b86f33640 0 -- 172.21.15.44:0/1223299604 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x564db28fc0e0 msgr2=0x564db28fe4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:56.877 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2023-12-03T11:38:56.750+0000 7f3b677fe640 1 client.6671.objecter ms_handle_reset 0x564db28fc0e0 session 0x564db2669320 osd.5 2023-12-03T11:38:56.877 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2023-12-03T11:38:56.750+0000 7f3b677fe640 10 monclient: _renew_subs 2023-12-03T11:38:56.877 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2023-12-03T11:38:56.750+0000 7f3b677fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:38:56.878 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2023-12-03T11:38:56.750+0000 7f3b86f33640 10 monclient: get_auth_request con 0x7f3b60079e10 auth_method 0 2023-12-03T11:38:56.878 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:56.878 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:56.878 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:56.878 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:56.878 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.878 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.878 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.878 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:56.878 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.878 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:56.878 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 zone default found 2023-12-03T11:38:56.878 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2023-12-03T11:38:56.752+0000 7f3b89433800 4 Realm: () 2023-12-03T11:38:56.878 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2023-12-03T11:38:56.752+0000 7f3b89433800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:56.879 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2023-12-03T11:38:56.752+0000 7f3b89433800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:56.879 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2023-12-03T11:38:56.752+0000 7f3b89433800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:56.879 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 zonegroup default 2023-12-03T11:38:56.879 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2023-12-03T11:38:56.752+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.879 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2023-12-03T11:38:56.753+0000 7f3b89433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.879 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2023-12-03T11:38:56.753+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.879 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2023-12-03T11:38:56.753+0000 7f3b89433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.879 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2023-12-03T11:38:56.753+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.879 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2023-12-03T11:38:56.753+0000 7f3b89433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.879 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2023-12-03T11:38:56.753+0000 7f3b89433800 20 started sync module instance, tier type = 2023-12-03T11:38:56.879 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2023-12-03T11:38:56.753+0000 7f3b89433800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:56.879 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2023-12-03T11:38:56.759+0000 7f3b87734640 0 -- 172.21.15.44:0/1223299604 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x564db29041a0 msgr2=0x564db2906660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:38:56.879 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2023-12-03T11:38:56.759+0000 7f3b677fe640 1 client.6671.objecter ms_handle_reset 0x564db29041a0 session 0x564db2903b20 osd.3 2023-12-03T11:38:56.879 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2023-12-03T11:38:56.759+0000 7f3b87734640 10 monclient: get_auth_request con 0x564db28fc0e0 auth_method 0 2023-12-03T11:38:56.879 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2023-12-03T11:38:56.762+0000 7f3b89433800 20 add_watcher() i=0 2023-12-03T11:38:56.880 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2023-12-03T11:38:56.762+0000 7f3b89433800 20 add_watcher() i=1 2023-12-03T11:38:56.880 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2023-12-03T11:38:56.762+0000 7f3b89433800 20 add_watcher() i=2 2023-12-03T11:38:56.880 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2023-12-03T11:38:56.762+0000 7f3b89433800 20 add_watcher() i=3 2023-12-03T11:38:56.880 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2023-12-03T11:38:56.762+0000 7f3b89433800 20 add_watcher() i=4 2023-12-03T11:38:56.880 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2023-12-03T11:38:56.762+0000 7f3b89433800 20 add_watcher() i=5 2023-12-03T11:38:56.880 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2023-12-03T11:38:56.762+0000 7f3b89433800 20 add_watcher() i=6 2023-12-03T11:38:56.880 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2023-12-03T11:38:56.763+0000 7f3b89433800 20 add_watcher() i=7 2023-12-03T11:38:56.880 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2023-12-03T11:38:56.763+0000 7f3b89433800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:56.880 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding auth protocol: cephx 2023-12-03T11:38:56.880 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding auth protocol: cephx 2023-12-03T11:38:56.880 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding auth protocol: cephx 2023-12-03T11:38:56.880 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: secure 2023-12-03T11:38:56.880 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: crc 2023-12-03T11:38:56.880 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: secure 2023-12-03T11:38:56.880 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: crc 2023-12-03T11:38:56.880 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: secure 2023-12-03T11:38:56.881 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: crc 2023-12-03T11:38:56.881 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: crc 2023-12-03T11:38:56.881 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: secure 2023-12-03T11:38:56.881 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: crc 2023-12-03T11:38:56.881 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: secure 2023-12-03T11:38:56.881 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2023-12-03T11:38:56.765+0000 7f3ac7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:56.881 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: crc 2023-12-03T11:38:56.881 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f980) adding con mode: secure 2023-12-03T11:38:56.881 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2023-12-03T11:38:56.765+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.881 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2023-12-03T11:38:56.765+0000 7f3b89433800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:56.881 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2023-12-03T11:38:56.765+0000 7f3b89433800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:56.881 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command cache list hook 0x564db2890d50 2023-12-03T11:38:56.881 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command cache inspect hook 0x564db2890d50 2023-12-03T11:38:56.881 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command cache erase hook 0x564db2890d50 2023-12-03T11:38:56.881 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command cache zap hook 0x564db2890d50 2023-12-03T11:38:56.881 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2023-12-03T11:38:56.765+0000 7f3b89433800 10 monclient: get_monmap_and_config 2023-12-03T11:38:56.881 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2023-12-03T11:38:56.765+0000 7f3b89433800 10 monclient: build_initial_monmap 2023-12-03T11:38:56.882 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2023-12-03T11:38:56.765+0000 7f3b89433800 1 build_initial for_mkfs: 0 2023-12-03T11:38:56.882 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2023-12-03T11:38:56.765+0000 7f3b89433800 10 monclient: monmap: 2023-12-03T11:38:56.882 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:38:56.882 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:38:56.882 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:38:56.882 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:38:56.882 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:38:56.882 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.882 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:38:56.882 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:38:56.882 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:38:56.882 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.882 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding auth protocol: cephx 2023-12-03T11:38:56.882 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding auth protocol: cephx 2023-12-03T11:38:56.882 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding auth protocol: cephx 2023-12-03T11:38:56.883 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: secure 2023-12-03T11:38:56.883 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: crc 2023-12-03T11:38:56.883 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: secure 2023-12-03T11:38:56.883 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: crc 2023-12-03T11:38:56.883 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: secure 2023-12-03T11:38:56.883 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: crc 2023-12-03T11:38:56.883 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: crc 2023-12-03T11:38:56.883 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: secure 2023-12-03T11:38:56.883 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: crc 2023-12-03T11:38:56.883 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: secure 2023-12-03T11:38:56.883 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: crc 2023-12-03T11:38:56.883 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2023-12-03T11:38:56.765+0000 7f3b89433800 5 AuthRegistry(0x564db293ce70) adding con mode: secure 2023-12-03T11:38:56.883 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2023-12-03T11:38:56.766+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.883 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2023-12-03T11:38:56.766+0000 7f3b89433800 10 monclient: init 2023-12-03T11:38:56.883 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding auth protocol: cephx 2023-12-03T11:38:56.883 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding auth protocol: cephx 2023-12-03T11:38:56.884 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding auth protocol: cephx 2023-12-03T11:38:56.884 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: secure 2023-12-03T11:38:56.884 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: crc 2023-12-03T11:38:56.884 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: secure 2023-12-03T11:38:56.884 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: crc 2023-12-03T11:38:56.884 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: secure 2023-12-03T11:38:56.884 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: crc 2023-12-03T11:38:56.884 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: crc 2023-12-03T11:38:56.884 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: secure 2023-12-03T11:38:56.884 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: crc 2023-12-03T11:38:56.884 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: secure 2023-12-03T11:38:56.884 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: crc 2023-12-03T11:38:56.884 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 AuthRegistry(0x7ffe3614f4d0) adding con mode: secure 2023-12-03T11:38:56.884 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2023-12-03T11:38:56.766+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.884 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2023-12-03T11:38:56.766+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.884 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2023-12-03T11:38:56.766+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command rotate-key cmddesc rotate-key hook 0x7ffe3614f618 EEXIST 2023-12-03T11:38:56.884 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2023-12-03T11:38:56.766+0000 7f3b89433800 10 monclient: _reopen_session rank -1 2023-12-03T11:38:56.885 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2023-12-03T11:38:56.766+0000 7f3b89433800 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:38:56.885 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2023-12-03T11:38:56.766+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-b con 0x564db293b5b0 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:38:56.885 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2023-12-03T11:38:56.766+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-a con 0x564db2933930 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:38:56.885 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2023-12-03T11:38:56.766+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-c con 0x564db29325d0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:38:56.885 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2023-12-03T11:38:56.766+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.885 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2023-12-03T11:38:56.766+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.885 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2023-12-03T11:38:56.766+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.885 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2023-12-03T11:38:56.766+0000 7f3b89433800 10 monclient(hunting): _renew_subs 2023-12-03T11:38:56.885 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2023-12-03T11:38:56.766+0000 7f3b89433800 10 monclient(hunting): authenticate will time out at 1615.992405s 2023-12-03T11:38:56.885 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2023-12-03T11:38:56.766+0000 7f3b86f33640 10 monclient(hunting): get_auth_request con 0x564db2933930 auth_method 0 2023-12-03T11:38:56.885 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2023-12-03T11:38:56.766+0000 7f3b86f33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.885 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2023-12-03T11:38:56.766+0000 7f3b86f33640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.885 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2023-12-03T11:38:56.766+0000 7f3b86f33640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.885 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2023-12-03T11:38:56.766+0000 7f3b86732640 10 monclient(hunting): get_auth_request con 0x564db29325d0 auth_method 0 2023-12-03T11:38:56.885 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2023-12-03T11:38:56.766+0000 7f3b86732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.885 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2023-12-03T11:38:56.766+0000 7f3b86732640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.886 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2023-12-03T11:38:56.766+0000 7f3b86732640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.886 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2023-12-03T11:38:56.766+0000 7f3b87734640 10 monclient(hunting): get_auth_request con 0x564db293b5b0 auth_method 0 2023-12-03T11:38:56.886 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2023-12-03T11:38:56.766+0000 7f3b87734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.886 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2023-12-03T11:38:56.766+0000 7f3b87734640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.886 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2023-12-03T11:38:56.766+0000 7f3b87734640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.886 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2023-12-03T11:38:56.766+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:56.886 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2023-12-03T11:38:56.766+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:56.886 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2023-12-03T11:38:56.766+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:56.886 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2023-12-03T11:38:56.766+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:56.886 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2023-12-03T11:38:56.766+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:56.886 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2023-12-03T11:38:56.766+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:56.886 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2023-12-03T11:38:56.767+0000 7f3b87734640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:56.886 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2023-12-03T11:38:56.767+0000 7f3b87734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:56.886 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2023-12-03T11:38:56.767+0000 7f3b87734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:56.886 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2023-12-03T11:38:56.767+0000 7f3b86f33640 10 monclient(hunting): handle_auth_done global_id 7053 payload 274 2023-12-03T11:38:56.887 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2023-12-03T11:38:56.767+0000 7f3b86f33640 10 monclient: _finish_hunting 0 2023-12-03T11:38:56.887 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2023-12-03T11:38:56.767+0000 7f3b86f33640 1 monclient: found mon.noname-a 2023-12-03T11:38:56.887 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2023-12-03T11:38:56.767+0000 7f3b86f33640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2023-12-03T11:38:56.887 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2023-12-03T11:38:56.767+0000 7f3ac77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:56.887 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2023-12-03T11:38:56.767+0000 7f3ac77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:38:56.887 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2023-12-03T11:38:56.767+0000 7f3ac77fe640 10 monclient: dump: 2023-12-03T11:38:56.887 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:56.887 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:56.887 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.887 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.887 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:56.887 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.887 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:56.887 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:56.887 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:56.887 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.887 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2023-12-03T11:38:56.767+0000 7f3ac77fe640 10 monclient: _finish_auth 0 2023-12-03T11:38:56.887 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2023-12-03T11:38:56.767+0000 7f3ac77fe640 10 monclient: _check_auth_tickets 2023-12-03T11:38:56.888 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2023-12-03T11:38:56.767+0000 7f3ac77fe640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:38:56.888 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2023-12-03T11:38:56.767+0000 7f3b89433800 5 monclient: authenticate success, global_id 7053 2023-12-03T11:38:56.888 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2023-12-03T11:38:56.767+0000 7f3b89433800 10 monclient: get_monmap_and_config success 2023-12-03T11:38:56.888 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2023-12-03T11:38:56.767+0000 7f3ac77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:56.888 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2023-12-03T11:38:56.767+0000 7f3b89433800 4 set_mon_vals no callback set 2023-12-03T11:38:56.888 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2023-12-03T11:38:56.767+0000 7f3ac77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:38:56.888 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2023-12-03T11:38:56.767+0000 7f3ac77fe640 10 monclient: dump: 2023-12-03T11:38:56.888 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:56.888 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:56.888 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.888 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.888 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:56.888 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.888 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:56.888 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:56.889 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:56.889 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.889 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2023-12-03T11:38:56.768+0000 7f3b89433800 10 monclient: shutdown 2023-12-03T11:38:56.889 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2023-12-03T11:38:56.768+0000 7f3b89433800 10 monclient: build_initial_monmap 2023-12-03T11:38:56.889 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2023-12-03T11:38:56.768+0000 7f3b89433800 1 build_initial for_mkfs: 0 2023-12-03T11:38:56.889 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2023-12-03T11:38:56.768+0000 7f3b89433800 10 monclient: monmap: 2023-12-03T11:38:56.889 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:38:56.889 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:38:56.889 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:38:56.889 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:38:56.889 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:38:56.889 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.889 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:38:56.889 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:38:56.889 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:38:56.889 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.890 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding auth protocol: cephx 2023-12-03T11:38:56.890 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding auth protocol: cephx 2023-12-03T11:38:56.890 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding auth protocol: cephx 2023-12-03T11:38:56.890 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: secure 2023-12-03T11:38:56.890 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: crc 2023-12-03T11:38:56.890 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: secure 2023-12-03T11:38:56.890 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: crc 2023-12-03T11:38:56.890 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: secure 2023-12-03T11:38:56.890 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: crc 2023-12-03T11:38:56.890 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: crc 2023-12-03T11:38:56.890 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: secure 2023-12-03T11:38:56.890 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: crc 2023-12-03T11:38:56.890 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: secure 2023-12-03T11:38:56.890 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: crc 2023-12-03T11:38:56.891 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db293e4d0) adding con mode: secure 2023-12-03T11:38:56.891 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2023-12-03T11:38:56.768+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.891 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2023-12-03T11:38:56.768+0000 7f3b89433800 1 librados: starting msgr at 2023-12-03T11:38:56.891 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2023-12-03T11:38:56.768+0000 7f3b89433800 1 librados: starting objecter 2023-12-03T11:38:56.891 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command objecter_requests cmddesc objecter_requests hook 0x564db2911cc0 EEXIST 2023-12-03T11:38:56.891 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2023-12-03T11:38:56.768+0000 7f3b89433800 1 librados: setting wanted keys 2023-12-03T11:38:56.891 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2023-12-03T11:38:56.768+0000 7f3b89433800 1 librados: calling monclient init 2023-12-03T11:38:56.891 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2023-12-03T11:38:56.768+0000 7f3b89433800 10 monclient: init 2023-12-03T11:38:56.891 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding auth protocol: cephx 2023-12-03T11:38:56.891 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding auth protocol: cephx 2023-12-03T11:38:56.891 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding auth protocol: cephx 2023-12-03T11:38:56.891 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: secure 2023-12-03T11:38:56.891 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: crc 2023-12-03T11:38:56.891 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: secure 2023-12-03T11:38:56.891 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: crc 2023-12-03T11:38:56.891 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: secure 2023-12-03T11:38:56.891 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: crc 2023-12-03T11:38:56.892 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: crc 2023-12-03T11:38:56.892 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: secure 2023-12-03T11:38:56.892 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: crc 2023-12-03T11:38:56.892 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: secure 2023-12-03T11:38:56.892 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: crc 2023-12-03T11:38:56.892 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2023-12-03T11:38:56.768+0000 7f3b89433800 5 AuthRegistry(0x564db2940388) adding con mode: secure 2023-12-03T11:38:56.892 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2023-12-03T11:38:56.768+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.892 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2023-12-03T11:38:56.769+0000 7f3b89433800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:38:56.892 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2023-12-03T11:38:56.769+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command rotate-key cmddesc rotate-key hook 0x564db29404d0 EEXIST 2023-12-03T11:38:56.892 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2023-12-03T11:38:56.769+0000 7f3b89433800 10 monclient: _reopen_session rank -1 2023-12-03T11:38:56.892 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2023-12-03T11:38:56.769+0000 7f3b89433800 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:38:56.892 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2023-12-03T11:38:56.769+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-b con 0x564db29325d0 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:38:56.892 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2023-12-03T11:38:56.769+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-a con 0x564db2933930 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:38:56.892 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2023-12-03T11:38:56.769+0000 7f3b89433800 10 monclient(hunting): picked mon.noname-c con 0x564db293b5b0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:38:56.892 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2023-12-03T11:38:56.769+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.892 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2023-12-03T11:38:56.769+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.892 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2023-12-03T11:38:56.769+0000 7f3b89433800 10 monclient(hunting): start opening mon connection 2023-12-03T11:38:56.893 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2023-12-03T11:38:56.769+0000 7f3b89433800 10 monclient(hunting): _renew_subs 2023-12-03T11:38:56.893 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2023-12-03T11:38:56.769+0000 7f3b89433800 10 monclient(hunting): authenticate will time out at 1615.994969s 2023-12-03T11:38:56.893 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2023-12-03T11:38:56.769+0000 7f3b86f33640 10 monclient(hunting): get_auth_request con 0x564db2933930 auth_method 0 2023-12-03T11:38:56.893 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2023-12-03T11:38:56.769+0000 7f3b86f33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.893 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2023-12-03T11:38:56.769+0000 7f3b86f33640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.893 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2023-12-03T11:38:56.769+0000 7f3b86f33640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.893 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2023-12-03T11:38:56.769+0000 7f3b86732640 10 monclient(hunting): get_auth_request con 0x564db293b5b0 auth_method 0 2023-12-03T11:38:56.893 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2023-12-03T11:38:56.769+0000 7f3b86732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.893 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2023-12-03T11:38:56.769+0000 7f3b86732640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.893 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2023-12-03T11:38:56.769+0000 7f3b86732640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.893 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2023-12-03T11:38:56.769+0000 7f3b87734640 10 monclient(hunting): get_auth_request con 0x564db29325d0 auth_method 0 2023-12-03T11:38:56.893 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2023-12-03T11:38:56.769+0000 7f3b87734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:38:56.893 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2023-12-03T11:38:56.769+0000 7f3b87734640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:38:56.893 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2023-12-03T11:38:56.769+0000 7f3b87734640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:38:56.893 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2023-12-03T11:38:56.769+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:56.893 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2023-12-03T11:38:56.769+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:56.893 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2023-12-03T11:38:56.769+0000 7f3b86732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:56.894 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2023-12-03T11:38:56.769+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:56.894 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2023-12-03T11:38:56.769+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:56.894 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2023-12-03T11:38:56.769+0000 7f3b86f33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:56.894 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2023-12-03T11:38:56.769+0000 7f3b87734640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:38:56.894 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2023-12-03T11:38:56.769+0000 7f3b87734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:38:56.894 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2023-12-03T11:38:56.769+0000 7f3b87734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:38:56.894 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2023-12-03T11:38:56.769+0000 7f3b86f33640 10 monclient(hunting): handle_auth_done global_id 7056 payload 824 2023-12-03T11:38:56.894 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2023-12-03T11:38:56.769+0000 7f3b86f33640 10 monclient: _finish_hunting 0 2023-12-03T11:38:56.894 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2023-12-03T11:38:56.769+0000 7f3b86f33640 1 monclient: found mon.noname-a 2023-12-03T11:38:56.894 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2023-12-03T11:38:56.769+0000 7f3b86f33640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2023-12-03T11:38:56.894 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2023-12-03T11:38:56.769+0000 7f3ac5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:56.894 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2023-12-03T11:38:56.769+0000 7f3ac5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:38:56.894 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2023-12-03T11:38:56.769+0000 7f3ac5ffb640 10 monclient: dump: 2023-12-03T11:38:56.894 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:56.894 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:56.895 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.895 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.895 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:56.895 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.895 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:56.895 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:56.895 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:56.895 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.895 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2023-12-03T11:38:56.769+0000 7f3ac5ffb640 10 monclient: _finish_auth 0 2023-12-03T11:38:56.895 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2023-12-03T11:38:56.769+0000 7f3ac5ffb640 10 monclient: _check_auth_tickets 2023-12-03T11:38:56.895 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2023-12-03T11:38:56.769+0000 7f3ac5ffb640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:38:56.895 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2023-12-03T11:38:56.769+0000 7f3ac5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:38:56.895 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2023-12-03T11:38:56.769+0000 7f3ac5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:38:56.895 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2023-12-03T11:38:56.769+0000 7f3ac5ffb640 10 monclient: dump: 2023-12-03T11:38:56.895 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:38:56.895 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:38:56.895 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.896 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:38:56.896 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:38:56.896 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:38:56.896 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:38:56.896 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:38:56.896 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:38:56.896 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.896 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2023-12-03T11:38:56.769+0000 7f3ac77fe640 4 set_mon_vals no callback set 2023-12-03T11:38:56.896 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2023-12-03T11:38:56.770+0000 7f3b89433800 5 monclient: authenticate success, global_id 7056 2023-12-03T11:38:56.896 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2023-12-03T11:38:56.770+0000 7f3b89433800 10 monclient: _renew_subs 2023-12-03T11:38:56.896 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2023-12-03T11:38:56.770+0000 7f3b89433800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2023-12-03T11:38:56.896 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2023-12-03T11:38:56.770+0000 7f3b89433800 10 monclient: _renew_subs 2023-12-03T11:38:56.896 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2023-12-03T11:38:56.770+0000 7f3b89433800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2023-12-03T11:38:56.896 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2023-12-03T11:38:56.770+0000 7f3b89433800 1 librados: init done 2023-12-03T11:38:56.896 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2023-12-03T11:38:56.770+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command cr dump hook 0x564db2935d48 2023-12-03T11:38:56.896 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2023-12-03T11:38:56.771+0000 7f3ac5ffb640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:38:56.896 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2023-12-03T11:38:56.771+0000 7f3ac5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:56.897 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2023-12-03T11:38:56.771+0000 7f3ac5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:38:56.897 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2023-12-03T11:38:56.771+0000 7f3b87734640 10 monclient: get_auth_request con 0x7f3ab8069820 auth_method 0 2023-12-03T11:38:56.897 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2023-12-03T11:38:56.771+0000 7f3b89433800 5 note: GC not initialized 2023-12-03T11:38:56.897 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2023-12-03T11:38:56.771+0000 7f3ab6ffd640 20 reqs_thread_entry: start 2023-12-03T11:38:56.897 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2023-12-03T11:38:56.772+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command sync trace show hook 0x7f3b780047e0 2023-12-03T11:38:56.897 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2023-12-03T11:38:56.772+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command sync trace history hook 0x7f3b780047e0 2023-12-03T11:38:56.897 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2023-12-03T11:38:56.772+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command sync trace active hook 0x7f3b780047e0 2023-12-03T11:38:56.897 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2023-12-03T11:38:56.772+0000 7f3b89433800 5 asok(0x564db26a0a10) register_command sync trace active_short hook 0x7f3b780047e0 2023-12-03T11:38:56.897 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2023-12-03T11:38:56.772+0000 7f3b89433800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:56.897 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2023-12-03T11:38:56.772+0000 7f3b89433800 20 Filter name: none 2023-12-03T11:38:56.897 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2023-12-03T11:38:56.772+0000 7f3ab4ff9640 20 reqs_thread_entry: start 2023-12-03T11:38:56.897 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2023-12-03T11:38:56.772+0000 7f3b89433800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2023-12-03T11:38:56.897 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2023-12-03T11:38:56.772+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.897 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2023-12-03T11:38:56.772+0000 7f3b89433800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:38:56.897 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2023-12-03T11:38:56.772+0000 7f3b89433800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2023-12-03T11:38:56.897 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2023-12-03T11:38:56.772+0000 7f3b89433800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2023-12-03T11:38:56.897 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2023-12-03T11:38:56.772+0000 7f3b89433800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 : miss 2023-12-03T11:38:56.897 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2023-12-03T11:38:56.772+0000 7f3b89433800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.898 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2023-12-03T11:38:56.773+0000 7f3b89433800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:38:56.898 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2023-12-03T11:38:56.773+0000 7f3b89433800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 info.flags=0x17 2023-12-03T11:38:56.898 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2023-12-03T11:38:56.773+0000 7f3b89433800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 to cache LRU end 2023-12-03T11:38:56.898 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2023-12-03T11:38:56.773+0000 7f3b89433800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:38:56.898 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2023-12-03T11:38:56.773+0000 7f3b89433800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:56.898 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2023-12-03T11:38:56.773+0000 7f3b89433800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 2023-12-03T11:38:56.898 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2023-12-03T11:38:56.773+0000 7f3b86732640 10 monclient: get_auth_request con 0x564db298d020 auth_method 0 2023-12-03T11:38:56.898 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2023-12-03T11:38:56.777+0000 7f3b89433800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 info.flags=0x17 2023-12-03T11:38:56.898 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2023-12-03T11:38:56.777+0000 7f3b89433800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 to cache LRU end 2023-12-03T11:38:56.898 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2023-12-03T11:38:56.777+0000 7f3b89433800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:56.898 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2023-12-03T11:38:56.777+0000 7f3b89433800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25, ofs0, ns] 2023-12-03T11:38:56.898 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2023-12-03T11:38:56.777+0000 7f3b7d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693259 cookie 94891708241568 notifier 6671 bl.length()=893 2023-12-03T11:38:56.898 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2023-12-03T11:38:56.777+0000 7f3b7d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 info.flags=0x17 2023-12-03T11:38:56.898 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2023-12-03T11:38:56.777+0000 7f3b7d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 to cache LRU end 2023-12-03T11:38:56.899 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2023-12-03T11:38:56.777+0000 7f3b7d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:38:56.899 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2023-12-03T11:38:56.777+0000 7f3b89433800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25]): orig_sources= new_sources= 2023-12-03T11:38:56.899 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2023-12-03T11:38:56.777+0000 7f3b89433800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25]): potential sources added=[] removed=[] 2023-12-03T11:38:56.899 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2023-12-03T11:38:56.777+0000 7f3b89433800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25]): orig_dests= new_dests= 2023-12-03T11:38:56.899 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2023-12-03T11:38:56.777+0000 7f3b89433800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25]): potential dests added=[] removed=[] 2023-12-03T11:38:56.899 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2023-12-03T11:38:56.778+0000 7f3b89433800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25.1.0 2023-12-03T11:38:56.899 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2023-12-03T11:38:56.778+0000 7f3b89433800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25.1.0 2023-12-03T11:38:56.899 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2023-12-03T11:38:56.778+0000 7f3b89433800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25.1.1 2023-12-03T11:38:56.899 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2023-12-03T11:38:56.778+0000 7f3b89433800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25.1.1 2023-12-03T11:38:56.899 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2023-12-03T11:38:56.778+0000 7f3b89433800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25.0 2023-12-03T11:38:56.899 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2023-12-03T11:38:56.781+0000 7f3b89433800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3b89433800 time 2023-12-03T11:38:56.781777+0000 2023-12-03T11:38:56.899 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:38:56.899 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.899 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:38:56.899 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3b8dd6eef8] 2023-12-03T11:38:56.899 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f3b8dd6f0b6] 2023-12-03T11:38:56.899 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564db00e9a71] 2023-12-03T11:38:56.900 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x564db00f61d8] 2023-12-03T11:38:56.900 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2023-12-03T11:38:56.900 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f3b8b63feb0] 2023-12-03T11:38:56.900 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2023-12-03T11:38:56.900 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2023-12-03T11:38:56.900 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.900 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2023-12-03T11:38:56.782+0000 7f3b89433800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:38:56.900 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f3b89433800 thread_name:radosgw-admin 2023-12-03T11:38:56.900 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.900 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:38:56.900 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f3b8b654db0] 2023-12-03T11:38:56.900 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f3b8b6a154c] 2023-12-03T11:38:56.900 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2023-12-03T11:38:56.900 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2023-12-03T11:38:56.900 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3b8dd6ef52] 2023-12-03T11:38:56.900 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f3b8dd6f0b6] 2023-12-03T11:38:56.900 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564db00e9a71] 2023-12-03T11:38:56.901 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x564db00f61d8] 2023-12-03T11:38:56.901 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2023-12-03T11:38:56.901 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f3b8b63feb0] 2023-12-03T11:38:56.901 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2023-12-03T11:38:56.901 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2023-12-03T11:38:56.901 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:38:56.901 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.901 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2023-12-03T11:38:56.901 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2023-12-03T11:38:56.901 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2023-12-03T11:38:56.901 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2023-12-03T11:38:56.901 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2023-12-03T11:38:56.901 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2023-12-03T11:38:56.901 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2023-12-03T11:38:56.901 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2023-12-03T11:38:56.901 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2023-12-03T11:38:56.901 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2023-12-03T11:38:56.901 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2023-12-03T11:38:56.902 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2023-12-03T11:38:56.902 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2023-12-03T11:38:56.902 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2023-12-03T11:38:56.902 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2023-12-03T11:38:56.902 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2023-12-03T11:38:56.902 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2023-12-03T11:38:56.902 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2023-12-03T11:38:56.902 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2023-12-03T11:38:56.902 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2023-12-03T11:38:56.902 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2023-12-03T11:38:56.902 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2023-12-03T11:38:56.902 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2023-12-03T11:38:56.902 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:38:56.902 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2023-12-03T11:38:56.902 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2023-12-03T11:38:56.902 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2023-12-03T11:38:56.902 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2023-12-03T11:38:56.903 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2023-12-03T11:38:56.903 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2023-12-03T11:38:56.903 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2023-12-03T11:38:56.903 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2023-12-03T11:38:56.903 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2023-12-03T11:38:56.903 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2023-12-03T11:38:56.903 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2023-12-03T11:38:56.903 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2023-12-03T11:38:56.903 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2023-12-03T11:38:56.903 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2023-12-03T11:38:56.903 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2023-12-03T11:38:56.903 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2023-12-03T11:38:56.903 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2023-12-03T11:38:56.903 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2023-12-03T11:38:56.903 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2023-12-03T11:38:56.903 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2023-12-03T11:38:56.904 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2023-12-03T11:38:56.904 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:38:56.904 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2023-12-03T11:38:56.904 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2023-12-03T11:38:56.904 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2023-12-03T11:38:56.904 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2023-12-03T11:38:56.904 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2023-12-03T11:38:56.904 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2023-12-03T11:38:56.904 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2023-12-03T11:38:56.904 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2023-12-03T11:38:56.904 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2023-12-03T11:38:56.904 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2023-12-03T11:38:56.904 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2023-12-03T11:38:56.904 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2023-12-03T11:38:56.905 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2023-12-03T11:38:56.905 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2023-12-03T11:38:56.905 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2023-12-03T11:38:56.905 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2023-12-03T11:38:56.905 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2023-12-03T11:38:56.905 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2023-12-03T11:38:56.905 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:38:56.905 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2023-12-03T11:38:56.905 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:38:56.905 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2023-12-03T11:38:56.905 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2023-12-03T11:38:56.905 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2023-12-03T11:38:56.905 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2023-12-03T11:38:56.905 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2023-12-03T11:38:56.905 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2023-12-03T11:38:56.905 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:38:56.905 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2023-12-03T11:38:56.905 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2023-12-03T11:38:56.906 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:38:56.906 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2023-12-03T11:38:56.906 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2023-12-03T11:38:56.906 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2023-12-03T11:38:56.906 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2023-12-03T11:38:56.906 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2023-12-03T11:38:56.906 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2023-12-03T11:38:56.906 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2023-12-03T11:38:56.906 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2023-12-03T11:38:56.906 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2023-12-03T11:38:56.906 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2023-12-03T11:38:56.906 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2023-12-03T11:38:56.906 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2023-12-03T11:38:56.906 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:38:56.906 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3ab4ff9640 / http_manager 2023-12-03T11:38:56.906 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3ab6ffd640 / http_manager 2023-12-03T11:38:56.906 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3ac5ffb640 / ms_dispatch 2023-12-03T11:38:56.907 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3ac77fe640 / io_context_pool 2023-12-03T11:38:56.907 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3ac7fff640 / rgw_dt_lg_renew 2023-12-03T11:38:56.907 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3b677fe640 / ms_dispatch 2023-12-03T11:38:56.907 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3b7d7fa640 / io_context_pool 2023-12-03T11:38:56.907 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3b7ffff640 / ms_dispatch 2023-12-03T11:38:56.907 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3b86732640 / msgr-worker-2 2023-12-03T11:38:56.907 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3b86f33640 / msgr-worker-1 2023-12-03T11:38:56.907 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3b87734640 / msgr-worker-0 2023-12-03T11:38:56.907 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3b89433800 / radosgw-admin 2023-12-03T11:38:56.907 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2023-12-03T11:38:56.907 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2023-12-03T11:38:56.907 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/lib/ceph/crash/2023-12-03T11:38:56.783132Z_fd2dfb1c-5b63-4f27-ae75-193f107190fd/log 2023-12-03T11:38:56.907 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2023-12-03T11:38:56.907 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2023-12-03T11:38:56.913 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:56.913 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:56.913 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.831+0000 7f7128b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.913 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.832+0000 7f7128b2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.913 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.832+0000 7f7128b2b800 20 realm 2023-12-03T11:38:56.913 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.832+0000 7f7128b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.913 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.833+0000 7f7128b2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.913 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.833+0000 7f7128b2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:56.913 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.833+0000 7f7128b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.913 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.833+0000 7f7128b2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.913 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.833+0000 7f7128b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.913 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.833+0000 7f7128b2b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:56.913 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.833+0000 7f7128b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.913 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.834+0000 7f7128b2b800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:56.914 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.834+0000 7f7128b2b800 20 searching for the correct realm 2023-12-03T11:38:56.914 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.843+0000 7f711bfff640 0 -- 172.21.15.44:0/748123604 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x55ba8610ed00 msgr2=0x55ba861110f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:38:56.914 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.845+0000 7f7128b2b800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:38:56.914 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.845+0000 7f7128b2b800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:38:56.914 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.845+0000 7f7128b2b800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:56.914 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.845+0000 7f7128b2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:56.914 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.845+0000 7f7128b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.914 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.845+0000 7f7128b2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.914 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.845+0000 7f7128b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.914 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.846+0000 7f7128b2b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:56.914 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.846+0000 7f7128b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.914 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.846+0000 7f7128b2b800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:56.914 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.846+0000 7f7128b2b800 20 zone default found 2023-12-03T11:38:56.914 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.846+0000 7f7128b2b800 4 Realm: () 2023-12-03T11:38:56.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.846+0000 7f7128b2b800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:38:56.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.846+0000 7f7128b2b800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:38:56.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.846+0000 7f7128b2b800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:56.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.846+0000 7f7128b2b800 20 zonegroup default 2023-12-03T11:38:56.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.846+0000 7f7128b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.846+0000 7f7128b2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.846+0000 7f7128b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.846+0000 7f7128b2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.846+0000 7f7128b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.847+0000 7f7128b2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.847+0000 7f7128b2b800 20 started sync module instance, tier type = 2023-12-03T11:38:56.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.847+0000 7f7128b2b800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:38:56.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.851+0000 7f711bfff640 0 -- 172.21.15.44:0/748123604 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x7f70fc079e10 msgr2=0x7f70fc07c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:38:56.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.855+0000 7f7128b2b800 20 add_watcher() i=0 2023-12-03T11:38:56.915 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.855+0000 7f7128b2b800 20 add_watcher() i=1 2023-12-03T11:38:56.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.855+0000 7f7128b2b800 20 add_watcher() i=2 2023-12-03T11:38:56.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.855+0000 7f7128b2b800 20 add_watcher() i=3 2023-12-03T11:38:56.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.855+0000 7f7128b2b800 20 add_watcher() i=4 2023-12-03T11:38:56.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.855+0000 7f7128b2b800 20 add_watcher() i=5 2023-12-03T11:38:56.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.856+0000 7f7128b2b800 20 add_watcher() i=6 2023-12-03T11:38:56.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.856+0000 7f7128b2b800 20 add_watcher() i=7 2023-12-03T11:38:56.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.856+0000 7f7128b2b800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:56.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.858+0000 7f70ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:56.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.858+0000 7f7128b2b800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:56.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.858+0000 7f7128b2b800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:56.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.864+0000 7f7128b2b800 5 note: GC not initialized 2023-12-03T11:38:56.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.864+0000 7f70597fa640 20 reqs_thread_entry: start 2023-12-03T11:38:56.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.865+0000 7f7128b2b800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:56.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.865+0000 7f7128b2b800 20 Filter name: none 2023-12-03T11:38:56.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.865+0000 7f7052ffd640 20 reqs_thread_entry: start 2023-12-03T11:38:56.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.865+0000 7f7128b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.916 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.865+0000 7f7128b2b800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:38:56.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.865+0000 7f7128b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.866+0000 7f7128b2b800 20 rados_obj.operate() r=0 bl.length=413 2023-12-03T11:38:56.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.866+0000 7f7128b2b800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:56.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.866+0000 7f7128b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.866+0000 7f7128b2b800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:38:56.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.866+0000 7f7128b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.867+0000 7f7128b2b800 20 rados_obj.operate() r=0 bl.length=413 2023-12-03T11:38:56.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.867+0000 7f7128b2b800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:56.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.867+0000 7f7128b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:56.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.867+0000 7f7128b2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:56.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.868+0000 7f70ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:56.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.870+0000 7f7128b2b800 20 remove_watcher() i=0 2023-12-03T11:38:56.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.870+0000 7f7128b2b800 2 removed watcher, disabling cache 2023-12-03T11:38:56.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.871+0000 7f7128b2b800 20 remove_watcher() i=1 2023-12-03T11:38:56.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.872+0000 7f7128b2b800 20 remove_watcher() i=2 2023-12-03T11:38:56.917 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.873+0000 7f7128b2b800 20 remove_watcher() i=3 2023-12-03T11:38:56.918 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.875+0000 7f7128b2b800 20 remove_watcher() i=4 2023-12-03T11:38:56.918 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.876+0000 7f7128b2b800 20 remove_watcher() i=5 2023-12-03T11:38:56.918 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.876+0000 7f7128b2b800 20 remove_watcher() i=6 2023-12-03T11:38:56.918 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:38:56.877+0000 7f7128b2b800 20 remove_watcher() i=7 2023-12-03T11:38:56.918 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:38:56.918 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:38:56.918 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-commit-target-layout id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:38:56.918 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:26.962 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:39:26.997 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:39:26.997 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:39:27.014 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.012+0000 7f3e0912c800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.016 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.014+0000 7f3e0912c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.014+0000 7f3e0912c800 20 realm 2023-12-03T11:39:27.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.014+0000 7f3e0912c800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.014+0000 7f3e0912c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.014+0000 7f3e0912c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:39:27.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.014+0000 7f3e0912c800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.014+0000 7f3e0912c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.014+0000 7f3e0912c800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.015+0000 7f3e0912c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:27.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.015+0000 7f3e0912c800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.016+0000 7f3e0912c800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:39:27.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.016+0000 7f3e0912c800 20 searching for the correct realm 2023-12-03T11:39:27.029 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.027+0000 7f3dfffff640 0 -- 172.21.15.44:0/2909576941 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x56478b936d10 msgr2=0x56478b939100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:27.031 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.029+0000 7f3e0912c800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:39:27.031 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.029+0000 7f3e0912c800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:39:27.031 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.029+0000 7f3e0912c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:39:27.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.029+0000 7f3e0912c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:39:27.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.029+0000 7f3e0912c800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.029+0000 7f3e0912c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.029+0000 7f3e0912c800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.029+0000 7f3e0912c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:27.032 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.030+0000 7f3e0912c800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.030+0000 7f3e0912c800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:39:27.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.030+0000 7f3e0912c800 20 zone default found 2023-12-03T11:39:27.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.030+0000 7f3e0912c800 4 Realm: () 2023-12-03T11:39:27.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.030+0000 7f3e0912c800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:39:27.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.030+0000 7f3e0912c800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:39:27.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.030+0000 7f3e0912c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:39:27.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.030+0000 7f3e0912c800 20 zonegroup default 2023-12-03T11:39:27.033 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.030+0000 7f3e0912c800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.034 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.030+0000 7f3e0912c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.034 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.030+0000 7f3e0912c800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.034 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.030+0000 7f3e0912c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.034 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.031+0000 7f3e0912c800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.034 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.031+0000 7f3e0912c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.034 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.031+0000 7f3e0912c800 20 started sync module instance, tier type = 2023-12-03T11:39:27.034 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.031+0000 7f3e0912c800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:39:27.040 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.038+0000 7f3dfffff640 0 -- 172.21.15.44:0/2909576941 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x7f3de0079e10 msgr2=0x7f3de007c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:27.044 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.042+0000 7f3e0912c800 20 add_watcher() i=0 2023-12-03T11:39:27.044 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.042+0000 7f3e0912c800 20 add_watcher() i=1 2023-12-03T11:39:27.044 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.042+0000 7f3e0912c800 20 add_watcher() i=2 2023-12-03T11:39:27.044 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.042+0000 7f3e0912c800 20 add_watcher() i=3 2023-12-03T11:39:27.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.042+0000 7f3e0912c800 20 add_watcher() i=4 2023-12-03T11:39:27.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.042+0000 7f3e0912c800 20 add_watcher() i=5 2023-12-03T11:39:27.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.042+0000 7f3e0912c800 20 add_watcher() i=6 2023-12-03T11:39:27.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.043+0000 7f3e0912c800 20 add_watcher() i=7 2023-12-03T11:39:27.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.043+0000 7f3e0912c800 2 all 8 watchers are set, enabling cache 2023-12-03T11:39:27.047 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.045+0000 7f3dca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:27.047 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.045+0000 7f3e0912c800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:39:27.047 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.045+0000 7f3e0912c800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:39:27.054 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.052+0000 7f3e0912c800 5 note: GC not initialized 2023-12-03T11:39:27.055 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.052+0000 7f3d397fa640 20 reqs_thread_entry: start 2023-12-03T11:39:27.055 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.052+0000 7f3e0912c800 20 init_complete bucket index max shards: 1 2023-12-03T11:39:27.055 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.052+0000 7f3e0912c800 20 Filter name: none 2023-12-03T11:39:27.055 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.052+0000 7f3d32ffd640 20 reqs_thread_entry: start 2023-12-03T11:39:27.055 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.052+0000 7f3e0912c800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2023-12-03T11:39:27.055 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.052+0000 7f3e0912c800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.055 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.053+0000 7f3e0912c800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:39:27.055 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.053+0000 7f3e0912c800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2023-12-03T11:39:27.056 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.053+0000 7f3e0912c800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2023-12-03T11:39:27.056 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.053+0000 7f3e0912c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 : miss 2023-12-03T11:39:27.056 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.053+0000 7f3e0912c800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.056 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.054+0000 7f3e0912c800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:39:27.056 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.054+0000 7f3e0912c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 info.flags=0x17 2023-12-03T11:39:27.056 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.054+0000 7f3e0912c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 to cache LRU end 2023-12-03T11:39:27.057 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.054+0000 7f3e0912c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:39:27.057 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.054+0000 7f3e0912c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:27.057 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.054+0000 7f3e0912c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 2023-12-03T11:39:27.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.058+0000 7f3e0912c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 info.flags=0x17 2023-12-03T11:39:27.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.058+0000 7f3e0912c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 to cache LRU end 2023-12-03T11:39:27.061 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.058+0000 7f3e0912c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:27.061 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.058+0000 7f3e0912c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25, ofs0, ns] 2023-12-03T11:39:27.061 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.059+0000 7f3de6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693261 cookie 94865284394064 notifier 7092 bl.length()=893 2023-12-03T11:39:27.061 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.059+0000 7f3de6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 info.flags=0x17 2023-12-03T11:39:27.061 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.059+0000 7f3de6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 to cache LRU end 2023-12-03T11:39:27.061 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.059+0000 7f3de6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:27.061 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.059+0000 7f3e0912c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25]): orig_sources= new_sources= 2023-12-03T11:39:27.062 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.059+0000 7f3e0912c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25]): potential sources added=[] removed=[] 2023-12-03T11:39:27.062 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.059+0000 7f3e0912c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25]): orig_dests= new_dests= 2023-12-03T11:39:27.062 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.059+0000 7f3e0912c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25]): potential dests added=[] removed=[] 2023-12-03T11:39:27.062 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.060+0000 7f3e0912c800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25.1.0 2023-12-03T11:39:27.062 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.060+0000 7f3e0912c800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25.1.0 2023-12-03T11:39:27.063 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.060+0000 7f3e0912c800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25.1.1 2023-12-03T11:39:27.063 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.060+0000 7f3e0912c800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25.1.1 2023-12-03T11:39:27.063 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.060+0000 7f3e0912c800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25.0 2023-12-03T11:39:27.065 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.063+0000 7f3e0912c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 : hit (requested=0x17, cached=0x17) 2023-12-03T11:39:27.065 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.063+0000 7f3e0912c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 2023-12-03T11:39:27.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.064+0000 7f3e0912c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 info.flags=0x17 2023-12-03T11:39:27.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.064+0000 7f3e0912c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 to cache LRU end 2023-12-03T11:39:27.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.064+0000 7f3e0912c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:27.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.064+0000 7f3e0912c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25, ofs0, ns] 2023-12-03T11:39:27.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.065+0000 7f3de67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693262 cookie 94865284394064 notifier 7092 bl.length()=861 2023-12-03T11:39:27.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.065+0000 7f3de67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 info.flags=0x17 2023-12-03T11:39:27.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.065+0000 7f3de67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 to cache LRU end 2023-12-03T11:39:27.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.065+0000 7f3de67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:27.067 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.065+0000 7f3e0912c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25]): orig_sources= new_sources= 2023-12-03T11:39:27.068 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.065+0000 7f3e0912c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25]): potential sources added=[] removed=[] 2023-12-03T11:39:27.068 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.065+0000 7f3e0912c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25]): orig_dests= new_dests= 2023-12-03T11:39:27.068 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.065+0000 7f3e0912c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25]): potential dests added=[] removed=[] 2023-12-03T11:39:27.068 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.066+0000 7f3e0912c800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" completed successfully 2023-12-03T11:39:27.070 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.069+0000 7f3dca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:27.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.071+0000 7f3e0912c800 20 remove_watcher() i=0 2023-12-03T11:39:27.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.071+0000 7f3e0912c800 2 removed watcher, disabling cache 2023-12-03T11:39:27.074 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.072+0000 7f3e0912c800 20 remove_watcher() i=1 2023-12-03T11:39:27.075 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.073+0000 7f3e0912c800 20 remove_watcher() i=2 2023-12-03T11:39:27.076 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.074+0000 7f3e0912c800 20 remove_watcher() i=3 2023-12-03T11:39:27.078 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.075+0000 7f3e0912c800 20 remove_watcher() i=4 2023-12-03T11:39:27.079 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.077+0000 7f3e0912c800 20 remove_watcher() i=5 2023-12-03T11:39:27.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.078+0000 7f3e0912c800 20 remove_watcher() i=6 2023-12-03T11:39:27.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.079+0000 7f3e0912c800 20 remove_watcher() i=7 2023-12-03T11:39:27.087 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2023-12-03T11:39:27.116 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:39:27.116 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:39:27.130 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.128+0000 7f2ab693a800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.132 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.130+0000 7f2ab693a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.133 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.130+0000 7f2ab693a800 20 realm 2023-12-03T11:39:27.133 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.130+0000 7f2ab693a800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.133 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.130+0000 7f2ab693a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.133 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.130+0000 7f2ab693a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:39:27.133 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.130+0000 7f2ab693a800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.133 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.130+0000 7f2ab693a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.133 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.130+0000 7f2ab693a800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.133 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.131+0000 7f2ab693a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:27.133 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.131+0000 7f2ab693a800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.134 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.132+0000 7f2ab693a800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:39:27.134 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.132+0000 7f2ab693a800 20 searching for the correct realm 2023-12-03T11:39:27.145 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.143+0000 7f2ab2e07640 0 -- 172.21.15.44:0/383033633 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x565451807c10 msgr2=0x56545180a0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:27.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.143+0000 7f2ab693a800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:39:27.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.143+0000 7f2ab693a800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:39:27.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.143+0000 7f2ab693a800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:39:27.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.143+0000 7f2ab693a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:39:27.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.143+0000 7f2ab693a800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.143+0000 7f2ab693a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.143+0000 7f2ab693a800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.144+0000 7f2ab693a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:27.146 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.144+0000 7f2ab693a800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.147 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.144+0000 7f2ab693a800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:39:27.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.144+0000 7f2ab693a800 20 zone default found 2023-12-03T11:39:27.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.144+0000 7f2ab693a800 4 Realm: () 2023-12-03T11:39:27.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.144+0000 7f2ab693a800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:39:27.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.144+0000 7f2ab693a800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:39:27.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.144+0000 7f2ab693a800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:39:27.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.144+0000 7f2ab693a800 20 zonegroup default 2023-12-03T11:39:27.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.144+0000 7f2ab693a800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.144+0000 7f2ab693a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.144+0000 7f2ab693a800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.145+0000 7f2ab693a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.145+0000 7f2ab693a800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.145+0000 7f2ab693a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.145+0000 7f2ab693a800 20 started sync module instance, tier type = 2023-12-03T11:39:27.148 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.145+0000 7f2ab693a800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:39:27.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.152+0000 7f2ab2e07640 0 -- 172.21.15.44:0/383033633 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f2aa802f8f0 msgr2=0x7f2aa80193e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:27.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.155+0000 7f2ab693a800 20 add_watcher() i=0 2023-12-03T11:39:27.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.155+0000 7f2ab693a800 20 add_watcher() i=1 2023-12-03T11:39:27.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.155+0000 7f2ab693a800 20 add_watcher() i=2 2023-12-03T11:39:27.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.155+0000 7f2ab693a800 20 add_watcher() i=3 2023-12-03T11:39:27.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.155+0000 7f2ab693a800 20 add_watcher() i=4 2023-12-03T11:39:27.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.155+0000 7f2ab693a800 20 add_watcher() i=5 2023-12-03T11:39:27.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.155+0000 7f2ab693a800 20 add_watcher() i=6 2023-12-03T11:39:27.158 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.156+0000 7f2ab693a800 20 add_watcher() i=7 2023-12-03T11:39:27.158 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.156+0000 7f2ab693a800 2 all 8 watchers are set, enabling cache 2023-12-03T11:39:27.159 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.157+0000 7f2a77fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:27.159 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.158+0000 7f2ab693a800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:39:27.160 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.158+0000 7f2ab693a800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:39:27.166 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.164+0000 7f2ab693a800 5 note: GC not initialized 2023-12-03T11:39:27.166 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.164+0000 7f29e6ffd640 20 reqs_thread_entry: start 2023-12-03T11:39:27.166 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.164+0000 7f2ab693a800 20 init_complete bucket index max shards: 1 2023-12-03T11:39:27.166 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.164+0000 7f2ab693a800 20 Filter name: none 2023-12-03T11:39:27.166 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.164+0000 7f29e4ff9640 20 reqs_thread_entry: start 2023-12-03T11:39:27.166 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.164+0000 7f2ab693a800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.167 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.165+0000 7f2ab693a800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:39:27.167 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.165+0000 7f2ab693a800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.165+0000 7f2ab693a800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:39:27.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.165+0000 7f2ab693a800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:39:27.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.165+0000 7f2ab693a800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.166+0000 7f2ab693a800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:39:27.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.166+0000 7f2ab693a800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.168 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.166+0000 7f2ab693a800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:39:27.169 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.166+0000 7f2ab693a800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:39:27.169 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.166+0000 7f2ab693a800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.169 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.167+0000 7f2ab693a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.169 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.167+0000 7f2a77fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:27.171 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.169+0000 7f2ab693a800 20 remove_watcher() i=0 2023-12-03T11:39:27.171 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.169+0000 7f2ab693a800 2 removed watcher, disabling cache 2023-12-03T11:39:27.172 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.171+0000 7f2ab693a800 20 remove_watcher() i=1 2023-12-03T11:39:27.173 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.172+0000 7f2ab693a800 20 remove_watcher() i=2 2023-12-03T11:39:27.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.173+0000 7f2ab693a800 20 remove_watcher() i=3 2023-12-03T11:39:27.175 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.174+0000 7f2ab693a800 20 remove_watcher() i=4 2023-12-03T11:39:27.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.175+0000 7f2ab693a800 20 remove_watcher() i=5 2023-12-03T11:39:27.177 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.175+0000 7f2ab693a800 20 remove_watcher() i=6 2023-12-03T11:39:27.178 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.177+0000 7f2ab693a800 20 remove_watcher() i=7 2023-12-03T11:39:27.183 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:27.183 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:39:27.183 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-commit-target-layout id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.25 num_objects: 19 size_kb: 1 num_shards: 2 2023-12-03T11:39:27.183 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:27.266 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with EIO injected at do_reshard 2023-12-03T11:39:27.266 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:27.449 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2023-12-03T11:39:27.476 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:39:27.477 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:39:27.491 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.489+0000 7f951f12b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.490+0000 7f951f12b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.490+0000 7f951f12b800 20 realm 2023-12-03T11:39:27.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.490+0000 7f951f12b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.490+0000 7f951f12b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.491+0000 7f951f12b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:39:27.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.491+0000 7f951f12b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.491+0000 7f951f12b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.493 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.491+0000 7f951f12b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.494 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.491+0000 7f951f12b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:27.494 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.491+0000 7f951f12b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.494 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.492+0000 7f951f12b800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:39:27.494 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.492+0000 7f951f12b800 20 searching for the correct realm 2023-12-03T11:39:27.503 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.501+0000 7f951a631640 0 -- 172.21.15.44:0/1123801320 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x564f356f32f0 msgr2=0x564f356f56e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:27.504 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.502+0000 7f951f12b800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:39:27.505 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.502+0000 7f951f12b800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:39:27.505 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.502+0000 7f951f12b800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:39:27.505 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.502+0000 7f951f12b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:39:27.505 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.502+0000 7f951f12b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.505 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.503+0000 7f951f12b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.505 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.503+0000 7f951f12b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.503+0000 7f951f12b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:27.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.503+0000 7f951f12b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.503+0000 7f951f12b800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:39:27.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.503+0000 7f951f12b800 20 zone default found 2023-12-03T11:39:27.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.503+0000 7f951f12b800 4 Realm: () 2023-12-03T11:39:27.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.503+0000 7f951f12b800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:39:27.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.503+0000 7f951f12b800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:39:27.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.503+0000 7f951f12b800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:39:27.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.503+0000 7f951f12b800 20 zonegroup default 2023-12-03T11:39:27.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.503+0000 7f951f12b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.503+0000 7f951f12b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.503+0000 7f951f12b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.506 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.504+0000 7f951f12b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.507 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.504+0000 7f951f12b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.507 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.504+0000 7f951f12b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.507 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.504+0000 7f951f12b800 20 started sync module instance, tier type = 2023-12-03T11:39:27.507 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.504+0000 7f951f12b800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:39:27.511 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.509+0000 7f951b633640 0 -- 172.21.15.44:0/1123801320 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f951000d8f0 msgr2=0x7f951003b380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:27.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.513+0000 7f951f12b800 20 add_watcher() i=0 2023-12-03T11:39:27.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.513+0000 7f951f12b800 20 add_watcher() i=1 2023-12-03T11:39:27.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.513+0000 7f951f12b800 20 add_watcher() i=2 2023-12-03T11:39:27.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.513+0000 7f951f12b800 20 add_watcher() i=3 2023-12-03T11:39:27.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.513+0000 7f951f12b800 20 add_watcher() i=4 2023-12-03T11:39:27.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.513+0000 7f951f12b800 20 add_watcher() i=5 2023-12-03T11:39:27.515 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.513+0000 7f951f12b800 20 add_watcher() i=6 2023-12-03T11:39:27.516 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.514+0000 7f951f12b800 20 add_watcher() i=7 2023-12-03T11:39:27.516 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.514+0000 7f951f12b800 2 all 8 watchers are set, enabling cache 2023-12-03T11:39:27.517 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.515+0000 7f945bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:27.517 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.516+0000 7f951f12b800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:39:27.518 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.516+0000 7f951f12b800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:39:27.524 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.522+0000 7f951f12b800 5 note: GC not initialized 2023-12-03T11:39:27.524 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.522+0000 7f944affd640 20 reqs_thread_entry: start 2023-12-03T11:39:27.524 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.522+0000 7f951f12b800 20 init_complete bucket index max shards: 1 2023-12-03T11:39:27.524 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.522+0000 7f951f12b800 20 Filter name: none 2023-12-03T11:39:27.524 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.522+0000 7f9448ff9640 20 reqs_thread_entry: start 2023-12-03T11:39:27.524 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.522+0000 7f951f12b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.525 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.523+0000 7f951f12b800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:39:27.525 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.523+0000 7f951f12b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.525 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.523+0000 7f951f12b800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:39:27.526 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.523+0000 7f951f12b800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:39:27.526 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.523+0000 7f951f12b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.526 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.524+0000 7f951f12b800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:39:27.526 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.524+0000 7f951f12b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.527 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.525+0000 7f951f12b800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:39:27.527 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.525+0000 7f951f12b800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:39:27.527 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.525+0000 7f951f12b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.527 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.525+0000 7f951f12b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.528 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.526+0000 7f945bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:27.530 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.528+0000 7f951f12b800 20 remove_watcher() i=0 2023-12-03T11:39:27.530 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.528+0000 7f951f12b800 2 removed watcher, disabling cache 2023-12-03T11:39:27.531 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.529+0000 7f951f12b800 20 remove_watcher() i=1 2023-12-03T11:39:27.532 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.530+0000 7f951f12b800 20 remove_watcher() i=2 2023-12-03T11:39:27.533 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.531+0000 7f951f12b800 20 remove_watcher() i=3 2023-12-03T11:39:27.534 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.532+0000 7f951f12b800 20 remove_watcher() i=4 2023-12-03T11:39:27.536 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.533+0000 7f951f12b800 20 remove_watcher() i=5 2023-12-03T11:39:27.536 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.534+0000 7f951f12b800 20 remove_watcher() i=6 2023-12-03T11:39:27.537 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.535+0000 7f951f12b800 20 remove_watcher() i=7 2023-12-03T11:39:27.542 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:27.542 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:39:27.542 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-do-reshard id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:39:27.542 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:27.544 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2023-12-03T11:39:27.576 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:39:27.577 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:39:27.590 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.588+0000 7ff02eb1e800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.593 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.590+0000 7ff02eb1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.593 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.590+0000 7ff02eb1e800 20 realm 2023-12-03T11:39:27.593 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.590+0000 7ff02eb1e800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.593 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.590+0000 7ff02eb1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.593 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.590+0000 7ff02eb1e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:39:27.593 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.591+0000 7ff02eb1e800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.593 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.591+0000 7ff02eb1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.593 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.591+0000 7ff02eb1e800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.593 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.592+0000 7ff02eb1e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:27.594 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.592+0000 7ff02eb1e800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.594 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.592+0000 7ff02eb1e800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:39:27.594 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.592+0000 7ff02eb1e800 20 searching for the correct realm 2023-12-03T11:39:27.604 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.602+0000 7ff02c625640 0 -- 172.21.15.44:0/347638633 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x557839023e20 msgr2=0x557839026250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:27.607 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.604+0000 7ff02eb1e800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:39:27.607 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.604+0000 7ff02eb1e800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:39:27.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.604+0000 7ff02eb1e800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:39:27.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.604+0000 7ff02eb1e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:39:27.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.604+0000 7ff02eb1e800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.604+0000 7ff02eb1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.604+0000 7ff02eb1e800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.604+0000 7ff02eb1e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:27.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.604+0000 7ff02eb1e800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.604+0000 7ff02eb1e800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:39:27.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.604+0000 7ff02eb1e800 20 zone default found 2023-12-03T11:39:27.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.604+0000 7ff02eb1e800 4 Realm: () 2023-12-03T11:39:27.608 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.604+0000 7ff02eb1e800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:39:27.609 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.604+0000 7ff02eb1e800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:39:27.609 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.604+0000 7ff02eb1e800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:39:27.609 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.604+0000 7ff02eb1e800 20 zonegroup default 2023-12-03T11:39:27.609 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.604+0000 7ff02eb1e800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.609 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.605+0000 7ff02eb1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.609 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.605+0000 7ff02eb1e800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.609 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.605+0000 7ff02eb1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.610 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.605+0000 7ff02eb1e800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.610 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.605+0000 7ff02eb1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.610 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.605+0000 7ff02eb1e800 20 started sync module instance, tier type = 2023-12-03T11:39:27.610 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.605+0000 7ff02eb1e800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:39:27.613 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.611+0000 7ff02ce26640 0 -- 172.21.15.44:0/347638633 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7ff02005ec80 msgr2=0x7ff02008ca20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:27.618 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.616+0000 7ff02eb1e800 20 add_watcher() i=0 2023-12-03T11:39:27.618 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.616+0000 7ff02eb1e800 20 add_watcher() i=1 2023-12-03T11:39:27.618 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.616+0000 7ff02eb1e800 20 add_watcher() i=2 2023-12-03T11:39:27.619 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.616+0000 7ff02eb1e800 20 add_watcher() i=3 2023-12-03T11:39:27.619 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.616+0000 7ff02eb1e800 20 add_watcher() i=4 2023-12-03T11:39:27.619 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.616+0000 7ff02eb1e800 20 add_watcher() i=5 2023-12-03T11:39:27.619 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.616+0000 7ff02eb1e800 20 add_watcher() i=6 2023-12-03T11:39:27.620 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.617+0000 7ff02eb1e800 20 add_watcher() i=7 2023-12-03T11:39:27.620 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.617+0000 7ff02eb1e800 2 all 8 watchers are set, enabling cache 2023-12-03T11:39:27.620 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.618+0000 7feff27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:27.621 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.619+0000 7ff02eb1e800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:39:27.621 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.619+0000 7ff02eb1e800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:39:27.628 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.625+0000 7ff02eb1e800 5 note: GC not initialized 2023-12-03T11:39:27.628 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.625+0000 7fef617fa640 20 reqs_thread_entry: start 2023-12-03T11:39:27.628 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.625+0000 7ff02eb1e800 20 init_complete bucket index max shards: 1 2023-12-03T11:39:27.628 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.625+0000 7ff02eb1e800 20 Filter name: none 2023-12-03T11:39:27.629 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.625+0000 7fef5affd640 20 reqs_thread_entry: start 2023-12-03T11:39:27.629 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.625+0000 7ff02eb1e800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2023-12-03T11:39:27.629 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.625+0000 7ff02eb1e800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.629 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.626+0000 7ff02eb1e800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:39:27.629 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.626+0000 7ff02eb1e800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2023-12-03T11:39:27.629 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.626+0000 7ff02eb1e800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2023-12-03T11:39:27.629 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.626+0000 7ff02eb1e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 : miss 2023-12-03T11:39:27.629 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.626+0000 7ff02eb1e800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.630 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.626+0000 7ff02eb1e800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:39:27.630 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.626+0000 7ff02eb1e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 info.flags=0x17 2023-12-03T11:39:27.630 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.626+0000 7ff02eb1e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 to cache LRU end 2023-12-03T11:39:27.630 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.626+0000 7ff02eb1e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:39:27.630 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.626+0000 7ff02eb1e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:27.631 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.626+0000 7ff02eb1e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 2023-12-03T11:39:27.634 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.630+0000 7ff02eb1e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 info.flags=0x17 2023-12-03T11:39:27.634 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.630+0000 7ff02eb1e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 to cache LRU end 2023-12-03T11:39:27.634 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.630+0000 7ff02eb1e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:27.634 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.630+0000 7ff02eb1e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26, ofs0, ns] 2023-12-03T11:39:27.634 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.631+0000 7ff012ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693283 cookie 93974840946144 notifier 7155 bl.length()=873 2023-12-03T11:39:27.634 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.631+0000 7ff012ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 info.flags=0x17 2023-12-03T11:39:27.634 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.631+0000 7ff012ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 to cache LRU end 2023-12-03T11:39:27.634 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.631+0000 7ff012ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:27.634 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.631+0000 7ff02eb1e800 20 handle_bi_update(): bucket=:error-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26]): orig_sources= new_sources= 2023-12-03T11:39:27.634 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.631+0000 7ff02eb1e800 20 handle_bi_update(): bucket=:error-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26]): potential sources added=[] removed=[] 2023-12-03T11:39:27.634 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.631+0000 7ff02eb1e800 20 handle_bi_update(): bucket=:error-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26]): orig_dests= new_dests= 2023-12-03T11:39:27.634 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.631+0000 7ff02eb1e800 20 handle_bi_update(): bucket=:error-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26]): potential dests added=[] removed=[] 2023-12-03T11:39:27.635 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.632+0000 7ff02eb1e800 -1 Injecting error=-5 at location=do_reshard 2023-12-03T11:39:27.636 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.634+0000 7ff02eb1e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 : hit (requested=0x17, cached=0x17) 2023-12-03T11:39:27.636 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.634+0000 7ff02eb1e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 2023-12-03T11:39:27.638 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.636+0000 7ff02eb1e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 info.flags=0x17 2023-12-03T11:39:27.638 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.636+0000 7ff02eb1e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 to cache LRU end 2023-12-03T11:39:27.638 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.636+0000 7ff02eb1e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:27.638 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.636+0000 7ff02eb1e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26, ofs0, ns] 2023-12-03T11:39:27.638 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.636+0000 7ff012ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693284 cookie 93974840946144 notifier 7155 bl.length()=841 2023-12-03T11:39:27.638 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.636+0000 7ff012ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 info.flags=0x17 2023-12-03T11:39:27.638 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.636+0000 7ff012ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 to cache LRU end 2023-12-03T11:39:27.638 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.636+0000 7ff012ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:27.639 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.636+0000 7ff02eb1e800 20 handle_bi_update(): bucket=:error-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26]): orig_sources= new_sources= 2023-12-03T11:39:27.639 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.636+0000 7ff02eb1e800 20 handle_bi_update(): bucket=:error-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26]): potential sources added=[] removed=[] 2023-12-03T11:39:27.639 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.636+0000 7ff02eb1e800 20 handle_bi_update(): bucket=:error-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26]): orig_dests= new_dests= 2023-12-03T11:39:27.639 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.636+0000 7ff02eb1e800 20 handle_bi_update(): bucket=:error-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26]): potential dests added=[] removed=[] 2023-12-03T11:39:27.639 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.636+0000 7ff02eb1e800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2023-12-03T11:39:27.640 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.638+0000 7feff27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:27.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.640+0000 7ff02eb1e800 20 remove_watcher() i=0 2023-12-03T11:39:27.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.640+0000 7ff02eb1e800 2 removed watcher, disabling cache 2023-12-03T11:39:27.643 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.641+0000 7ff02eb1e800 20 remove_watcher() i=1 2023-12-03T11:39:27.644 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.642+0000 7ff02eb1e800 20 remove_watcher() i=2 2023-12-03T11:39:27.646 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.644+0000 7ff02eb1e800 20 remove_watcher() i=3 2023-12-03T11:39:27.647 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.645+0000 7ff02eb1e800 20 remove_watcher() i=4 2023-12-03T11:39:27.648 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.646+0000 7ff02eb1e800 20 remove_watcher() i=5 2023-12-03T11:39:27.649 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.647+0000 7ff02eb1e800 20 remove_watcher() i=6 2023-12-03T11:39:27.650 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.648+0000 7ff02eb1e800 20 remove_watcher() i=7 2023-12-03T11:39:27.656 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2023-12-03T11:39:27.684 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:39:27.684 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:39:27.699 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.697+0000 7fe870b37800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.701 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.698+0000 7fe870b37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.701 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.698+0000 7fe870b37800 20 realm 2023-12-03T11:39:27.701 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.698+0000 7fe870b37800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.701 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.699+0000 7fe870b37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.701 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.699+0000 7fe870b37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:39:27.701 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.699+0000 7fe870b37800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.701 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.699+0000 7fe870b37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.701 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.699+0000 7fe870b37800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.702 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.700+0000 7fe870b37800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:27.702 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.700+0000 7fe870b37800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.702 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.700+0000 7fe870b37800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:39:27.702 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.700+0000 7fe870b37800 20 searching for the correct realm 2023-12-03T11:39:27.709 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.707+0000 7fe86c86f640 0 -- 172.21.15.44:0/1678527940 >> [v2:172.21.15.91:6808/776869758,v1:172.21.15.91:6809/776869758] conn(0x7fe86801faa0 msgr2=0x7fe86804e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:39:27.714 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.711+0000 7fe870b37800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:39:27.714 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.711+0000 7fe870b37800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:39:27.714 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.711+0000 7fe870b37800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:39:27.714 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.711+0000 7fe870b37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:39:27.714 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.711+0000 7fe870b37800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.714 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.712+0000 7fe870b37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.714 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.712+0000 7fe870b37800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.714 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.712+0000 7fe870b37800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:27.714 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.712+0000 7fe870b37800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.715 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.712+0000 7fe870b37800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:39:27.715 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.712+0000 7fe870b37800 20 zone default found 2023-12-03T11:39:27.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.712+0000 7fe870b37800 4 Realm: () 2023-12-03T11:39:27.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.712+0000 7fe870b37800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:39:27.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.712+0000 7fe870b37800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:39:27.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.712+0000 7fe870b37800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:39:27.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.712+0000 7fe870b37800 20 zonegroup default 2023-12-03T11:39:27.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.712+0000 7fe870b37800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.712+0000 7fe86c86f640 0 -- 172.21.15.44:0/1678527940 >> [v2:172.21.15.44:6800/4244511941,v1:172.21.15.44:6801/4244511941] conn(0x7fe85808f460 msgr2=0x7fe85808f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:27.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.712+0000 7fe870b37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.712+0000 7fe870b37800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.713+0000 7fe870b37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.713+0000 7fe870b37800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.713+0000 7fe870b37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.713+0000 7fe870b37800 20 started sync module instance, tier type = 2023-12-03T11:39:27.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.713+0000 7fe870b37800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:39:27.724 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.722+0000 7fe870b37800 20 add_watcher() i=0 2023-12-03T11:39:27.724 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.722+0000 7fe870b37800 20 add_watcher() i=1 2023-12-03T11:39:27.724 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.722+0000 7fe870b37800 20 add_watcher() i=2 2023-12-03T11:39:27.724 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.722+0000 7fe870b37800 20 add_watcher() i=3 2023-12-03T11:39:27.724 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.722+0000 7fe870b37800 20 add_watcher() i=4 2023-12-03T11:39:27.724 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.722+0000 7fe870b37800 20 add_watcher() i=5 2023-12-03T11:39:27.725 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.722+0000 7fe870b37800 20 add_watcher() i=6 2023-12-03T11:39:27.725 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.723+0000 7fe870b37800 20 add_watcher() i=7 2023-12-03T11:39:27.725 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.723+0000 7fe870b37800 2 all 8 watchers are set, enabling cache 2023-12-03T11:39:27.726 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.724+0000 7fe82e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:27.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.725+0000 7fe870b37800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:39:27.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.725+0000 7fe870b37800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:39:27.733 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.731+0000 7fe870b37800 5 note: GC not initialized 2023-12-03T11:39:27.733 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.731+0000 7fe79d7fa640 20 reqs_thread_entry: start 2023-12-03T11:39:27.734 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.731+0000 7fe870b37800 20 init_complete bucket index max shards: 1 2023-12-03T11:39:27.734 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.731+0000 7fe870b37800 20 Filter name: none 2023-12-03T11:39:27.734 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.731+0000 7fe796ffd640 20 reqs_thread_entry: start 2023-12-03T11:39:27.734 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.731+0000 7fe870b37800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.732+0000 7fe870b37800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:39:27.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.732+0000 7fe870b37800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.732+0000 7fe870b37800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:39:27.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.732+0000 7fe870b37800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:39:27.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.732+0000 7fe870b37800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.733+0000 7fe870b37800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:39:27.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.733+0000 7fe870b37800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.733+0000 7fe870b37800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:39:27.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.733+0000 7fe870b37800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:39:27.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.733+0000 7fe870b37800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.734+0000 7fe870b37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.734+0000 7fe82e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:27.738 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.736+0000 7fe870b37800 20 remove_watcher() i=0 2023-12-03T11:39:27.738 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.736+0000 7fe870b37800 2 removed watcher, disabling cache 2023-12-03T11:39:27.739 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.737+0000 7fe870b37800 20 remove_watcher() i=1 2023-12-03T11:39:27.741 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.739+0000 7fe870b37800 20 remove_watcher() i=2 2023-12-03T11:39:27.742 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.740+0000 7fe870b37800 20 remove_watcher() i=3 2023-12-03T11:39:27.743 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.741+0000 7fe870b37800 20 remove_watcher() i=4 2023-12-03T11:39:27.744 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.742+0000 7fe870b37800 20 remove_watcher() i=5 2023-12-03T11:39:27.745 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.743+0000 7fe870b37800 20 remove_watcher() i=6 2023-12-03T11:39:27.746 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.744+0000 7fe870b37800 20 remove_watcher() i=7 2023-12-03T11:39:27.751 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:27.751 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:39:27.751 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-do-reshard id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:39:27.751 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:27.802 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:39:27.834 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:39:27.834 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:39:27.847 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.845+0000 7f0091725800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.849 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.847+0000 7f0091725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.849 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.847+0000 7f0091725800 20 realm 2023-12-03T11:39:27.849 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.847+0000 7f0091725800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.850 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.847+0000 7f0091725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.850 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.847+0000 7f0091725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:39:27.850 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.847+0000 7f0091725800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.850 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.847+0000 7f0091725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.850 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.847+0000 7f0091725800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.851 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.848+0000 7f0091725800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:27.851 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.848+0000 7f0091725800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.852 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.849+0000 7f0091725800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:39:27.852 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.849+0000 7f0091725800 20 searching for the correct realm 2023-12-03T11:39:27.864 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.859+0000 7f008db55640 0 -- 172.21.15.44:0/1443376919 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f008400b040 msgr2=0x7f008402f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:27.865 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.860+0000 7f0091725800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:39:27.865 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.860+0000 7f0091725800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:39:27.865 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.860+0000 7f0091725800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:39:27.865 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.860+0000 7f0091725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:39:27.865 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.860+0000 7f0091725800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.865 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.860+0000 7f0091725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.866 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.860+0000 7f0091725800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.866 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.860+0000 7f0091725800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:27.866 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.860+0000 7f0091725800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.866 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.860+0000 7f0091725800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:39:27.866 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.860+0000 7f0091725800 20 zone default found 2023-12-03T11:39:27.866 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.860+0000 7f0091725800 4 Realm: () 2023-12-03T11:39:27.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.860+0000 7f0091725800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:39:27.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.860+0000 7f0091725800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:39:27.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.860+0000 7f0091725800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:39:27.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.860+0000 7f0091725800 20 zonegroup default 2023-12-03T11:39:27.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.860+0000 7f0091725800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.861+0000 7f0091725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.861+0000 7f0091725800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.861+0000 7f0091725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.861+0000 7f0091725800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.861+0000 7f0091725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.861+0000 7f0091725800 20 started sync module instance, tier type = 2023-12-03T11:39:27.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.861+0000 7f0091725800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:39:27.874 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.871+0000 7f008db55640 0 -- 172.21.15.44:0/1443376919 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x5601a5420810 msgr2=0x5601a5422cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:27.874 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.871+0000 7f0091725800 20 add_watcher() i=0 2023-12-03T11:39:27.874 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.871+0000 7f0091725800 20 add_watcher() i=1 2023-12-03T11:39:27.874 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.871+0000 7f0091725800 20 add_watcher() i=2 2023-12-03T11:39:27.874 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.871+0000 7f0091725800 20 add_watcher() i=3 2023-12-03T11:39:27.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.871+0000 7f0091725800 20 add_watcher() i=4 2023-12-03T11:39:27.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.871+0000 7f0091725800 20 add_watcher() i=5 2023-12-03T11:39:27.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.871+0000 7f0091725800 20 add_watcher() i=6 2023-12-03T11:39:27.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.872+0000 7f0091725800 20 add_watcher() i=7 2023-12-03T11:39:27.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.872+0000 7f0091725800 2 all 8 watchers are set, enabling cache 2023-12-03T11:39:27.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.874+0000 7f0052fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:27.876 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.874+0000 7f0091725800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:39:27.876 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.874+0000 7f0091725800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:39:27.882 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.880+0000 7f0091725800 5 note: GC not initialized 2023-12-03T11:39:27.882 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.880+0000 7effc1ffb640 20 reqs_thread_entry: start 2023-12-03T11:39:27.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.880+0000 7f0091725800 20 init_complete bucket index max shards: 1 2023-12-03T11:39:27.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.880+0000 7f0091725800 20 Filter name: none 2023-12-03T11:39:27.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.880+0000 7effb37fe640 20 reqs_thread_entry: start 2023-12-03T11:39:27.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.880+0000 7f0091725800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2023-12-03T11:39:27.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.880+0000 7f0091725800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.881+0000 7f0091725800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:39:27.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.881+0000 7f0091725800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2023-12-03T11:39:27.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.881+0000 7f0091725800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2023-12-03T11:39:27.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.881+0000 7f0091725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 : miss 2023-12-03T11:39:27.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.881+0000 7f0091725800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.881+0000 7f0091725800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:39:27.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.881+0000 7f0091725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 info.flags=0x17 2023-12-03T11:39:27.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.881+0000 7f0091725800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 to cache LRU end 2023-12-03T11:39:27.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.881+0000 7f0091725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:39:27.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.881+0000 7f0091725800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:27.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.881+0000 7f0091725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 2023-12-03T11:39:27.888 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.885+0000 7f0091725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 info.flags=0x17 2023-12-03T11:39:27.888 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.885+0000 7f0091725800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 to cache LRU end 2023-12-03T11:39:27.888 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.885+0000 7f0091725800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:27.888 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.885+0000 7f0091725800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26, ofs0, ns] 2023-12-03T11:39:27.888 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.886+0000 7f006f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693285 cookie 94565067563632 notifier 6812 bl.length()=873 2023-12-03T11:39:27.888 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.886+0000 7f006f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 info.flags=0x17 2023-12-03T11:39:27.888 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.886+0000 7f006f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 to cache LRU end 2023-12-03T11:39:27.888 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.886+0000 7f006f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:27.889 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.886+0000 7f0091725800 20 handle_bi_update(): bucket=:error-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26]): orig_sources= new_sources= 2023-12-03T11:39:27.889 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.886+0000 7f0091725800 20 handle_bi_update(): bucket=:error-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26]): potential sources added=[] removed=[] 2023-12-03T11:39:27.889 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.886+0000 7f0091725800 20 handle_bi_update(): bucket=:error-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26]): orig_dests= new_dests= 2023-12-03T11:39:27.889 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.886+0000 7f0091725800 20 handle_bi_update(): bucket=:error-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26]): potential dests added=[] removed=[] 2023-12-03T11:39:27.890 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.887+0000 7f0091725800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26.1.0 2023-12-03T11:39:27.890 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.887+0000 7f0091725800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26.1.0 2023-12-03T11:39:27.890 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.887+0000 7f0091725800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26.1.1 2023-12-03T11:39:27.890 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.888+0000 7f0091725800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26.1.1 2023-12-03T11:39:27.890 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.888+0000 7f0091725800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26.0 2023-12-03T11:39:27.892 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.890+0000 7f0091725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 : hit (requested=0x17, cached=0x17) 2023-12-03T11:39:27.892 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.890+0000 7f0091725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 2023-12-03T11:39:27.893 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.891+0000 7f0091725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 info.flags=0x17 2023-12-03T11:39:27.893 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.891+0000 7f0091725800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 to cache LRU end 2023-12-03T11:39:27.893 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.891+0000 7f0091725800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:27.893 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.891+0000 7f0091725800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26, ofs0, ns] 2023-12-03T11:39:27.894 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.891+0000 7f006effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693286 cookie 94565067563632 notifier 6812 bl.length()=841 2023-12-03T11:39:27.894 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.891+0000 7f006effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 info.flags=0x17 2023-12-03T11:39:27.894 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.891+0000 7f006effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 to cache LRU end 2023-12-03T11:39:27.894 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.891+0000 7f006effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:27.894 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.892+0000 7f0091725800 20 handle_bi_update(): bucket=:error-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26]): orig_sources= new_sources= 2023-12-03T11:39:27.894 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.892+0000 7f0091725800 20 handle_bi_update(): bucket=:error-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26]): potential sources added=[] removed=[] 2023-12-03T11:39:27.894 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.892+0000 7f0091725800 20 handle_bi_update(): bucket=:error-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26]): orig_dests= new_dests= 2023-12-03T11:39:27.894 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.892+0000 7f0091725800 20 handle_bi_update(): bucket=:error-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26]): potential dests added=[] removed=[] 2023-12-03T11:39:27.895 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.893+0000 7f0091725800 1 execute INFO: reshard of bucket "error-at-do-reshard" completed successfully 2023-12-03T11:39:27.897 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.895+0000 7f0052fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:27.899 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.897+0000 7f0091725800 20 remove_watcher() i=0 2023-12-03T11:39:27.900 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.897+0000 7f0091725800 2 removed watcher, disabling cache 2023-12-03T11:39:27.901 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.899+0000 7f0091725800 20 remove_watcher() i=1 2023-12-03T11:39:27.902 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.900+0000 7f0091725800 20 remove_watcher() i=2 2023-12-03T11:39:27.903 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.901+0000 7f0091725800 20 remove_watcher() i=3 2023-12-03T11:39:27.904 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.902+0000 7f0091725800 20 remove_watcher() i=4 2023-12-03T11:39:27.904 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.903+0000 7f0091725800 20 remove_watcher() i=5 2023-12-03T11:39:27.905 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.903+0000 7f0091725800 20 remove_watcher() i=6 2023-12-03T11:39:27.906 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.904+0000 7f0091725800 20 remove_watcher() i=7 2023-12-03T11:39:27.913 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2023-12-03T11:39:27.941 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:39:27.941 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:39:27.955 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.953+0000 7f8917b31800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.957 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.955+0000 7f8917b31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.957 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.955+0000 7f8917b31800 20 realm 2023-12-03T11:39:27.957 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.955+0000 7f8917b31800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.957 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.955+0000 7f8917b31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.955+0000 7f8917b31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:39:27.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.955+0000 7f8917b31800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.955+0000 7f8917b31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.955+0000 7f8917b31800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.956+0000 7f8917b31800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:27.958 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.956+0000 7f8917b31800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.959 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.957+0000 7f8917b31800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:39:27.959 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.957+0000 7f8917b31800 20 searching for the correct realm 2023-12-03T11:39:27.968 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.966+0000 7f8912fd6640 0 -- 172.21.15.44:0/1815605903 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x556c622d4490 msgr2=0x556c622d6880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:27.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.967+0000 7f8917b31800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:39:27.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.967+0000 7f8917b31800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:39:27.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.967+0000 7f8917b31800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:39:27.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.967+0000 7f8917b31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:39:27.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.967+0000 7f8917b31800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.968+0000 7f8917b31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.968+0000 7f8917b31800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.971 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.968+0000 7f8917b31800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:27.971 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.968+0000 7f8917b31800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.971 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.968+0000 7f8917b31800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:39:27.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.968+0000 7f8917b31800 20 zone default found 2023-12-03T11:39:27.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.968+0000 7f8917b31800 4 Realm: () 2023-12-03T11:39:27.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.968+0000 7f8917b31800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:39:27.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.968+0000 7f8917b31800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:39:27.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.968+0000 7f8917b31800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:39:27.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.968+0000 7f8917b31800 20 zonegroup default 2023-12-03T11:39:27.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.968+0000 7f8917b31800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.969+0000 7f8917b31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.969+0000 7f8917b31800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.969+0000 7f8917b31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.969+0000 7f8917b31800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.969+0000 7f8917b31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.969+0000 7f8917b31800 20 started sync module instance, tier type = 2023-12-03T11:39:27.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.969+0000 7f8917b31800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:39:27.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.975+0000 7f8912fd6640 0 -- 172.21.15.44:0/1815605903 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x7f88ec079e40 msgr2=0x7f88ec07c270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:27.981 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.979+0000 7f8917b31800 20 add_watcher() i=0 2023-12-03T11:39:27.981 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.979+0000 7f8917b31800 20 add_watcher() i=1 2023-12-03T11:39:27.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.979+0000 7f8917b31800 20 add_watcher() i=2 2023-12-03T11:39:27.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.979+0000 7f8917b31800 20 add_watcher() i=3 2023-12-03T11:39:27.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.979+0000 7f8917b31800 20 add_watcher() i=4 2023-12-03T11:39:27.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.979+0000 7f8917b31800 20 add_watcher() i=5 2023-12-03T11:39:27.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.979+0000 7f8917b31800 20 add_watcher() i=6 2023-12-03T11:39:27.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.981+0000 7f8917b31800 20 add_watcher() i=7 2023-12-03T11:39:27.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.981+0000 7f8917b31800 2 all 8 watchers are set, enabling cache 2023-12-03T11:39:27.984 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.983+0000 7f88d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:27.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.983+0000 7f8917b31800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:39:27.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.983+0000 7f8917b31800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:39:27.991 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.989+0000 7f8917b31800 5 note: GC not initialized 2023-12-03T11:39:27.992 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.989+0000 7f8847fff640 20 reqs_thread_entry: start 2023-12-03T11:39:27.992 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.989+0000 7f8917b31800 20 init_complete bucket index max shards: 1 2023-12-03T11:39:27.992 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.989+0000 7f8917b31800 20 Filter name: none 2023-12-03T11:39:27.992 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.989+0000 7f8845ffb640 20 reqs_thread_entry: start 2023-12-03T11:39:27.992 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.990+0000 7f8917b31800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.990+0000 7f8917b31800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:39:27.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.990+0000 7f8917b31800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.991+0000 7f8917b31800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:39:27.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.991+0000 7f8917b31800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:39:27.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.991+0000 7f8917b31800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.991+0000 7f8917b31800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:39:27.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.991+0000 7f8917b31800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.991+0000 7f8917b31800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:39:27.994 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.991+0000 7f8917b31800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:39:27.994 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.992+0000 7f8917b31800 20 rados->read ofs=0 len=0 2023-12-03T11:39:27.994 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.992+0000 7f8917b31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:27.995 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.993+0000 7f88d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:27.996 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.995+0000 7f8917b31800 20 remove_watcher() i=0 2023-12-03T11:39:27.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.995+0000 7f8917b31800 2 removed watcher, disabling cache 2023-12-03T11:39:27.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.996+0000 7f8917b31800 20 remove_watcher() i=1 2023-12-03T11:39:27.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.997+0000 7f8917b31800 20 remove_watcher() i=2 2023-12-03T11:39:28.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.998+0000 7f8917b31800 20 remove_watcher() i=3 2023-12-03T11:39:28.001 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:27.999+0000 7f8917b31800 20 remove_watcher() i=4 2023-12-03T11:39:28.002 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.000+0000 7f8917b31800 20 remove_watcher() i=5 2023-12-03T11:39:28.003 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.001+0000 7f8917b31800 20 remove_watcher() i=6 2023-12-03T11:39:28.003 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.002+0000 7f8917b31800 20 remove_watcher() i=7 2023-12-03T11:39:28.008 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.009 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:39:28.009 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-do-reshard id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.26 num_objects: 19 size_kb: 1 num_shards: 2 2023-12-03T11:39:28.009 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.070 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with abort at do_reshard 2023-12-03T11:39:28.071 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.257 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2023-12-03T11:39:28.284 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:39:28.284 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:39:28.298 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.296+0000 7f4f7b375800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.298+0000 7f4f7b375800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.298+0000 7f4f7b375800 20 realm 2023-12-03T11:39:28.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.298+0000 7f4f7b375800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.298+0000 7f4f7b375800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.298+0000 7f4f7b375800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:39:28.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.298+0000 7f4f7b375800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.298+0000 7f4f7b375800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.301 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.298+0000 7f4f7b375800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.301 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.299+0000 7f4f7b375800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:28.301 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.299+0000 7f4f7b375800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.302 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.300+0000 7f4f7b375800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:39:28.302 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.300+0000 7f4f7b375800 20 searching for the correct realm 2023-12-03T11:39:28.311 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.309+0000 7f4f78e75640 0 -- 172.21.15.44:0/460549780 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55ee734abb60 msgr2=0x55ee734adf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:39:28.312 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.310+0000 7f4f7b375800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:39:28.312 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.310+0000 7f4f7b375800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:39:28.313 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.310+0000 7f4f7b375800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:39:28.313 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.310+0000 7f4f7b375800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:39:28.313 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.310+0000 7f4f7b375800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.313 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.311+0000 7f4f7b375800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.313 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.311+0000 7f4f7b375800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.314 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.311+0000 7f4f7b375800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:28.314 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.311+0000 7f4f7b375800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.314 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.311+0000 7f4f7b375800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:39:28.314 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.311+0000 7f4f7b375800 20 zone default found 2023-12-03T11:39:28.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.311+0000 7f4f7b375800 4 Realm: () 2023-12-03T11:39:28.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.311+0000 7f4f7b375800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:39:28.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.311+0000 7f4f7b375800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:39:28.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.311+0000 7f4f7b375800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:39:28.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.311+0000 7f4f7b375800 20 zonegroup default 2023-12-03T11:39:28.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.311+0000 7f4f7b375800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.311+0000 7f4f7b375800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.311+0000 7f4f7b375800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.312+0000 7f4f7b375800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.312+0000 7f4f7b375800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.312+0000 7f4f7b375800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.312+0000 7f4f7b375800 20 started sync module instance, tier type = 2023-12-03T11:39:28.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.312+0000 7f4f7b375800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:39:28.321 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.319+0000 7f4f79676640 0 -- 172.21.15.44:0/460549780 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f4f6c01b940 msgr2=0x7f4f6c028420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:28.324 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.322+0000 7f4f7b375800 20 add_watcher() i=0 2023-12-03T11:39:28.324 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.322+0000 7f4f7b375800 20 add_watcher() i=1 2023-12-03T11:39:28.324 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.322+0000 7f4f7b375800 20 add_watcher() i=2 2023-12-03T11:39:28.324 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.322+0000 7f4f7b375800 20 add_watcher() i=3 2023-12-03T11:39:28.324 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.322+0000 7f4f7b375800 20 add_watcher() i=4 2023-12-03T11:39:28.324 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.322+0000 7f4f7b375800 20 add_watcher() i=5 2023-12-03T11:39:28.324 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.322+0000 7f4f7b375800 20 add_watcher() i=6 2023-12-03T11:39:28.325 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.323+0000 7f4f7b375800 20 add_watcher() i=7 2023-12-03T11:39:28.325 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.323+0000 7f4f7b375800 2 all 8 watchers are set, enabling cache 2023-12-03T11:39:28.327 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.325+0000 7f4f3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:28.327 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.325+0000 7f4f7b375800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:39:28.327 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.325+0000 7f4f7b375800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:39:28.333 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.331+0000 7f4f7b375800 5 note: GC not initialized 2023-12-03T11:39:28.334 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.331+0000 7f4eadffb640 20 reqs_thread_entry: start 2023-12-03T11:39:28.334 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.331+0000 7f4f7b375800 20 init_complete bucket index max shards: 1 2023-12-03T11:39:28.334 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.331+0000 7f4f7b375800 20 Filter name: none 2023-12-03T11:39:28.334 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.332+0000 7f4e9f7fe640 20 reqs_thread_entry: start 2023-12-03T11:39:28.334 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.332+0000 7f4f7b375800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.334 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.332+0000 7f4f7b375800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:39:28.334 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.332+0000 7f4f7b375800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.335 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.333+0000 7f4f7b375800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:39:28.335 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.333+0000 7f4f7b375800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:39:28.335 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.333+0000 7f4f7b375800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.336 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.333+0000 7f4f7b375800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:39:28.336 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.333+0000 7f4f7b375800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.336 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.334+0000 7f4f7b375800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:39:28.336 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.334+0000 7f4f7b375800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:39:28.336 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.334+0000 7f4f7b375800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.336 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.334+0000 7f4f7b375800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.337 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.335+0000 7f4f3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:28.339 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.337+0000 7f4f7b375800 20 remove_watcher() i=0 2023-12-03T11:39:28.339 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.337+0000 7f4f7b375800 2 removed watcher, disabling cache 2023-12-03T11:39:28.340 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.338+0000 7f4f7b375800 20 remove_watcher() i=1 2023-12-03T11:39:28.341 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.339+0000 7f4f7b375800 20 remove_watcher() i=2 2023-12-03T11:39:28.342 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.340+0000 7f4f7b375800 20 remove_watcher() i=3 2023-12-03T11:39:28.343 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.341+0000 7f4f7b375800 20 remove_watcher() i=4 2023-12-03T11:39:28.344 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.342+0000 7f4f7b375800 20 remove_watcher() i=5 2023-12-03T11:39:28.345 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.343+0000 7f4f7b375800 20 remove_watcher() i=6 2023-12-03T11:39:28.346 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.344+0000 7f4f7b375800 20 remove_watcher() i=7 2023-12-03T11:39:28.351 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.351 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:39:28.351 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-do-reshard id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:39:28.351 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.353 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2023-12-03T11:39:28.385 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:39:28.386 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:39:28.400 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.398+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.400+0000 7f7adab2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.400+0000 7f7adab2b800 20 realm 2023-12-03T11:39:28.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.400+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.400+0000 7f7adab2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.400+0000 7f7adab2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:39:28.402 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.400+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.403 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.400+0000 7f7adab2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.403 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.400+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.403 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.401+0000 7f7adab2b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:28.403 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.401+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.404 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.402+0000 7f7adab2b800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:39:28.404 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.402+0000 7f7adab2b800 20 searching for the correct realm 2023-12-03T11:39:28.412 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.410+0000 7f7ad7033640 0 -- 172.21.15.44:0/2010397879 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55ce360bac00 msgr2=0x55ce360bd0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:28.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.412+0000 7f7adab2b800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:39:28.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.412+0000 7f7adab2b800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:39:28.414 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.412+0000 7f7adab2b800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:39:28.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.412+0000 7f7adab2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:39:28.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.412+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.412+0000 7f7adab2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.415 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.412+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.413+0000 7f7adab2b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:28.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.413+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.413+0000 7f7adab2b800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:39:28.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.413+0000 7f7adab2b800 20 zone default found 2023-12-03T11:39:28.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.413+0000 7f7adab2b800 4 Realm: () 2023-12-03T11:39:28.416 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.413+0000 7f7adab2b800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:39:28.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.413+0000 7f7adab2b800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:39:28.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.413+0000 7f7adab2b800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:39:28.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.413+0000 7f7adab2b800 20 zonegroup default 2023-12-03T11:39:28.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.413+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.414+0000 7f7adab2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.414+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.414+0000 7f7adab2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.414+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.414+0000 7f7adab2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.414+0000 7f7adab2b800 20 started sync module instance, tier type = 2023-12-03T11:39:28.417 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.414+0000 7f7adab2b800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:39:28.421 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.419+0000 7f7ad6832640 0 -- 172.21.15.44:0/2010397879 >> [v2:172.21.15.91:6808/776869758,v1:172.21.15.91:6809/776869758] conn(0x7f7ad0031060 msgr2=0x7f7ad008b8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:28.426 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.424+0000 7f7adab2b800 20 add_watcher() i=0 2023-12-03T11:39:28.426 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.424+0000 7f7adab2b800 20 add_watcher() i=1 2023-12-03T11:39:28.426 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.424+0000 7f7adab2b800 20 add_watcher() i=2 2023-12-03T11:39:28.426 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.424+0000 7f7adab2b800 20 add_watcher() i=3 2023-12-03T11:39:28.426 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.424+0000 7f7adab2b800 20 add_watcher() i=4 2023-12-03T11:39:28.426 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.424+0000 7f7adab2b800 20 add_watcher() i=5 2023-12-03T11:39:28.426 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.424+0000 7f7adab2b800 20 add_watcher() i=6 2023-12-03T11:39:28.427 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.425+0000 7f7adab2b800 20 add_watcher() i=7 2023-12-03T11:39:28.427 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.425+0000 7f7adab2b800 2 all 8 watchers are set, enabling cache 2023-12-03T11:39:28.428 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.426+0000 7f7a17fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:28.429 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.427+0000 7f7adab2b800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:39:28.429 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.427+0000 7f7adab2b800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:39:28.435 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.433+0000 7f7adab2b800 5 note: GC not initialized 2023-12-03T11:39:28.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.433+0000 7f7a06ffd640 20 reqs_thread_entry: start 2023-12-03T11:39:28.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.433+0000 7f7adab2b800 20 init_complete bucket index max shards: 1 2023-12-03T11:39:28.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.433+0000 7f7adab2b800 20 Filter name: none 2023-12-03T11:39:28.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.433+0000 7f7a04ff9640 20 reqs_thread_entry: start 2023-12-03T11:39:28.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.433+0000 7f7adab2b800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2023-12-03T11:39:28.436 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.433+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.434+0000 7f7adab2b800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:39:28.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.434+0000 7f7adab2b800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2023-12-03T11:39:28.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.434+0000 7f7adab2b800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2023-12-03T11:39:28.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.434+0000 7f7adab2b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 : miss 2023-12-03T11:39:28.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.434+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.434+0000 7f7adab2b800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:39:28.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.434+0000 7f7adab2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 info.flags=0x17 2023-12-03T11:39:28.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.434+0000 7f7adab2b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 to cache LRU end 2023-12-03T11:39:28.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.434+0000 7f7adab2b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:39:28.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.434+0000 7f7adab2b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:28.437 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.434+0000 7f7adab2b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 2023-12-03T11:39:28.441 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.438+0000 7f7adab2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 info.flags=0x17 2023-12-03T11:39:28.441 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.438+0000 7f7adab2b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 to cache LRU end 2023-12-03T11:39:28.441 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.438+0000 7f7adab2b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:28.441 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.438+0000 7f7adab2b800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27, ofs0, ns] 2023-12-03T11:39:28.441 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.439+0000 7f7acd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693290 cookie 94344158385328 notifier 6872 bl.length()=873 2023-12-03T11:39:28.441 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.439+0000 7f7acd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 info.flags=0x17 2023-12-03T11:39:28.441 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.439+0000 7f7acd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 to cache LRU end 2023-12-03T11:39:28.442 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.439+0000 7f7acd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:28.442 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.439+0000 7f7adab2b800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27]): orig_sources= new_sources= 2023-12-03T11:39:28.442 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.439+0000 7f7adab2b800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27]): potential sources added=[] removed=[] 2023-12-03T11:39:28.442 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.439+0000 7f7adab2b800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27]): orig_dests= new_dests= 2023-12-03T11:39:28.442 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.439+0000 7f7adab2b800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27]): potential dests added=[] removed=[] 2023-12-03T11:39:28.442 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7adab2b800 time 2023-12-03T11:39:28.442589+0000 2023-12-03T11:39:28.443 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:39:28.443 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:39:28.443 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7add76eef8] 2023-12-03T11:39:28.443 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7add76f0b6] 2023-12-03T11:39:28.443 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ce34f60a71] 2023-12-03T11:39:28.444 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55ce34f6cf34] 2023-12-03T11:39:28.444 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2023-12-03T11:39:28.444 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f7adb03feb0] 2023-12-03T11:39:28.444 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2023-12-03T11:39:28.444 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2023-12-03T11:39:28.444 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.441+0000 7f7adab2b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7adab2b800 time 2023-12-03T11:39:28.442589+0000 2023-12-03T11:39:28.444 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:39:28.444 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.444 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:39:28.444 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7add76eef8] 2023-12-03T11:39:28.444 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7add76f0b6] 2023-12-03T11:39:28.444 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ce34f60a71] 2023-12-03T11:39:28.444 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55ce34f6cf34] 2023-12-03T11:39:28.445 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2023-12-03T11:39:28.445 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f7adb03feb0] 2023-12-03T11:39:28.445 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2023-12-03T11:39:28.445 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2023-12-03T11:39:28.445 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.445 INFO:tasks.workunit.client.0.smithi044.stderr:*** Caught signal (Aborted) ** 2023-12-03T11:39:28.445 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f7adab2b800 thread_name:radosgw-admin 2023-12-03T11:39:28.464 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:39:28.464 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7adb054db0] 2023-12-03T11:39:28.464 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f7adb0a154c] 2023-12-03T11:39:28.464 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2023-12-03T11:39:28.464 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2023-12-03T11:39:28.464 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7add76ef52] 2023-12-03T11:39:28.464 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7add76f0b6] 2023-12-03T11:39:28.464 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ce34f60a71] 2023-12-03T11:39:28.465 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55ce34f6cf34] 2023-12-03T11:39:28.465 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2023-12-03T11:39:28.465 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f7adb03feb0] 2023-12-03T11:39:28.465 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2023-12-03T11:39:28.465 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2023-12-03T11:39:28.465 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.442+0000 7f7adab2b800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:39:28.465 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f7adab2b800 thread_name:radosgw-admin 2023-12-03T11:39:28.465 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.465 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:39:28.465 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7adb054db0] 2023-12-03T11:39:28.465 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f7adb0a154c] 2023-12-03T11:39:28.465 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2023-12-03T11:39:28.466 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2023-12-03T11:39:28.466 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7add76ef52] 2023-12-03T11:39:28.466 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7add76f0b6] 2023-12-03T11:39:28.466 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ce34f60a71] 2023-12-03T11:39:28.466 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55ce34f6cf34] 2023-12-03T11:39:28.466 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2023-12-03T11:39:28.466 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f7adb03feb0] 2023-12-03T11:39:28.466 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2023-12-03T11:39:28.466 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2023-12-03T11:39:28.466 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:39:28.466 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.466 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2023-12-03T11:39:28.466 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2023-12-03T11:39:28.392+0000 7f7adab2b800 10 monclient: _renew_subs 2023-12-03T11:39:28.466 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2023-12-03T11:39:28.392+0000 7f7adab2b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2023-12-03T11:39:28.466 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2023-12-03T11:39:28.392+0000 7f7adab2b800 1 librados: init done 2023-12-03T11:39:28.467 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2023-12-03T11:39:28.393+0000 7f7adab2b800 10 monclient: get_monmap_and_config 2023-12-03T11:39:28.467 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2023-12-03T11:39:28.393+0000 7f7adab2b800 10 monclient: build_initial_monmap 2023-12-03T11:39:28.467 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2023-12-03T11:39:28.393+0000 7f7adab2b800 1 build_initial for_mkfs: 0 2023-12-03T11:39:28.467 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2023-12-03T11:39:28.393+0000 7f7adab2b800 10 monclient: monmap: 2023-12-03T11:39:28.467 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:39:28.467 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:39:28.467 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:39:28.467 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:39:28.467 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:39:28.467 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.467 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:39:28.467 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:39:28.467 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:39:28.467 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.467 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding auth protocol: cephx 2023-12-03T11:39:28.467 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding auth protocol: cephx 2023-12-03T11:39:28.468 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding auth protocol: cephx 2023-12-03T11:39:28.468 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: secure 2023-12-03T11:39:28.468 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: crc 2023-12-03T11:39:28.468 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: secure 2023-12-03T11:39:28.468 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: crc 2023-12-03T11:39:28.468 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: secure 2023-12-03T11:39:28.468 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: crc 2023-12-03T11:39:28.468 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: crc 2023-12-03T11:39:28.468 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: secure 2023-12-03T11:39:28.468 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: crc 2023-12-03T11:39:28.468 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: secure 2023-12-03T11:39:28.468 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: crc 2023-12-03T11:39:28.468 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: secure 2023-12-03T11:39:28.468 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2023-12-03T11:39:28.393+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.468 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2023-12-03T11:39:28.393+0000 7f7adab2b800 10 monclient: init 2023-12-03T11:39:28.469 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding auth protocol: cephx 2023-12-03T11:39:28.469 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding auth protocol: cephx 2023-12-03T11:39:28.469 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding auth protocol: cephx 2023-12-03T11:39:28.469 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: secure 2023-12-03T11:39:28.469 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: crc 2023-12-03T11:39:28.469 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: secure 2023-12-03T11:39:28.469 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: crc 2023-12-03T11:39:28.469 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: secure 2023-12-03T11:39:28.469 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: crc 2023-12-03T11:39:28.469 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: crc 2023-12-03T11:39:28.469 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: secure 2023-12-03T11:39:28.469 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: crc 2023-12-03T11:39:28.469 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: secure 2023-12-03T11:39:28.469 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: crc 2023-12-03T11:39:28.470 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: secure 2023-12-03T11:39:28.470 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2023-12-03T11:39:28.393+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.470 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2023-12-03T11:39:28.394+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.470 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2023-12-03T11:39:28.394+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command rotate-key cmddesc rotate-key hook 0x7ffe71491978 EEXIST 2023-12-03T11:39:28.470 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2023-12-03T11:39:28.394+0000 7f7adab2b800 10 monclient: _reopen_session rank -1 2023-12-03T11:39:28.470 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2023-12-03T11:39:28.394+0000 7f7adab2b800 10 monclient: _add_conns ranks=[1,2,0] 2023-12-03T11:39:28.470 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2023-12-03T11:39:28.394+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-b con 0x55ce360966c0 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:39:28.470 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2023-12-03T11:39:28.394+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-c con 0x55ce36096aa0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:39:28.470 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2023-12-03T11:39:28.394+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-a con 0x55ce36092620 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:39:28.470 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2023-12-03T11:39:28.394+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.470 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2023-12-03T11:39:28.394+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.470 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2023-12-03T11:39:28.394+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.470 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2023-12-03T11:39:28.394+0000 7f7adab2b800 10 monclient(hunting): _renew_subs 2023-12-03T11:39:28.470 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2023-12-03T11:39:28.394+0000 7f7adab2b800 10 monclient(hunting): authenticate will time out at 1647.620820s 2023-12-03T11:39:28.470 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2023-12-03T11:39:28.394+0000 7f7ad6832640 10 monclient(hunting): get_auth_request con 0x55ce36096aa0 auth_method 0 2023-12-03T11:39:28.471 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2023-12-03T11:39:28.394+0000 7f7ad6832640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.471 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2023-12-03T11:39:28.394+0000 7f7ad6832640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.471 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2023-12-03T11:39:28.394+0000 7f7ad6832640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.471 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2023-12-03T11:39:28.394+0000 7f7ad7033640 10 monclient(hunting): get_auth_request con 0x55ce360966c0 auth_method 0 2023-12-03T11:39:28.471 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2023-12-03T11:39:28.394+0000 7f7ad7033640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.471 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2023-12-03T11:39:28.394+0000 7f7ad7033640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.471 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2023-12-03T11:39:28.394+0000 7f7ad7033640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.471 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2023-12-03T11:39:28.394+0000 7f7ad6031640 10 monclient(hunting): get_auth_request con 0x55ce36092620 auth_method 0 2023-12-03T11:39:28.471 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2023-12-03T11:39:28.394+0000 7f7ad6031640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.471 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2023-12-03T11:39:28.394+0000 7f7ad6031640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.471 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2023-12-03T11:39:28.394+0000 7f7ad6031640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.471 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2023-12-03T11:39:28.394+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.471 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2023-12-03T11:39:28.394+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.471 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2023-12-03T11:39:28.394+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.471 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2023-12-03T11:39:28.394+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.472 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2023-12-03T11:39:28.394+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.472 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2023-12-03T11:39:28.394+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.472 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2023-12-03T11:39:28.394+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.472 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2023-12-03T11:39:28.394+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.472 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2023-12-03T11:39:28.394+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.472 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2023-12-03T11:39:28.394+0000 7f7ad6832640 10 monclient(hunting): handle_auth_done global_id 6869 payload 274 2023-12-03T11:39:28.472 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2023-12-03T11:39:28.394+0000 7f7ad6832640 10 monclient: _finish_hunting 0 2023-12-03T11:39:28.472 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2023-12-03T11:39:28.394+0000 7f7acffff640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:39:28.472 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2023-12-03T11:39:28.394+0000 7f7ad6832640 1 monclient: found mon.noname-c 2023-12-03T11:39:28.473 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2023-12-03T11:39:28.394+0000 7f7acffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:39:28.473 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2023-12-03T11:39:28.394+0000 7f7acffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:39:28.473 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2023-12-03T11:39:28.394+0000 7f7ad6832640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2023-12-03T11:39:28.473 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2023-12-03T11:39:28.394+0000 7f7ad7033640 10 monclient: get_auth_request con 0x7f7ab8069820 auth_method 0 2023-12-03T11:39:28.473 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2023-12-03T11:39:28.394+0000 7f7acd7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:39:28.473 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2023-12-03T11:39:28.394+0000 7f7acd7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:39:28.473 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2023-12-03T11:39:28.394+0000 7f7acd7fa640 10 monclient: dump: 2023-12-03T11:39:28.473 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:39:28.473 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:39:28.473 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.473 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.473 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:39:28.473 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.473 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:39:28.474 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:39:28.474 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:39:28.474 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.474 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2023-12-03T11:39:28.394+0000 7f7acd7fa640 10 monclient: _finish_auth 0 2023-12-03T11:39:28.474 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2023-12-03T11:39:28.394+0000 7f7acd7fa640 10 monclient: _check_auth_tickets 2023-12-03T11:39:28.474 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2023-12-03T11:39:28.394+0000 7f7acd7fa640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:39:28.474 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2023-12-03T11:39:28.394+0000 7f7adab2b800 5 monclient: authenticate success, global_id 6869 2023-12-03T11:39:28.474 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2023-12-03T11:39:28.394+0000 7f7adab2b800 10 monclient: get_monmap_and_config success 2023-12-03T11:39:28.474 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2023-12-03T11:39:28.394+0000 7f7adab2b800 4 set_mon_vals no callback set 2023-12-03T11:39:28.474 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2023-12-03T11:39:28.394+0000 7f7acd7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:39:28.474 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2023-12-03T11:39:28.394+0000 7f7acd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:39:28.474 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2023-12-03T11:39:28.394+0000 7f7acd7fa640 10 monclient: dump: 2023-12-03T11:39:28.474 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:39:28.474 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:39:28.474 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.475 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.475 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:39:28.475 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.475 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:39:28.475 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:39:28.475 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:39:28.475 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.475 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2023-12-03T11:39:28.395+0000 7f7adab2b800 10 monclient: shutdown 2023-12-03T11:39:28.475 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2023-12-03T11:39:28.395+0000 7f7adab2b800 10 monclient: build_initial_monmap 2023-12-03T11:39:28.475 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2023-12-03T11:39:28.395+0000 7f7adab2b800 1 build_initial for_mkfs: 0 2023-12-03T11:39:28.475 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2023-12-03T11:39:28.395+0000 7f7adab2b800 10 monclient: monmap: 2023-12-03T11:39:28.475 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:39:28.475 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:39:28.475 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:39:28.475 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:39:28.476 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:39:28.476 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.476 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:39:28.476 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:39:28.476 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:39:28.476 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.476 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding auth protocol: cephx 2023-12-03T11:39:28.476 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding auth protocol: cephx 2023-12-03T11:39:28.476 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding auth protocol: cephx 2023-12-03T11:39:28.476 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: secure 2023-12-03T11:39:28.476 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: crc 2023-12-03T11:39:28.476 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: secure 2023-12-03T11:39:28.476 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: crc 2023-12-03T11:39:28.476 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: secure 2023-12-03T11:39:28.476 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: crc 2023-12-03T11:39:28.476 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: crc 2023-12-03T11:39:28.477 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: secure 2023-12-03T11:39:28.477 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: crc 2023-12-03T11:39:28.477 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: secure 2023-12-03T11:39:28.477 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: crc 2023-12-03T11:39:28.477 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: secure 2023-12-03T11:39:28.477 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2023-12-03T11:39:28.395+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.477 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2023-12-03T11:39:28.395+0000 7f7adab2b800 1 librados: starting msgr at 2023-12-03T11:39:28.477 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2023-12-03T11:39:28.395+0000 7f7adab2b800 1 librados: starting objecter 2023-12-03T11:39:28.477 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command objecter_requests cmddesc objecter_requests hook 0x55ce36067290 EEXIST 2023-12-03T11:39:28.477 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2023-12-03T11:39:28.396+0000 7f7adab2b800 1 librados: setting wanted keys 2023-12-03T11:39:28.477 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2023-12-03T11:39:28.396+0000 7f7adab2b800 1 librados: calling monclient init 2023-12-03T11:39:28.477 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2023-12-03T11:39:28.396+0000 7f7adab2b800 10 monclient: init 2023-12-03T11:39:28.477 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding auth protocol: cephx 2023-12-03T11:39:28.478 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding auth protocol: cephx 2023-12-03T11:39:28.478 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding auth protocol: cephx 2023-12-03T11:39:28.478 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: secure 2023-12-03T11:39:28.478 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: crc 2023-12-03T11:39:28.478 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: secure 2023-12-03T11:39:28.478 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: crc 2023-12-03T11:39:28.478 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: secure 2023-12-03T11:39:28.478 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: crc 2023-12-03T11:39:28.478 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: crc 2023-12-03T11:39:28.478 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: secure 2023-12-03T11:39:28.478 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: crc 2023-12-03T11:39:28.478 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: secure 2023-12-03T11:39:28.478 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: crc 2023-12-03T11:39:28.478 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: secure 2023-12-03T11:39:28.478 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2023-12-03T11:39:28.396+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.479 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2023-12-03T11:39:28.396+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.479 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command rotate-key cmddesc rotate-key hook 0x55ce35fa0d60 EEXIST 2023-12-03T11:39:28.479 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2023-12-03T11:39:28.396+0000 7f7adab2b800 10 monclient: _reopen_session rank -1 2023-12-03T11:39:28.479 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2023-12-03T11:39:28.396+0000 7f7adab2b800 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:39:28.479 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2023-12-03T11:39:28.396+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-b con 0x55ce36092620 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:39:28.479 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2023-12-03T11:39:28.396+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-a con 0x55ce360966c0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:39:28.479 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2023-12-03T11:39:28.396+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-c con 0x55ce3608ee00 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:39:28.479 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2023-12-03T11:39:28.396+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.479 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2023-12-03T11:39:28.396+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.479 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2023-12-03T11:39:28.396+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.479 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2023-12-03T11:39:28.396+0000 7f7adab2b800 10 monclient(hunting): _renew_subs 2023-12-03T11:39:28.479 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2023-12-03T11:39:28.396+0000 7f7adab2b800 10 monclient(hunting): authenticate will time out at 1647.623239s 2023-12-03T11:39:28.479 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2023-12-03T11:39:28.396+0000 7f7ad6031640 10 monclient(hunting): get_auth_request con 0x55ce360966c0 auth_method 0 2023-12-03T11:39:28.479 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2023-12-03T11:39:28.396+0000 7f7ad6031640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.479 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2023-12-03T11:39:28.396+0000 7f7ad6031640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.480 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2023-12-03T11:39:28.396+0000 7f7ad6031640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.480 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2023-12-03T11:39:28.396+0000 7f7ad7033640 10 monclient(hunting): get_auth_request con 0x55ce3608ee00 auth_method 0 2023-12-03T11:39:28.480 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2023-12-03T11:39:28.396+0000 7f7ad7033640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.480 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2023-12-03T11:39:28.396+0000 7f7ad7033640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.480 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2023-12-03T11:39:28.396+0000 7f7ad7033640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.480 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2023-12-03T11:39:28.396+0000 7f7ad6832640 10 monclient(hunting): get_auth_request con 0x55ce36092620 auth_method 0 2023-12-03T11:39:28.480 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2023-12-03T11:39:28.396+0000 7f7ad6832640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.480 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2023-12-03T11:39:28.396+0000 7f7ad6832640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.480 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2023-12-03T11:39:28.396+0000 7f7ad6832640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.480 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2023-12-03T11:39:28.396+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.480 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2023-12-03T11:39:28.396+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.480 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2023-12-03T11:39:28.396+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.480 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2023-12-03T11:39:28.396+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.480 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2023-12-03T11:39:28.396+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.480 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2023-12-03T11:39:28.396+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.480 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2023-12-03T11:39:28.396+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.481 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2023-12-03T11:39:28.396+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.481 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2023-12-03T11:39:28.396+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.481 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2023-12-03T11:39:28.396+0000 7f7ad7033640 10 monclient(hunting): handle_auth_done global_id 6872 payload 824 2023-12-03T11:39:28.481 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2023-12-03T11:39:28.396+0000 7f7ad7033640 10 monclient: _finish_hunting 0 2023-12-03T11:39:28.481 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2023-12-03T11:39:28.396+0000 7f7ad7033640 1 monclient: found mon.noname-c 2023-12-03T11:39:28.481 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2023-12-03T11:39:28.396+0000 7f7ad7033640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2023-12-03T11:39:28.481 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2023-12-03T11:39:28.397+0000 7f7ab77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:39:28.481 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2023-12-03T11:39:28.397+0000 7f7ab77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:39:28.481 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2023-12-03T11:39:28.397+0000 7f7ab77fe640 10 monclient: dump: 2023-12-03T11:39:28.481 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:39:28.481 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:39:28.481 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.481 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.481 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:39:28.481 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.481 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:39:28.482 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:39:28.482 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:39:28.482 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.482 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2023-12-03T11:39:28.397+0000 7f7ab77fe640 10 monclient: _finish_auth 0 2023-12-03T11:39:28.482 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2023-12-03T11:39:28.397+0000 7f7ab77fe640 10 monclient: _check_auth_tickets 2023-12-03T11:39:28.482 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2023-12-03T11:39:28.397+0000 7f7ab77fe640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:39:28.482 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2023-12-03T11:39:28.397+0000 7f7ab77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:39:28.482 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2023-12-03T11:39:28.397+0000 7f7ab77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:39:28.482 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2023-12-03T11:39:28.397+0000 7f7ab77fe640 10 monclient: dump: 2023-12-03T11:39:28.482 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:39:28.482 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:39:28.482 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.482 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.482 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:39:28.482 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.483 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:39:28.483 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:39:28.483 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:39:28.483 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.483 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2023-12-03T11:39:28.397+0000 7f7adab2b800 5 monclient: authenticate success, global_id 6872 2023-12-03T11:39:28.483 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2023-12-03T11:39:28.397+0000 7f7acd7fa640 4 set_mon_vals no callback set 2023-12-03T11:39:28.483 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2023-12-03T11:39:28.397+0000 7f7adab2b800 10 monclient: _renew_subs 2023-12-03T11:39:28.483 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2023-12-03T11:39:28.397+0000 7f7adab2b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:39:28.483 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2023-12-03T11:39:28.397+0000 7f7adab2b800 10 monclient: _renew_subs 2023-12-03T11:39:28.483 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2023-12-03T11:39:28.397+0000 7f7adab2b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:39:28.483 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2023-12-03T11:39:28.397+0000 7f7adab2b800 1 librados: init done 2023-12-03T11:39:28.483 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2023-12-03T11:39:28.398+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.483 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2023-12-03T11:39:28.399+0000 7f7ab77fe640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:39:28.483 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2023-12-03T11:39:28.399+0000 7f7ab77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:39:28.483 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2023-12-03T11:39:28.399+0000 7f7ab77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:39:28.483 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2023-12-03T11:39:28.399+0000 7f7ad6832640 10 monclient: get_auth_request con 0x7f7ab0069820 auth_method 0 2023-12-03T11:39:28.484 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2023-12-03T11:39:28.399+0000 7f7ad6031640 10 monclient: get_auth_request con 0x55ce360aebf0 auth_method 0 2023-12-03T11:39:28.484 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2023-12-03T11:39:28.400+0000 7f7adab2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.484 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2023-12-03T11:39:28.400+0000 7f7adab2b800 20 realm 2023-12-03T11:39:28.484 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2023-12-03T11:39:28.400+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.484 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2023-12-03T11:39:28.400+0000 7f7adab2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.484 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2023-12-03T11:39:28.400+0000 7f7adab2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:39:28.484 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2023-12-03T11:39:28.400+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.484 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2023-12-03T11:39:28.400+0000 7f7adab2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.484 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2023-12-03T11:39:28.400+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.484 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2023-12-03T11:39:28.400+0000 7f7ad6832640 10 monclient: get_auth_request con 0x55ce360b2b20 auth_method 0 2023-12-03T11:39:28.484 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2023-12-03T11:39:28.401+0000 7f7adab2b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:28.484 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2023-12-03T11:39:28.401+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.484 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2023-12-03T11:39:28.401+0000 7f7ad6031640 10 monclient: get_auth_request con 0x55ce360b6310 auth_method 0 2023-12-03T11:39:28.484 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2023-12-03T11:39:28.402+0000 7f7adab2b800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:39:28.484 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2023-12-03T11:39:28.402+0000 7f7adab2b800 20 searching for the correct realm 2023-12-03T11:39:28.484 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2023-12-03T11:39:28.402+0000 7f7ad7033640 10 monclient: get_auth_request con 0x55ce360bac00 auth_method 0 2023-12-03T11:39:28.485 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2023-12-03T11:39:28.403+0000 7f7ad6832640 10 monclient: get_auth_request con 0x7f7ad0031060 auth_method 0 2023-12-03T11:39:28.485 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2023-12-03T11:39:28.404+0000 7f7ad6031640 10 monclient: get_auth_request con 0x7f7ac0002040 auth_method 0 2023-12-03T11:39:28.485 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2023-12-03T11:39:28.405+0000 7f7ad7033640 10 monclient: get_auth_request con 0x7f7ac0017070 auth_method 0 2023-12-03T11:39:28.485 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2023-12-03T11:39:28.407+0000 7f7ad6832640 10 monclient: get_auth_request con 0x7f7ac006bbe0 auth_method 0 2023-12-03T11:39:28.485 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2023-12-03T11:39:28.410+0000 7f7ad7033640 0 -- 172.21.15.44:0/2010397879 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55ce360bac00 msgr2=0x55ce360bd0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:28.485 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2023-12-03T11:39:28.410+0000 7f7ab77fe640 1 client.6872.objecter ms_handle_reset 0x55ce360bac00 session 0x55ce360ba580 osd.3 2023-12-03T11:39:28.485 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2023-12-03T11:39:28.410+0000 7f7ab77fe640 10 monclient: _renew_subs 2023-12-03T11:39:28.485 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2023-12-03T11:39:28.410+0000 7f7ab77fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:39:28.485 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2023-12-03T11:39:28.411+0000 7f7ad7033640 10 monclient: get_auth_request con 0x7f7ab0079e10 auth_method 0 2023-12-03T11:39:28.485 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2023-12-03T11:39:28.412+0000 7f7adab2b800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:39:28.485 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2023-12-03T11:39:28.412+0000 7f7adab2b800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:39:28.485 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2023-12-03T11:39:28.412+0000 7f7adab2b800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:39:28.485 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2023-12-03T11:39:28.412+0000 7f7adab2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:39:28.485 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2023-12-03T11:39:28.412+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.485 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2023-12-03T11:39:28.412+0000 7f7adab2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.485 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2023-12-03T11:39:28.412+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.486 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2023-12-03T11:39:28.413+0000 7f7adab2b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:28.486 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2023-12-03T11:39:28.413+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.486 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2023-12-03T11:39:28.413+0000 7f7adab2b800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:39:28.486 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2023-12-03T11:39:28.413+0000 7f7adab2b800 20 zone default found 2023-12-03T11:39:28.486 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2023-12-03T11:39:28.413+0000 7f7adab2b800 4 Realm: () 2023-12-03T11:39:28.486 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2023-12-03T11:39:28.413+0000 7f7adab2b800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:39:28.486 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2023-12-03T11:39:28.413+0000 7f7adab2b800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:39:28.486 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2023-12-03T11:39:28.413+0000 7f7adab2b800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:39:28.486 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2023-12-03T11:39:28.413+0000 7f7adab2b800 20 zonegroup default 2023-12-03T11:39:28.486 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2023-12-03T11:39:28.413+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.486 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2023-12-03T11:39:28.414+0000 7f7adab2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.486 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2023-12-03T11:39:28.414+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.486 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2023-12-03T11:39:28.414+0000 7f7adab2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.486 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2023-12-03T11:39:28.414+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.487 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2023-12-03T11:39:28.414+0000 7f7adab2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.487 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2023-12-03T11:39:28.414+0000 7f7adab2b800 20 started sync module instance, tier type = 2023-12-03T11:39:28.487 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2023-12-03T11:39:28.414+0000 7f7adab2b800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:39:28.487 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2023-12-03T11:39:28.419+0000 7f7ad6832640 0 -- 172.21.15.44:0/2010397879 >> [v2:172.21.15.91:6808/776869758,v1:172.21.15.91:6809/776869758] conn(0x7f7ad0031060 msgr2=0x7f7ad008b8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:28.487 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2023-12-03T11:39:28.419+0000 7f7ab77fe640 1 client.6872.objecter ms_handle_reset 0x7f7ad0031060 session 0x7f7ad005fea0 osd.7 2023-12-03T11:39:28.487 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2023-12-03T11:39:28.419+0000 7f7ad6832640 10 monclient: get_auth_request con 0x55ce360bac00 auth_method 0 2023-12-03T11:39:28.487 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2023-12-03T11:39:28.424+0000 7f7adab2b800 20 add_watcher() i=0 2023-12-03T11:39:28.487 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2023-12-03T11:39:28.424+0000 7f7adab2b800 20 add_watcher() i=1 2023-12-03T11:39:28.487 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2023-12-03T11:39:28.424+0000 7f7adab2b800 20 add_watcher() i=2 2023-12-03T11:39:28.487 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2023-12-03T11:39:28.424+0000 7f7adab2b800 20 add_watcher() i=3 2023-12-03T11:39:28.487 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2023-12-03T11:39:28.424+0000 7f7adab2b800 20 add_watcher() i=4 2023-12-03T11:39:28.487 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2023-12-03T11:39:28.424+0000 7f7adab2b800 20 add_watcher() i=5 2023-12-03T11:39:28.487 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2023-12-03T11:39:28.424+0000 7f7adab2b800 20 add_watcher() i=6 2023-12-03T11:39:28.487 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2023-12-03T11:39:28.425+0000 7f7adab2b800 20 add_watcher() i=7 2023-12-03T11:39:28.488 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2023-12-03T11:39:28.425+0000 7f7adab2b800 2 all 8 watchers are set, enabling cache 2023-12-03T11:39:28.488 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2023-12-03T11:39:28.426+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding auth protocol: cephx 2023-12-03T11:39:28.488 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2023-12-03T11:39:28.426+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding auth protocol: cephx 2023-12-03T11:39:28.488 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding auth protocol: cephx 2023-12-03T11:39:28.488 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: secure 2023-12-03T11:39:28.488 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: crc 2023-12-03T11:39:28.488 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: secure 2023-12-03T11:39:28.488 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: crc 2023-12-03T11:39:28.488 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: secure 2023-12-03T11:39:28.488 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: crc 2023-12-03T11:39:28.488 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: crc 2023-12-03T11:39:28.488 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: secure 2023-12-03T11:39:28.488 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: crc 2023-12-03T11:39:28.488 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: secure 2023-12-03T11:39:28.489 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: crc 2023-12-03T11:39:28.489 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: secure 2023-12-03T11:39:28.489 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2023-12-03T11:39:28.426+0000 7f7a17fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:28.489 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2023-12-03T11:39:28.427+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.489 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2023-12-03T11:39:28.427+0000 7f7adab2b800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:39:28.489 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2023-12-03T11:39:28.427+0000 7f7adab2b800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:39:28.489 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command cache list hook 0x55ce36046400 2023-12-03T11:39:28.489 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command cache inspect hook 0x55ce36046400 2023-12-03T11:39:28.489 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command cache erase hook 0x55ce36046400 2023-12-03T11:39:28.489 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command cache zap hook 0x55ce36046400 2023-12-03T11:39:28.489 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2023-12-03T11:39:28.427+0000 7f7adab2b800 10 monclient: get_monmap_and_config 2023-12-03T11:39:28.489 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2023-12-03T11:39:28.427+0000 7f7adab2b800 10 monclient: build_initial_monmap 2023-12-03T11:39:28.489 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2023-12-03T11:39:28.427+0000 7f7adab2b800 1 build_initial for_mkfs: 0 2023-12-03T11:39:28.489 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2023-12-03T11:39:28.427+0000 7f7adab2b800 10 monclient: monmap: 2023-12-03T11:39:28.489 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:39:28.490 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:39:28.490 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:39:28.490 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:39:28.490 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:39:28.490 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.490 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:39:28.490 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:39:28.490 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:39:28.490 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.490 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding auth protocol: cephx 2023-12-03T11:39:28.490 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding auth protocol: cephx 2023-12-03T11:39:28.490 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding auth protocol: cephx 2023-12-03T11:39:28.490 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: secure 2023-12-03T11:39:28.490 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: crc 2023-12-03T11:39:28.491 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: secure 2023-12-03T11:39:28.491 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: crc 2023-12-03T11:39:28.491 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: secure 2023-12-03T11:39:28.491 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: crc 2023-12-03T11:39:28.491 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: crc 2023-12-03T11:39:28.491 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: secure 2023-12-03T11:39:28.491 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: crc 2023-12-03T11:39:28.491 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: secure 2023-12-03T11:39:28.491 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: crc 2023-12-03T11:39:28.491 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: secure 2023-12-03T11:39:28.491 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2023-12-03T11:39:28.427+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.491 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2023-12-03T11:39:28.427+0000 7f7adab2b800 10 monclient: init 2023-12-03T11:39:28.491 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding auth protocol: cephx 2023-12-03T11:39:28.492 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding auth protocol: cephx 2023-12-03T11:39:28.492 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding auth protocol: cephx 2023-12-03T11:39:28.492 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: secure 2023-12-03T11:39:28.492 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: crc 2023-12-03T11:39:28.492 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: secure 2023-12-03T11:39:28.492 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: crc 2023-12-03T11:39:28.492 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: secure 2023-12-03T11:39:28.492 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: crc 2023-12-03T11:39:28.492 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: crc 2023-12-03T11:39:28.492 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: secure 2023-12-03T11:39:28.492 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: crc 2023-12-03T11:39:28.492 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: secure 2023-12-03T11:39:28.492 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: crc 2023-12-03T11:39:28.492 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: secure 2023-12-03T11:39:28.492 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2023-12-03T11:39:28.428+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.493 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2023-12-03T11:39:28.428+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.493 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2023-12-03T11:39:28.428+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command rotate-key cmddesc rotate-key hook 0x7ffe71491ef8 EEXIST 2023-12-03T11:39:28.493 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2023-12-03T11:39:28.428+0000 7f7adab2b800 10 monclient: _reopen_session rank -1 2023-12-03T11:39:28.493 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2023-12-03T11:39:28.428+0000 7f7adab2b800 10 monclient: _add_conns ranks=[2,0,1] 2023-12-03T11:39:28.493 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2023-12-03T11:39:28.428+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-c con 0x55ce360f81a0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:39:28.493 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2023-12-03T11:39:28.428+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-a con 0x55ce360f91b0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:39:28.493 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2023-12-03T11:39:28.428+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-b con 0x55ce360ec3b0 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:39:28.493 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2023-12-03T11:39:28.428+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.493 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2023-12-03T11:39:28.428+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.493 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2023-12-03T11:39:28.428+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.493 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2023-12-03T11:39:28.428+0000 7f7adab2b800 10 monclient(hunting): _renew_subs 2023-12-03T11:39:28.493 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2023-12-03T11:39:28.428+0000 7f7adab2b800 10 monclient(hunting): authenticate will time out at 1647.655034s 2023-12-03T11:39:28.493 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2023-12-03T11:39:28.428+0000 7f7ad6832640 10 monclient(hunting): get_auth_request con 0x55ce360f91b0 auth_method 0 2023-12-03T11:39:28.493 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2023-12-03T11:39:28.428+0000 7f7ad6832640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.494 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2023-12-03T11:39:28.428+0000 7f7ad6832640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.494 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2023-12-03T11:39:28.428+0000 7f7ad6832640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.494 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2023-12-03T11:39:28.428+0000 7f7ad7033640 10 monclient(hunting): get_auth_request con 0x55ce360f81a0 auth_method 0 2023-12-03T11:39:28.494 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2023-12-03T11:39:28.428+0000 7f7ad7033640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.494 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2023-12-03T11:39:28.428+0000 7f7ad7033640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.494 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2023-12-03T11:39:28.428+0000 7f7ad7033640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.494 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2023-12-03T11:39:28.428+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.494 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2023-12-03T11:39:28.428+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.494 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2023-12-03T11:39:28.428+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.494 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2023-12-03T11:39:28.428+0000 7f7ad6031640 10 monclient(hunting): get_auth_request con 0x55ce360ec3b0 auth_method 0 2023-12-03T11:39:28.494 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2023-12-03T11:39:28.428+0000 7f7ad6031640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.494 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2023-12-03T11:39:28.428+0000 7f7ad6031640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.494 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2023-12-03T11:39:28.428+0000 7f7ad6031640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.494 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2023-12-03T11:39:28.428+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.494 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2023-12-03T11:39:28.428+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.495 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2023-12-03T11:39:28.428+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.495 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2023-12-03T11:39:28.428+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.495 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2023-12-03T11:39:28.428+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.495 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2023-12-03T11:39:28.428+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.495 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2023-12-03T11:39:28.428+0000 7f7ad6832640 10 monclient(hunting): handle_auth_done global_id 7269 payload 274 2023-12-03T11:39:28.495 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2023-12-03T11:39:28.428+0000 7f7ad6832640 10 monclient: _finish_hunting 0 2023-12-03T11:39:28.495 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2023-12-03T11:39:28.428+0000 7f7ad6832640 1 monclient: found mon.noname-a 2023-12-03T11:39:28.495 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2023-12-03T11:39:28.428+0000 7f7ad6832640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2023-12-03T11:39:28.495 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2023-12-03T11:39:28.429+0000 7f7a177fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:39:28.495 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2023-12-03T11:39:28.429+0000 7f7a177fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:39:28.495 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2023-12-03T11:39:28.429+0000 7f7a177fe640 10 monclient: dump: 2023-12-03T11:39:28.495 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:39:28.495 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:39:28.495 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.495 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.496 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:39:28.496 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.496 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:39:28.496 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:39:28.496 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:39:28.496 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.496 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2023-12-03T11:39:28.429+0000 7f7a177fe640 10 monclient: _finish_auth 0 2023-12-03T11:39:28.496 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2023-12-03T11:39:28.429+0000 7f7a177fe640 10 monclient: _check_auth_tickets 2023-12-03T11:39:28.496 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2023-12-03T11:39:28.429+0000 7f7a177fe640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:39:28.496 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2023-12-03T11:39:28.429+0000 7f7a177fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:39:28.496 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2023-12-03T11:39:28.429+0000 7f7a177fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:39:28.496 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2023-12-03T11:39:28.429+0000 7f7a177fe640 10 monclient: dump: 2023-12-03T11:39:28.496 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:39:28.496 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:39:28.496 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.496 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.497 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:39:28.497 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.497 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:39:28.497 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:39:28.497 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:39:28.497 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.497 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 monclient: authenticate success, global_id 7269 2023-12-03T11:39:28.497 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2023-12-03T11:39:28.429+0000 7f7adab2b800 10 monclient: get_monmap_and_config success 2023-12-03T11:39:28.497 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2023-12-03T11:39:28.429+0000 7f7adab2b800 4 set_mon_vals no callback set 2023-12-03T11:39:28.497 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2023-12-03T11:39:28.429+0000 7f7adab2b800 10 monclient: shutdown 2023-12-03T11:39:28.497 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2023-12-03T11:39:28.429+0000 7f7adab2b800 10 monclient: build_initial_monmap 2023-12-03T11:39:28.497 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2023-12-03T11:39:28.429+0000 7f7adab2b800 1 build_initial for_mkfs: 0 2023-12-03T11:39:28.497 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2023-12-03T11:39:28.429+0000 7f7adab2b800 10 monclient: monmap: 2023-12-03T11:39:28.497 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:39:28.497 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:39:28.497 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:39:28.498 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:39:28.498 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:39:28.498 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.498 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:39:28.498 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:39:28.498 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:39:28.498 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.498 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding auth protocol: cephx 2023-12-03T11:39:28.498 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding auth protocol: cephx 2023-12-03T11:39:28.498 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding auth protocol: cephx 2023-12-03T11:39:28.498 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: secure 2023-12-03T11:39:28.498 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: crc 2023-12-03T11:39:28.498 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: secure 2023-12-03T11:39:28.498 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: crc 2023-12-03T11:39:28.499 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: secure 2023-12-03T11:39:28.499 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: crc 2023-12-03T11:39:28.499 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: crc 2023-12-03T11:39:28.499 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: secure 2023-12-03T11:39:28.499 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: crc 2023-12-03T11:39:28.499 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: secure 2023-12-03T11:39:28.499 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: crc 2023-12-03T11:39:28.499 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: secure 2023-12-03T11:39:28.499 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2023-12-03T11:39:28.430+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.499 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2023-12-03T11:39:28.430+0000 7f7adab2b800 1 librados: starting msgr at 2023-12-03T11:39:28.499 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2023-12-03T11:39:28.430+0000 7f7adab2b800 1 librados: starting objecter 2023-12-03T11:39:28.499 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command objecter_requests cmddesc objecter_requests hook 0x55ce360c2d10 EEXIST 2023-12-03T11:39:28.499 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2023-12-03T11:39:28.430+0000 7f7adab2b800 1 librados: setting wanted keys 2023-12-03T11:39:28.500 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2023-12-03T11:39:28.430+0000 7f7adab2b800 1 librados: calling monclient init 2023-12-03T11:39:28.500 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2023-12-03T11:39:28.430+0000 7f7adab2b800 10 monclient: init 2023-12-03T11:39:28.500 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding auth protocol: cephx 2023-12-03T11:39:28.500 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding auth protocol: cephx 2023-12-03T11:39:28.500 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding auth protocol: cephx 2023-12-03T11:39:28.500 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: secure 2023-12-03T11:39:28.500 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: crc 2023-12-03T11:39:28.500 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: secure 2023-12-03T11:39:28.500 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: crc 2023-12-03T11:39:28.500 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: secure 2023-12-03T11:39:28.500 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: crc 2023-12-03T11:39:28.500 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: crc 2023-12-03T11:39:28.501 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: secure 2023-12-03T11:39:28.501 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: crc 2023-12-03T11:39:28.501 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: secure 2023-12-03T11:39:28.501 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: crc 2023-12-03T11:39:28.501 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: secure 2023-12-03T11:39:28.501 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2023-12-03T11:39:28.430+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.501 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2023-12-03T11:39:28.430+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.501 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command rotate-key cmddesc rotate-key hook 0x55ce360fa2b0 EEXIST 2023-12-03T11:39:28.501 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2023-12-03T11:39:28.430+0000 7f7adab2b800 10 monclient: _reopen_session rank -1 2023-12-03T11:39:28.501 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2023-12-03T11:39:28.430+0000 7f7adab2b800 10 monclient: _add_conns ranks=[2,1,0] 2023-12-03T11:39:28.501 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2023-12-03T11:39:28.430+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-c con 0x55ce360ec3b0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:39:28.501 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2023-12-03T11:39:28.430+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-b con 0x55ce360f81a0 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:39:28.501 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2023-12-03T11:39:28.430+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-a con 0x55ce360f91b0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:39:28.501 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2023-12-03T11:39:28.430+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.501 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2023-12-03T11:39:28.430+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.502 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2023-12-03T11:39:28.430+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.502 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2023-12-03T11:39:28.430+0000 7f7adab2b800 10 monclient(hunting): _renew_subs 2023-12-03T11:39:28.502 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2023-12-03T11:39:28.430+0000 7f7adab2b800 10 monclient(hunting): authenticate will time out at 1647.657600s 2023-12-03T11:39:28.502 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2023-12-03T11:39:28.431+0000 7f7ad7033640 10 monclient(hunting): get_auth_request con 0x55ce360ec3b0 auth_method 0 2023-12-03T11:39:28.502 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2023-12-03T11:39:28.431+0000 7f7ad7033640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.502 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2023-12-03T11:39:28.431+0000 7f7ad7033640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.502 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2023-12-03T11:39:28.431+0000 7f7ad7033640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.502 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2023-12-03T11:39:28.431+0000 7f7ad6031640 10 monclient(hunting): get_auth_request con 0x55ce360f91b0 auth_method 0 2023-12-03T11:39:28.502 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2023-12-03T11:39:28.431+0000 7f7ad6031640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.502 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2023-12-03T11:39:28.431+0000 7f7ad6031640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.502 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2023-12-03T11:39:28.431+0000 7f7ad6031640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.502 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2023-12-03T11:39:28.431+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.502 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2023-12-03T11:39:28.431+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.503 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2023-12-03T11:39:28.431+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.503 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2023-12-03T11:39:28.431+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.503 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2023-12-03T11:39:28.431+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.503 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2023-12-03T11:39:28.431+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.503 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2023-12-03T11:39:28.431+0000 7f7ad6832640 10 monclient(hunting): get_auth_request con 0x55ce360f81a0 auth_method 0 2023-12-03T11:39:28.503 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2023-12-03T11:39:28.431+0000 7f7ad6832640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.503 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2023-12-03T11:39:28.431+0000 7f7ad6832640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.503 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2023-12-03T11:39:28.431+0000 7f7ad6832640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.503 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2023-12-03T11:39:28.431+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.503 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2023-12-03T11:39:28.431+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.503 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2023-12-03T11:39:28.431+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.503 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2023-12-03T11:39:28.431+0000 7f7ad6031640 10 monclient(hunting): handle_auth_done global_id 7272 payload 824 2023-12-03T11:39:28.503 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2023-12-03T11:39:28.431+0000 7f7ad6031640 10 monclient: _finish_hunting 0 2023-12-03T11:39:28.503 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2023-12-03T11:39:28.431+0000 7f7ad6031640 1 monclient: found mon.noname-a 2023-12-03T11:39:28.503 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2023-12-03T11:39:28.431+0000 7f7ad6031640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2023-12-03T11:39:28.503 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2023-12-03T11:39:28.431+0000 7f7a15ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:39:28.504 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2023-12-03T11:39:28.431+0000 7f7a15ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:39:28.504 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2023-12-03T11:39:28.431+0000 7f7a15ffb640 10 monclient: dump: 2023-12-03T11:39:28.504 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:39:28.504 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:39:28.504 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.504 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.504 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:39:28.504 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.504 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:39:28.504 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:39:28.504 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:39:28.504 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.504 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2023-12-03T11:39:28.431+0000 7f7a15ffb640 10 monclient: _finish_auth 0 2023-12-03T11:39:28.504 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2023-12-03T11:39:28.431+0000 7f7a15ffb640 10 monclient: _check_auth_tickets 2023-12-03T11:39:28.504 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2023-12-03T11:39:28.431+0000 7f7adab2b800 5 monclient: authenticate success, global_id 7272 2023-12-03T11:39:28.504 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2023-12-03T11:39:28.431+0000 7f7a15ffb640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:39:28.505 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2023-12-03T11:39:28.431+0000 7f7a15ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:39:28.505 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2023-12-03T11:39:28.431+0000 7f7a15ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:39:28.505 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2023-12-03T11:39:28.431+0000 7f7a15ffb640 10 monclient: dump: 2023-12-03T11:39:28.505 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:39:28.505 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:39:28.505 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.505 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.505 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:39:28.505 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.505 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:39:28.505 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:39:28.505 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:39:28.505 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.505 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2023-12-03T11:39:28.431+0000 7f7adab2b800 10 monclient: _renew_subs 2023-12-03T11:39:28.505 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2023-12-03T11:39:28.431+0000 7f7adab2b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2023-12-03T11:39:28.506 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2023-12-03T11:39:28.431+0000 7f7a177fe640 4 set_mon_vals no callback set 2023-12-03T11:39:28.506 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2023-12-03T11:39:28.431+0000 7f7adab2b800 10 monclient: _renew_subs 2023-12-03T11:39:28.506 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2023-12-03T11:39:28.431+0000 7f7adab2b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2023-12-03T11:39:28.506 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2023-12-03T11:39:28.431+0000 7f7adab2b800 1 librados: init done 2023-12-03T11:39:28.506 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2023-12-03T11:39:28.431+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command cr dump hook 0x55ce360f5ee8 2023-12-03T11:39:28.506 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2023-12-03T11:39:28.433+0000 7f7a15ffb640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:39:28.506 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2023-12-03T11:39:28.433+0000 7f7a15ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:39:28.507 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2023-12-03T11:39:28.433+0000 7f7a15ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:39:28.507 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2023-12-03T11:39:28.433+0000 7f7ad7033640 10 monclient: get_auth_request con 0x7f7a08069820 auth_method 0 2023-12-03T11:39:28.507 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2023-12-03T11:39:28.433+0000 7f7adab2b800 5 note: GC not initialized 2023-12-03T11:39:28.507 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2023-12-03T11:39:28.433+0000 7f7a06ffd640 20 reqs_thread_entry: start 2023-12-03T11:39:28.507 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2023-12-03T11:39:28.433+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command sync trace show hook 0x7f7ac80043a0 2023-12-03T11:39:28.507 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2023-12-03T11:39:28.433+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command sync trace history hook 0x7f7ac80043a0 2023-12-03T11:39:28.507 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2023-12-03T11:39:28.433+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command sync trace active hook 0x7f7ac80043a0 2023-12-03T11:39:28.507 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2023-12-03T11:39:28.433+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command sync trace active_short hook 0x7f7ac80043a0 2023-12-03T11:39:28.508 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2023-12-03T11:39:28.433+0000 7f7adab2b800 20 init_complete bucket index max shards: 1 2023-12-03T11:39:28.508 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2023-12-03T11:39:28.433+0000 7f7adab2b800 20 Filter name: none 2023-12-03T11:39:28.508 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2023-12-03T11:39:28.433+0000 7f7a04ff9640 20 reqs_thread_entry: start 2023-12-03T11:39:28.508 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2023-12-03T11:39:28.433+0000 7f7adab2b800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2023-12-03T11:39:28.508 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2023-12-03T11:39:28.433+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.508 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2023-12-03T11:39:28.434+0000 7f7adab2b800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:39:28.508 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2023-12-03T11:39:28.434+0000 7f7adab2b800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2023-12-03T11:39:28.508 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2023-12-03T11:39:28.434+0000 7f7adab2b800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2023-12-03T11:39:28.509 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2023-12-03T11:39:28.434+0000 7f7adab2b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 : miss 2023-12-03T11:39:28.509 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2023-12-03T11:39:28.434+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.509 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2023-12-03T11:39:28.434+0000 7f7adab2b800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:39:28.509 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2023-12-03T11:39:28.434+0000 7f7adab2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 info.flags=0x17 2023-12-03T11:39:28.509 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2023-12-03T11:39:28.434+0000 7f7adab2b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 to cache LRU end 2023-12-03T11:39:28.509 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2023-12-03T11:39:28.434+0000 7f7adab2b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:39:28.509 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2023-12-03T11:39:28.434+0000 7f7adab2b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:28.510 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2023-12-03T11:39:28.434+0000 7f7adab2b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 2023-12-03T11:39:28.510 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2023-12-03T11:39:28.435+0000 7f7ad6832640 10 monclient: get_auth_request con 0x55ce36147140 auth_method 0 2023-12-03T11:39:28.510 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2023-12-03T11:39:28.438+0000 7f7adab2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 info.flags=0x17 2023-12-03T11:39:28.510 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2023-12-03T11:39:28.438+0000 7f7adab2b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 to cache LRU end 2023-12-03T11:39:28.510 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2023-12-03T11:39:28.438+0000 7f7adab2b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:28.510 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2023-12-03T11:39:28.438+0000 7f7adab2b800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27, ofs0, ns] 2023-12-03T11:39:28.510 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2023-12-03T11:39:28.439+0000 7f7acd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693290 cookie 94344158385328 notifier 6872 bl.length()=873 2023-12-03T11:39:28.511 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2023-12-03T11:39:28.439+0000 7f7acd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 info.flags=0x17 2023-12-03T11:39:28.511 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2023-12-03T11:39:28.439+0000 7f7acd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 to cache LRU end 2023-12-03T11:39:28.511 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2023-12-03T11:39:28.439+0000 7f7acd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:28.511 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2023-12-03T11:39:28.439+0000 7f7adab2b800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27]): orig_sources= new_sources= 2023-12-03T11:39:28.511 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2023-12-03T11:39:28.439+0000 7f7adab2b800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27]): potential sources added=[] removed=[] 2023-12-03T11:39:28.511 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2023-12-03T11:39:28.439+0000 7f7adab2b800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27]): orig_dests= new_dests= 2023-12-03T11:39:28.512 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2023-12-03T11:39:28.439+0000 7f7adab2b800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27]): potential dests added=[] removed=[] 2023-12-03T11:39:28.512 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2023-12-03T11:39:28.441+0000 7f7adab2b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7adab2b800 time 2023-12-03T11:39:28.442589+0000 2023-12-03T11:39:28.512 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:39:28.512 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.512 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:39:28.512 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7add76eef8] 2023-12-03T11:39:28.512 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7add76f0b6] 2023-12-03T11:39:28.512 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ce34f60a71] 2023-12-03T11:39:28.513 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55ce34f6cf34] 2023-12-03T11:39:28.513 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2023-12-03T11:39:28.513 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f7adb03feb0] 2023-12-03T11:39:28.513 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2023-12-03T11:39:28.513 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2023-12-03T11:39:28.514 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.514 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2023-12-03T11:39:28.442+0000 7f7adab2b800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:39:28.514 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f7adab2b800 thread_name:radosgw-admin 2023-12-03T11:39:28.514 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.514 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:39:28.515 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7adb054db0] 2023-12-03T11:39:28.515 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f7adb0a154c] 2023-12-03T11:39:28.515 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2023-12-03T11:39:28.515 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2023-12-03T11:39:28.515 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7add76ef52] 2023-12-03T11:39:28.515 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7add76f0b6] 2023-12-03T11:39:28.515 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ce34f60a71] 2023-12-03T11:39:28.516 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55ce34f6cf34] 2023-12-03T11:39:28.516 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2023-12-03T11:39:28.516 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f7adb03feb0] 2023-12-03T11:39:28.516 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2023-12-03T11:39:28.516 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2023-12-03T11:39:28.516 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:39:28.516 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.517 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2023-12-03T11:39:28.517 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2023-12-03T11:39:28.517 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2023-12-03T11:39:28.517 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2023-12-03T11:39:28.517 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2023-12-03T11:39:28.517 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2023-12-03T11:39:28.517 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2023-12-03T11:39:28.518 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2023-12-03T11:39:28.518 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2023-12-03T11:39:28.518 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2023-12-03T11:39:28.518 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2023-12-03T11:39:28.518 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2023-12-03T11:39:28.518 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2023-12-03T11:39:28.518 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2023-12-03T11:39:28.519 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2023-12-03T11:39:28.519 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2023-12-03T11:39:28.519 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2023-12-03T11:39:28.519 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2023-12-03T11:39:28.519 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2023-12-03T11:39:28.519 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2023-12-03T11:39:28.519 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2023-12-03T11:39:28.520 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2023-12-03T11:39:28.520 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2023-12-03T11:39:28.520 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:39:28.520 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2023-12-03T11:39:28.520 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2023-12-03T11:39:28.520 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2023-12-03T11:39:28.520 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2023-12-03T11:39:28.520 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2023-12-03T11:39:28.520 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2023-12-03T11:39:28.521 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2023-12-03T11:39:28.521 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2023-12-03T11:39:28.521 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2023-12-03T11:39:28.521 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2023-12-03T11:39:28.521 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2023-12-03T11:39:28.521 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2023-12-03T11:39:28.521 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2023-12-03T11:39:28.521 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2023-12-03T11:39:28.522 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2023-12-03T11:39:28.522 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2023-12-03T11:39:28.522 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2023-12-03T11:39:28.522 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2023-12-03T11:39:28.522 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2023-12-03T11:39:28.522 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2023-12-03T11:39:28.522 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2023-12-03T11:39:28.522 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:39:28.523 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2023-12-03T11:39:28.523 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2023-12-03T11:39:28.523 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2023-12-03T11:39:28.523 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2023-12-03T11:39:28.523 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2023-12-03T11:39:28.523 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2023-12-03T11:39:28.523 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2023-12-03T11:39:28.524 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2023-12-03T11:39:28.524 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2023-12-03T11:39:28.524 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2023-12-03T11:39:28.524 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2023-12-03T11:39:28.524 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2023-12-03T11:39:28.524 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2023-12-03T11:39:28.524 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2023-12-03T11:39:28.524 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2023-12-03T11:39:28.525 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2023-12-03T11:39:28.525 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2023-12-03T11:39:28.525 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2023-12-03T11:39:28.525 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:39:28.525 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2023-12-03T11:39:28.525 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:39:28.525 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2023-12-03T11:39:28.525 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2023-12-03T11:39:28.526 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2023-12-03T11:39:28.526 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2023-12-03T11:39:28.526 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2023-12-03T11:39:28.526 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2023-12-03T11:39:28.526 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:39:28.526 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2023-12-03T11:39:28.526 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2023-12-03T11:39:28.526 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:39:28.527 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2023-12-03T11:39:28.527 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2023-12-03T11:39:28.527 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2023-12-03T11:39:28.527 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2023-12-03T11:39:28.527 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2023-12-03T11:39:28.527 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2023-12-03T11:39:28.527 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2023-12-03T11:39:28.527 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2023-12-03T11:39:28.528 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2023-12-03T11:39:28.528 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2023-12-03T11:39:28.528 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2023-12-03T11:39:28.528 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2023-12-03T11:39:28.528 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:39:28.528 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7a04ff9640 / http_manager 2023-12-03T11:39:28.528 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7a06ffd640 / http_manager 2023-12-03T11:39:28.529 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7a15ffb640 / ms_dispatch 2023-12-03T11:39:28.529 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7a177fe640 / io_context_pool 2023-12-03T11:39:28.529 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7a17fff640 / rgw_dt_lg_renew 2023-12-03T11:39:28.529 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7ab77fe640 / ms_dispatch 2023-12-03T11:39:28.529 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7acd7fa640 / io_context_pool 2023-12-03T11:39:28.529 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7acffff640 / ms_dispatch 2023-12-03T11:39:28.529 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7ad6031640 / msgr-worker-2 2023-12-03T11:39:28.529 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7ad6832640 / msgr-worker-1 2023-12-03T11:39:28.530 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7ad7033640 / msgr-worker-0 2023-12-03T11:39:28.530 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7adab2b800 / radosgw-admin 2023-12-03T11:39:28.530 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2023-12-03T11:39:28.530 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2023-12-03T11:39:28.530 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/log/ceph/ceph-client.admin.104635.log 2023-12-03T11:39:28.530 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2023-12-03T11:39:28.530 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2023-12-03T11:39:28.531 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2023-12-03T11:39:28.392+0000 7f7adab2b800 10 monclient: _renew_subs 2023-12-03T11:39:28.531 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2023-12-03T11:39:28.392+0000 7f7adab2b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2023-12-03T11:39:28.531 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2023-12-03T11:39:28.392+0000 7f7adab2b800 1 librados: init done 2023-12-03T11:39:28.531 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2023-12-03T11:39:28.393+0000 7f7adab2b800 10 monclient: get_monmap_and_config 2023-12-03T11:39:28.531 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2023-12-03T11:39:28.393+0000 7f7adab2b800 10 monclient: build_initial_monmap 2023-12-03T11:39:28.531 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2023-12-03T11:39:28.393+0000 7f7adab2b800 1 build_initial for_mkfs: 0 2023-12-03T11:39:28.531 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2023-12-03T11:39:28.393+0000 7f7adab2b800 10 monclient: monmap: 2023-12-03T11:39:28.532 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:39:28.532 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:39:28.532 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:39:28.532 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:39:28.532 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:39:28.532 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.532 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:39:28.532 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:39:28.533 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:39:28.533 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.533 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding auth protocol: cephx 2023-12-03T11:39:28.533 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding auth protocol: cephx 2023-12-03T11:39:28.533 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding auth protocol: cephx 2023-12-03T11:39:28.533 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: secure 2023-12-03T11:39:28.534 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: crc 2023-12-03T11:39:28.534 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: secure 2023-12-03T11:39:28.534 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: crc 2023-12-03T11:39:28.534 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: secure 2023-12-03T11:39:28.534 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: crc 2023-12-03T11:39:28.534 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: crc 2023-12-03T11:39:28.534 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: secure 2023-12-03T11:39:28.535 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: crc 2023-12-03T11:39:28.535 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: secure 2023-12-03T11:39:28.535 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: crc 2023-12-03T11:39:28.535 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061de0) adding con mode: secure 2023-12-03T11:39:28.535 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2023-12-03T11:39:28.393+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.535 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2023-12-03T11:39:28.393+0000 7f7adab2b800 10 monclient: init 2023-12-03T11:39:28.535 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding auth protocol: cephx 2023-12-03T11:39:28.536 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding auth protocol: cephx 2023-12-03T11:39:28.536 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding auth protocol: cephx 2023-12-03T11:39:28.536 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: secure 2023-12-03T11:39:28.536 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: crc 2023-12-03T11:39:28.536 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: secure 2023-12-03T11:39:28.536 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: crc 2023-12-03T11:39:28.536 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: secure 2023-12-03T11:39:28.536 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: crc 2023-12-03T11:39:28.537 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: crc 2023-12-03T11:39:28.537 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: secure 2023-12-03T11:39:28.537 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: crc 2023-12-03T11:39:28.537 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: secure 2023-12-03T11:39:28.537 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: crc 2023-12-03T11:39:28.537 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2023-12-03T11:39:28.393+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491830) adding con mode: secure 2023-12-03T11:39:28.537 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2023-12-03T11:39:28.393+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.537 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2023-12-03T11:39:28.394+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.538 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2023-12-03T11:39:28.394+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command rotate-key cmddesc rotate-key hook 0x7ffe71491978 EEXIST 2023-12-03T11:39:28.538 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2023-12-03T11:39:28.394+0000 7f7adab2b800 10 monclient: _reopen_session rank -1 2023-12-03T11:39:28.538 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2023-12-03T11:39:28.394+0000 7f7adab2b800 10 monclient: _add_conns ranks=[1,2,0] 2023-12-03T11:39:28.538 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2023-12-03T11:39:28.394+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-b con 0x55ce360966c0 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:39:28.538 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2023-12-03T11:39:28.394+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-c con 0x55ce36096aa0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:39:28.538 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2023-12-03T11:39:28.394+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-a con 0x55ce36092620 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:39:28.538 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2023-12-03T11:39:28.394+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.539 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2023-12-03T11:39:28.394+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.539 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2023-12-03T11:39:28.394+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.539 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2023-12-03T11:39:28.394+0000 7f7adab2b800 10 monclient(hunting): _renew_subs 2023-12-03T11:39:28.539 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2023-12-03T11:39:28.394+0000 7f7adab2b800 10 monclient(hunting): authenticate will time out at 1647.620820s 2023-12-03T11:39:28.539 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2023-12-03T11:39:28.394+0000 7f7ad6832640 10 monclient(hunting): get_auth_request con 0x55ce36096aa0 auth_method 0 2023-12-03T11:39:28.539 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2023-12-03T11:39:28.394+0000 7f7ad6832640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.539 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2023-12-03T11:39:28.394+0000 7f7ad6832640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.540 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2023-12-03T11:39:28.394+0000 7f7ad6832640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.540 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2023-12-03T11:39:28.394+0000 7f7ad7033640 10 monclient(hunting): get_auth_request con 0x55ce360966c0 auth_method 0 2023-12-03T11:39:28.540 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2023-12-03T11:39:28.394+0000 7f7ad7033640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.540 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2023-12-03T11:39:28.394+0000 7f7ad7033640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.540 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2023-12-03T11:39:28.394+0000 7f7ad7033640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.540 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2023-12-03T11:39:28.394+0000 7f7ad6031640 10 monclient(hunting): get_auth_request con 0x55ce36092620 auth_method 0 2023-12-03T11:39:28.540 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2023-12-03T11:39:28.394+0000 7f7ad6031640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.541 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2023-12-03T11:39:28.394+0000 7f7ad6031640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.541 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2023-12-03T11:39:28.394+0000 7f7ad6031640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.541 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2023-12-03T11:39:28.394+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.541 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2023-12-03T11:39:28.394+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.541 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2023-12-03T11:39:28.394+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.541 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2023-12-03T11:39:28.394+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.541 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2023-12-03T11:39:28.394+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.542 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2023-12-03T11:39:28.394+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.542 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2023-12-03T11:39:28.394+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.542 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2023-12-03T11:39:28.394+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.542 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2023-12-03T11:39:28.394+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.542 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2023-12-03T11:39:28.394+0000 7f7ad6832640 10 monclient(hunting): handle_auth_done global_id 6869 payload 274 2023-12-03T11:39:28.542 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2023-12-03T11:39:28.394+0000 7f7ad6832640 10 monclient: _finish_hunting 0 2023-12-03T11:39:28.543 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2023-12-03T11:39:28.394+0000 7f7acffff640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:39:28.543 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2023-12-03T11:39:28.394+0000 7f7ad6832640 1 monclient: found mon.noname-c 2023-12-03T11:39:28.543 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2023-12-03T11:39:28.394+0000 7f7acffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:39:28.543 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2023-12-03T11:39:28.394+0000 7f7acffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:39:28.543 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2023-12-03T11:39:28.394+0000 7f7ad6832640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2023-12-03T11:39:28.543 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2023-12-03T11:39:28.394+0000 7f7ad7033640 10 monclient: get_auth_request con 0x7f7ab8069820 auth_method 0 2023-12-03T11:39:28.543 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2023-12-03T11:39:28.394+0000 7f7acd7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:39:28.543 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2023-12-03T11:39:28.394+0000 7f7acd7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:39:28.543 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2023-12-03T11:39:28.394+0000 7f7acd7fa640 10 monclient: dump: 2023-12-03T11:39:28.543 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:39:28.543 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:39:28.543 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.543 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.543 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:39:28.543 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.544 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:39:28.544 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:39:28.544 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:39:28.544 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.544 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2023-12-03T11:39:28.394+0000 7f7acd7fa640 10 monclient: _finish_auth 0 2023-12-03T11:39:28.544 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2023-12-03T11:39:28.394+0000 7f7acd7fa640 10 monclient: _check_auth_tickets 2023-12-03T11:39:28.544 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2023-12-03T11:39:28.394+0000 7f7acd7fa640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:39:28.544 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2023-12-03T11:39:28.394+0000 7f7adab2b800 5 monclient: authenticate success, global_id 6869 2023-12-03T11:39:28.544 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2023-12-03T11:39:28.394+0000 7f7adab2b800 10 monclient: get_monmap_and_config success 2023-12-03T11:39:28.544 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2023-12-03T11:39:28.394+0000 7f7adab2b800 4 set_mon_vals no callback set 2023-12-03T11:39:28.544 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2023-12-03T11:39:28.394+0000 7f7acd7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:39:28.544 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2023-12-03T11:39:28.394+0000 7f7acd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:39:28.545 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2023-12-03T11:39:28.394+0000 7f7acd7fa640 10 monclient: dump: 2023-12-03T11:39:28.545 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:39:28.545 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:39:28.545 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.545 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.545 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:39:28.545 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.545 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:39:28.545 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:39:28.545 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:39:28.545 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.545 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2023-12-03T11:39:28.395+0000 7f7adab2b800 10 monclient: shutdown 2023-12-03T11:39:28.545 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2023-12-03T11:39:28.395+0000 7f7adab2b800 10 monclient: build_initial_monmap 2023-12-03T11:39:28.545 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2023-12-03T11:39:28.395+0000 7f7adab2b800 1 build_initial for_mkfs: 0 2023-12-03T11:39:28.545 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2023-12-03T11:39:28.395+0000 7f7adab2b800 10 monclient: monmap: 2023-12-03T11:39:28.545 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:39:28.546 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:39:28.546 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:39:28.546 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:39:28.546 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:39:28.546 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.546 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:39:28.546 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:39:28.546 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:39:28.547 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.547 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding auth protocol: cephx 2023-12-03T11:39:28.547 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding auth protocol: cephx 2023-12-03T11:39:28.547 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding auth protocol: cephx 2023-12-03T11:39:28.547 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: secure 2023-12-03T11:39:28.547 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: crc 2023-12-03T11:39:28.547 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: secure 2023-12-03T11:39:28.547 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: crc 2023-12-03T11:39:28.547 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: secure 2023-12-03T11:39:28.547 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: crc 2023-12-03T11:39:28.547 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: crc 2023-12-03T11:39:28.547 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: secure 2023-12-03T11:39:28.548 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: crc 2023-12-03T11:39:28.548 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: secure 2023-12-03T11:39:28.548 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: crc 2023-12-03T11:39:28.548 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 AuthRegistry(0x55ce36061cb0) adding con mode: secure 2023-12-03T11:39:28.548 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2023-12-03T11:39:28.395+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.548 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2023-12-03T11:39:28.395+0000 7f7adab2b800 1 librados: starting msgr at 2023-12-03T11:39:28.548 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2023-12-03T11:39:28.395+0000 7f7adab2b800 1 librados: starting objecter 2023-12-03T11:39:28.548 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2023-12-03T11:39:28.395+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command objecter_requests cmddesc objecter_requests hook 0x55ce36067290 EEXIST 2023-12-03T11:39:28.548 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2023-12-03T11:39:28.396+0000 7f7adab2b800 1 librados: setting wanted keys 2023-12-03T11:39:28.548 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2023-12-03T11:39:28.396+0000 7f7adab2b800 1 librados: calling monclient init 2023-12-03T11:39:28.548 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2023-12-03T11:39:28.396+0000 7f7adab2b800 10 monclient: init 2023-12-03T11:39:28.548 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding auth protocol: cephx 2023-12-03T11:39:28.548 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding auth protocol: cephx 2023-12-03T11:39:28.548 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding auth protocol: cephx 2023-12-03T11:39:28.548 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: secure 2023-12-03T11:39:28.549 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: crc 2023-12-03T11:39:28.549 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: secure 2023-12-03T11:39:28.549 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: crc 2023-12-03T11:39:28.549 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: secure 2023-12-03T11:39:28.549 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: crc 2023-12-03T11:39:28.549 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: crc 2023-12-03T11:39:28.549 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: secure 2023-12-03T11:39:28.549 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: crc 2023-12-03T11:39:28.549 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: secure 2023-12-03T11:39:28.549 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: crc 2023-12-03T11:39:28.549 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 AuthRegistry(0x55ce35fa0c18) adding con mode: secure 2023-12-03T11:39:28.549 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2023-12-03T11:39:28.396+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.549 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2023-12-03T11:39:28.396+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.549 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2023-12-03T11:39:28.396+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command rotate-key cmddesc rotate-key hook 0x55ce35fa0d60 EEXIST 2023-12-03T11:39:28.549 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2023-12-03T11:39:28.396+0000 7f7adab2b800 10 monclient: _reopen_session rank -1 2023-12-03T11:39:28.550 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2023-12-03T11:39:28.396+0000 7f7adab2b800 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:39:28.550 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2023-12-03T11:39:28.396+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-b con 0x55ce36092620 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:39:28.550 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2023-12-03T11:39:28.396+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-a con 0x55ce360966c0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:39:28.550 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2023-12-03T11:39:28.396+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-c con 0x55ce3608ee00 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:39:28.550 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2023-12-03T11:39:28.396+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.550 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2023-12-03T11:39:28.396+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.550 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2023-12-03T11:39:28.396+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.550 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2023-12-03T11:39:28.396+0000 7f7adab2b800 10 monclient(hunting): _renew_subs 2023-12-03T11:39:28.550 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2023-12-03T11:39:28.396+0000 7f7adab2b800 10 monclient(hunting): authenticate will time out at 1647.623239s 2023-12-03T11:39:28.550 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2023-12-03T11:39:28.396+0000 7f7ad6031640 10 monclient(hunting): get_auth_request con 0x55ce360966c0 auth_method 0 2023-12-03T11:39:28.550 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2023-12-03T11:39:28.396+0000 7f7ad6031640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.550 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2023-12-03T11:39:28.396+0000 7f7ad6031640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.550 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2023-12-03T11:39:28.396+0000 7f7ad6031640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.550 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2023-12-03T11:39:28.396+0000 7f7ad7033640 10 monclient(hunting): get_auth_request con 0x55ce3608ee00 auth_method 0 2023-12-03T11:39:28.551 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2023-12-03T11:39:28.396+0000 7f7ad7033640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.551 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2023-12-03T11:39:28.396+0000 7f7ad7033640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.551 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2023-12-03T11:39:28.396+0000 7f7ad7033640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.551 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2023-12-03T11:39:28.396+0000 7f7ad6832640 10 monclient(hunting): get_auth_request con 0x55ce36092620 auth_method 0 2023-12-03T11:39:28.551 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2023-12-03T11:39:28.396+0000 7f7ad6832640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.551 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2023-12-03T11:39:28.396+0000 7f7ad6832640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.551 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2023-12-03T11:39:28.396+0000 7f7ad6832640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.551 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2023-12-03T11:39:28.396+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.551 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2023-12-03T11:39:28.396+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.551 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2023-12-03T11:39:28.396+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.551 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2023-12-03T11:39:28.396+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.551 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2023-12-03T11:39:28.396+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.551 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2023-12-03T11:39:28.396+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.551 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2023-12-03T11:39:28.396+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.551 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2023-12-03T11:39:28.396+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.552 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2023-12-03T11:39:28.396+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.552 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2023-12-03T11:39:28.396+0000 7f7ad7033640 10 monclient(hunting): handle_auth_done global_id 6872 payload 824 2023-12-03T11:39:28.552 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2023-12-03T11:39:28.396+0000 7f7ad7033640 10 monclient: _finish_hunting 0 2023-12-03T11:39:28.552 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2023-12-03T11:39:28.396+0000 7f7ad7033640 1 monclient: found mon.noname-c 2023-12-03T11:39:28.552 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2023-12-03T11:39:28.396+0000 7f7ad7033640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2023-12-03T11:39:28.552 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2023-12-03T11:39:28.397+0000 7f7ab77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:39:28.552 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2023-12-03T11:39:28.397+0000 7f7ab77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:39:28.552 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2023-12-03T11:39:28.397+0000 7f7ab77fe640 10 monclient: dump: 2023-12-03T11:39:28.552 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:39:28.552 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:39:28.552 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.552 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.552 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:39:28.552 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.552 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:39:28.552 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:39:28.552 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:39:28.553 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.553 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2023-12-03T11:39:28.397+0000 7f7ab77fe640 10 monclient: _finish_auth 0 2023-12-03T11:39:28.553 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2023-12-03T11:39:28.397+0000 7f7ab77fe640 10 monclient: _check_auth_tickets 2023-12-03T11:39:28.553 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2023-12-03T11:39:28.397+0000 7f7ab77fe640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:39:28.553 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2023-12-03T11:39:28.397+0000 7f7ab77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:39:28.553 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2023-12-03T11:39:28.397+0000 7f7ab77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:39:28.553 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2023-12-03T11:39:28.397+0000 7f7ab77fe640 10 monclient: dump: 2023-12-03T11:39:28.553 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:39:28.553 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:39:28.553 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.553 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.553 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:39:28.553 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.553 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:39:28.553 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:39:28.553 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:39:28.554 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.554 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2023-12-03T11:39:28.397+0000 7f7adab2b800 5 monclient: authenticate success, global_id 6872 2023-12-03T11:39:28.554 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2023-12-03T11:39:28.397+0000 7f7acd7fa640 4 set_mon_vals no callback set 2023-12-03T11:39:28.554 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2023-12-03T11:39:28.397+0000 7f7adab2b800 10 monclient: _renew_subs 2023-12-03T11:39:28.554 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2023-12-03T11:39:28.397+0000 7f7adab2b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:39:28.554 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2023-12-03T11:39:28.397+0000 7f7adab2b800 10 monclient: _renew_subs 2023-12-03T11:39:28.554 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2023-12-03T11:39:28.397+0000 7f7adab2b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:39:28.554 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2023-12-03T11:39:28.397+0000 7f7adab2b800 1 librados: init done 2023-12-03T11:39:28.555 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2023-12-03T11:39:28.398+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.555 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2023-12-03T11:39:28.399+0000 7f7ab77fe640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:39:28.555 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2023-12-03T11:39:28.399+0000 7f7ab77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:39:28.555 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2023-12-03T11:39:28.399+0000 7f7ab77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:39:28.555 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2023-12-03T11:39:28.399+0000 7f7ad6832640 10 monclient: get_auth_request con 0x7f7ab0069820 auth_method 0 2023-12-03T11:39:28.555 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2023-12-03T11:39:28.399+0000 7f7ad6031640 10 monclient: get_auth_request con 0x55ce360aebf0 auth_method 0 2023-12-03T11:39:28.555 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2023-12-03T11:39:28.400+0000 7f7adab2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.555 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2023-12-03T11:39:28.400+0000 7f7adab2b800 20 realm 2023-12-03T11:39:28.555 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2023-12-03T11:39:28.400+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.556 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2023-12-03T11:39:28.400+0000 7f7adab2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.556 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2023-12-03T11:39:28.400+0000 7f7adab2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:39:28.556 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2023-12-03T11:39:28.400+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.556 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2023-12-03T11:39:28.400+0000 7f7adab2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.556 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2023-12-03T11:39:28.400+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.556 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2023-12-03T11:39:28.400+0000 7f7ad6832640 10 monclient: get_auth_request con 0x55ce360b2b20 auth_method 0 2023-12-03T11:39:28.556 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2023-12-03T11:39:28.401+0000 7f7adab2b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:28.557 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2023-12-03T11:39:28.401+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.557 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2023-12-03T11:39:28.401+0000 7f7ad6031640 10 monclient: get_auth_request con 0x55ce360b6310 auth_method 0 2023-12-03T11:39:28.557 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2023-12-03T11:39:28.402+0000 7f7adab2b800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:39:28.557 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2023-12-03T11:39:28.402+0000 7f7adab2b800 20 searching for the correct realm 2023-12-03T11:39:28.557 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2023-12-03T11:39:28.402+0000 7f7ad7033640 10 monclient: get_auth_request con 0x55ce360bac00 auth_method 0 2023-12-03T11:39:28.557 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2023-12-03T11:39:28.403+0000 7f7ad6832640 10 monclient: get_auth_request con 0x7f7ad0031060 auth_method 0 2023-12-03T11:39:28.558 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2023-12-03T11:39:28.404+0000 7f7ad6031640 10 monclient: get_auth_request con 0x7f7ac0002040 auth_method 0 2023-12-03T11:39:28.558 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2023-12-03T11:39:28.405+0000 7f7ad7033640 10 monclient: get_auth_request con 0x7f7ac0017070 auth_method 0 2023-12-03T11:39:28.558 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2023-12-03T11:39:28.407+0000 7f7ad6832640 10 monclient: get_auth_request con 0x7f7ac006bbe0 auth_method 0 2023-12-03T11:39:28.558 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2023-12-03T11:39:28.410+0000 7f7ad7033640 0 -- 172.21.15.44:0/2010397879 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55ce360bac00 msgr2=0x55ce360bd0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:28.558 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2023-12-03T11:39:28.410+0000 7f7ab77fe640 1 client.6872.objecter ms_handle_reset 0x55ce360bac00 session 0x55ce360ba580 osd.3 2023-12-03T11:39:28.558 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2023-12-03T11:39:28.410+0000 7f7ab77fe640 10 monclient: _renew_subs 2023-12-03T11:39:28.558 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2023-12-03T11:39:28.410+0000 7f7ab77fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2023-12-03T11:39:28.559 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2023-12-03T11:39:28.411+0000 7f7ad7033640 10 monclient: get_auth_request con 0x7f7ab0079e10 auth_method 0 2023-12-03T11:39:28.559 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2023-12-03T11:39:28.412+0000 7f7adab2b800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:39:28.559 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2023-12-03T11:39:28.412+0000 7f7adab2b800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:39:28.559 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2023-12-03T11:39:28.412+0000 7f7adab2b800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:39:28.559 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2023-12-03T11:39:28.412+0000 7f7adab2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:39:28.559 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2023-12-03T11:39:28.412+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.559 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2023-12-03T11:39:28.412+0000 7f7adab2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.559 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2023-12-03T11:39:28.412+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.560 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2023-12-03T11:39:28.413+0000 7f7adab2b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:28.560 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2023-12-03T11:39:28.413+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.560 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2023-12-03T11:39:28.413+0000 7f7adab2b800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:39:28.560 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2023-12-03T11:39:28.413+0000 7f7adab2b800 20 zone default found 2023-12-03T11:39:28.560 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2023-12-03T11:39:28.413+0000 7f7adab2b800 4 Realm: () 2023-12-03T11:39:28.560 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2023-12-03T11:39:28.413+0000 7f7adab2b800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:39:28.560 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2023-12-03T11:39:28.413+0000 7f7adab2b800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:39:28.560 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2023-12-03T11:39:28.413+0000 7f7adab2b800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:39:28.560 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2023-12-03T11:39:28.413+0000 7f7adab2b800 20 zonegroup default 2023-12-03T11:39:28.561 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2023-12-03T11:39:28.413+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.561 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2023-12-03T11:39:28.414+0000 7f7adab2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.561 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2023-12-03T11:39:28.414+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.561 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2023-12-03T11:39:28.414+0000 7f7adab2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.561 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2023-12-03T11:39:28.414+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.561 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2023-12-03T11:39:28.414+0000 7f7adab2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.561 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2023-12-03T11:39:28.414+0000 7f7adab2b800 20 started sync module instance, tier type = 2023-12-03T11:39:28.562 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2023-12-03T11:39:28.414+0000 7f7adab2b800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:39:28.562 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2023-12-03T11:39:28.419+0000 7f7ad6832640 0 -- 172.21.15.44:0/2010397879 >> [v2:172.21.15.91:6808/776869758,v1:172.21.15.91:6809/776869758] conn(0x7f7ad0031060 msgr2=0x7f7ad008b8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:28.562 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2023-12-03T11:39:28.419+0000 7f7ab77fe640 1 client.6872.objecter ms_handle_reset 0x7f7ad0031060 session 0x7f7ad005fea0 osd.7 2023-12-03T11:39:28.562 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2023-12-03T11:39:28.419+0000 7f7ad6832640 10 monclient: get_auth_request con 0x55ce360bac00 auth_method 0 2023-12-03T11:39:28.562 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2023-12-03T11:39:28.424+0000 7f7adab2b800 20 add_watcher() i=0 2023-12-03T11:39:28.562 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2023-12-03T11:39:28.424+0000 7f7adab2b800 20 add_watcher() i=1 2023-12-03T11:39:28.562 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2023-12-03T11:39:28.424+0000 7f7adab2b800 20 add_watcher() i=2 2023-12-03T11:39:28.563 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2023-12-03T11:39:28.424+0000 7f7adab2b800 20 add_watcher() i=3 2023-12-03T11:39:28.563 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2023-12-03T11:39:28.424+0000 7f7adab2b800 20 add_watcher() i=4 2023-12-03T11:39:28.563 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2023-12-03T11:39:28.424+0000 7f7adab2b800 20 add_watcher() i=5 2023-12-03T11:39:28.563 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2023-12-03T11:39:28.424+0000 7f7adab2b800 20 add_watcher() i=6 2023-12-03T11:39:28.563 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2023-12-03T11:39:28.425+0000 7f7adab2b800 20 add_watcher() i=7 2023-12-03T11:39:28.563 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2023-12-03T11:39:28.425+0000 7f7adab2b800 2 all 8 watchers are set, enabling cache 2023-12-03T11:39:28.563 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2023-12-03T11:39:28.426+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding auth protocol: cephx 2023-12-03T11:39:28.563 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2023-12-03T11:39:28.426+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding auth protocol: cephx 2023-12-03T11:39:28.563 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding auth protocol: cephx 2023-12-03T11:39:28.564 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: secure 2023-12-03T11:39:28.564 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: crc 2023-12-03T11:39:28.564 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: secure 2023-12-03T11:39:28.564 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: crc 2023-12-03T11:39:28.564 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: secure 2023-12-03T11:39:28.564 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: crc 2023-12-03T11:39:28.564 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: crc 2023-12-03T11:39:28.564 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: secure 2023-12-03T11:39:28.564 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: crc 2023-12-03T11:39:28.564 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: secure 2023-12-03T11:39:28.564 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: crc 2023-12-03T11:39:28.564 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71492260) adding con mode: secure 2023-12-03T11:39:28.564 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2023-12-03T11:39:28.426+0000 7f7a17fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:28.564 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2023-12-03T11:39:28.427+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.564 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2023-12-03T11:39:28.427+0000 7f7adab2b800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:39:28.564 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2023-12-03T11:39:28.427+0000 7f7adab2b800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:39:28.565 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command cache list hook 0x55ce36046400 2023-12-03T11:39:28.565 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command cache inspect hook 0x55ce36046400 2023-12-03T11:39:28.565 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command cache erase hook 0x55ce36046400 2023-12-03T11:39:28.565 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command cache zap hook 0x55ce36046400 2023-12-03T11:39:28.565 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2023-12-03T11:39:28.427+0000 7f7adab2b800 10 monclient: get_monmap_and_config 2023-12-03T11:39:28.565 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2023-12-03T11:39:28.427+0000 7f7adab2b800 10 monclient: build_initial_monmap 2023-12-03T11:39:28.565 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2023-12-03T11:39:28.427+0000 7f7adab2b800 1 build_initial for_mkfs: 0 2023-12-03T11:39:28.565 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2023-12-03T11:39:28.427+0000 7f7adab2b800 10 monclient: monmap: 2023-12-03T11:39:28.565 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:39:28.565 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:39:28.565 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:39:28.565 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:39:28.565 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:39:28.565 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.565 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:39:28.565 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:39:28.566 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:39:28.566 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.566 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding auth protocol: cephx 2023-12-03T11:39:28.566 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding auth protocol: cephx 2023-12-03T11:39:28.566 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding auth protocol: cephx 2023-12-03T11:39:28.566 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: secure 2023-12-03T11:39:28.566 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: crc 2023-12-03T11:39:28.566 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: secure 2023-12-03T11:39:28.566 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: crc 2023-12-03T11:39:28.566 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: secure 2023-12-03T11:39:28.566 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: crc 2023-12-03T11:39:28.566 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: crc 2023-12-03T11:39:28.566 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: secure 2023-12-03T11:39:28.566 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: crc 2023-12-03T11:39:28.566 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: secure 2023-12-03T11:39:28.567 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: crc 2023-12-03T11:39:28.567 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x55ce360f6c50) adding con mode: secure 2023-12-03T11:39:28.567 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2023-12-03T11:39:28.427+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.567 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2023-12-03T11:39:28.427+0000 7f7adab2b800 10 monclient: init 2023-12-03T11:39:28.567 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding auth protocol: cephx 2023-12-03T11:39:28.567 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding auth protocol: cephx 2023-12-03T11:39:28.567 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding auth protocol: cephx 2023-12-03T11:39:28.567 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: secure 2023-12-03T11:39:28.567 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: crc 2023-12-03T11:39:28.567 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: secure 2023-12-03T11:39:28.567 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: crc 2023-12-03T11:39:28.567 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: secure 2023-12-03T11:39:28.567 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: crc 2023-12-03T11:39:28.567 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: crc 2023-12-03T11:39:28.567 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: secure 2023-12-03T11:39:28.567 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: crc 2023-12-03T11:39:28.568 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: secure 2023-12-03T11:39:28.568 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: crc 2023-12-03T11:39:28.568 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2023-12-03T11:39:28.427+0000 7f7adab2b800 5 AuthRegistry(0x7ffe71491db0) adding con mode: secure 2023-12-03T11:39:28.568 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2023-12-03T11:39:28.428+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.568 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2023-12-03T11:39:28.428+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.568 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2023-12-03T11:39:28.428+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command rotate-key cmddesc rotate-key hook 0x7ffe71491ef8 EEXIST 2023-12-03T11:39:28.568 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2023-12-03T11:39:28.428+0000 7f7adab2b800 10 monclient: _reopen_session rank -1 2023-12-03T11:39:28.568 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2023-12-03T11:39:28.428+0000 7f7adab2b800 10 monclient: _add_conns ranks=[2,0,1] 2023-12-03T11:39:28.568 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2023-12-03T11:39:28.428+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-c con 0x55ce360f81a0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:39:28.568 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2023-12-03T11:39:28.428+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-a con 0x55ce360f91b0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:39:28.568 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2023-12-03T11:39:28.428+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-b con 0x55ce360ec3b0 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:39:28.568 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2023-12-03T11:39:28.428+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.568 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2023-12-03T11:39:28.428+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.568 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2023-12-03T11:39:28.428+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.568 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2023-12-03T11:39:28.428+0000 7f7adab2b800 10 monclient(hunting): _renew_subs 2023-12-03T11:39:28.569 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2023-12-03T11:39:28.428+0000 7f7adab2b800 10 monclient(hunting): authenticate will time out at 1647.655034s 2023-12-03T11:39:28.569 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2023-12-03T11:39:28.428+0000 7f7ad6832640 10 monclient(hunting): get_auth_request con 0x55ce360f91b0 auth_method 0 2023-12-03T11:39:28.569 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2023-12-03T11:39:28.428+0000 7f7ad6832640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.569 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2023-12-03T11:39:28.428+0000 7f7ad6832640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.569 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2023-12-03T11:39:28.428+0000 7f7ad6832640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.569 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2023-12-03T11:39:28.428+0000 7f7ad7033640 10 monclient(hunting): get_auth_request con 0x55ce360f81a0 auth_method 0 2023-12-03T11:39:28.569 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2023-12-03T11:39:28.428+0000 7f7ad7033640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.569 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2023-12-03T11:39:28.428+0000 7f7ad7033640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.569 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2023-12-03T11:39:28.428+0000 7f7ad7033640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.569 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2023-12-03T11:39:28.428+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.569 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2023-12-03T11:39:28.428+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.569 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2023-12-03T11:39:28.428+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.569 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2023-12-03T11:39:28.428+0000 7f7ad6031640 10 monclient(hunting): get_auth_request con 0x55ce360ec3b0 auth_method 0 2023-12-03T11:39:28.569 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2023-12-03T11:39:28.428+0000 7f7ad6031640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.569 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2023-12-03T11:39:28.428+0000 7f7ad6031640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.569 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2023-12-03T11:39:28.428+0000 7f7ad6031640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.570 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2023-12-03T11:39:28.428+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.570 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2023-12-03T11:39:28.428+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.570 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2023-12-03T11:39:28.428+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.570 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2023-12-03T11:39:28.428+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.570 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2023-12-03T11:39:28.428+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.570 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2023-12-03T11:39:28.428+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.570 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2023-12-03T11:39:28.428+0000 7f7ad6832640 10 monclient(hunting): handle_auth_done global_id 7269 payload 274 2023-12-03T11:39:28.570 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2023-12-03T11:39:28.428+0000 7f7ad6832640 10 monclient: _finish_hunting 0 2023-12-03T11:39:28.570 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2023-12-03T11:39:28.428+0000 7f7ad6832640 1 monclient: found mon.noname-a 2023-12-03T11:39:28.570 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2023-12-03T11:39:28.428+0000 7f7ad6832640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2023-12-03T11:39:28.570 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2023-12-03T11:39:28.429+0000 7f7a177fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:39:28.570 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2023-12-03T11:39:28.429+0000 7f7a177fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:39:28.570 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2023-12-03T11:39:28.429+0000 7f7a177fe640 10 monclient: dump: 2023-12-03T11:39:28.570 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:39:28.570 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:39:28.571 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.571 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.571 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:39:28.571 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.571 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:39:28.571 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:39:28.571 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:39:28.571 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.571 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2023-12-03T11:39:28.429+0000 7f7a177fe640 10 monclient: _finish_auth 0 2023-12-03T11:39:28.571 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2023-12-03T11:39:28.429+0000 7f7a177fe640 10 monclient: _check_auth_tickets 2023-12-03T11:39:28.571 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2023-12-03T11:39:28.429+0000 7f7a177fe640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:39:28.571 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2023-12-03T11:39:28.429+0000 7f7a177fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:39:28.571 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2023-12-03T11:39:28.429+0000 7f7a177fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:39:28.571 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2023-12-03T11:39:28.429+0000 7f7a177fe640 10 monclient: dump: 2023-12-03T11:39:28.571 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:39:28.572 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:39:28.572 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.572 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.572 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:39:28.572 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.572 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:39:28.572 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:39:28.572 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:39:28.572 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.572 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 monclient: authenticate success, global_id 7269 2023-12-03T11:39:28.572 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2023-12-03T11:39:28.429+0000 7f7adab2b800 10 monclient: get_monmap_and_config success 2023-12-03T11:39:28.572 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2023-12-03T11:39:28.429+0000 7f7adab2b800 4 set_mon_vals no callback set 2023-12-03T11:39:28.573 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2023-12-03T11:39:28.429+0000 7f7adab2b800 10 monclient: shutdown 2023-12-03T11:39:28.573 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2023-12-03T11:39:28.429+0000 7f7adab2b800 10 monclient: build_initial_monmap 2023-12-03T11:39:28.573 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2023-12-03T11:39:28.429+0000 7f7adab2b800 1 build_initial for_mkfs: 0 2023-12-03T11:39:28.573 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2023-12-03T11:39:28.429+0000 7f7adab2b800 10 monclient: monmap: 2023-12-03T11:39:28.573 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2023-12-03T11:39:28.573 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:39:28.573 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2023-12-03T11:39:28.573 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2023-12-03T11:39:28.573 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2023-12-03T11:39:28.573 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.573 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2023-12-03T11:39:28.573 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.noname-b 2023-12-03T11:39:28.573 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2023-12-03T11:39:28.573 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.573 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding auth protocol: cephx 2023-12-03T11:39:28.574 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding auth protocol: cephx 2023-12-03T11:39:28.574 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding auth protocol: cephx 2023-12-03T11:39:28.574 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: secure 2023-12-03T11:39:28.574 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: crc 2023-12-03T11:39:28.574 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: secure 2023-12-03T11:39:28.574 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: crc 2023-12-03T11:39:28.574 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: secure 2023-12-03T11:39:28.574 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: crc 2023-12-03T11:39:28.574 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: crc 2023-12-03T11:39:28.574 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: secure 2023-12-03T11:39:28.574 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: crc 2023-12-03T11:39:28.574 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: secure 2023-12-03T11:39:28.574 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: crc 2023-12-03T11:39:28.574 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2023-12-03T11:39:28.429+0000 7f7adab2b800 5 AuthRegistry(0x55ce360ed400) adding con mode: secure 2023-12-03T11:39:28.575 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2023-12-03T11:39:28.430+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.575 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2023-12-03T11:39:28.430+0000 7f7adab2b800 1 librados: starting msgr at 2023-12-03T11:39:28.575 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2023-12-03T11:39:28.430+0000 7f7adab2b800 1 librados: starting objecter 2023-12-03T11:39:28.575 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command objecter_requests cmddesc objecter_requests hook 0x55ce360c2d10 EEXIST 2023-12-03T11:39:28.575 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2023-12-03T11:39:28.430+0000 7f7adab2b800 1 librados: setting wanted keys 2023-12-03T11:39:28.575 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2023-12-03T11:39:28.430+0000 7f7adab2b800 1 librados: calling monclient init 2023-12-03T11:39:28.575 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2023-12-03T11:39:28.430+0000 7f7adab2b800 10 monclient: init 2023-12-03T11:39:28.575 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding auth protocol: cephx 2023-12-03T11:39:28.575 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding auth protocol: cephx 2023-12-03T11:39:28.575 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding auth protocol: cephx 2023-12-03T11:39:28.575 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: secure 2023-12-03T11:39:28.575 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: crc 2023-12-03T11:39:28.575 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: secure 2023-12-03T11:39:28.575 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: crc 2023-12-03T11:39:28.575 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: secure 2023-12-03T11:39:28.575 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: crc 2023-12-03T11:39:28.576 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: crc 2023-12-03T11:39:28.576 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: secure 2023-12-03T11:39:28.576 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: crc 2023-12-03T11:39:28.576 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: secure 2023-12-03T11:39:28.576 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: crc 2023-12-03T11:39:28.576 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 AuthRegistry(0x55ce360fa168) adding con mode: secure 2023-12-03T11:39:28.576 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2023-12-03T11:39:28.430+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.576 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2023-12-03T11:39:28.430+0000 7f7adab2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:39:28.576 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2023-12-03T11:39:28.430+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command rotate-key cmddesc rotate-key hook 0x55ce360fa2b0 EEXIST 2023-12-03T11:39:28.576 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2023-12-03T11:39:28.430+0000 7f7adab2b800 10 monclient: _reopen_session rank -1 2023-12-03T11:39:28.576 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2023-12-03T11:39:28.430+0000 7f7adab2b800 10 monclient: _add_conns ranks=[2,1,0] 2023-12-03T11:39:28.576 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2023-12-03T11:39:28.430+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-c con 0x55ce360ec3b0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2023-12-03T11:39:28.576 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2023-12-03T11:39:28.430+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-b con 0x55ce360f81a0 addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] 2023-12-03T11:39:28.577 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2023-12-03T11:39:28.430+0000 7f7adab2b800 10 monclient(hunting): picked mon.noname-a con 0x55ce360f91b0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2023-12-03T11:39:28.577 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2023-12-03T11:39:28.430+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.577 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2023-12-03T11:39:28.430+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.577 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2023-12-03T11:39:28.430+0000 7f7adab2b800 10 monclient(hunting): start opening mon connection 2023-12-03T11:39:28.577 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2023-12-03T11:39:28.430+0000 7f7adab2b800 10 monclient(hunting): _renew_subs 2023-12-03T11:39:28.577 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2023-12-03T11:39:28.430+0000 7f7adab2b800 10 monclient(hunting): authenticate will time out at 1647.657600s 2023-12-03T11:39:28.577 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2023-12-03T11:39:28.431+0000 7f7ad7033640 10 monclient(hunting): get_auth_request con 0x55ce360ec3b0 auth_method 0 2023-12-03T11:39:28.577 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2023-12-03T11:39:28.431+0000 7f7ad7033640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.577 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2023-12-03T11:39:28.431+0000 7f7ad7033640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.577 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2023-12-03T11:39:28.431+0000 7f7ad7033640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.577 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2023-12-03T11:39:28.431+0000 7f7ad6031640 10 monclient(hunting): get_auth_request con 0x55ce360f91b0 auth_method 0 2023-12-03T11:39:28.577 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2023-12-03T11:39:28.431+0000 7f7ad6031640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.577 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2023-12-03T11:39:28.431+0000 7f7ad6031640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.577 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2023-12-03T11:39:28.431+0000 7f7ad6031640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.578 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2023-12-03T11:39:28.431+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.578 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2023-12-03T11:39:28.431+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.578 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2023-12-03T11:39:28.431+0000 7f7ad7033640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.578 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2023-12-03T11:39:28.431+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.578 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2023-12-03T11:39:28.431+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.578 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2023-12-03T11:39:28.431+0000 7f7ad6031640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.578 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2023-12-03T11:39:28.431+0000 7f7ad6832640 10 monclient(hunting): get_auth_request con 0x55ce360f81a0 auth_method 0 2023-12-03T11:39:28.578 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2023-12-03T11:39:28.431+0000 7f7ad6832640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:39:28.578 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2023-12-03T11:39:28.431+0000 7f7ad6832640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:39:28.578 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2023-12-03T11:39:28.431+0000 7f7ad6832640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:39:28.578 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2023-12-03T11:39:28.431+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:39:28.578 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2023-12-03T11:39:28.431+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:39:28.579 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2023-12-03T11:39:28.431+0000 7f7ad6832640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:39:28.579 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2023-12-03T11:39:28.431+0000 7f7ad6031640 10 monclient(hunting): handle_auth_done global_id 7272 payload 824 2023-12-03T11:39:28.579 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2023-12-03T11:39:28.431+0000 7f7ad6031640 10 monclient: _finish_hunting 0 2023-12-03T11:39:28.579 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2023-12-03T11:39:28.431+0000 7f7ad6031640 1 monclient: found mon.noname-a 2023-12-03T11:39:28.579 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2023-12-03T11:39:28.431+0000 7f7ad6031640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2023-12-03T11:39:28.579 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2023-12-03T11:39:28.431+0000 7f7a15ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:39:28.579 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2023-12-03T11:39:28.431+0000 7f7a15ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:39:28.579 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2023-12-03T11:39:28.431+0000 7f7a15ffb640 10 monclient: dump: 2023-12-03T11:39:28.579 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:39:28.579 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:39:28.579 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.579 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.579 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:39:28.579 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.579 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:39:28.580 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:39:28.580 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:39:28.580 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.580 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2023-12-03T11:39:28.431+0000 7f7a15ffb640 10 monclient: _finish_auth 0 2023-12-03T11:39:28.580 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2023-12-03T11:39:28.431+0000 7f7a15ffb640 10 monclient: _check_auth_tickets 2023-12-03T11:39:28.580 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2023-12-03T11:39:28.431+0000 7f7adab2b800 5 monclient: authenticate success, global_id 7272 2023-12-03T11:39:28.580 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2023-12-03T11:39:28.431+0000 7f7a15ffb640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:39:28.580 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2023-12-03T11:39:28.431+0000 7f7a15ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:39:28.580 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2023-12-03T11:39:28.431+0000 7f7a15ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:39:28.580 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2023-12-03T11:39:28.431+0000 7f7a15ffb640 10 monclient: dump: 2023-12-03T11:39:28.580 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2023-12-03T11:39:28.580 INFO:tasks.workunit.client.0.smithi044.stderr:fsid bb5d2624-dbc6-4dd8-acfe-13ca5d09896c 2023-12-03T11:39:28.580 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.580 INFO:tasks.workunit.client.0.smithi044.stderr:created 2023-12-03T11:25:22.648441+0000 2023-12-03T11:39:28.580 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 18 (reef) 2023-12-03T11:39:28.580 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2023-12-03T11:39:28.581 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-12-03T11:39:28.581 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-12-03T11:39:28.581 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2023-12-03T11:39:28.581 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.581 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2023-12-03T11:39:28.431+0000 7f7adab2b800 10 monclient: _renew_subs 2023-12-03T11:39:28.581 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2023-12-03T11:39:28.431+0000 7f7adab2b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2023-12-03T11:39:28.581 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2023-12-03T11:39:28.431+0000 7f7a177fe640 4 set_mon_vals no callback set 2023-12-03T11:39:28.581 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2023-12-03T11:39:28.431+0000 7f7adab2b800 10 monclient: _renew_subs 2023-12-03T11:39:28.581 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2023-12-03T11:39:28.431+0000 7f7adab2b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2023-12-03T11:39:28.581 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2023-12-03T11:39:28.431+0000 7f7adab2b800 1 librados: init done 2023-12-03T11:39:28.581 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2023-12-03T11:39:28.431+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command cr dump hook 0x55ce360f5ee8 2023-12-03T11:39:28.581 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2023-12-03T11:39:28.433+0000 7f7a15ffb640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:39:28.581 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2023-12-03T11:39:28.433+0000 7f7a15ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:39:28.581 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2023-12-03T11:39:28.433+0000 7f7a15ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.44:6832/936700219,v1:172.21.15.44:6833/936700219] 2023-12-03T11:39:28.581 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2023-12-03T11:39:28.433+0000 7f7ad7033640 10 monclient: get_auth_request con 0x7f7a08069820 auth_method 0 2023-12-03T11:39:28.581 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2023-12-03T11:39:28.433+0000 7f7adab2b800 5 note: GC not initialized 2023-12-03T11:39:28.582 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2023-12-03T11:39:28.433+0000 7f7a06ffd640 20 reqs_thread_entry: start 2023-12-03T11:39:28.582 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2023-12-03T11:39:28.433+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command sync trace show hook 0x7f7ac80043a0 2023-12-03T11:39:28.582 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2023-12-03T11:39:28.433+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command sync trace history hook 0x7f7ac80043a0 2023-12-03T11:39:28.582 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2023-12-03T11:39:28.433+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command sync trace active hook 0x7f7ac80043a0 2023-12-03T11:39:28.582 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2023-12-03T11:39:28.433+0000 7f7adab2b800 5 asok(0x55ce35e57a10) register_command sync trace active_short hook 0x7f7ac80043a0 2023-12-03T11:39:28.582 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2023-12-03T11:39:28.433+0000 7f7adab2b800 20 init_complete bucket index max shards: 1 2023-12-03T11:39:28.582 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2023-12-03T11:39:28.433+0000 7f7adab2b800 20 Filter name: none 2023-12-03T11:39:28.582 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2023-12-03T11:39:28.433+0000 7f7a04ff9640 20 reqs_thread_entry: start 2023-12-03T11:39:28.582 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2023-12-03T11:39:28.433+0000 7f7adab2b800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2023-12-03T11:39:28.582 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2023-12-03T11:39:28.433+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.582 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2023-12-03T11:39:28.434+0000 7f7adab2b800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:39:28.582 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2023-12-03T11:39:28.434+0000 7f7adab2b800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2023-12-03T11:39:28.582 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2023-12-03T11:39:28.434+0000 7f7adab2b800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2023-12-03T11:39:28.582 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2023-12-03T11:39:28.434+0000 7f7adab2b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 : miss 2023-12-03T11:39:28.583 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2023-12-03T11:39:28.434+0000 7f7adab2b800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.583 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2023-12-03T11:39:28.434+0000 7f7adab2b800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:39:28.583 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2023-12-03T11:39:28.434+0000 7f7adab2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 info.flags=0x17 2023-12-03T11:39:28.583 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2023-12-03T11:39:28.434+0000 7f7adab2b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 to cache LRU end 2023-12-03T11:39:28.583 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2023-12-03T11:39:28.434+0000 7f7adab2b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:39:28.583 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2023-12-03T11:39:28.434+0000 7f7adab2b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:28.583 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2023-12-03T11:39:28.434+0000 7f7adab2b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 2023-12-03T11:39:28.583 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2023-12-03T11:39:28.435+0000 7f7ad6832640 10 monclient: get_auth_request con 0x55ce36147140 auth_method 0 2023-12-03T11:39:28.583 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2023-12-03T11:39:28.438+0000 7f7adab2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 info.flags=0x17 2023-12-03T11:39:28.583 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2023-12-03T11:39:28.438+0000 7f7adab2b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 to cache LRU end 2023-12-03T11:39:28.583 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2023-12-03T11:39:28.438+0000 7f7adab2b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:28.583 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2023-12-03T11:39:28.438+0000 7f7adab2b800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27, ofs0, ns] 2023-12-03T11:39:28.583 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2023-12-03T11:39:28.439+0000 7f7acd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693290 cookie 94344158385328 notifier 6872 bl.length()=873 2023-12-03T11:39:28.583 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2023-12-03T11:39:28.439+0000 7f7acd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 info.flags=0x17 2023-12-03T11:39:28.583 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2023-12-03T11:39:28.439+0000 7f7acd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 to cache LRU end 2023-12-03T11:39:28.584 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2023-12-03T11:39:28.439+0000 7f7acd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:28.584 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2023-12-03T11:39:28.439+0000 7f7adab2b800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27]): orig_sources= new_sources= 2023-12-03T11:39:28.584 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2023-12-03T11:39:28.439+0000 7f7adab2b800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27]): potential sources added=[] removed=[] 2023-12-03T11:39:28.584 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2023-12-03T11:39:28.439+0000 7f7adab2b800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27]): orig_dests= new_dests= 2023-12-03T11:39:28.584 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2023-12-03T11:39:28.439+0000 7f7adab2b800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27]): potential dests added=[] removed=[] 2023-12-03T11:39:28.584 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2023-12-03T11:39:28.441+0000 7f7adab2b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7adab2b800 time 2023-12-03T11:39:28.442589+0000 2023-12-03T11:39:28.584 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:39:28.584 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.584 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:39:28.584 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7add76eef8] 2023-12-03T11:39:28.584 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7add76f0b6] 2023-12-03T11:39:28.584 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ce34f60a71] 2023-12-03T11:39:28.584 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55ce34f6cf34] 2023-12-03T11:39:28.584 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2023-12-03T11:39:28.584 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f7adb03feb0] 2023-12-03T11:39:28.584 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2023-12-03T11:39:28.585 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2023-12-03T11:39:28.585 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.585 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2023-12-03T11:39:28.442+0000 7f7adab2b800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:39:28.585 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f7adab2b800 thread_name:radosgw-admin 2023-12-03T11:39:28.585 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.585 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:39:28.585 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7adb054db0] 2023-12-03T11:39:28.585 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f7adb0a154c] 2023-12-03T11:39:28.585 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2023-12-03T11:39:28.585 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2023-12-03T11:39:28.585 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7add76ef52] 2023-12-03T11:39:28.585 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7add76f0b6] 2023-12-03T11:39:28.585 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ce34f60a71] 2023-12-03T11:39:28.585 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55ce34f6cf34] 2023-12-03T11:39:28.585 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2023-12-03T11:39:28.585 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f7adb03feb0] 2023-12-03T11:39:28.585 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2023-12-03T11:39:28.585 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2023-12-03T11:39:28.586 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:39:28.586 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.586 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2023-12-03T11:39:28.586 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2023-12-03T11:39:28.586 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2023-12-03T11:39:28.586 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2023-12-03T11:39:28.586 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2023-12-03T11:39:28.586 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2023-12-03T11:39:28.586 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2023-12-03T11:39:28.586 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2023-12-03T11:39:28.586 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2023-12-03T11:39:28.586 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2023-12-03T11:39:28.586 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2023-12-03T11:39:28.586 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2023-12-03T11:39:28.587 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2023-12-03T11:39:28.587 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2023-12-03T11:39:28.587 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2023-12-03T11:39:28.587 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2023-12-03T11:39:28.587 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2023-12-03T11:39:28.587 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2023-12-03T11:39:28.587 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2023-12-03T11:39:28.587 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2023-12-03T11:39:28.587 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2023-12-03T11:39:28.587 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2023-12-03T11:39:28.587 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2023-12-03T11:39:28.587 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:39:28.587 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2023-12-03T11:39:28.587 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2023-12-03T11:39:28.587 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2023-12-03T11:39:28.587 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2023-12-03T11:39:28.587 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2023-12-03T11:39:28.588 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2023-12-03T11:39:28.588 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2023-12-03T11:39:28.588 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2023-12-03T11:39:28.588 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2023-12-03T11:39:28.588 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2023-12-03T11:39:28.588 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2023-12-03T11:39:28.588 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2023-12-03T11:39:28.588 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2023-12-03T11:39:28.588 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2023-12-03T11:39:28.588 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2023-12-03T11:39:28.588 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2023-12-03T11:39:28.588 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2023-12-03T11:39:28.588 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2023-12-03T11:39:28.588 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2023-12-03T11:39:28.588 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2023-12-03T11:39:28.588 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2023-12-03T11:39:28.588 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:39:28.589 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2023-12-03T11:39:28.589 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2023-12-03T11:39:28.589 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2023-12-03T11:39:28.589 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2023-12-03T11:39:28.589 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2023-12-03T11:39:28.589 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2023-12-03T11:39:28.589 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2023-12-03T11:39:28.589 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2023-12-03T11:39:28.589 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2023-12-03T11:39:28.589 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2023-12-03T11:39:28.589 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2023-12-03T11:39:28.589 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2023-12-03T11:39:28.589 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2023-12-03T11:39:28.589 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2023-12-03T11:39:28.590 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2023-12-03T11:39:28.590 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2023-12-03T11:39:28.590 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2023-12-03T11:39:28.590 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2023-12-03T11:39:28.590 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:39:28.590 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2023-12-03T11:39:28.590 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:39:28.590 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2023-12-03T11:39:28.590 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2023-12-03T11:39:28.590 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2023-12-03T11:39:28.590 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2023-12-03T11:39:28.590 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2023-12-03T11:39:28.590 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2023-12-03T11:39:28.590 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:39:28.590 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2023-12-03T11:39:28.591 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2023-12-03T11:39:28.591 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:39:28.591 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2023-12-03T11:39:28.591 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2023-12-03T11:39:28.591 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2023-12-03T11:39:28.591 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2023-12-03T11:39:28.591 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2023-12-03T11:39:28.591 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2023-12-03T11:39:28.591 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2023-12-03T11:39:28.591 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2023-12-03T11:39:28.591 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2023-12-03T11:39:28.591 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2023-12-03T11:39:28.591 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2023-12-03T11:39:28.591 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2023-12-03T11:39:28.592 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:39:28.592 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7a04ff9640 / http_manager 2023-12-03T11:39:28.592 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7a06ffd640 / http_manager 2023-12-03T11:39:28.592 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7a15ffb640 / ms_dispatch 2023-12-03T11:39:28.592 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7a177fe640 / io_context_pool 2023-12-03T11:39:28.592 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7a17fff640 / rgw_dt_lg_renew 2023-12-03T11:39:28.592 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7ab77fe640 / ms_dispatch 2023-12-03T11:39:28.592 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7acd7fa640 / io_context_pool 2023-12-03T11:39:28.592 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7acffff640 / ms_dispatch 2023-12-03T11:39:28.592 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7ad6031640 / msgr-worker-2 2023-12-03T11:39:28.592 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7ad6832640 / msgr-worker-1 2023-12-03T11:39:28.592 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7ad7033640 / msgr-worker-0 2023-12-03T11:39:28.592 INFO:tasks.workunit.client.0.smithi044.stderr: 7f7adab2b800 / radosgw-admin 2023-12-03T11:39:28.592 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2023-12-03T11:39:28.592 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2023-12-03T11:39:28.593 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/lib/ceph/crash/2023-12-03T11:39:28.443979Z_52b57ec2-5b79-44b3-a018-012a51ba25b9/log 2023-12-03T11:39:28.593 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2023-12-03T11:39:28.593 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2023-12-03T11:39:28.598 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:39:28.598 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:39:28.598 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.492+0000 7ff3631af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.494+0000 7ff3631af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.494+0000 7ff3631af800 20 realm 2023-12-03T11:39:28.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.494+0000 7ff3631af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.494+0000 7ff3631af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.494+0000 7ff3631af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:39:28.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.494+0000 7ff3631af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.494+0000 7ff3631af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.494+0000 7ff3631af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.495+0000 7ff3631af800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:28.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.495+0000 7ff3631af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.495+0000 7ff3631af800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:39:28.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.495+0000 7ff3631af800 20 searching for the correct realm 2023-12-03T11:39:28.599 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.504+0000 7ff35bfff640 0 -- 172.21.15.44:0/3761786746 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x557c5223aff0 msgr2=0x557c5223d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:28.600 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.505+0000 7ff3631af800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:39:28.600 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.505+0000 7ff3631af800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:39:28.600 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.505+0000 7ff3631af800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:39:28.600 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.505+0000 7ff3631af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:39:28.600 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.505+0000 7ff3631af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.600 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.506+0000 7ff3631af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.600 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.506+0000 7ff3631af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.600 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.506+0000 7ff3631af800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:28.600 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.506+0000 7ff3631af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.600 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.506+0000 7ff3631af800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:39:28.600 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.506+0000 7ff3631af800 20 zone default found 2023-12-03T11:39:28.600 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.506+0000 7ff3631af800 4 Realm: () 2023-12-03T11:39:28.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.506+0000 7ff3631af800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:39:28.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.506+0000 7ff3631af800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:39:28.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.506+0000 7ff3631af800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:39:28.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.506+0000 7ff3631af800 20 zonegroup default 2023-12-03T11:39:28.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.506+0000 7ff3631af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.506+0000 7ff3631af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.506+0000 7ff3631af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.507+0000 7ff3631af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.507+0000 7ff3631af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.507+0000 7ff3631af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.507+0000 7ff3631af800 20 started sync module instance, tier type = 2023-12-03T11:39:28.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.507+0000 7ff3631af800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:39:28.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.512+0000 7ff35bfff640 0 -- 172.21.15.44:0/3761786746 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x7ff338079e40 msgr2=0x7ff33807c270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:28.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.516+0000 7ff3631af800 20 add_watcher() i=0 2023-12-03T11:39:28.601 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.516+0000 7ff3631af800 20 add_watcher() i=1 2023-12-03T11:39:28.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.516+0000 7ff3631af800 20 add_watcher() i=2 2023-12-03T11:39:28.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.516+0000 7ff3631af800 20 add_watcher() i=3 2023-12-03T11:39:28.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.516+0000 7ff3631af800 20 add_watcher() i=4 2023-12-03T11:39:28.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.516+0000 7ff3631af800 20 add_watcher() i=5 2023-12-03T11:39:28.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.516+0000 7ff3631af800 20 add_watcher() i=6 2023-12-03T11:39:28.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.517+0000 7ff3631af800 20 add_watcher() i=7 2023-12-03T11:39:28.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.517+0000 7ff3631af800 2 all 8 watchers are set, enabling cache 2023-12-03T11:39:28.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.519+0000 7ff3267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:28.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.519+0000 7ff3631af800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:39:28.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.519+0000 7ff3631af800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:39:28.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.525+0000 7ff3631af800 5 note: GC not initialized 2023-12-03T11:39:28.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.525+0000 7ff2957fa640 20 reqs_thread_entry: start 2023-12-03T11:39:28.602 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.525+0000 7ff3631af800 20 init_complete bucket index max shards: 1 2023-12-03T11:39:28.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.526+0000 7ff3631af800 20 Filter name: none 2023-12-03T11:39:28.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.526+0000 7ff28effd640 20 reqs_thread_entry: start 2023-12-03T11:39:28.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.526+0000 7ff3631af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.526+0000 7ff3631af800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:39:28.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.526+0000 7ff3631af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.527+0000 7ff3631af800 20 rados_obj.operate() r=0 bl.length=403 2023-12-03T11:39:28.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.527+0000 7ff3631af800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:39:28.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.527+0000 7ff3631af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.527+0000 7ff3631af800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:39:28.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.527+0000 7ff3631af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.528+0000 7ff3631af800 20 rados_obj.operate() r=0 bl.length=403 2023-12-03T11:39:28.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.528+0000 7ff3631af800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:39:28.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.528+0000 7ff3631af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:28.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.528+0000 7ff3631af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:28.603 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.529+0000 7ff3267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:28.604 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.531+0000 7ff3631af800 20 remove_watcher() i=0 2023-12-03T11:39:28.604 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.531+0000 7ff3631af800 2 removed watcher, disabling cache 2023-12-03T11:39:28.604 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.532+0000 7ff3631af800 20 remove_watcher() i=1 2023-12-03T11:39:28.604 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.533+0000 7ff3631af800 20 remove_watcher() i=2 2023-12-03T11:39:28.604 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.534+0000 7ff3631af800 20 remove_watcher() i=3 2023-12-03T11:39:28.604 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.535+0000 7ff3631af800 20 remove_watcher() i=4 2023-12-03T11:39:28.604 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.536+0000 7ff3631af800 20 remove_watcher() i=5 2023-12-03T11:39:28.604 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.537+0000 7ff3631af800 20 remove_watcher() i=6 2023-12-03T11:39:28.604 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:28.538+0000 7ff3631af800 20 remove_watcher() i=7 2023-12-03T11:39:28.604 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:28.604 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:39:28.604 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-do-reshard id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:39:28.604 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:58.624 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:39:58.659 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:39:58.659 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:39:58.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.674+0000 7ff6ba812800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.676+0000 7ff6ba812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:58.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.676+0000 7ff6ba812800 20 realm 2023-12-03T11:39:58.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.676+0000 7ff6ba812800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.676+0000 7ff6ba812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:58.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.676+0000 7ff6ba812800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:39:58.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.676+0000 7ff6ba812800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.677+0000 7ff6ba812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:58.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.677+0000 7ff6ba812800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.679 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.678+0000 7ff6ba812800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:58.679 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.678+0000 7ff6ba812800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.680 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.679+0000 7ff6ba812800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:39:58.680 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.679+0000 7ff6ba812800 20 searching for the correct realm 2023-12-03T11:39:58.690 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.689+0000 7ff6b5729640 0 -- 172.21.15.44:0/1436445369 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x55aaebe8f290 msgr2=0x55aaebe91680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:58.692 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.691+0000 7ff6ba812800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:39:58.692 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.691+0000 7ff6ba812800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:39:58.692 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.691+0000 7ff6ba812800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:39:58.692 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.691+0000 7ff6ba812800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:39:58.692 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.691+0000 7ff6ba812800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.693 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.691+0000 7ff6ba812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:58.693 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.691+0000 7ff6ba812800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.693 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.692+0000 7ff6ba812800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:58.693 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.692+0000 7ff6ba812800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.693 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.692+0000 7ff6ba812800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:39:58.694 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.692+0000 7ff6ba812800 20 zone default found 2023-12-03T11:39:58.694 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.692+0000 7ff6ba812800 4 Realm: () 2023-12-03T11:39:58.694 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.692+0000 7ff6ba812800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:39:58.694 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.692+0000 7ff6ba812800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:39:58.694 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.692+0000 7ff6ba812800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:39:58.694 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.692+0000 7ff6ba812800 20 zonegroup default 2023-12-03T11:39:58.694 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.692+0000 7ff6ba812800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.694 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.692+0000 7ff6ba812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:58.694 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.692+0000 7ff6ba812800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.695 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.693+0000 7ff6ba812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:58.695 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.693+0000 7ff6ba812800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.695 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.693+0000 7ff6ba812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:58.695 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.693+0000 7ff6ba812800 20 started sync module instance, tier type = 2023-12-03T11:39:58.695 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.693+0000 7ff6ba812800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:39:58.700 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.699+0000 7ff6b672b640 0 -- 172.21.15.44:0/1436445369 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7ff6ac001ab0 msgr2=0x7ff6ac0508f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:58.704 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.703+0000 7ff6ba812800 20 add_watcher() i=0 2023-12-03T11:39:58.704 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.703+0000 7ff6ba812800 20 add_watcher() i=1 2023-12-03T11:39:58.704 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.703+0000 7ff6ba812800 20 add_watcher() i=2 2023-12-03T11:39:58.704 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.703+0000 7ff6ba812800 20 add_watcher() i=3 2023-12-03T11:39:58.704 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.703+0000 7ff6ba812800 20 add_watcher() i=4 2023-12-03T11:39:58.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.703+0000 7ff6ba812800 20 add_watcher() i=5 2023-12-03T11:39:58.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.703+0000 7ff6ba812800 20 add_watcher() i=6 2023-12-03T11:39:58.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.704+0000 7ff6ba812800 20 add_watcher() i=7 2023-12-03T11:39:58.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.704+0000 7ff6ba812800 2 all 8 watchers are set, enabling cache 2023-12-03T11:39:58.707 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.706+0000 7ff67b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:58.707 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.706+0000 7ff6ba812800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:39:58.707 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.706+0000 7ff6ba812800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:39:58.714 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.713+0000 7ff6ba812800 5 note: GC not initialized 2023-12-03T11:39:58.714 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.713+0000 7ff5ea7fc640 20 reqs_thread_entry: start 2023-12-03T11:39:58.715 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.713+0000 7ff6ba812800 20 init_complete bucket index max shards: 1 2023-12-03T11:39:58.715 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.713+0000 7ff6ba812800 20 Filter name: none 2023-12-03T11:39:58.715 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.713+0000 7ff5dbfff640 20 reqs_thread_entry: start 2023-12-03T11:39:58.715 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.713+0000 7ff6ba812800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2023-12-03T11:39:58.715 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.713+0000 7ff6ba812800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.715 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.714+0000 7ff6ba812800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:39:58.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.714+0000 7ff6ba812800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2023-12-03T11:39:58.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.714+0000 7ff6ba812800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2023-12-03T11:39:58.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.714+0000 7ff6ba812800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 : miss 2023-12-03T11:39:58.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.714+0000 7ff6ba812800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.714+0000 7ff6ba812800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:39:58.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.714+0000 7ff6ba812800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 info.flags=0x17 2023-12-03T11:39:58.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.714+0000 7ff6ba812800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 to cache LRU end 2023-12-03T11:39:58.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.714+0000 7ff6ba812800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:39:58.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.714+0000 7ff6ba812800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:58.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.714+0000 7ff6ba812800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 2023-12-03T11:39:58.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.719+0000 7ff6ba812800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 info.flags=0x17 2023-12-03T11:39:58.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.719+0000 7ff6ba812800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 to cache LRU end 2023-12-03T11:39:58.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.719+0000 7ff6ba812800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:58.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.719+0000 7ff6ba812800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27, ofs0, ns] 2023-12-03T11:39:58.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.719+0000 7ff6977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693292 cookie 94192590759184 notifier 6914 bl.length()=873 2023-12-03T11:39:58.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.719+0000 7ff6977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 info.flags=0x17 2023-12-03T11:39:58.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.719+0000 7ff6977fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 to cache LRU end 2023-12-03T11:39:58.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.719+0000 7ff6977fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:58.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.720+0000 7ff6ba812800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27]): orig_sources= new_sources= 2023-12-03T11:39:58.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.720+0000 7ff6ba812800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27]): potential sources added=[] removed=[] 2023-12-03T11:39:58.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.720+0000 7ff6ba812800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27]): orig_dests= new_dests= 2023-12-03T11:39:58.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.720+0000 7ff6ba812800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27]): potential dests added=[] removed=[] 2023-12-03T11:39:58.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.721+0000 7ff6ba812800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27.1.0 2023-12-03T11:39:58.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.721+0000 7ff6ba812800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27.1.0 2023-12-03T11:39:58.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.721+0000 7ff6ba812800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27.1.1 2023-12-03T11:39:58.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.721+0000 7ff6ba812800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27.1.1 2023-12-03T11:39:58.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.721+0000 7ff6ba812800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27.0 2023-12-03T11:39:58.725 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.724+0000 7ff6ba812800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 : hit (requested=0x17, cached=0x17) 2023-12-03T11:39:58.725 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.724+0000 7ff6ba812800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 2023-12-03T11:39:58.726 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.725+0000 7ff6ba812800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 info.flags=0x17 2023-12-03T11:39:58.726 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.725+0000 7ff6ba812800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 to cache LRU end 2023-12-03T11:39:58.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.725+0000 7ff6ba812800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:58.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.725+0000 7ff6ba812800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27, ofs0, ns] 2023-12-03T11:39:58.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.726+0000 7ff697fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693293 cookie 94192590759184 notifier 6914 bl.length()=841 2023-12-03T11:39:58.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.726+0000 7ff697fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 info.flags=0x17 2023-12-03T11:39:58.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.726+0000 7ff697fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 to cache LRU end 2023-12-03T11:39:58.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.726+0000 7ff697fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:39:58.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.726+0000 7ff6ba812800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27]): orig_sources= new_sources= 2023-12-03T11:39:58.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.726+0000 7ff6ba812800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27]): potential sources added=[] removed=[] 2023-12-03T11:39:58.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.726+0000 7ff6ba812800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27]): orig_dests= new_dests= 2023-12-03T11:39:58.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.726+0000 7ff6ba812800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27]): potential dests added=[] removed=[] 2023-12-03T11:39:58.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.727+0000 7ff6ba812800 1 execute INFO: reshard of bucket "abort-at-do-reshard" completed successfully 2023-12-03T11:39:58.730 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.729+0000 7ff67b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:58.732 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.732+0000 7ff6ba812800 20 remove_watcher() i=0 2023-12-03T11:39:58.733 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.732+0000 7ff6ba812800 2 removed watcher, disabling cache 2023-12-03T11:39:58.733 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.733+0000 7ff6ba812800 20 remove_watcher() i=1 2023-12-03T11:39:58.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.734+0000 7ff6ba812800 20 remove_watcher() i=2 2023-12-03T11:39:58.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.735+0000 7ff6ba812800 20 remove_watcher() i=3 2023-12-03T11:39:58.737 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.736+0000 7ff6ba812800 20 remove_watcher() i=4 2023-12-03T11:39:58.738 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.737+0000 7ff6ba812800 20 remove_watcher() i=5 2023-12-03T11:39:58.739 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.738+0000 7ff6ba812800 20 remove_watcher() i=6 2023-12-03T11:39:58.740 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.739+0000 7ff6ba812800 20 remove_watcher() i=7 2023-12-03T11:39:58.747 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2023-12-03T11:39:58.775 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:39:58.776 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:39:58.790 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.789+0000 7fc9aa124800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.792 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.791+0000 7fc9aa124800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:58.792 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.791+0000 7fc9aa124800 20 realm 2023-12-03T11:39:58.792 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.791+0000 7fc9aa124800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.793 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.791+0000 7fc9aa124800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:58.793 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.791+0000 7fc9aa124800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:39:58.793 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.791+0000 7fc9aa124800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.793 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.791+0000 7fc9aa124800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:58.793 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.791+0000 7fc9aa124800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.793 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.792+0000 7fc9aa124800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:58.793 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.792+0000 7fc9aa124800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.794 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.793+0000 7fc9aa124800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:39:58.794 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.793+0000 7fc9aa124800 20 searching for the correct realm 2023-12-03T11:39:58.804 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.803+0000 7fc9a5d1c640 0 -- 172.21.15.44:0/1737006891 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55c7f1dc97b0 msgr2=0x55c7f1dcbba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:58.805 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.804+0000 7fc9aa124800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:39:58.805 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.804+0000 7fc9aa124800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:39:58.805 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.804+0000 7fc9aa124800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:39:58.805 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.804+0000 7fc9aa124800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:39:58.805 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.804+0000 7fc9aa124800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.805 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.804+0000 7fc9aa124800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:58.806 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.804+0000 7fc9aa124800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.807 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.804+0000 7fc9aa124800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:58.807 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.805+0000 7fc9aa124800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.807 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.805+0000 7fc9aa124800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:39:58.807 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.805+0000 7fc9aa124800 20 zone default found 2023-12-03T11:39:58.807 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.805+0000 7fc9aa124800 4 Realm: () 2023-12-03T11:39:58.807 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.805+0000 7fc9aa124800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:39:58.807 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.805+0000 7fc9aa124800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:39:58.807 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.805+0000 7fc9aa124800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:39:58.807 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.805+0000 7fc9aa124800 20 zonegroup default 2023-12-03T11:39:58.807 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.805+0000 7fc9aa124800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.807 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.805+0000 7fc9aa124800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:58.807 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.805+0000 7fc9aa124800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.807 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.805+0000 7fc9aa124800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:58.807 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.805+0000 7fc9aa124800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.806+0000 7fc9aa124800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:58.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.806+0000 7fc9aa124800 20 started sync module instance, tier type = 2023-12-03T11:39:58.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.806+0000 7fc9aa124800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:39:58.814 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.813+0000 7fc9a651d640 0 -- 172.21.15.44:0/1737006891 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55c7f1dd1770 msgr2=0x55c7f1dd3c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:58.817 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.816+0000 7fc9aa124800 20 add_watcher() i=0 2023-12-03T11:39:58.817 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.816+0000 7fc9aa124800 20 add_watcher() i=1 2023-12-03T11:39:58.817 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.816+0000 7fc9aa124800 20 add_watcher() i=2 2023-12-03T11:39:58.817 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.816+0000 7fc9aa124800 20 add_watcher() i=3 2023-12-03T11:39:58.817 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.816+0000 7fc9aa124800 20 add_watcher() i=4 2023-12-03T11:39:58.817 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.816+0000 7fc9aa124800 20 add_watcher() i=5 2023-12-03T11:39:58.817 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.816+0000 7fc9aa124800 20 add_watcher() i=6 2023-12-03T11:39:58.818 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.817+0000 7fc9aa124800 20 add_watcher() i=7 2023-12-03T11:39:58.818 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.817+0000 7fc9aa124800 2 all 8 watchers are set, enabling cache 2023-12-03T11:39:58.819 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.818+0000 7fc96b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:58.820 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.819+0000 7fc9aa124800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:39:58.820 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.819+0000 7fc9aa124800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:39:58.826 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.825+0000 7fc9aa124800 5 note: GC not initialized 2023-12-03T11:39:58.826 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.825+0000 7fc8da7fc640 20 reqs_thread_entry: start 2023-12-03T11:39:58.826 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.825+0000 7fc9aa124800 20 init_complete bucket index max shards: 1 2023-12-03T11:39:58.827 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.825+0000 7fc9aa124800 20 Filter name: none 2023-12-03T11:39:58.827 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.825+0000 7fc8cbfff640 20 reqs_thread_entry: start 2023-12-03T11:39:58.827 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.825+0000 7fc9aa124800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.828 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.826+0000 7fc9aa124800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:39:58.828 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.826+0000 7fc9aa124800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.828 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.827+0000 7fc9aa124800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:39:58.828 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.827+0000 7fc9aa124800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:39:58.828 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.827+0000 7fc9aa124800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.827+0000 7fc9aa124800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:39:58.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.827+0000 7fc9aa124800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.828+0000 7fc9aa124800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:39:58.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.828+0000 7fc9aa124800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:39:58.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.828+0000 7fc9aa124800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.830 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.829+0000 7fc9aa124800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:58.830 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.829+0000 7fc96b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:58.833 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.832+0000 7fc9aa124800 20 remove_watcher() i=0 2023-12-03T11:39:58.833 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.832+0000 7fc9aa124800 2 removed watcher, disabling cache 2023-12-03T11:39:58.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.834+0000 7fc9aa124800 20 remove_watcher() i=1 2023-12-03T11:39:58.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.835+0000 7fc9aa124800 20 remove_watcher() i=2 2023-12-03T11:39:58.837 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.836+0000 7fc9aa124800 20 remove_watcher() i=3 2023-12-03T11:39:58.838 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.837+0000 7fc9aa124800 20 remove_watcher() i=4 2023-12-03T11:39:58.839 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.838+0000 7fc9aa124800 20 remove_watcher() i=5 2023-12-03T11:39:58.840 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.839+0000 7fc9aa124800 20 remove_watcher() i=6 2023-12-03T11:39:58.841 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.840+0000 7fc9aa124800 20 remove_watcher() i=7 2023-12-03T11:39:58.845 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:58.846 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:39:58.846 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-do-reshard id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.27 num_objects: 19 size_kb: 1 num_shards: 2 2023-12-03T11:39:58.846 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:58.927 INFO:tasks.workunit.client.0.smithi044.stderr: test: reshard versioned bucket 2023-12-03T11:39:58.928 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket myver 2023-12-03T11:39:58.956 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:39:58.956 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:39:58.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.969+0000 7fdb2eb75800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.971+0000 7fdb2eb75800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:58.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.971+0000 7fdb2eb75800 20 realm 2023-12-03T11:39:58.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.971+0000 7fdb2eb75800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.971+0000 7fdb2eb75800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:58.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.971+0000 7fdb2eb75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:39:58.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.971+0000 7fdb2eb75800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.971+0000 7fdb2eb75800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:58.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.971+0000 7fdb2eb75800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.973 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.972+0000 7fdb2eb75800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:58.973 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.972+0000 7fdb2eb75800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.974 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.973+0000 7fdb2eb75800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:39:58.974 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.973+0000 7fdb2eb75800 20 searching for the correct realm 2023-12-03T11:39:58.984 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.983+0000 7fdb2ce7d640 0 -- 172.21.15.44:0/806399353 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55851cc22390 msgr2=0x55851cc24820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:58.984 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.983+0000 7fdb2eb75800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:39:58.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.983+0000 7fdb2eb75800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:39:58.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.983+0000 7fdb2eb75800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:39:58.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.983+0000 7fdb2eb75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:39:58.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.983+0000 7fdb2eb75800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.984+0000 7fdb2eb75800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:58.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.984+0000 7fdb2eb75800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.984+0000 7fdb2eb75800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:58.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.984+0000 7fdb2eb75800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.984+0000 7fdb2eb75800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:39:58.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.984+0000 7fdb2eb75800 20 zone default found 2023-12-03T11:39:58.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.984+0000 7fdb2eb75800 4 Realm: () 2023-12-03T11:39:58.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.984+0000 7fdb2eb75800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:39:58.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.984+0000 7fdb2eb75800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:39:58.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.984+0000 7fdb2eb75800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:39:58.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.984+0000 7fdb2eb75800 20 zonegroup default 2023-12-03T11:39:58.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.984+0000 7fdb2eb75800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.984+0000 7fdb2eb75800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:58.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.984+0000 7fdb2eb75800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.985+0000 7fdb2eb75800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:58.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.985+0000 7fdb2eb75800 20 rados->read ofs=0 len=0 2023-12-03T11:39:58.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.985+0000 7fdb2eb75800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:58.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.985+0000 7fdb2eb75800 20 started sync module instance, tier type = 2023-12-03T11:39:58.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.985+0000 7fdb2eb75800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:39:58.994 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.993+0000 7fdb2ce7d640 0 -- 172.21.15.44:0/806399353 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x7fdb04079e10 msgr2=0x7fdb0407c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:58.996 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.995+0000 7fdb2eb75800 20 add_watcher() i=0 2023-12-03T11:39:58.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.995+0000 7fdb2eb75800 20 add_watcher() i=1 2023-12-03T11:39:58.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.995+0000 7fdb2eb75800 20 add_watcher() i=2 2023-12-03T11:39:58.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.995+0000 7fdb2eb75800 20 add_watcher() i=3 2023-12-03T11:39:58.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.995+0000 7fdb2eb75800 20 add_watcher() i=4 2023-12-03T11:39:58.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.995+0000 7fdb2eb75800 20 add_watcher() i=5 2023-12-03T11:39:58.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.995+0000 7fdb2eb75800 20 add_watcher() i=6 2023-12-03T11:39:58.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.996+0000 7fdb2eb75800 20 add_watcher() i=7 2023-12-03T11:39:58.997 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.996+0000 7fdb2eb75800 2 all 8 watchers are set, enabling cache 2023-12-03T11:39:58.999 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.998+0000 7fdaf27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:58.999 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.998+0000 7fdb2eb75800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:39:58.999 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:58.998+0000 7fdb2eb75800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:39:59.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.004+0000 7fdb2eb75800 5 note: GC not initialized 2023-12-03T11:39:59.006 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.004+0000 7fda617fa640 20 reqs_thread_entry: start 2023-12-03T11:39:59.006 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.004+0000 7fdb2eb75800 20 init_complete bucket index max shards: 1 2023-12-03T11:39:59.006 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.004+0000 7fdb2eb75800 20 Filter name: none 2023-12-03T11:39:59.006 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.005+0000 7fda5affd640 20 reqs_thread_entry: start 2023-12-03T11:39:59.006 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.005+0000 7fdb2eb75800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.006 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.005+0000 7fdb2eb75800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:39:59.006 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.005+0000 7fdb2eb75800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.010 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.006+0000 7fdb2eb75800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:39:59.010 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.006+0000 7fdb2eb75800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:39:59.010 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.006+0000 7fdb2eb75800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.010 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.006+0000 7fdb2eb75800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:39:59.010 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.006+0000 7fdb2eb75800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.010 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.007+0000 7fdb2eb75800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:39:59.010 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.007+0000 7fdb2eb75800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:39:59.010 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.007+0000 7fdb2eb75800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.010 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.007+0000 7fdb2eb75800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.011 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.008+0000 7fdaf27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:59.011 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.010+0000 7fdb2eb75800 20 remove_watcher() i=0 2023-12-03T11:39:59.011 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.010+0000 7fdb2eb75800 2 removed watcher, disabling cache 2023-12-03T11:39:59.012 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.011+0000 7fdb2eb75800 20 remove_watcher() i=1 2023-12-03T11:39:59.013 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.012+0000 7fdb2eb75800 20 remove_watcher() i=2 2023-12-03T11:39:59.014 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.013+0000 7fdb2eb75800 20 remove_watcher() i=3 2023-12-03T11:39:59.015 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.014+0000 7fdb2eb75800 20 remove_watcher() i=4 2023-12-03T11:39:59.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.016+0000 7fdb2eb75800 20 remove_watcher() i=5 2023-12-03T11:39:59.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.017+0000 7fdb2eb75800 20 remove_watcher() i=6 2023-12-03T11:39:59.019 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.018+0000 7fdb2eb75800 20 remove_watcher() i=7 2023-12-03T11:39:59.024 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:59.024 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:39:59.024 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: myver id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 num_objects: 0 size_kb: 0 num_shards: 1 2023-12-03T11:39:59.024 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:59.025 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 2 2023-12-03T11:39:59.055 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:39:59.055 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:39:59.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.068+0000 7f44c262f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.071 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.070+0000 7f44c262f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.071 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.070+0000 7f44c262f800 20 realm 2023-12-03T11:39:59.071 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.070+0000 7f44c262f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.072 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.070+0000 7f44c262f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.072 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.070+0000 7f44c262f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:39:59.072 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.070+0000 7f44c262f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.072 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.070+0000 7f44c262f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.072 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.070+0000 7f44c262f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.072 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.072+0000 7f44c262f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:59.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.072+0000 7f44c262f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.072+0000 7f44c262f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:39:59.073 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.072+0000 7f44c262f800 20 searching for the correct realm 2023-12-03T11:39:59.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.081+0000 7f44bd0f9640 0 -- 172.21.15.44:0/348840685 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x557dd0b1ff80 msgr2=0x557dd0b22370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:59.084 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.083+0000 7f44c262f800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:39:59.084 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.083+0000 7f44c262f800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:39:59.084 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.083+0000 7f44c262f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:39:59.084 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.083+0000 7f44c262f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:39:59.084 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.083+0000 7f44c262f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.084 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.083+0000 7f44c262f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.084 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.083+0000 7f44c262f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.085 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.083+0000 7f44c262f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:59.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.083+0000 7f44c262f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.083+0000 7f44c262f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:39:59.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.083+0000 7f44c262f800 20 zone default found 2023-12-03T11:39:59.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.083+0000 7f44c262f800 4 Realm: () 2023-12-03T11:39:59.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.083+0000 7f44c262f800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:39:59.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.083+0000 7f44c262f800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:39:59.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.083+0000 7f44c262f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:39:59.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.083+0000 7f44c262f800 20 zonegroup default 2023-12-03T11:39:59.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.083+0000 7f44c262f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.084+0000 7f44c262f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.084+0000 7f44c262f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.084+0000 7f44c262f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.084+0000 7f44c262f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.084+0000 7f44c262f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.084+0000 7f44c262f800 20 started sync module instance, tier type = 2023-12-03T11:39:59.087 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.084+0000 7f44c262f800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:39:59.091 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.090+0000 7f44bd0f9640 0 -- 172.21.15.44:0/348840685 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x7f4498079e10 msgr2=0x7f449807c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:59.095 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.094+0000 7f44c262f800 20 add_watcher() i=0 2023-12-03T11:39:59.095 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.094+0000 7f44c262f800 20 add_watcher() i=1 2023-12-03T11:39:59.095 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.094+0000 7f44c262f800 20 add_watcher() i=2 2023-12-03T11:39:59.095 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.094+0000 7f44c262f800 20 add_watcher() i=3 2023-12-03T11:39:59.095 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.094+0000 7f44c262f800 20 add_watcher() i=4 2023-12-03T11:39:59.095 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.094+0000 7f44c262f800 20 add_watcher() i=5 2023-12-03T11:39:59.095 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.094+0000 7f44c262f800 20 add_watcher() i=6 2023-12-03T11:39:59.096 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.095+0000 7f44c262f800 20 add_watcher() i=7 2023-12-03T11:39:59.096 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.095+0000 7f44c262f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:39:59.097 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.096+0000 7f44837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:59.097 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.096+0000 7f44c262f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:39:59.097 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.096+0000 7f44c262f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:39:59.104 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.102+0000 7f44c262f800 5 note: GC not initialized 2023-12-03T11:39:59.104 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.102+0000 7f43f27fc640 20 reqs_thread_entry: start 2023-12-03T11:39:59.104 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.103+0000 7f44c262f800 20 init_complete bucket index max shards: 1 2023-12-03T11:39:59.104 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.103+0000 7f44c262f800 20 Filter name: none 2023-12-03T11:39:59.104 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.103+0000 7f43e3fff640 20 reqs_thread_entry: start 2023-12-03T11:39:59.104 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.103+0000 7f44c262f800 10 cache get: name=default.rgw.meta+root+myver : miss 2023-12-03T11:39:59.104 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.103+0000 7f44c262f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.103+0000 7f44c262f800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:39:59.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.103+0000 7f44c262f800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2023-12-03T11:39:59.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.103+0000 7f44c262f800 10 adding default.rgw.meta+root+myver to cache LRU end 2023-12-03T11:39:59.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.103+0000 7f44c262f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 : miss 2023-12-03T11:39:59.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.103+0000 7f44c262f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.104+0000 7f44c262f800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:39:59.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.104+0000 7f44c262f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 info.flags=0x17 2023-12-03T11:39:59.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.104+0000 7f44c262f800 10 adding default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 to cache LRU end 2023-12-03T11:39:59.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.104+0000 7f44c262f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:39:59.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.104+0000 7f44c262f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:39:59.106 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.104+0000 7f44c262f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 2023-12-03T11:39:59.109 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.108+0000 7f44c262f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 info.flags=0x17 2023-12-03T11:39:59.109 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.108+0000 7f44c262f800 10 moving default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 to cache LRU end 2023-12-03T11:39:59.109 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.108+0000 7f44c262f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:39:59.109 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.108+0000 7f44c262f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17, ofs0, ns] 2023-12-03T11:39:59.109 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.108+0000 7f449ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693218 cookie 93998860637184 notifier 6977 bl.length()=783 2023-12-03T11:39:59.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.108+0000 7f449ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 info.flags=0x17 2023-12-03T11:39:59.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.108+0000 7f449ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 to cache LRU end 2023-12-03T11:39:59.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.108+0000 7f449ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:39:59.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.109+0000 7f44c262f800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): orig_sources= new_sources= 2023-12-03T11:39:59.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.109+0000 7f44c262f800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): potential sources added=[] removed=[] 2023-12-03T11:39:59.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.109+0000 7f44c262f800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): orig_dests= new_dests= 2023-12-03T11:39:59.110 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.109+0000 7f44c262f800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): potential dests added=[] removed=[] 2023-12-03T11:39:59.111 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.110+0000 7f44c262f800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.1.0 2023-12-03T11:39:59.111 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.110+0000 7f44c262f800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.1.0 2023-12-03T11:39:59.111 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.110+0000 7f44c262f800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.1.1 2023-12-03T11:39:59.111 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.110+0000 7f44c262f800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.1.1 2023-12-03T11:39:59.111 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.110+0000 7f44c262f800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.0 2023-12-03T11:39:59.111 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.110+0000 7f44c262f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 : hit (requested=0x17, cached=0x17) 2023-12-03T11:39:59.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.110+0000 7f44c262f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 2023-12-03T11:39:59.112 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.112+0000 7f44c262f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 info.flags=0x17 2023-12-03T11:39:59.113 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.112+0000 7f44c262f800 10 moving default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 to cache LRU end 2023-12-03T11:39:59.113 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.112+0000 7f44c262f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:39:59.113 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.112+0000 7f44c262f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17, ofs0, ns] 2023-12-03T11:39:59.113 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.112+0000 7f449ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693219 cookie 93998860637184 notifier 6977 bl.length()=751 2023-12-03T11:39:59.113 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.112+0000 7f449ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 info.flags=0x17 2023-12-03T11:39:59.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.112+0000 7f449ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 to cache LRU end 2023-12-03T11:39:59.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.112+0000 7f449ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:39:59.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.112+0000 7f44c262f800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): orig_sources= new_sources= 2023-12-03T11:39:59.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.112+0000 7f44c262f800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): potential sources added=[] removed=[] 2023-12-03T11:39:59.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.112+0000 7f44c262f800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): orig_dests= new_dests= 2023-12-03T11:39:59.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.112+0000 7f44c262f800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): potential dests added=[] removed=[] 2023-12-03T11:39:59.114 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.113+0000 7f44c262f800 1 execute INFO: reshard of bucket "myver" completed successfully 2023-12-03T11:39:59.116 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.115+0000 7f44837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:59.119 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.118+0000 7f44c262f800 20 remove_watcher() i=0 2023-12-03T11:39:59.119 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.118+0000 7f44c262f800 2 removed watcher, disabling cache 2023-12-03T11:39:59.120 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.119+0000 7f44c262f800 20 remove_watcher() i=1 2023-12-03T11:39:59.121 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.120+0000 7f44c262f800 20 remove_watcher() i=2 2023-12-03T11:39:59.122 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.121+0000 7f44c262f800 20 remove_watcher() i=3 2023-12-03T11:39:59.123 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.122+0000 7f44c262f800 20 remove_watcher() i=4 2023-12-03T11:39:59.124 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.123+0000 7f44c262f800 20 remove_watcher() i=5 2023-12-03T11:39:59.125 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.124+0000 7f44c262f800 20 remove_watcher() i=6 2023-12-03T11:39:59.126 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.125+0000 7f44c262f800 20 remove_watcher() i=7 2023-12-03T11:39:59.132 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket myver 2023-12-03T11:39:59.160 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:39:59.160 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:39:59.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.173+0000 7f0d26311800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.174+0000 7f0d26311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.174+0000 7f0d26311800 20 realm 2023-12-03T11:39:59.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.174+0000 7f0d26311800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.174+0000 7f0d26311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.174+0000 7f0d26311800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:39:59.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.174+0000 7f0d26311800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.175+0000 7f0d26311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.175+0000 7f0d26311800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.177 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.176+0000 7f0d26311800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:59.177 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.176+0000 7f0d26311800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.178 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.176+0000 7f0d26311800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:39:59.178 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.177+0000 7f0d26311800 20 searching for the correct realm 2023-12-03T11:39:59.187 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.186+0000 7f0d23e18640 0 -- 172.21.15.44:0/921706736 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x5575d0101020 msgr2=0x5575d0103410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:59.188 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.187+0000 7f0d26311800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:39:59.188 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.187+0000 7f0d26311800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:39:59.188 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.187+0000 7f0d26311800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:39:59.188 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.187+0000 7f0d26311800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:39:59.189 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.187+0000 7f0d26311800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.189 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.187+0000 7f0d26311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.189 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.187+0000 7f0d26311800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.188+0000 7f0d26311800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:59.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.188+0000 7f0d26311800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.188+0000 7f0d26311800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:39:59.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.188+0000 7f0d26311800 20 zone default found 2023-12-03T11:39:59.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.188+0000 7f0d26311800 4 Realm: () 2023-12-03T11:39:59.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.188+0000 7f0d26311800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:39:59.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.188+0000 7f0d26311800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:39:59.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.188+0000 7f0d26311800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:39:59.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.188+0000 7f0d26311800 20 zonegroup default 2023-12-03T11:39:59.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.188+0000 7f0d26311800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.188+0000 7f0d26311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.188+0000 7f0d26311800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.190 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.189+0000 7f0d26311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.191 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.189+0000 7f0d26311800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.191 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.189+0000 7f0d26311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.191 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.189+0000 7f0d26311800 20 started sync module instance, tier type = 2023-12-03T11:39:59.191 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.189+0000 7f0d26311800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:39:59.196 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.195+0000 7f0d23617640 0 -- 172.21.15.44:0/921706736 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x5575d01047b0 msgr2=0x5575d0106ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:59.199 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.198+0000 7f0d26311800 20 add_watcher() i=0 2023-12-03T11:39:59.199 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.198+0000 7f0d26311800 20 add_watcher() i=1 2023-12-03T11:39:59.199 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.198+0000 7f0d26311800 20 add_watcher() i=2 2023-12-03T11:39:59.199 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.198+0000 7f0d26311800 20 add_watcher() i=3 2023-12-03T11:39:59.200 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.198+0000 7f0d26311800 20 add_watcher() i=4 2023-12-03T11:39:59.200 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.198+0000 7f0d26311800 20 add_watcher() i=5 2023-12-03T11:39:59.200 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.198+0000 7f0d26311800 20 add_watcher() i=6 2023-12-03T11:39:59.200 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.199+0000 7f0d26311800 20 add_watcher() i=7 2023-12-03T11:39:59.200 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.199+0000 7f0d26311800 2 all 8 watchers are set, enabling cache 2023-12-03T11:39:59.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.201+0000 7f0ce9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:59.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.201+0000 7f0d26311800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:39:59.202 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.201+0000 7f0d26311800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:39:59.209 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.207+0000 7f0d26311800 5 note: GC not initialized 2023-12-03T11:39:59.209 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.208+0000 7f0c60ff9640 20 reqs_thread_entry: start 2023-12-03T11:39:59.209 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.208+0000 7f0d26311800 20 init_complete bucket index max shards: 1 2023-12-03T11:39:59.209 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.208+0000 7f0d26311800 20 Filter name: none 2023-12-03T11:39:59.210 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.208+0000 7f0c567fc640 20 reqs_thread_entry: start 2023-12-03T11:39:59.210 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.208+0000 7f0d26311800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.210 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.208+0000 7f0d26311800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:39:59.210 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.208+0000 7f0d26311800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.210 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.209+0000 7f0d26311800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:39:59.210 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.209+0000 7f0d26311800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:39:59.210 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.209+0000 7f0d26311800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.211 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.209+0000 7f0d26311800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:39:59.211 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.209+0000 7f0d26311800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.214 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.210+0000 7f0d26311800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:39:59.214 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.210+0000 7f0d26311800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:39:59.214 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.210+0000 7f0d26311800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.214 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.211+0000 7f0d26311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.214 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.211+0000 7f0ce9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:59.215 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.214+0000 7f0d26311800 20 remove_watcher() i=0 2023-12-03T11:39:59.215 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.214+0000 7f0d26311800 2 removed watcher, disabling cache 2023-12-03T11:39:59.216 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.215+0000 7f0d26311800 20 remove_watcher() i=1 2023-12-03T11:39:59.217 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.216+0000 7f0d26311800 20 remove_watcher() i=2 2023-12-03T11:39:59.218 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.217+0000 7f0d26311800 20 remove_watcher() i=3 2023-12-03T11:39:59.219 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.218+0000 7f0d26311800 20 remove_watcher() i=4 2023-12-03T11:39:59.220 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.219+0000 7f0d26311800 20 remove_watcher() i=5 2023-12-03T11:39:59.221 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.220+0000 7f0d26311800 20 remove_watcher() i=6 2023-12-03T11:39:59.222 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.221+0000 7f0d26311800 20 remove_watcher() i=7 2023-12-03T11:39:59.227 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:59.227 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:39:59.227 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: myver id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 num_objects: 0 size_kb: 0 num_shards: 2 2023-12-03T11:39:59.227 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:59.273 INFO:tasks.workunit.client.0.smithi044.stderr: test: reshard removes olh entries with empty name 2023-12-03T11:39:59.364 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket a-bucket 2023-12-03T11:39:59.391 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:39:59.392 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:39:59.406 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.404+0000 7f190f3af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.408 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.406+0000 7f190f3af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.408 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.406+0000 7f190f3af800 20 realm 2023-12-03T11:39:59.408 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.406+0000 7f190f3af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.408 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.406+0000 7f190f3af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.408 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.406+0000 7f190f3af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:39:59.408 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.406+0000 7f190f3af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.408 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.407+0000 7f190f3af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.408 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.407+0000 7f190f3af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.407+0000 7f190f3af800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:59.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.407+0000 7f190f3af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.408+0000 7f190f3af800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:39:59.409 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.408+0000 7f190f3af800 20 searching for the correct realm 2023-12-03T11:39:59.623 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.618+0000 7f190c6ae640 0 -- 172.21.15.44:0/3078829033 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x562a2c370050 msgr2=0x562a2c372440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:39:59.623 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.620+0000 7f190f3af800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:39:59.623 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.620+0000 7f190f3af800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:39:59.623 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.620+0000 7f190f3af800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:39:59.623 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.620+0000 7f190f3af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:39:59.623 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.620+0000 7f190f3af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.623 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.620+0000 7f190f3af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.623 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.620+0000 7f190f3af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.623 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.621+0000 7f190f3af800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:59.623 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.621+0000 7f190f3af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.623 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.621+0000 7f190f3af800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:39:59.623 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.621+0000 7f190f3af800 20 zone default found 2023-12-03T11:39:59.623 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.621+0000 7f190f3af800 4 Realm: () 2023-12-03T11:39:59.624 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.621+0000 7f190f3af800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:39:59.624 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.621+0000 7f190f3af800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:39:59.624 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.621+0000 7f190f3af800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:39:59.624 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.621+0000 7f190f3af800 20 zonegroup default 2023-12-03T11:39:59.624 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.621+0000 7f190f3af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.624 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.621+0000 7f190f3af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.624 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.621+0000 7f190f3af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.624 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.622+0000 7f190f3af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.624 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.622+0000 7f190f3af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.624 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.622+0000 7f190f3af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.625 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.622+0000 7f190f3af800 20 started sync module instance, tier type = 2023-12-03T11:39:59.625 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.622+0000 7f190f3af800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:39:59.627 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.626+0000 7f190ceaf640 0 -- 172.21.15.44:0/3078829033 >> [v2:172.21.15.91:6808/776869758,v1:172.21.15.91:6809/776869758] conn(0x7f19040763f0 msgr2=0x7f1904076850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:59.632 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.631+0000 7f190f3af800 20 add_watcher() i=0 2023-12-03T11:39:59.632 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.631+0000 7f190f3af800 20 add_watcher() i=1 2023-12-03T11:39:59.632 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.631+0000 7f190f3af800 20 add_watcher() i=2 2023-12-03T11:39:59.632 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.631+0000 7f190f3af800 20 add_watcher() i=3 2023-12-03T11:39:59.632 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.631+0000 7f190f3af800 20 add_watcher() i=4 2023-12-03T11:39:59.632 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.631+0000 7f190f3af800 20 add_watcher() i=5 2023-12-03T11:39:59.632 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.631+0000 7f190f3af800 20 add_watcher() i=6 2023-12-03T11:39:59.633 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.632+0000 7f190f3af800 20 add_watcher() i=7 2023-12-03T11:39:59.633 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.632+0000 7f190f3af800 2 all 8 watchers are set, enabling cache 2023-12-03T11:39:59.634 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.633+0000 7f18d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:59.635 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.634+0000 7f190f3af800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:39:59.635 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.634+0000 7f190f3af800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:39:59.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.640+0000 7f190f3af800 5 note: GC not initialized 2023-12-03T11:39:59.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.640+0000 7f1841ffb640 20 reqs_thread_entry: start 2023-12-03T11:39:59.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.640+0000 7f190f3af800 20 init_complete bucket index max shards: 1 2023-12-03T11:39:59.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.640+0000 7f190f3af800 20 Filter name: none 2023-12-03T11:39:59.641 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.640+0000 7f18337fe640 20 reqs_thread_entry: start 2023-12-03T11:39:59.642 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.640+0000 7f190f3af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.643 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.641+0000 7f190f3af800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:39:59.643 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.641+0000 7f190f3af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.643 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.641+0000 7f190f3af800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:39:59.643 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.641+0000 7f190f3af800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:39:59.643 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.641+0000 7f190f3af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.643 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.641+0000 7f190f3af800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:39:59.643 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.641+0000 7f190f3af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.643 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.642+0000 7f190f3af800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:39:59.643 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.642+0000 7f190f3af800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:39:59.644 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.642+0000 7f190f3af800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.644 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.642+0000 7f190f3af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.644 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.643+0000 7f18d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:59.646 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.645+0000 7f190f3af800 20 remove_watcher() i=0 2023-12-03T11:39:59.646 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.645+0000 7f190f3af800 2 removed watcher, disabling cache 2023-12-03T11:39:59.647 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.646+0000 7f190f3af800 20 remove_watcher() i=1 2023-12-03T11:39:59.648 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.647+0000 7f190f3af800 20 remove_watcher() i=2 2023-12-03T11:39:59.649 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.648+0000 7f190f3af800 20 remove_watcher() i=3 2023-12-03T11:39:59.650 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.649+0000 7f190f3af800 20 remove_watcher() i=4 2023-12-03T11:39:59.651 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.650+0000 7f190f3af800 20 remove_watcher() i=5 2023-12-03T11:39:59.652 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.651+0000 7f190f3af800 20 remove_watcher() i=6 2023-12-03T11:39:59.653 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.652+0000 7f190f3af800 20 remove_watcher() i=7 2023-12-03T11:39:59.658 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:59.658 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:39:59.658 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: a-bucket id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 num_objects: 0 size_kb: 0 num_shards: 3 2023-12-03T11:39:59.658 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:39:59.660 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket layout --bucket a-bucket 2023-12-03T11:39:59.688 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:39:59.688 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:39:59.702 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.701+0000 7f6cf9926800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.704 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.703+0000 7f6cf9926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.704 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.703+0000 7f6cf9926800 20 realm 2023-12-03T11:39:59.704 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.703+0000 7f6cf9926800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.704 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.703+0000 7f6cf9926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.704 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.703+0000 7f6cf9926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:39:59.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.703+0000 7f6cf9926800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.703+0000 7f6cf9926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.703+0000 7f6cf9926800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.704+0000 7f6cf9926800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:59.705 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.704+0000 7f6cf9926800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.706 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.705+0000 7f6cf9926800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:39:59.706 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.705+0000 7f6cf9926800 20 searching for the correct realm 2023-12-03T11:39:59.715 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.714+0000 7f6cf4dcf640 0 -- 172.21.15.44:0/1771755242 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x564e7cf022c0 msgr2=0x564e7cf046b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:59.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.715+0000 7f6cf9926800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:39:59.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.715+0000 7f6cf9926800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:39:59.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.715+0000 7f6cf9926800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:39:59.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.715+0000 7f6cf9926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:39:59.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.715+0000 7f6cf9926800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.716 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.715+0000 7f6cf9926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.717 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.715+0000 7f6cf9926800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.715+0000 7f6cf9926800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:59.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.715+0000 7f6cf9926800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.716+0000 7f6cf9926800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:39:59.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.716+0000 7f6cf9926800 20 zone default found 2023-12-03T11:39:59.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.716+0000 7f6cf9926800 4 Realm: () 2023-12-03T11:39:59.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.716+0000 7f6cf9926800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:39:59.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.716+0000 7f6cf9926800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:39:59.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.716+0000 7f6cf9926800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:39:59.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.716+0000 7f6cf9926800 20 zonegroup default 2023-12-03T11:39:59.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.716+0000 7f6cf9926800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.716+0000 7f6cf9926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.716+0000 7f6cf9926800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.716+0000 7f6cf9926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.716+0000 7f6cf9926800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.717+0000 7f6cf9926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.717+0000 7f6cf9926800 20 started sync module instance, tier type = 2023-12-03T11:39:59.719 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.717+0000 7f6cf9926800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:39:59.723 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.722+0000 7f6cf5dd1640 0 -- 172.21.15.44:0/1771755242 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f6cec066960 msgr2=0x7f6cec0943e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:59.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.726+0000 7f6cf9926800 20 add_watcher() i=0 2023-12-03T11:39:59.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.726+0000 7f6cf9926800 20 add_watcher() i=1 2023-12-03T11:39:59.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.726+0000 7f6cf9926800 20 add_watcher() i=2 2023-12-03T11:39:59.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.726+0000 7f6cf9926800 20 add_watcher() i=3 2023-12-03T11:39:59.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.726+0000 7f6cf9926800 20 add_watcher() i=4 2023-12-03T11:39:59.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.726+0000 7f6cf9926800 20 add_watcher() i=5 2023-12-03T11:39:59.727 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.726+0000 7f6cf9926800 20 add_watcher() i=6 2023-12-03T11:39:59.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.727+0000 7f6cf9926800 20 add_watcher() i=7 2023-12-03T11:39:59.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.727+0000 7f6cf9926800 2 all 8 watchers are set, enabling cache 2023-12-03T11:39:59.730 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.728+0000 7f6cbafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:59.730 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.728+0000 7f6cf9926800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:39:59.730 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.728+0000 7f6cf9926800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:39:59.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.734+0000 7f6cf9926800 5 note: GC not initialized 2023-12-03T11:39:59.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.734+0000 7f6c29ffb640 20 reqs_thread_entry: start 2023-12-03T11:39:59.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.734+0000 7f6cf9926800 20 init_complete bucket index max shards: 1 2023-12-03T11:39:59.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.735+0000 7f6cf9926800 20 Filter name: none 2023-12-03T11:39:59.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.735+0000 7f6c1b7fe640 20 reqs_thread_entry: start 2023-12-03T11:39:59.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.735+0000 7f6cf9926800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.737 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.735+0000 7f6cf9926800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:39:59.737 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.735+0000 7f6cf9926800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.737 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.736+0000 7f6cf9926800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:39:59.737 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.736+0000 7f6cf9926800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:39:59.737 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.736+0000 7f6cbafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:59.739 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.739+0000 7f6cf9926800 20 remove_watcher() i=0 2023-12-03T11:39:59.740 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.739+0000 7f6cf9926800 2 removed watcher, disabling cache 2023-12-03T11:39:59.740 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.740+0000 7f6cf9926800 20 remove_watcher() i=1 2023-12-03T11:39:59.742 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.741+0000 7f6cf9926800 20 remove_watcher() i=2 2023-12-03T11:39:59.743 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.742+0000 7f6cf9926800 20 remove_watcher() i=3 2023-12-03T11:39:59.744 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.743+0000 7f6cf9926800 20 remove_watcher() i=4 2023-12-03T11:39:59.745 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.744+0000 7f6cf9926800 20 remove_watcher() i=5 2023-12-03T11:39:59.746 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.745+0000 7f6cf9926800 20 remove_watcher() i=6 2023-12-03T11:39:59.747 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.746+0000 7f6cf9926800 20 remove_watcher() i=7 2023-12-03T11:39:59.753 INFO:tasks.workunit.client.0.smithi044.stderr:rados -p default.rgw.buckets.index setomapval .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2023-12-03T11:39:59.779 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:39:59.779 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:39:59.795 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket a-bucket 2023-12-03T11:39:59.825 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:39:59.826 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:39:59.838 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.837+0000 7f3759e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.840 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.838+0000 7f3759e0f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.840 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.838+0000 7f3759e0f800 20 realm 2023-12-03T11:39:59.840 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.838+0000 7f3759e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.840 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.838+0000 7f3759e0f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.840 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.839+0000 7f3759e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:39:59.840 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.839+0000 7f3759e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.840 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.839+0000 7f3759e0f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.840 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.839+0000 7f3759e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.841 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.840+0000 7f3759e0f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:59.841 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.840+0000 7f3759e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.841 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.840+0000 7f3759e0f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:39:59.842 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.840+0000 7f3759e0f800 20 searching for the correct realm 2023-12-03T11:39:59.851 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.849+0000 7f3754d46640 0 -- 172.21.15.44:0/160509477 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x56351b012200 msgr2=0x56351b0145f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:59.852 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.851+0000 7f3759e0f800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:39:59.852 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.851+0000 7f3759e0f800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:39:59.852 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.851+0000 7f3759e0f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:39:59.852 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.851+0000 7f3759e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:39:59.852 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.851+0000 7f3759e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.852 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.851+0000 7f3759e0f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.852 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.851+0000 7f3759e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.853 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.851+0000 7f3759e0f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:59.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.851+0000 7f3759e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.852+0000 7f3759e0f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:39:59.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.852+0000 7f3759e0f800 20 zone default found 2023-12-03T11:39:59.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.852+0000 7f3759e0f800 4 Realm: () 2023-12-03T11:39:59.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.852+0000 7f3759e0f800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:39:59.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.852+0000 7f3759e0f800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:39:59.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.852+0000 7f3759e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:39:59.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.852+0000 7f3759e0f800 20 zonegroup default 2023-12-03T11:39:59.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.852+0000 7f3759e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.852+0000 7f3759e0f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.852+0000 7f3759e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.852+0000 7f3759e0f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.852+0000 7f3759e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.853+0000 7f3759e0f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.853+0000 7f3759e0f800 20 started sync module instance, tier type = 2023-12-03T11:39:59.855 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.853+0000 7f3759e0f800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:39:59.859 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.858+0000 7f3754d46640 0 -- 172.21.15.44:0/160509477 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x7f3730079e40 msgr2=0x7f373007c270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:59.863 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.862+0000 7f3759e0f800 20 add_watcher() i=0 2023-12-03T11:39:59.863 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.862+0000 7f3759e0f800 20 add_watcher() i=1 2023-12-03T11:39:59.863 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.862+0000 7f3759e0f800 20 add_watcher() i=2 2023-12-03T11:39:59.863 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.862+0000 7f3759e0f800 20 add_watcher() i=3 2023-12-03T11:39:59.863 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.862+0000 7f3759e0f800 20 add_watcher() i=4 2023-12-03T11:39:59.863 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.862+0000 7f3759e0f800 20 add_watcher() i=5 2023-12-03T11:39:59.863 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.862+0000 7f3759e0f800 20 add_watcher() i=6 2023-12-03T11:39:59.863 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.862+0000 7f3759e0f800 20 add_watcher() i=7 2023-12-03T11:39:59.863 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.862+0000 7f3759e0f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:39:59.865 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.864+0000 7f371afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:59.865 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.864+0000 7f3759e0f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:39:59.865 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.864+0000 7f3759e0f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:39:59.872 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.870+0000 7f3759e0f800 5 note: GC not initialized 2023-12-03T11:39:59.872 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.870+0000 7f3689ffb640 20 reqs_thread_entry: start 2023-12-03T11:39:59.872 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.871+0000 7f3759e0f800 20 init_complete bucket index max shards: 1 2023-12-03T11:39:59.872 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.871+0000 7f3759e0f800 20 Filter name: none 2023-12-03T11:39:59.872 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.871+0000 7f367b7fe640 20 reqs_thread_entry: start 2023-12-03T11:39:59.872 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.871+0000 7f3759e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.873 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.871+0000 7f3759e0f800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:39:59.873 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.871+0000 7f3759e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.873 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.872+0000 7f3759e0f800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:39:59.873 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.872+0000 7f3759e0f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:39:59.873 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.872+0000 7f3759e0f800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2023-12-03T11:39:59.873 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.872+0000 7f3759e0f800 20 INFO: main: starting shard=0 2023-12-03T11:39:59.873 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.872+0000 7f3759e0f800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.2.0 2023-12-03T11:39:59.873 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.872+0000 7f3759e0f800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.2.0 2023-12-03T11:39:59.874 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.872+0000 7f3759e0f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:39:59.874 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.872+0000 7f3759e0f800 20 INFO: main: starting shard=1 2023-12-03T11:39:59.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.872+0000 7f3759e0f800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.2.1 2023-12-03T11:39:59.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.872+0000 7f3759e0f800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.2.1 2023-12-03T11:39:59.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.873+0000 7f3759e0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:39:59.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.873+0000 7f3759e0f800 20 INFO: main: starting shard=2 2023-12-03T11:39:59.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.873+0000 7f3759e0f800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.2.2 2023-12-03T11:39:59.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.873+0000 7f3759e0f800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.2.2 2023-12-03T11:39:59.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.873+0000 7f3759e0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:39:59.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.873+0000 7f3759e0f800 20 INFO: main: done 2023-12-03T11:39:59.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.874+0000 7f371afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:59.877 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.876+0000 7f3759e0f800 20 remove_watcher() i=0 2023-12-03T11:39:59.877 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.876+0000 7f3759e0f800 2 removed watcher, disabling cache 2023-12-03T11:39:59.879 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.877+0000 7f3759e0f800 20 remove_watcher() i=1 2023-12-03T11:39:59.879 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.878+0000 7f3759e0f800 20 remove_watcher() i=2 2023-12-03T11:39:59.881 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.879+0000 7f3759e0f800 20 remove_watcher() i=3 2023-12-03T11:39:59.881 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.880+0000 7f3759e0f800 20 remove_watcher() i=4 2023-12-03T11:39:59.882 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.881+0000 7f3759e0f800 20 remove_watcher() i=5 2023-12-03T11:39:59.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.882+0000 7f3759e0f800 20 remove_watcher() i=6 2023-12-03T11:39:59.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.883+0000 7f3759e0f800 20 remove_watcher() i=7 2023-12-03T11:39:59.891 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2023-12-03T11:39:59.922 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:39:59.922 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:39:59.936 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.935+0000 7febba929800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.938 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.936+0000 7febba929800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.938 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.936+0000 7febba929800 20 realm 2023-12-03T11:39:59.938 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.936+0000 7febba929800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.938 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.937+0000 7febba929800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.938 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.937+0000 7febba929800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:39:59.938 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.937+0000 7febba929800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.938 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.937+0000 7febba929800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.938 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.937+0000 7febba929800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.939 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.938+0000 7febba929800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:59.939 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.938+0000 7febba929800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.939 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.938+0000 7febba929800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:39:59.939 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.938+0000 7febba929800 20 searching for the correct realm 2023-12-03T11:39:59.951 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.948+0000 7febb6ec0640 0 -- 172.21.15.44:0/4228008339 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x558a48893440 msgr2=0x558a48895900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:59.951 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.948+0000 7febba929800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:39:59.952 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.948+0000 7febba929800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:39:59.952 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.948+0000 7febba929800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:39:59.952 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.948+0000 7febba929800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:39:59.952 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.948+0000 7febba929800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.953 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.949+0000 7febba929800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.953 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.949+0000 7febba929800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.953 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.949+0000 7febba929800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:39:59.953 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.949+0000 7febba929800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.953 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.949+0000 7febba929800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:39:59.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.949+0000 7febba929800 20 zone default found 2023-12-03T11:39:59.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.949+0000 7febba929800 4 Realm: () 2023-12-03T11:39:59.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.949+0000 7febba929800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:39:59.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.949+0000 7febba929800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:39:59.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.949+0000 7febba929800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:39:59.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.949+0000 7febba929800 20 zonegroup default 2023-12-03T11:39:59.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.949+0000 7febba929800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.949+0000 7febba929800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.949+0000 7febba929800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.950+0000 7febba929800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.950+0000 7febba929800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.950+0000 7febba929800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:39:59.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.950+0000 7febba929800 20 started sync module instance, tier type = 2023-12-03T11:39:59.954 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.950+0000 7febba929800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:39:59.957 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.956+0000 7febb6ec0640 0 -- 172.21.15.44:0/4228008339 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x7feb90079e10 msgr2=0x7feb9007c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:39:59.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.959+0000 7febba929800 20 add_watcher() i=0 2023-12-03T11:39:59.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.959+0000 7febba929800 20 add_watcher() i=1 2023-12-03T11:39:59.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.959+0000 7febba929800 20 add_watcher() i=2 2023-12-03T11:39:59.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.959+0000 7febba929800 20 add_watcher() i=3 2023-12-03T11:39:59.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.959+0000 7febba929800 20 add_watcher() i=4 2023-12-03T11:39:59.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.959+0000 7febba929800 20 add_watcher() i=5 2023-12-03T11:39:59.960 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.959+0000 7febba929800 20 add_watcher() i=6 2023-12-03T11:39:59.961 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.960+0000 7febba929800 20 add_watcher() i=7 2023-12-03T11:39:59.961 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.960+0000 7febba929800 2 all 8 watchers are set, enabling cache 2023-12-03T11:39:59.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.962+0000 7feb7bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:59.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.962+0000 7febba929800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:39:59.963 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.962+0000 7febba929800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:39:59.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.968+0000 7febba929800 5 note: GC not initialized 2023-12-03T11:39:59.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.968+0000 7feaeaffd640 20 reqs_thread_entry: start 2023-12-03T11:39:59.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.968+0000 7febba929800 20 init_complete bucket index max shards: 1 2023-12-03T11:39:59.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.969+0000 7febba929800 20 Filter name: none 2023-12-03T11:39:59.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.969+0000 7feae8ff9640 20 reqs_thread_entry: start 2023-12-03T11:39:59.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.969+0000 7febba929800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2023-12-03T11:39:59.970 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.969+0000 7febba929800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.971 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.969+0000 7febba929800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:39:59.971 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.969+0000 7febba929800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2023-12-03T11:39:59.971 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.969+0000 7febba929800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2023-12-03T11:39:59.971 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.969+0000 7febba929800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 : miss 2023-12-03T11:39:59.971 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.969+0000 7febba929800 20 rados->read ofs=0 len=0 2023-12-03T11:39:59.971 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.970+0000 7febba929800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:39:59.971 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.970+0000 7febba929800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 info.flags=0x17 2023-12-03T11:39:59.971 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.970+0000 7febba929800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 to cache LRU end 2023-12-03T11:39:59.971 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.970+0000 7febba929800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:39:59.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.970+0000 7febba929800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:39:59.972 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.970+0000 7febba929800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 2023-12-03T11:39:59.976 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.974+0000 7febba929800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 info.flags=0x17 2023-12-03T11:39:59.976 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.974+0000 7febba929800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 to cache LRU end 2023-12-03T11:39:59.976 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.974+0000 7febba929800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:39:59.976 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.974+0000 7febba929800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16, ofs0, ns] 2023-12-03T11:39:59.976 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.975+0000 7feb97fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693265 cookie 94052410812256 notifier 7491 bl.length()=789 2023-12-03T11:39:59.976 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.975+0000 7feb97fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 info.flags=0x17 2023-12-03T11:39:59.976 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.975+0000 7feb97fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 to cache LRU end 2023-12-03T11:39:59.976 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.975+0000 7feb97fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:39:59.977 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.975+0000 7febba929800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): orig_sources= new_sources= 2023-12-03T11:39:59.977 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.975+0000 7febba929800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): potential sources added=[] removed=[] 2023-12-03T11:39:59.977 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.975+0000 7febba929800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): orig_dests= new_dests= 2023-12-03T11:39:59.977 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.975+0000 7febba929800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): potential dests added=[] removed=[] 2023-12-03T11:39:59.977 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.977+0000 7febba929800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.3.0 2023-12-03T11:39:59.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.977+0000 7febba929800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.3.0 2023-12-03T11:39:59.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.977+0000 7febba929800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.2.0 2023-12-03T11:39:59.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.977+0000 7febba929800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.2.0 2023-12-03T11:39:59.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.977+0000 7febba929800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2023-12-03T11:39:59.978 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.977+0000 7febba929800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.2.1 2023-12-03T11:39:59.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.977+0000 7febba929800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.2.1 2023-12-03T11:39:59.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.977+0000 7febba929800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.2.2 2023-12-03T11:39:59.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.977+0000 7febba929800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.2.2 2023-12-03T11:39:59.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.978+0000 7febba929800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 : hit (requested=0x17, cached=0x17) 2023-12-03T11:39:59.979 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.978+0000 7febba929800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 2023-12-03T11:39:59.980 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.979+0000 7febba929800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 info.flags=0x17 2023-12-03T11:39:59.981 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.979+0000 7febba929800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 to cache LRU end 2023-12-03T11:39:59.981 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.979+0000 7febba929800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:39:59.981 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.979+0000 7febba929800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16, ofs0, ns] 2023-12-03T11:39:59.981 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.979+0000 7feb97fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693266 cookie 94052410812256 notifier 7491 bl.length()=757 2023-12-03T11:39:59.981 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.980+0000 7feb97fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 info.flags=0x17 2023-12-03T11:39:59.981 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.980+0000 7feb97fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16 to cache LRU end 2023-12-03T11:39:59.981 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.980+0000 7feb97fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:39:59.981 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.980+0000 7febba929800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): orig_sources= new_sources= 2023-12-03T11:39:59.981 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.980+0000 7febba929800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): potential sources added=[] removed=[] 2023-12-03T11:39:59.981 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.980+0000 7febba929800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): orig_dests= new_dests= 2023-12-03T11:39:59.982 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.980+0000 7febba929800 20 handle_bi_update(): bucket=:a-bucket[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16]): potential dests added=[] removed=[] 2023-12-03T11:39:59.982 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.981+0000 7febba929800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2023-12-03T11:39:59.984 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.983+0000 7feb7bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:39:59.986 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.985+0000 7febba929800 20 remove_watcher() i=0 2023-12-03T11:39:59.986 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.985+0000 7febba929800 2 removed watcher, disabling cache 2023-12-03T11:39:59.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.986+0000 7febba929800 20 remove_watcher() i=1 2023-12-03T11:39:59.988 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.987+0000 7febba929800 20 remove_watcher() i=2 2023-12-03T11:39:59.989 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.988+0000 7febba929800 20 remove_watcher() i=3 2023-12-03T11:39:59.990 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.989+0000 7febba929800 20 remove_watcher() i=4 2023-12-03T11:39:59.991 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.990+0000 7febba929800 20 remove_watcher() i=5 2023-12-03T11:39:59.992 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.991+0000 7febba929800 20 remove_watcher() i=6 2023-12-03T11:39:59.993 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:39:59.992+0000 7febba929800 20 remove_watcher() i=7 2023-12-03T11:39:59.999 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket a-bucket 2023-12-03T11:40:00.029 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:40:00.030 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:40:00.043 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.041+0000 7f058372c800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.043+0000 7f058372c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:00.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.043+0000 7f058372c800 20 realm 2023-12-03T11:40:00.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.043+0000 7f058372c800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.043+0000 7f058372c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:00.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.043+0000 7f058372c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:40:00.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.043+0000 7f058372c800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.044+0000 7f058372c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:00.045 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.044+0000 7f058372c800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.046 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.045+0000 7f058372c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:40:00.046 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.045+0000 7f058372c800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.046 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.045+0000 7f058372c800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:40:00.046 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.045+0000 7f058372c800 20 searching for the correct realm 2023-12-03T11:40:00.055 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.055+0000 7f057f4f0640 0 -- 172.21.15.44:0/3947305158 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x5599f875fd80 msgr2=0x5599f8762170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:40:00.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.056+0000 7f058372c800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:40:00.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.056+0000 7f058372c800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:40:00.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.056+0000 7f058372c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:40:00.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.056+0000 7f058372c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:40:00.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.056+0000 7f058372c800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.056+0000 7f058372c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:00.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.056+0000 7f058372c800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.056+0000 7f058372c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:40:00.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.057+0000 7f058372c800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.058 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.057+0000 7f058372c800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:40:00.059 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.057+0000 7f058372c800 20 zone default found 2023-12-03T11:40:00.059 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.057+0000 7f058372c800 4 Realm: () 2023-12-03T11:40:00.059 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.057+0000 7f058372c800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:40:00.059 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.057+0000 7f058372c800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:40:00.059 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.057+0000 7f058372c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:40:00.059 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.057+0000 7f058372c800 20 zonegroup default 2023-12-03T11:40:00.059 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.057+0000 7f058372c800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.059 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.057+0000 7f058372c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:00.059 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.057+0000 7f058372c800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.057+0000 7f058372c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:00.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.057+0000 7f058372c800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.058+0000 7f058372c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:00.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.058+0000 7f058372c800 20 started sync module instance, tier type = 2023-12-03T11:40:00.060 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.058+0000 7f058372c800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:40:00.065 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.064+0000 7f057fcf1640 0 -- 172.21.15.44:0/3947305158 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x5599f8767e10 msgr2=0x5599f876a2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:40:00.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.068+0000 7f058372c800 20 add_watcher() i=0 2023-12-03T11:40:00.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.068+0000 7f058372c800 20 add_watcher() i=1 2023-12-03T11:40:00.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.068+0000 7f058372c800 20 add_watcher() i=2 2023-12-03T11:40:00.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.068+0000 7f058372c800 20 add_watcher() i=3 2023-12-03T11:40:00.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.068+0000 7f058372c800 20 add_watcher() i=4 2023-12-03T11:40:00.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.068+0000 7f058372c800 20 add_watcher() i=5 2023-12-03T11:40:00.069 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.068+0000 7f058372c800 20 add_watcher() i=6 2023-12-03T11:40:00.070 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.069+0000 7f058372c800 20 add_watcher() i=7 2023-12-03T11:40:00.070 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.069+0000 7f058372c800 2 all 8 watchers are set, enabling cache 2023-12-03T11:40:00.072 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.070+0000 7f05457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:40:00.072 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.071+0000 7f058372c800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:40:00.072 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.071+0000 7f058372c800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:40:00.078 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.077+0000 7f058372c800 5 note: GC not initialized 2023-12-03T11:40:00.078 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.077+0000 7f04b3fff640 20 reqs_thread_entry: start 2023-12-03T11:40:00.079 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.077+0000 7f058372c800 20 init_complete bucket index max shards: 1 2023-12-03T11:40:00.079 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.077+0000 7f058372c800 20 Filter name: none 2023-12-03T11:40:00.079 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.077+0000 7f04b1ffb640 20 reqs_thread_entry: start 2023-12-03T11:40:00.079 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.077+0000 7f058372c800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.078+0000 7f058372c800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:40:00.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.078+0000 7f058372c800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.078+0000 7f058372c800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:40:00.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.078+0000 7f058372c800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:40:00.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.078+0000 7f058372c800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2023-12-03T11:40:00.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.078+0000 7f058372c800 20 INFO: main: starting shard=0 2023-12-03T11:40:00.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.078+0000 7f058372c800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.3.0 2023-12-03T11:40:00.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.078+0000 7f058372c800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.16.3.0 2023-12-03T11:40:00.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.079+0000 7f058372c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:40:00.080 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.079+0000 7f058372c800 20 INFO: main: done 2023-12-03T11:40:00.081 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.080+0000 7f05457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:40:00.082 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.082+0000 7f058372c800 20 remove_watcher() i=0 2023-12-03T11:40:00.083 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.082+0000 7f058372c800 2 removed watcher, disabling cache 2023-12-03T11:40:00.084 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.083+0000 7f058372c800 20 remove_watcher() i=1 2023-12-03T11:40:00.085 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.084+0000 7f058372c800 20 remove_watcher() i=2 2023-12-03T11:40:00.085 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.085+0000 7f058372c800 20 remove_watcher() i=3 2023-12-03T11:40:00.086 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.085+0000 7f058372c800 20 remove_watcher() i=4 2023-12-03T11:40:00.088 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.087+0000 7f058372c800 20 remove_watcher() i=5 2023-12-03T11:40:00.089 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.088+0000 7f058372c800 20 remove_watcher() i=6 2023-12-03T11:40:00.090 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.089+0000 7f058372c800 20 remove_watcher() i=7 2023-12-03T11:40:00.094 INFO:tasks.workunit.client.0.smithi044.stderr: test: PUT succeeds during reshard 2023-12-03T11:40:00.096 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket myver 2023-12-03T11:40:00.124 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:40:00.124 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:40:00.140 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.139+0000 7f5bd9725800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.140+0000 7f5bd9725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:00.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.140+0000 7f5bd9725800 20 realm 2023-12-03T11:40:00.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.140+0000 7f5bd9725800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.141+0000 7f5bd9725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:00.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.141+0000 7f5bd9725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:40:00.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.141+0000 7f5bd9725800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.141+0000 7f5bd9725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:00.142 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.141+0000 7f5bd9725800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.143 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.142+0000 7f5bd9725800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:40:00.143 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.142+0000 7f5bd9725800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.143 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.142+0000 7f5bd9725800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:40:00.143 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.142+0000 7f5bd9725800 20 searching for the correct realm 2023-12-03T11:40:00.151 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.150+0000 7f5bd5b55640 0 -- 172.21.15.44:0/2006185994 >> [v2:172.21.15.44:6808/1530174506,v1:172.21.15.44:6809/1530174506] conn(0x556dd4a34890 msgr2=0x556dd4a36c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:40:00.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.153+0000 7f5bd9725800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:40:00.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.153+0000 7f5bd9725800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:40:00.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.153+0000 7f5bd9725800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:40:00.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.153+0000 7f5bd9725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:40:00.154 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.153+0000 7f5bd9725800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.153+0000 7f5bd9725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:00.155 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.153+0000 7f5bd9725800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.156 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.153+0000 7f5bd9725800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:40:00.156 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.153+0000 7f5bd9725800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.156 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.154+0000 7f5bd9725800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:40:00.156 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.154+0000 7f5bd9725800 20 zone default found 2023-12-03T11:40:00.156 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.154+0000 7f5bd9725800 4 Realm: () 2023-12-03T11:40:00.156 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.154+0000 7f5bd9725800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:40:00.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.154+0000 7f5bd9725800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:40:00.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.154+0000 7f5bd9725800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:40:00.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.154+0000 7f5bd9725800 20 zonegroup default 2023-12-03T11:40:00.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.154+0000 7f5bd9725800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.154+0000 7f5bd9725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:00.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.154+0000 7f5bd9725800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.154+0000 7f5bd9725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:00.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.154+0000 7f5bd9725800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.155+0000 7f5bd5b55640 0 -- 172.21.15.44:0/2006185994 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x556dd4a407c0 msgr2=0x556dd4a42c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:40:00.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.155+0000 7f5bd9725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:00.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.155+0000 7f5bd9725800 20 started sync module instance, tier type = 2023-12-03T11:40:00.157 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.155+0000 7f5bd9725800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:40:00.165 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.163+0000 7f5bd9725800 20 add_watcher() i=0 2023-12-03T11:40:00.165 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.163+0000 7f5bd9725800 20 add_watcher() i=1 2023-12-03T11:40:00.165 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.163+0000 7f5bd9725800 20 add_watcher() i=2 2023-12-03T11:40:00.165 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.163+0000 7f5bd9725800 20 add_watcher() i=3 2023-12-03T11:40:00.165 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.163+0000 7f5bd9725800 20 add_watcher() i=4 2023-12-03T11:40:00.165 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.163+0000 7f5bd9725800 20 add_watcher() i=5 2023-12-03T11:40:00.165 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.163+0000 7f5bd9725800 20 add_watcher() i=6 2023-12-03T11:40:00.166 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.164+0000 7f5bd9725800 20 add_watcher() i=7 2023-12-03T11:40:00.166 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.164+0000 7f5bd9725800 2 all 8 watchers are set, enabling cache 2023-12-03T11:40:00.167 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.166+0000 7f5b9afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:40:00.167 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.166+0000 7f5bd9725800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:40:00.167 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.166+0000 7f5bd9725800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:40:00.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.172+0000 7f5bd9725800 5 note: GC not initialized 2023-12-03T11:40:00.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.172+0000 7f5b09ffb640 20 reqs_thread_entry: start 2023-12-03T11:40:00.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.172+0000 7f5bd9725800 20 init_complete bucket index max shards: 1 2023-12-03T11:40:00.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.172+0000 7f5bd9725800 20 Filter name: none 2023-12-03T11:40:00.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.172+0000 7f5afb7fe640 20 reqs_thread_entry: start 2023-12-03T11:40:00.174 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.173+0000 7f5bd9725800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.175 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.173+0000 7f5bd9725800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:40:00.175 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.173+0000 7f5bd9725800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.175 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.174+0000 7f5bd9725800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:40:00.175 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.174+0000 7f5bd9725800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:40:00.175 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.174+0000 7f5bd9725800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.175 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.174+0000 7f5bd9725800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:40:00.175 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.174+0000 7f5bd9725800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.175+0000 7f5bd9725800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:40:00.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.175+0000 7f5bd9725800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:40:00.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.175+0000 7f5bd9725800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.176 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.175+0000 7f5bd9725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:00.177 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.176+0000 7f5b9afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:40:00.179 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.178+0000 7f5bd9725800 20 remove_watcher() i=0 2023-12-03T11:40:00.179 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.178+0000 7f5bd9725800 2 removed watcher, disabling cache 2023-12-03T11:40:00.180 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.179+0000 7f5bd9725800 20 remove_watcher() i=1 2023-12-03T11:40:00.181 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.180+0000 7f5bd9725800 20 remove_watcher() i=2 2023-12-03T11:40:00.182 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.181+0000 7f5bd9725800 20 remove_watcher() i=3 2023-12-03T11:40:00.183 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.182+0000 7f5bd9725800 20 remove_watcher() i=4 2023-12-03T11:40:00.184 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.183+0000 7f5bd9725800 20 remove_watcher() i=5 2023-12-03T11:40:00.185 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.184+0000 7f5bd9725800 20 remove_watcher() i=6 2023-12-03T11:40:00.186 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.185+0000 7f5bd9725800 20 remove_watcher() i=7 2023-12-03T11:40:00.191 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:40:00.192 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2023-12-03T11:40:00.192 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: myver id: ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 num_objects: 0 size_kb: 0 num_shards: 2 2023-12-03T11:40:00.192 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:40:00.193 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 3 2023-12-03T11:40:00.224 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:40:00.224 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:40:00.239 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.238+0000 7fdf85f21800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.240+0000 7fdf85f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:00.241 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.240+0000 7fdf85f21800 20 realm 2023-12-03T11:40:00.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.240+0000 7fdf85f21800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.240+0000 7fdf85f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:00.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.240+0000 7fdf85f21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:40:00.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.240+0000 7fdf85f21800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.240+0000 7fdf85f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:00.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.240+0000 7fdf85f21800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.241+0000 7fdf85f21800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:40:00.242 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.241+0000 7fdf85f21800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.242+0000 7fdf85f21800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:40:00.243 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.242+0000 7fdf85f21800 20 searching for the correct realm 2023-12-03T11:40:00.252 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.251+0000 7fdf81cb8640 0 -- 172.21.15.44:0/3947715878 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55ea13b866d0 msgr2=0x55ea13b88ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:40:00.254 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.252+0000 7fdf85f21800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:40:00.254 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.252+0000 7fdf85f21800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:40:00.254 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.252+0000 7fdf85f21800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:40:00.254 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.252+0000 7fdf85f21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:40:00.254 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.253+0000 7fdf85f21800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.254 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.253+0000 7fdf85f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:00.254 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.253+0000 7fdf85f21800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.255 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.253+0000 7fdf85f21800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:40:00.255 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.253+0000 7fdf85f21800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.255 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.253+0000 7fdf85f21800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:40:00.255 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.253+0000 7fdf85f21800 20 zone default found 2023-12-03T11:40:00.255 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.253+0000 7fdf85f21800 4 Realm: () 2023-12-03T11:40:00.255 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.253+0000 7fdf85f21800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:40:00.256 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.253+0000 7fdf85f21800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:40:00.256 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.253+0000 7fdf85f21800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:40:00.256 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.253+0000 7fdf85f21800 20 zonegroup default 2023-12-03T11:40:00.256 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.253+0000 7fdf85f21800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.256 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.253+0000 7fdf85f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:00.256 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.253+0000 7fdf85f21800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.256 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.254+0000 7fdf85f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:00.256 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.254+0000 7fdf85f21800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.256 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.254+0000 7fdf85f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:00.256 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.254+0000 7fdf85f21800 20 started sync module instance, tier type = 2023-12-03T11:40:00.256 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.254+0000 7fdf85f21800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:40:00.261 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.260+0000 7fdf824b9640 0 -- 172.21.15.44:0/3947715878 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55ea13b8e760 msgr2=0x55ea13b90c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:40:00.264 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.263+0000 7fdf85f21800 20 add_watcher() i=0 2023-12-03T11:40:00.264 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.263+0000 7fdf85f21800 20 add_watcher() i=1 2023-12-03T11:40:00.264 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.263+0000 7fdf85f21800 20 add_watcher() i=2 2023-12-03T11:40:00.264 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.263+0000 7fdf85f21800 20 add_watcher() i=3 2023-12-03T11:40:00.264 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.263+0000 7fdf85f21800 20 add_watcher() i=4 2023-12-03T11:40:00.265 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.263+0000 7fdf85f21800 20 add_watcher() i=5 2023-12-03T11:40:00.265 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.263+0000 7fdf85f21800 20 add_watcher() i=6 2023-12-03T11:40:00.265 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.264+0000 7fdf85f21800 20 add_watcher() i=7 2023-12-03T11:40:00.265 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.264+0000 7fdf85f21800 2 all 8 watchers are set, enabling cache 2023-12-03T11:40:00.267 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.266+0000 7fdf477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:40:00.267 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.266+0000 7fdf85f21800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:40:00.267 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.266+0000 7fdf85f21800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:40:00.273 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.272+0000 7fdf85f21800 5 note: GC not initialized 2023-12-03T11:40:00.274 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.272+0000 7fdeb67fc640 20 reqs_thread_entry: start 2023-12-03T11:40:00.274 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.272+0000 7fdf85f21800 20 init_complete bucket index max shards: 1 2023-12-03T11:40:00.274 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.272+0000 7fdf85f21800 20 Filter name: none 2023-12-03T11:40:00.274 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.272+0000 7fdea7fff640 20 reqs_thread_entry: start 2023-12-03T11:40:00.274 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.273+0000 7fdf85f21800 10 cache get: name=default.rgw.meta+root+myver : miss 2023-12-03T11:40:00.274 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.273+0000 7fdf85f21800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.273+0000 7fdf85f21800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:40:00.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.273+0000 7fdf85f21800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2023-12-03T11:40:00.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.273+0000 7fdf85f21800 10 adding default.rgw.meta+root+myver to cache LRU end 2023-12-03T11:40:00.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.273+0000 7fdf85f21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 : miss 2023-12-03T11:40:00.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.273+0000 7fdf85f21800 20 rados->read ofs=0 len=0 2023-12-03T11:40:00.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.274+0000 7fdf85f21800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:40:00.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.274+0000 7fdf85f21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 info.flags=0x17 2023-12-03T11:40:00.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.274+0000 7fdf85f21800 10 adding default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 to cache LRU end 2023-12-03T11:40:00.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.274+0000 7fdf85f21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:40:00.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.274+0000 7fdf85f21800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:40:00.275 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.274+0000 7fdf85f21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 2023-12-03T11:40:00.279 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.278+0000 7fdf85f21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 info.flags=0x17 2023-12-03T11:40:00.279 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.278+0000 7fdf85f21800 10 moving default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 to cache LRU end 2023-12-03T11:40:00.279 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.278+0000 7fdf85f21800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:40:00.279 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.278+0000 7fdf85f21800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17, ofs0, ns] 2023-12-03T11:40:00.279 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.278+0000 7fdf637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693220 cookie 94463841610912 notifier 7145 bl.length()=783 2023-12-03T11:40:00.279 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.278+0000 7fdf637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 info.flags=0x17 2023-12-03T11:40:00.279 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.278+0000 7fdf637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 to cache LRU end 2023-12-03T11:40:00.279 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.278+0000 7fdf637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:40:00.280 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.278+0000 7fdf85f21800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): orig_sources= new_sources= 2023-12-03T11:40:00.280 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.278+0000 7fdf85f21800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): potential sources added=[] removed=[] 2023-12-03T11:40:00.280 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.278+0000 7fdf85f21800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): orig_dests= new_dests= 2023-12-03T11:40:00.280 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.278+0000 7fdf85f21800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): potential dests added=[] removed=[] 2023-12-03T11:40:00.281 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:00.280+0000 7fdf85f21800 -1 Injecting delay=5.000000000s at location=do_reshard 2023-12-03T11:40:05.281 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.280+0000 7fdf85f21800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.0 2023-12-03T11:40:05.281 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.280+0000 7fdf85f21800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.0 2023-12-03T11:40:05.282 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.280+0000 7fdf85f21800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.1 2023-12-03T11:40:05.282 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.280+0000 7fdf85f21800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.1 2023-12-03T11:40:05.282 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.280+0000 7fdf85f21800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.2 2023-12-03T11:40:05.282 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.280+0000 7fdf85f21800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.2 2023-12-03T11:40:05.282 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.280+0000 7fdf85f21800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.1.0 2023-12-03T11:40:05.282 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.280+0000 7fdf85f21800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.1.0 2023-12-03T11:40:05.282 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.281+0000 7fdf85f21800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.1.1 2023-12-03T11:40:05.282 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.281+0000 7fdf85f21800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.1.1 2023-12-03T11:40:05.283 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.281+0000 7fdf85f21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 : hit (requested=0x17, cached=0x17) 2023-12-03T11:40:05.283 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.281+0000 7fdf85f21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 2023-12-03T11:40:05.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.284+0000 7fdf85f21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 info.flags=0x17 2023-12-03T11:40:05.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.284+0000 7fdf85f21800 10 moving default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 to cache LRU end 2023-12-03T11:40:05.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.284+0000 7fdf85f21800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:40:05.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.284+0000 7fdf85f21800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17, ofs0, ns] 2023-12-03T11:40:05.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.284+0000 7fdf637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693221 cookie 94463841610912 notifier 7145 bl.length()=751 2023-12-03T11:40:05.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.284+0000 7fdf637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 info.flags=0x17 2023-12-03T11:40:05.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.284+0000 7fdf637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 to cache LRU end 2023-12-03T11:40:05.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.284+0000 7fdf637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:40:05.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.284+0000 7fdf85f21800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): orig_sources= new_sources= 2023-12-03T11:40:05.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.284+0000 7fdf85f21800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): potential sources added=[] removed=[] 2023-12-03T11:40:05.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.284+0000 7fdf85f21800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): orig_dests= new_dests= 2023-12-03T11:40:05.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.284+0000 7fdf85f21800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): potential dests added=[] removed=[] 2023-12-03T11:40:05.287 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.286+0000 7fdf85f21800 1 execute INFO: reshard of bucket "myver" completed successfully 2023-12-03T11:40:05.290 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.289+0000 7fdf477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:40:05.292 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.291+0000 7fdf85f21800 20 remove_watcher() i=0 2023-12-03T11:40:05.292 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.291+0000 7fdf85f21800 2 removed watcher, disabling cache 2023-12-03T11:40:05.294 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.293+0000 7fdf85f21800 20 remove_watcher() i=1 2023-12-03T11:40:05.295 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.294+0000 7fdf85f21800 20 remove_watcher() i=2 2023-12-03T11:40:05.297 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.296+0000 7fdf85f21800 20 remove_watcher() i=3 2023-12-03T11:40:05.298 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.297+0000 7fdf85f21800 20 remove_watcher() i=4 2023-12-03T11:40:05.299 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.298+0000 7fdf85f21800 20 remove_watcher() i=5 2023-12-03T11:40:05.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.299+0000 7fdf85f21800 20 remove_watcher() i=6 2023-12-03T11:40:05.302 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:05.301+0000 7fdf85f21800 20 remove_watcher() i=7 2023-12-03T11:40:06.222 INFO:tasks.workunit.client.0.smithi044.stderr:put object successful 2023-12-03T11:40:06.223 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2023-12-03T11:40:06.223 INFO:tasks.workunit.client.0.smithi044.stderr: 2023-12-03T11:40:06.368 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2023-12-03T11:40:06.766 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2023-12-03T11:40:08.214 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:40:08.216 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket myver --object x 2023-12-03T11:40:08.251 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:40:08.251 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:40:08.267 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.266+0000 7f57bc911800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.270 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.268+0000 7f57bc911800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:08.270 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.268+0000 7f57bc911800 20 realm 2023-12-03T11:40:08.270 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.268+0000 7f57bc911800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.270 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.268+0000 7f57bc911800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:08.270 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.268+0000 7f57bc911800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:40:08.270 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.268+0000 7f57bc911800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.270 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.269+0000 7f57bc911800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:08.270 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.269+0000 7f57bc911800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.270+0000 7f57bc911800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:40:08.271 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.270+0000 7f57bc911800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.272 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.271+0000 7f57bc911800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:40:08.272 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.271+0000 7f57bc911800 20 searching for the correct realm 2023-12-03T11:40:08.283 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.283+0000 7f57bac12640 0 -- 172.21.15.44:0/2610318299 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55ebe6a60bc0 msgr2=0x55ebe6a63030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:40:08.285 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.284+0000 7f57bc911800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:40:08.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.284+0000 7f57bc911800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:40:08.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.284+0000 7f57bc911800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:40:08.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.284+0000 7f57bc911800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:40:08.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.284+0000 7f57bc911800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.284+0000 7f57bc911800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:08.286 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.284+0000 7f57bc911800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.287 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.285+0000 7f57bc911800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:40:08.287 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.285+0000 7f57bc911800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.287 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.285+0000 7f57bc911800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:40:08.287 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.285+0000 7f57bc911800 20 zone default found 2023-12-03T11:40:08.287 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.285+0000 7f57bc911800 4 Realm: () 2023-12-03T11:40:08.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.285+0000 7f57bc911800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:40:08.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.285+0000 7f57bc911800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:40:08.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.285+0000 7f57bc911800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:40:08.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.285+0000 7f57bc911800 20 zonegroup default 2023-12-03T11:40:08.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.285+0000 7f57bc911800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.285+0000 7f57bc911800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:08.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.285+0000 7f57bc911800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.286+0000 7f57bc911800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:08.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.286+0000 7f57bc911800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.286+0000 7f57bc911800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:08.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.286+0000 7f57bc911800 20 started sync module instance, tier type = 2023-12-03T11:40:08.288 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.286+0000 7f57bc911800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:40:08.295 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.294+0000 7f57bac12640 0 -- 172.21.15.44:0/2610318299 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f57b0099130 msgr2=0x7f57b00b8860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:40:08.298 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.297+0000 7f57bc911800 20 add_watcher() i=0 2023-12-03T11:40:08.298 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.297+0000 7f57bc911800 20 add_watcher() i=1 2023-12-03T11:40:08.298 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.297+0000 7f57bc911800 20 add_watcher() i=2 2023-12-03T11:40:08.298 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.297+0000 7f57bc911800 20 add_watcher() i=3 2023-12-03T11:40:08.298 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.297+0000 7f57bc911800 20 add_watcher() i=4 2023-12-03T11:40:08.298 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.297+0000 7f57bc911800 20 add_watcher() i=5 2023-12-03T11:40:08.298 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.297+0000 7f57bc911800 20 add_watcher() i=6 2023-12-03T11:40:08.299 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.298+0000 7f57bc911800 20 add_watcher() i=7 2023-12-03T11:40:08.299 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.298+0000 7f57bc911800 2 all 8 watchers are set, enabling cache 2023-12-03T11:40:08.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.299+0000 7f577ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:40:08.300 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.300+0000 7f57bc911800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:40:08.301 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.300+0000 7f57bc911800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:40:08.308 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.306+0000 7f57bc911800 5 note: GC not initialized 2023-12-03T11:40:08.308 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.306+0000 7f56eeffd640 20 reqs_thread_entry: start 2023-12-03T11:40:08.308 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.306+0000 7f57bc911800 20 init_complete bucket index max shards: 1 2023-12-03T11:40:08.308 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.306+0000 7f57bc911800 20 Filter name: none 2023-12-03T11:40:08.308 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.307+0000 7f56ecff9640 20 reqs_thread_entry: start 2023-12-03T11:40:08.308 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.307+0000 7f57bc911800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.308 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.307+0000 7f57bc911800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:40:08.309 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.307+0000 7f57bc911800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.309 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.308+0000 7f57bc911800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:40:08.309 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.308+0000 7f57bc911800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:40:08.309 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.308+0000 7f57bc911800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2023-12-03T11:40:08.309 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.308+0000 7f57bc911800 20 INFO: main: starting shard=0 2023-12-03T11:40:08.309 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.308+0000 7f57bc911800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.0 2023-12-03T11:40:08.309 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.308+0000 7f57bc911800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.0 2023-12-03T11:40:08.310 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.308+0000 7f57bc911800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:40:08.310 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.309+0000 7f57bc911800 20 INFO: main: starting shard=1 2023-12-03T11:40:08.310 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.309+0000 7f57bc911800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.1 2023-12-03T11:40:08.310 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.309+0000 7f57bc911800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.1 2023-12-03T11:40:08.310 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.309+0000 7f57bc911800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:40:08.310 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.309+0000 7f57bc911800 20 INFO: main: starting shard=2 2023-12-03T11:40:08.310 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.309+0000 7f57bc911800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.2 2023-12-03T11:40:08.310 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.309+0000 7f57bc911800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.2 2023-12-03T11:40:08.311 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.310+0000 7f57bc911800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:40:08.311 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.310+0000 7f57bc911800 20 INFO: main: done 2023-12-03T11:40:08.311 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.311+0000 7f577ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:40:08.314 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.313+0000 7f57bc911800 20 remove_watcher() i=0 2023-12-03T11:40:08.314 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.313+0000 7f57bc911800 2 removed watcher, disabling cache 2023-12-03T11:40:08.315 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.314+0000 7f57bc911800 20 remove_watcher() i=1 2023-12-03T11:40:08.316 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.315+0000 7f57bc911800 20 remove_watcher() i=2 2023-12-03T11:40:08.317 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.316+0000 7f57bc911800 20 remove_watcher() i=3 2023-12-03T11:40:08.318 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.317+0000 7f57bc911800 20 remove_watcher() i=4 2023-12-03T11:40:08.319 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.318+0000 7f57bc911800 20 remove_watcher() i=5 2023-12-03T11:40:08.321 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.320+0000 7f57bc911800 20 remove_watcher() i=6 2023-12-03T11:40:08.322 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.321+0000 7f57bc911800 20 remove_watcher() i=7 2023-12-03T11:40:08.381 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:40:08.383 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket myver --object y 2023-12-03T11:40:08.413 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:40:08.413 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:40:08.429 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.428+0000 7ffaf4721800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.431 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.429+0000 7ffaf4721800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:08.431 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.429+0000 7ffaf4721800 20 realm 2023-12-03T11:40:08.431 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.429+0000 7ffaf4721800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.431 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.429+0000 7ffaf4721800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:08.431 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.429+0000 7ffaf4721800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:40:08.431 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.429+0000 7ffaf4721800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.431 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.429+0000 7ffaf4721800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:08.431 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.429+0000 7ffaf4721800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.431 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.430+0000 7ffaf4721800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:40:08.432 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.430+0000 7ffaf4721800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.432 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.431+0000 7ffaf4721800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:40:08.432 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.431+0000 7ffaf4721800 20 searching for the correct realm 2023-12-03T11:40:08.443 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.442+0000 7ffaf0cb9640 0 -- 172.21.15.44:0/2880516901 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x563ff0d69620 msgr2=0x563ff0d6bae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:40:08.444 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.443+0000 7ffaf4721800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:40:08.444 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.443+0000 7ffaf4721800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:40:08.444 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.443+0000 7ffaf4721800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:40:08.444 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.443+0000 7ffaf4721800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:40:08.445 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.443+0000 7ffaf4721800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.445 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.443+0000 7ffaf4721800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:08.445 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.443+0000 7ffaf4721800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.446 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.443+0000 7ffaf4721800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:40:08.446 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.443+0000 7ffaf4721800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.446 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.444+0000 7ffaf4721800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:40:08.447 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.444+0000 7ffaf4721800 20 zone default found 2023-12-03T11:40:08.447 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.444+0000 7ffaf4721800 4 Realm: () 2023-12-03T11:40:08.447 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.444+0000 7ffaf4721800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:40:08.447 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.444+0000 7ffaf4721800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:40:08.447 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.444+0000 7ffaf4721800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:40:08.447 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.444+0000 7ffaf4721800 20 zonegroup default 2023-12-03T11:40:08.447 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.444+0000 7ffaf4721800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.447 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.444+0000 7ffaf4721800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:08.447 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.444+0000 7ffaf4721800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.447 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.444+0000 7ffaf4721800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:08.447 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.444+0000 7ffaf4721800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.646 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.644+0000 7ffaf4721800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:08.646 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.644+0000 7ffaf4721800 20 started sync module instance, tier type = 2023-12-03T11:40:08.646 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.644+0000 7ffaf4721800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:40:08.651 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.650+0000 7ffaf04b8640 0 -- 172.21.15.44:0/2880516901 >> [v2:172.21.15.91:6808/776869758,v1:172.21.15.91:6809/776869758] conn(0x7ffae806b040 msgr2=0x7ffae805e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:40:08.655 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.654+0000 7ffaf4721800 20 add_watcher() i=0 2023-12-03T11:40:08.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.654+0000 7ffaf4721800 20 add_watcher() i=1 2023-12-03T11:40:08.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.654+0000 7ffaf4721800 20 add_watcher() i=2 2023-12-03T11:40:08.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.654+0000 7ffaf4721800 20 add_watcher() i=3 2023-12-03T11:40:08.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.654+0000 7ffaf4721800 20 add_watcher() i=4 2023-12-03T11:40:08.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.654+0000 7ffaf4721800 20 add_watcher() i=5 2023-12-03T11:40:08.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.654+0000 7ffaf4721800 20 add_watcher() i=6 2023-12-03T11:40:08.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.655+0000 7ffaf4721800 20 add_watcher() i=7 2023-12-03T11:40:08.656 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.655+0000 7ffaf4721800 2 all 8 watchers are set, enabling cache 2023-12-03T11:40:08.658 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.657+0000 7ffab67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:40:08.659 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.657+0000 7ffaf4721800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:40:08.659 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.657+0000 7ffaf4721800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:40:08.665 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.664+0000 7ffaf4721800 5 note: GC not initialized 2023-12-03T11:40:08.665 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.664+0000 7ffa257fa640 20 reqs_thread_entry: start 2023-12-03T11:40:08.665 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.664+0000 7ffaf4721800 20 init_complete bucket index max shards: 1 2023-12-03T11:40:08.665 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.664+0000 7ffaf4721800 20 Filter name: none 2023-12-03T11:40:08.666 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.664+0000 7ffa1effd640 20 reqs_thread_entry: start 2023-12-03T11:40:08.666 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.664+0000 7ffaf4721800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.665+0000 7ffaf4721800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:40:08.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.665+0000 7ffaf4721800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.665+0000 7ffaf4721800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:40:08.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.665+0000 7ffaf4721800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:40:08.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.665+0000 7ffaf4721800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2023-12-03T11:40:08.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.665+0000 7ffaf4721800 20 INFO: main: starting shard=0 2023-12-03T11:40:08.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.665+0000 7ffaf4721800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.0 2023-12-03T11:40:08.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.665+0000 7ffaf4721800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.0 2023-12-03T11:40:08.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.666+0000 7ffaf4721800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:40:08.667 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.666+0000 7ffaf4721800 20 INFO: main: starting shard=1 2023-12-03T11:40:08.668 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.666+0000 7ffaf4721800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.1 2023-12-03T11:40:08.668 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.666+0000 7ffaf4721800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.1 2023-12-03T11:40:08.668 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.666+0000 7ffaf4721800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:40:08.668 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.666+0000 7ffaf4721800 20 INFO: main: starting shard=2 2023-12-03T11:40:08.668 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.666+0000 7ffaf4721800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.2 2023-12-03T11:40:08.668 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.666+0000 7ffaf4721800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.2 2023-12-03T11:40:08.668 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.667+0000 7ffaf4721800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:40:08.668 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.667+0000 7ffaf4721800 20 INFO: main: done 2023-12-03T11:40:08.669 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.668+0000 7ffab67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:40:08.671 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.670+0000 7ffaf4721800 20 remove_watcher() i=0 2023-12-03T11:40:08.671 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.670+0000 7ffaf4721800 2 removed watcher, disabling cache 2023-12-03T11:40:08.672 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.671+0000 7ffaf4721800 20 remove_watcher() i=1 2023-12-03T11:40:08.674 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.673+0000 7ffaf4721800 20 remove_watcher() i=2 2023-12-03T11:40:08.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.674+0000 7ffaf4721800 20 remove_watcher() i=3 2023-12-03T11:40:08.676 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.675+0000 7ffaf4721800 20 remove_watcher() i=4 2023-12-03T11:40:08.677 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.676+0000 7ffaf4721800 20 remove_watcher() i=5 2023-12-03T11:40:08.678 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.677+0000 7ffaf4721800 20 remove_watcher() i=6 2023-12-03T11:40:08.679 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.678+0000 7ffaf4721800 20 remove_watcher() i=7 2023-12-03T11:40:08.739 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:40:08.741 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket myver --object z 2023-12-03T11:40:08.771 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:40:08.771 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:40:08.786 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.784+0000 7f068b520800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.787 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.786+0000 7f068b520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:08.787 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.786+0000 7f068b520800 20 realm 2023-12-03T11:40:08.787 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.786+0000 7f068b520800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.787 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.786+0000 7f068b520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:08.788 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.786+0000 7f068b520800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:40:08.788 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.786+0000 7f068b520800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.788 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.786+0000 7f068b520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:08.788 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.786+0000 7f068b520800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.788 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.787+0000 7f068b520800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:40:08.789 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.787+0000 7f068b520800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.789 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.788+0000 7f068b520800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:40:08.789 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.788+0000 7f068b520800 20 searching for the correct realm 2023-12-03T11:40:08.802 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.800+0000 7f068b520800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:40:08.802 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.800+0000 7f068b520800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:40:08.802 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.800+0000 7f068b520800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:40:08.802 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.800+0000 7f068b520800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:40:08.802 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.800+0000 7f068b520800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.802 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.801+0000 7f068b520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:08.802 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.801+0000 7f06869a5640 0 -- 172.21.15.44:0/3339732852 >> [v2:172.21.15.44:6808/1530174506,v1:172.21.15.44:6809/1530174506] conn(0x559e6b1b1ba0 msgr2=0x559e6b1b3f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:40:08.802 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.801+0000 7f068b520800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.803 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.801+0000 7f068b520800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:40:08.803 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.801+0000 7f068b520800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.803 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.801+0000 7f068b520800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:40:08.803 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.801+0000 7f068b520800 20 zone default found 2023-12-03T11:40:08.804 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.801+0000 7f068b520800 4 Realm: () 2023-12-03T11:40:08.804 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.801+0000 7f068b520800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:40:08.804 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.801+0000 7f068b520800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:40:08.804 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.801+0000 7f068b520800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:40:08.804 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.801+0000 7f068b520800 20 zonegroup default 2023-12-03T11:40:08.804 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.801+0000 7f068b520800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.804 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.802+0000 7f068b520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:08.804 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.802+0000 7f068b520800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.804 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.802+0000 7f068b520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:08.804 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.802+0000 7f068b520800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.804 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.802+0000 7f068b520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:08.804 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.802+0000 7f068b520800 20 started sync module instance, tier type = 2023-12-03T11:40:08.805 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.802+0000 7f068b520800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:40:08.813 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.812+0000 7f068b520800 20 add_watcher() i=0 2023-12-03T11:40:08.813 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.812+0000 7f068b520800 20 add_watcher() i=1 2023-12-03T11:40:08.813 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.812+0000 7f068b520800 20 add_watcher() i=2 2023-12-03T11:40:08.813 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.812+0000 7f068b520800 20 add_watcher() i=3 2023-12-03T11:40:08.813 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.812+0000 7f068b520800 20 add_watcher() i=4 2023-12-03T11:40:08.813 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.812+0000 7f068b520800 20 add_watcher() i=5 2023-12-03T11:40:08.813 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.812+0000 7f068b520800 20 add_watcher() i=6 2023-12-03T11:40:08.814 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.812+0000 7f06871a6640 0 -- 172.21.15.44:0/3339732852 >> [v2:172.21.15.44:6800/4244511941,v1:172.21.15.44:6801/4244511941] conn(0x7f067002a410 msgr2=0x7f067002a890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:40:08.814 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.812+0000 7f068b520800 20 add_watcher() i=7 2023-12-03T11:40:08.814 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.812+0000 7f068b520800 2 all 8 watchers are set, enabling cache 2023-12-03T11:40:08.816 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.814+0000 7f064d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:40:08.816 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.815+0000 7f068b520800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:40:08.816 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.815+0000 7f068b520800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:40:08.822 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.821+0000 7f068b520800 5 note: GC not initialized 2023-12-03T11:40:08.822 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.821+0000 7f05bbfff640 20 reqs_thread_entry: start 2023-12-03T11:40:08.822 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.821+0000 7f068b520800 20 init_complete bucket index max shards: 1 2023-12-03T11:40:08.822 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.821+0000 7f068b520800 20 Filter name: none 2023-12-03T11:40:08.823 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.821+0000 7f05b9ffb640 20 reqs_thread_entry: start 2023-12-03T11:40:08.823 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.821+0000 7f068b520800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.823 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.822+0000 7f068b520800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:40:08.823 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.822+0000 7f068b520800 20 rados->read ofs=0 len=0 2023-12-03T11:40:08.823 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.822+0000 7f068b520800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:40:08.824 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.822+0000 7f068b520800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:40:08.824 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.822+0000 7f068b520800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2023-12-03T11:40:08.824 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.822+0000 7f068b520800 20 INFO: main: starting shard=0 2023-12-03T11:40:08.824 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.822+0000 7f068b520800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.0 2023-12-03T11:40:08.824 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.822+0000 7f068b520800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.0 2023-12-03T11:40:08.824 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.823+0000 7f068b520800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:40:08.824 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.823+0000 7f068b520800 20 INFO: main: starting shard=1 2023-12-03T11:40:08.825 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.823+0000 7f068b520800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.1 2023-12-03T11:40:08.825 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.823+0000 7f068b520800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.1 2023-12-03T11:40:08.825 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.823+0000 7f068b520800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:40:08.825 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.823+0000 7f068b520800 20 INFO: main: starting shard=2 2023-12-03T11:40:08.825 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.823+0000 7f068b520800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.2 2023-12-03T11:40:08.825 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.823+0000 7f068b520800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.2 2023-12-03T11:40:08.825 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.824+0000 7f068b520800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:40:08.825 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.824+0000 7f068b520800 20 INFO: main: done 2023-12-03T11:40:08.826 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.825+0000 7f064d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:40:08.828 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.827+0000 7f068b520800 20 remove_watcher() i=0 2023-12-03T11:40:08.828 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.827+0000 7f068b520800 2 removed watcher, disabling cache 2023-12-03T11:40:08.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.828+0000 7f068b520800 20 remove_watcher() i=1 2023-12-03T11:40:08.831 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.830+0000 7f068b520800 20 remove_watcher() i=2 2023-12-03T11:40:08.832 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.831+0000 7f068b520800 20 remove_watcher() i=3 2023-12-03T11:40:08.833 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.832+0000 7f068b520800 20 remove_watcher() i=4 2023-12-03T11:40:08.834 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.833+0000 7f068b520800 20 remove_watcher() i=5 2023-12-03T11:40:08.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.834+0000 7f068b520800 20 remove_watcher() i=6 2023-12-03T11:40:08.838 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:08.835+0000 7f068b520800 20 remove_watcher() i=7 2023-12-03T11:40:08.847 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2023-12-03T11:40:09.238 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2023-12-03T11:40:09.627 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2023-12-03T11:40:09.658 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:40:09.658 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:40:09.672 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.671+0000 7f1af1412800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.674 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.673+0000 7f1af1412800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:09.674 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.673+0000 7f1af1412800 20 realm 2023-12-03T11:40:09.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.673+0000 7f1af1412800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.673+0000 7f1af1412800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:09.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.673+0000 7f1af1412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:40:09.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.673+0000 7f1af1412800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.673+0000 7f1af1412800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:09.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.673+0000 7f1af1412800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.675 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.674+0000 7f1af1412800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:40:09.676 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.674+0000 7f1af1412800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.676 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.675+0000 7f1af1412800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:40:09.676 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.675+0000 7f1af1412800 20 searching for the correct realm 2023-12-03T11:40:09.687 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.686+0000 7f1aecb2a640 0 -- 172.21.15.44:0/2029959049 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x56022d510070 msgr2=0x56022d5124c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:40:09.689 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.687+0000 7f1af1412800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:40:09.689 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.687+0000 7f1af1412800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:40:09.689 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.687+0000 7f1af1412800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:40:09.689 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.687+0000 7f1af1412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:40:09.689 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.687+0000 7f1af1412800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.689 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.688+0000 7f1af1412800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:09.689 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.688+0000 7f1af1412800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.690 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.688+0000 7f1af1412800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:40:09.690 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.688+0000 7f1af1412800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.690 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.688+0000 7f1af1412800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:40:09.690 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.688+0000 7f1af1412800 20 zone default found 2023-12-03T11:40:09.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.688+0000 7f1af1412800 4 Realm: () 2023-12-03T11:40:09.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.688+0000 7f1af1412800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:40:09.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.688+0000 7f1af1412800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:40:09.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.688+0000 7f1af1412800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:40:09.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.688+0000 7f1af1412800 20 zonegroup default 2023-12-03T11:40:09.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.688+0000 7f1af1412800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.689+0000 7f1af1412800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:09.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.689+0000 7f1af1412800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.689+0000 7f1af1412800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:09.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.689+0000 7f1af1412800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.689+0000 7f1af1412800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:09.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.689+0000 7f1af1412800 20 started sync module instance, tier type = 2023-12-03T11:40:09.691 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.689+0000 7f1af1412800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:40:09.697 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.696+0000 7f1aed32b640 0 -- 172.21.15.44:0/2029959049 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x56022d5181b0 msgr2=0x56022d51a670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:40:09.700 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.699+0000 7f1af1412800 20 add_watcher() i=0 2023-12-03T11:40:09.700 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.699+0000 7f1af1412800 20 add_watcher() i=1 2023-12-03T11:40:09.700 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.699+0000 7f1af1412800 20 add_watcher() i=2 2023-12-03T11:40:09.700 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.699+0000 7f1af1412800 20 add_watcher() i=3 2023-12-03T11:40:09.700 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.699+0000 7f1af1412800 20 add_watcher() i=4 2023-12-03T11:40:09.701 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.699+0000 7f1af1412800 20 add_watcher() i=5 2023-12-03T11:40:09.701 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.699+0000 7f1af1412800 20 add_watcher() i=6 2023-12-03T11:40:09.701 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.700+0000 7f1af1412800 20 add_watcher() i=7 2023-12-03T11:40:09.701 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.700+0000 7f1af1412800 2 all 8 watchers are set, enabling cache 2023-12-03T11:40:09.703 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.702+0000 7f1ab2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:40:09.703 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.702+0000 7f1af1412800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:40:09.703 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.702+0000 7f1af1412800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:40:09.710 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.708+0000 7f1af1412800 5 note: GC not initialized 2023-12-03T11:40:09.710 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.708+0000 7f1a21ffb640 20 reqs_thread_entry: start 2023-12-03T11:40:09.710 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.709+0000 7f1af1412800 20 init_complete bucket index max shards: 1 2023-12-03T11:40:09.710 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.709+0000 7f1af1412800 20 Filter name: none 2023-12-03T11:40:09.710 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.709+0000 7f1a137fe640 20 reqs_thread_entry: start 2023-12-03T11:40:09.710 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.709+0000 7f1af1412800 10 cache get: name=default.rgw.meta+root+myver : miss 2023-12-03T11:40:09.710 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.709+0000 7f1af1412800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.711 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.709+0000 7f1af1412800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:40:09.711 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.709+0000 7f1af1412800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2023-12-03T11:40:09.711 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.709+0000 7f1af1412800 10 adding default.rgw.meta+root+myver to cache LRU end 2023-12-03T11:40:09.711 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.709+0000 7f1af1412800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 : miss 2023-12-03T11:40:09.711 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.709+0000 7f1af1412800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.711 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.710+0000 7f1af1412800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:40:09.711 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.710+0000 7f1af1412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 info.flags=0x17 2023-12-03T11:40:09.711 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.710+0000 7f1af1412800 10 adding default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 to cache LRU end 2023-12-03T11:40:09.712 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.710+0000 7f1af1412800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:40:09.712 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.710+0000 7f1af1412800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:40:09.712 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.710+0000 7f1af1412800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 2023-12-03T11:40:09.717 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.716+0000 7f1af1412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 info.flags=0x17 2023-12-03T11:40:09.717 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.716+0000 7f1af1412800 10 moving default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 to cache LRU end 2023-12-03T11:40:09.717 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.716+0000 7f1af1412800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:40:09.717 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.716+0000 7f1af1412800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17, ofs0, ns] 2023-12-03T11:40:09.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.717+0000 7f1ad37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693222 cookie 94567350234592 notifier 7244 bl.length()=783 2023-12-03T11:40:09.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.717+0000 7f1ad37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 info.flags=0x17 2023-12-03T11:40:09.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.717+0000 7f1ad37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 to cache LRU end 2023-12-03T11:40:09.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.717+0000 7f1ad37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:40:09.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.717+0000 7f1af1412800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): orig_sources= new_sources= 2023-12-03T11:40:09.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.717+0000 7f1af1412800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): potential sources added=[] removed=[] 2023-12-03T11:40:09.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.717+0000 7f1af1412800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): orig_dests= new_dests= 2023-12-03T11:40:09.718 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.717+0000 7f1af1412800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): potential dests added=[] removed=[] 2023-12-03T11:40:09.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.0 2023-12-03T11:40:09.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.0 2023-12-03T11:40:09.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.1 2023-12-03T11:40:09.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.1 2023-12-03T11:40:09.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.2 2023-12-03T11:40:09.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.2 2023-12-03T11:40:09.720 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.3 2023-12-03T11:40:09.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.3 2023-12-03T11:40:09.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.4 2023-12-03T11:40:09.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.4 2023-12-03T11:40:09.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.5 2023-12-03T11:40:09.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.5 2023-12-03T11:40:09.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.6 2023-12-03T11:40:09.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.6 2023-12-03T11:40:09.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.7 2023-12-03T11:40:09.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.7 2023-12-03T11:40:09.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.8 2023-12-03T11:40:09.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.8 2023-12-03T11:40:09.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.9 2023-12-03T11:40:09.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.9 2023-12-03T11:40:09.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.10 2023-12-03T11:40:09.721 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.10 2023-12-03T11:40:09.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.11 2023-12-03T11:40:09.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.11 2023-12-03T11:40:09.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.12 2023-12-03T11:40:09.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.12 2023-12-03T11:40:09.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.13 2023-12-03T11:40:09.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.13 2023-12-03T11:40:09.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.14 2023-12-03T11:40:09.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.14 2023-12-03T11:40:09.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.15 2023-12-03T11:40:09.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.15 2023-12-03T11:40:09.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.16 2023-12-03T11:40:09.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.16 2023-12-03T11:40:09.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.0 2023-12-03T11:40:09.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.718+0000 7f1af1412800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.0 2023-12-03T11:40:09.722 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.719+0000 7f1af1412800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.1 2023-12-03T11:40:09.723 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.719+0000 7f1af1412800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.1 2023-12-03T11:40:09.723 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.719+0000 7f1af1412800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.2 2023-12-03T11:40:09.723 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.719+0000 7f1af1412800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.2.2 2023-12-03T11:40:09.723 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.722+0000 7f1af1412800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 : hit (requested=0x17, cached=0x17) 2023-12-03T11:40:09.723 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.722+0000 7f1af1412800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 2023-12-03T11:40:09.724 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.723+0000 7f1af1412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 info.flags=0x17 2023-12-03T11:40:09.724 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.723+0000 7f1af1412800 10 moving default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 to cache LRU end 2023-12-03T11:40:09.724 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.723+0000 7f1af1412800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:40:09.724 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.723+0000 7f1af1412800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17, ofs0, ns] 2023-12-03T11:40:09.725 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.723+0000 7f1ad2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693223 cookie 94567350234592 notifier 7244 bl.length()=751 2023-12-03T11:40:09.725 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.723+0000 7f1ad2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 info.flags=0x17 2023-12-03T11:40:09.725 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.723+0000 7f1ad2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 to cache LRU end 2023-12-03T11:40:09.725 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.723+0000 7f1ad2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:40:09.725 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.724+0000 7f1af1412800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): orig_sources= new_sources= 2023-12-03T11:40:09.725 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.724+0000 7f1af1412800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): potential sources added=[] removed=[] 2023-12-03T11:40:09.725 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.724+0000 7f1af1412800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): orig_dests= new_dests= 2023-12-03T11:40:09.725 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.724+0000 7f1af1412800 20 handle_bi_update(): bucket=:myver[ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17]): potential dests added=[] removed=[] 2023-12-03T11:40:09.726 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.725+0000 7f1af1412800 1 execute INFO: reshard of bucket "myver" completed successfully 2023-12-03T11:40:09.728 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.727+0000 7f1ab2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:40:09.730 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.729+0000 7f1af1412800 20 remove_watcher() i=0 2023-12-03T11:40:09.730 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.729+0000 7f1af1412800 2 removed watcher, disabling cache 2023-12-03T11:40:09.731 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.730+0000 7f1af1412800 20 remove_watcher() i=1 2023-12-03T11:40:09.732 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.731+0000 7f1af1412800 20 remove_watcher() i=2 2023-12-03T11:40:09.733 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.732+0000 7f1af1412800 20 remove_watcher() i=3 2023-12-03T11:40:09.734 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.733+0000 7f1af1412800 20 remove_watcher() i=4 2023-12-03T11:40:09.735 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.734+0000 7f1af1412800 20 remove_watcher() i=5 2023-12-03T11:40:09.736 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.735+0000 7f1af1412800 20 remove_watcher() i=6 2023-12-03T11:40:09.738 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.737+0000 7f1af1412800 20 remove_watcher() i=7 2023-12-03T11:40:09.744 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2023-12-03T11:40:09.778 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:40:09.778 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:40:09.793 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.792+0000 7fe419d20800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.795 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.794+0000 7fe419d20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:09.795 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.794+0000 7fe419d20800 20 realm 2023-12-03T11:40:09.795 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.794+0000 7fe419d20800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.795 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.794+0000 7fe419d20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:09.795 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.794+0000 7fe419d20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:40:09.795 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.794+0000 7fe419d20800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.795 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.794+0000 7fe419d20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:09.796 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.794+0000 7fe419d20800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.796 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.795+0000 7fe419d20800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:40:09.796 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.795+0000 7fe419d20800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.797 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.796+0000 7fe419d20800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:40:09.797 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.796+0000 7fe419d20800 20 searching for the correct realm 2023-12-03T11:40:09.805 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.804+0000 7fe4159ed640 0 -- 172.21.15.44:0/2177788646 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x557756ee3b20 msgr2=0x557756ee5f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:40:09.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.807+0000 7fe419d20800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:40:09.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.807+0000 7fe419d20800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:40:09.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.807+0000 7fe419d20800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:40:09.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.807+0000 7fe419d20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:40:09.808 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.807+0000 7fe419d20800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.809 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.807+0000 7fe419d20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:09.809 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.807+0000 7fe419d20800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.809 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.808+0000 7fe419d20800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:40:09.809 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.808+0000 7fe419d20800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.810 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.808+0000 7fe419d20800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:40:09.810 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.808+0000 7fe419d20800 20 zone default found 2023-12-03T11:40:09.810 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.808+0000 7fe419d20800 4 Realm: () 2023-12-03T11:40:09.810 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.808+0000 7fe419d20800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:40:09.810 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.808+0000 7fe419d20800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:40:09.810 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.808+0000 7fe419d20800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:40:09.810 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.808+0000 7fe419d20800 20 zonegroup default 2023-12-03T11:40:09.810 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.808+0000 7fe419d20800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.810 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.808+0000 7fe419d20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:09.810 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.808+0000 7fe419d20800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.810 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.808+0000 7fe419d20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:09.810 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.808+0000 7fe419d20800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.811 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.809+0000 7fe419d20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:09.811 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.809+0000 7fe419d20800 20 started sync module instance, tier type = 2023-12-03T11:40:09.811 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.809+0000 7fe419d20800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:40:09.812 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.811+0000 7fe4159ed640 0 -- 172.21.15.44:0/2177788646 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x7fe3f0079e10 msgr2=0x7fe3f007c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:40:09.819 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.818+0000 7fe419d20800 20 add_watcher() i=0 2023-12-03T11:40:09.819 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.818+0000 7fe419d20800 20 add_watcher() i=1 2023-12-03T11:40:09.819 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.818+0000 7fe419d20800 20 add_watcher() i=2 2023-12-03T11:40:09.819 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.818+0000 7fe419d20800 20 add_watcher() i=3 2023-12-03T11:40:09.819 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.818+0000 7fe419d20800 20 add_watcher() i=4 2023-12-03T11:40:09.820 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.818+0000 7fe419d20800 20 add_watcher() i=5 2023-12-03T11:40:09.820 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.818+0000 7fe419d20800 20 add_watcher() i=6 2023-12-03T11:40:09.820 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.819+0000 7fe419d20800 20 add_watcher() i=7 2023-12-03T11:40:09.820 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.819+0000 7fe419d20800 2 all 8 watchers are set, enabling cache 2023-12-03T11:40:09.822 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.821+0000 7fe3db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:40:09.822 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.821+0000 7fe419d20800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:40:09.822 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.821+0000 7fe419d20800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:40:09.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.827+0000 7fe419d20800 5 note: GC not initialized 2023-12-03T11:40:09.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.827+0000 7fe34a7fc640 20 reqs_thread_entry: start 2023-12-03T11:40:09.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.827+0000 7fe419d20800 20 init_complete bucket index max shards: 1 2023-12-03T11:40:09.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.828+0000 7fe419d20800 20 Filter name: none 2023-12-03T11:40:09.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.828+0000 7fe33bfff640 20 reqs_thread_entry: start 2023-12-03T11:40:09.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.828+0000 7fe419d20800 10 cache get: name=default.rgw.meta+root+myver : miss 2023-12-03T11:40:09.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.828+0000 7fe419d20800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.829 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.828+0000 7fe419d20800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:40:09.830 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.828+0000 7fe419d20800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2023-12-03T11:40:09.830 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.828+0000 7fe419d20800 10 adding default.rgw.meta+root+myver to cache LRU end 2023-12-03T11:40:09.830 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.828+0000 7fe419d20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 : miss 2023-12-03T11:40:09.830 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.828+0000 7fe419d20800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.831 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.829+0000 7fe419d20800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:40:09.831 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.829+0000 7fe419d20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 info.flags=0x17 2023-12-03T11:40:09.831 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.829+0000 7fe419d20800 10 adding default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 to cache LRU end 2023-12-03T11:40:09.831 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.829+0000 7fe419d20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:40:09.831 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.829+0000 7fe419d20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:40:09.831 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.829+0000 7fe419d20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17 2023-12-03T11:40:09.831 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.829+0000 7fe419d20800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.0 2023-12-03T11:40:09.831 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.829+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.0 2023-12-03T11:40:09.831 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.829+0000 7fe419d20800 1 NOTICE: finished shard 0 (0 entries removed) 2023-12-03T11:40:09.831 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.829+0000 7fe419d20800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.1 2023-12-03T11:40:09.831 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.829+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.1 2023-12-03T11:40:09.832 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.830+0000 7fe419d20800 1 NOTICE: finished shard 1 (0 entries removed) 2023-12-03T11:40:09.832 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.830+0000 7fe419d20800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.2 2023-12-03T11:40:09.832 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.830+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.2 2023-12-03T11:40:09.832 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.831+0000 7fe419d20800 1 NOTICE: finished shard 2 (0 entries removed) 2023-12-03T11:40:09.832 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.831+0000 7fe419d20800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.3 2023-12-03T11:40:09.832 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.831+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.3 2023-12-03T11:40:09.832 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.831+0000 7fe419d20800 1 NOTICE: finished shard 3 (0 entries removed) 2023-12-03T11:40:09.833 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.831+0000 7fe419d20800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.4 2023-12-03T11:40:09.833 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.831+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.4 2023-12-03T11:40:09.833 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.831+0000 7fe419d20800 1 NOTICE: finished shard 4 (0 entries removed) 2023-12-03T11:40:09.833 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.831+0000 7fe419d20800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.5 2023-12-03T11:40:09.834 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.831+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.5 2023-12-03T11:40:09.834 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.832+0000 7fe419d20800 1 NOTICE: finished shard 5 (0 entries removed) 2023-12-03T11:40:09.834 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.832+0000 7fe419d20800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.6 2023-12-03T11:40:09.834 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.832+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.6 2023-12-03T11:40:09.834 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.832+0000 7fe419d20800 1 NOTICE: finished shard 6 (0 entries removed) 2023-12-03T11:40:09.834 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.832+0000 7fe419d20800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.7 2023-12-03T11:40:09.834 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.832+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.7 2023-12-03T11:40:09.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.833+0000 7fe419d20800 1 NOTICE: finished shard 7 (0 entries removed) 2023-12-03T11:40:09.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.833+0000 7fe419d20800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.8 2023-12-03T11:40:09.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.833+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.8 2023-12-03T11:40:09.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.833+0000 7fe419d20800 1 NOTICE: finished shard 8 (0 entries removed) 2023-12-03T11:40:09.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.833+0000 7fe419d20800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.9 2023-12-03T11:40:09.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.833+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.9 2023-12-03T11:40:09.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.834+0000 7fe419d20800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.10 2023-12-03T11:40:09.835 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.834+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.10 2023-12-03T11:40:09.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.834+0000 7fe419d20800 1 NOTICE: finished shard 10 (0 entries removed) 2023-12-03T11:40:09.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.834+0000 7fe419d20800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.11 2023-12-03T11:40:09.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.834+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.11 2023-12-03T11:40:09.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.835+0000 7fe419d20800 1 NOTICE: finished shard 11 (0 entries removed) 2023-12-03T11:40:09.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.835+0000 7fe419d20800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.12 2023-12-03T11:40:09.836 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.835+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.12 2023-12-03T11:40:09.837 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.835+0000 7fe419d20800 1 NOTICE: finished shard 12 (0 entries removed) 2023-12-03T11:40:09.837 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.835+0000 7fe419d20800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.13 2023-12-03T11:40:09.837 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.835+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.13 2023-12-03T11:40:09.837 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.836+0000 7fe419d20800 1 NOTICE: finished shard 13 (0 entries removed) 2023-12-03T11:40:09.837 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.836+0000 7fe419d20800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.14 2023-12-03T11:40:09.837 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.836+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.14 2023-12-03T11:40:09.837 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.836+0000 7fe419d20800 1 NOTICE: finished shard 14 (0 entries removed) 2023-12-03T11:40:09.837 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.836+0000 7fe419d20800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.15 2023-12-03T11:40:09.837 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.836+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.15 2023-12-03T11:40:09.838 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.837+0000 7fe419d20800 1 NOTICE: finished shard 15 (0 entries removed) 2023-12-03T11:40:09.838 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.837+0000 7fe419d20800 10 bucket_obj is .dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.16 2023-12-03T11:40:09.838 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.837+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.16 2023-12-03T11:40:09.839 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.837+0000 7fe419d20800 1 NOTICE: finished shard 16 (0 entries removed) 2023-12-03T11:40:09.839 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.837+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.9 2023-12-03T11:40:09.839 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.837+0000 7fe419d20800 20 get_obj_state: octx=0x7fe4080a1000 obj=myver:x state=0x557756f99a88 s->prefetch_data=0 2023-12-03T11:40:09.839 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.838+0000 7fe419d20800 20 get_obj_state: setting s->obj_tag to arj34iqwt9ww724dcr6ga0f3morp1mn9 2023-12-03T11:40:09.839 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.838+0000 7fe419d20800 20 get_obj_state_impl: setting s->olh_tag to 0dk8wr3t9tjnsf2c5lizty7a11ybrrl4 2023-12-03T11:40:09.839 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.838+0000 7fe419d20800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0dk8wr3t9tjnsf2c5lizty7a11ybrrl4 2023-12-03T11:40:09.840 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.839+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.9 2023-12-03T11:40:09.841 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.840+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.9 2023-12-03T11:40:09.842 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.841+0000 7fe419d20800 20 olh_log_entry: epoch=2 op=2 key=x[] 2023-12-03T11:40:09.842 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.841+0000 7fe419d20800 20 olh_log_entry: epoch=2 op=3 key=x[QjpDJfNA7Az-AT97HiUBzt609J.kwjn] 2023-12-03T11:40:09.842 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.841+0000 7fe419d20800 20 get_obj_state: octx=0x7fe4080a1000 obj=myver:_:QjpDJfNA7Az-AT97HiUBzt609J.kwjn_x state=0x557756fa4e38 s->prefetch_data=0 2023-12-03T11:40:09.842 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.841+0000 7fe419d20800 10 manifest: total_size = 22 2023-12-03T11:40:09.842 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.841+0000 7fe419d20800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.905386487395322314 2023-12-03T11:40:09.842 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.841+0000 7fe419d20800 20 get_obj_state: octx=0x7fe4080a1000 obj=myver:_:QjpDJfNA7Az-AT97HiUBzt609J.kwjn_x state=0x557756fa4e38 s->prefetch_data=0 2023-12-03T11:40:09.842 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.841+0000 7fe419d20800 20 prepare_atomic_modification: state is not atomic. state=0x557756fa4e38 2023-12-03T11:40:09.842 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.841+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.9 2023-12-03T11:40:09.846 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.845+0000 7fe419d20800 20 get_obj_state: octx=0x7fe4080a1000 obj=myver:x state=0x557756f99a88 s->prefetch_data=0 2023-12-03T11:40:09.846 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.845+0000 7fe419d20800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0dk8wr3t9tjnsf2c5lizty7a11ybrrl4 2023-12-03T11:40:09.846 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.845+0000 7fe3f77fe640 20 handle_completion(): completion ok for obj=x[QjpDJfNA7Az-AT97HiUBzt609J.kwjn] 2023-12-03T11:40:09.849 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.848+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.9 2023-12-03T11:40:09.850 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.849+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.9 2023-12-03T11:40:09.850 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.850+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.9 2023-12-03T11:40:09.851 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.850+0000 7fe419d20800 20 get_obj_state: octx=0x7fe4080a1000 obj=myver:y state=0x557756f99a88 s->prefetch_data=0 2023-12-03T11:40:09.851 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.850+0000 7fe419d20800 20 get_obj_state: setting s->obj_tag to 6v6bzghduh1m9cmftxoegpwbl3052zst 2023-12-03T11:40:09.851 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.850+0000 7fe419d20800 20 get_obj_state_impl: setting s->olh_tag to bf8nf3i7asyttujno8su9blzqrmdfg2s 2023-12-03T11:40:09.851 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.850+0000 7fe419d20800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=bf8nf3i7asyttujno8su9blzqrmdfg2s 2023-12-03T11:40:09.853 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.852+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.9 2023-12-03T11:40:09.854 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.853+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.9 2023-12-03T11:40:09.855 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.854+0000 7fe419d20800 20 olh_log_entry: epoch=2 op=2 key=y[] 2023-12-03T11:40:09.855 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.854+0000 7fe419d20800 20 olh_log_entry: epoch=2 op=3 key=y[RmULEaSJYEyUJA-0W0eZLQ71N2xxm2Z] 2023-12-03T11:40:09.855 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.854+0000 7fe419d20800 20 get_obj_state: octx=0x7fe4080a1000 obj=myver:_:RmULEaSJYEyUJA-0W0eZLQ71N2xxm2Z_y state=0x557756fa2e18 s->prefetch_data=0 2023-12-03T11:40:09.856 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.854+0000 7fe419d20800 10 manifest: total_size = 22 2023-12-03T11:40:09.856 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.854+0000 7fe419d20800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.4467747494140820455 2023-12-03T11:40:09.856 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.854+0000 7fe419d20800 20 get_obj_state: octx=0x7fe4080a1000 obj=myver:_:RmULEaSJYEyUJA-0W0eZLQ71N2xxm2Z_y state=0x557756fa2e18 s->prefetch_data=0 2023-12-03T11:40:09.856 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.854+0000 7fe419d20800 20 prepare_atomic_modification: state is not atomic. state=0x557756fa2e18 2023-12-03T11:40:09.856 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.854+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.9 2023-12-03T11:40:09.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.858+0000 7fe3f77fe640 20 handle_completion(): completion ok for obj=y[RmULEaSJYEyUJA-0W0eZLQ71N2xxm2Z] 2023-12-03T11:40:09.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.858+0000 7fe419d20800 20 get_obj_state: octx=0x7fe4080a1000 obj=myver:y state=0x557756f99a88 s->prefetch_data=0 2023-12-03T11:40:09.861 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.858+0000 7fe419d20800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=bf8nf3i7asyttujno8su9blzqrmdfg2s 2023-12-03T11:40:09.862 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.861+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.9 2023-12-03T11:40:09.864 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.863+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.9 2023-12-03T11:40:09.864 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.863+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.9 2023-12-03T11:40:09.865 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.864+0000 7fe419d20800 20 get_obj_state: octx=0x7fe4080a1000 obj=myver:z state=0x557756f99a58 s->prefetch_data=0 2023-12-03T11:40:09.865 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.864+0000 7fe419d20800 20 get_obj_state: setting s->obj_tag to pgxf080zec99356ge5vhg074o3b3es6h 2023-12-03T11:40:09.865 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.864+0000 7fe419d20800 20 get_obj_state_impl: setting s->olh_tag to m0wpi08y0z064v6165cay5ov1al23mwc 2023-12-03T11:40:09.865 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.864+0000 7fe419d20800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=m0wpi08y0z064v6165cay5ov1al23mwc 2023-12-03T11:40:09.866 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.865+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.9 2023-12-03T11:40:09.867 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.866+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.9 2023-12-03T11:40:09.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.867+0000 7fe419d20800 20 olh_log_entry: epoch=2 op=2 key=z[] 2023-12-03T11:40:09.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.867+0000 7fe419d20800 20 olh_log_entry: epoch=2 op=3 key=z[-RA0zYPchonJ57ZuCzG3mLAVB72qlxb] 2023-12-03T11:40:09.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.867+0000 7fe419d20800 20 get_obj_state: octx=0x7fe4080a1000 obj=myver:_:-RA0zYPchonJ57ZuCzG3mLAVB72qlxb_z state=0x557756fa0df8 s->prefetch_data=0 2023-12-03T11:40:09.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.867+0000 7fe419d20800 10 manifest: total_size = 11 2023-12-03T11:40:09.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.867+0000 7fe419d20800 20 get_obj_state: setting s->obj_tag to ff414afd-0753-48a7-8bb4-762be6d38c82.4641.16138785723935992401 2023-12-03T11:40:09.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.867+0000 7fe419d20800 20 get_obj_state: octx=0x7fe4080a1000 obj=myver:_:-RA0zYPchonJ57ZuCzG3mLAVB72qlxb_z state=0x557756fa0df8 s->prefetch_data=0 2023-12-03T11:40:09.868 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.867+0000 7fe419d20800 20 prepare_atomic_modification: state is not atomic. state=0x557756fa0df8 2023-12-03T11:40:09.869 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.867+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.9 2023-12-03T11:40:09.871 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.870+0000 7fe3f7fff640 20 handle_completion(): completion ok for obj=z[-RA0zYPchonJ57ZuCzG3mLAVB72qlxb] 2023-12-03T11:40:09.872 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.870+0000 7fe419d20800 20 get_obj_state: octx=0x7fe4080a1000 obj=myver:z state=0x557756f99a58 s->prefetch_data=0 2023-12-03T11:40:09.872 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.870+0000 7fe419d20800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=m0wpi08y0z064v6165cay5ov1al23mwc 2023-12-03T11:40:09.874 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.873+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.9 2023-12-03T11:40:09.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.874+0000 7fe419d20800 20 bucket index object: default.rgw.buckets.index:.dir.ff414afd-0753-48a7-8bb4-762be6d38c82.4647.17.3.9 2023-12-03T11:40:09.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.874+0000 7fe419d20800 1 NOTICE: finished shard 9 (3 entries removed) 2023-12-03T11:40:09.875 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.874+0000 7fe419d20800 1 NOTICE: finished all shards (3 entries removed) 2023-12-03T11:40:09.876 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.875+0000 7fe3db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:40:09.878 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.877+0000 7fe419d20800 20 remove_watcher() i=0 2023-12-03T11:40:09.878 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.877+0000 7fe419d20800 2 removed watcher, disabling cache 2023-12-03T11:40:09.879 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.878+0000 7fe419d20800 20 remove_watcher() i=1 2023-12-03T11:40:09.880 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.879+0000 7fe419d20800 20 remove_watcher() i=2 2023-12-03T11:40:09.881 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.880+0000 7fe419d20800 20 remove_watcher() i=3 2023-12-03T11:40:09.882 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.881+0000 7fe419d20800 20 remove_watcher() i=4 2023-12-03T11:40:09.883 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.882+0000 7fe419d20800 20 remove_watcher() i=5 2023-12-03T11:40:09.884 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.883+0000 7fe419d20800 20 remove_watcher() i=6 2023-12-03T11:40:09.885 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.884+0000 7fe419d20800 20 remove_watcher() i=7 2023-12-03T11:40:09.941 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket myver 2023-12-03T11:40:09.969 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:40:09.969 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:40:09.983 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.982+0000 7fa981f26800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.984+0000 7fa981f26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:09.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.984+0000 7fa981f26800 20 realm 2023-12-03T11:40:09.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.984+0000 7fa981f26800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.984+0000 7fa981f26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:09.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.984+0000 7fa981f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:40:09.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.984+0000 7fa981f26800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.984+0000 7fa981f26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:09.985 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.984+0000 7fa981f26800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.986 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.985+0000 7fa981f26800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:40:09.986 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.985+0000 7fa981f26800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.986+0000 7fa981f26800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:40:09.987 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.986+0000 7fa981f26800 20 searching for the correct realm 2023-12-03T11:40:09.996 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.995+0000 7fa97db77640 0 -- 172.21.15.44:0/1487074939 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x559f03f6b130 msgr2=0x559f03f6d520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:40:09.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.996+0000 7fa981f26800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:40:09.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.996+0000 7fa981f26800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:40:09.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.996+0000 7fa981f26800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:40:09.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.996+0000 7fa981f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:40:09.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.996+0000 7fa981f26800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.997+0000 7fa981f26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:09.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.997+0000 7fa981f26800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.997+0000 7fa981f26800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:40:09.998 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.997+0000 7fa981f26800 20 rados->read ofs=0 len=0 2023-12-03T11:40:09.999 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.997+0000 7fa981f26800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:40:09.999 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.997+0000 7fa981f26800 20 zone default found 2023-12-03T11:40:09.999 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.997+0000 7fa981f26800 4 Realm: () 2023-12-03T11:40:09.999 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.997+0000 7fa981f26800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:40:09.999 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.997+0000 7fa981f26800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:40:10.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.997+0000 7fa981f26800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:40:10.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.997+0000 7fa981f26800 20 zonegroup default 2023-12-03T11:40:10.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.997+0000 7fa981f26800 20 rados->read ofs=0 len=0 2023-12-03T11:40:10.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.997+0000 7fa981f26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:10.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.997+0000 7fa981f26800 20 rados->read ofs=0 len=0 2023-12-03T11:40:10.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.998+0000 7fa981f26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:10.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.998+0000 7fa981f26800 20 rados->read ofs=0 len=0 2023-12-03T11:40:10.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.998+0000 7fa981f26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:10.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.998+0000 7fa981f26800 20 started sync module instance, tier type = 2023-12-03T11:40:10.000 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:09.998+0000 7fa981f26800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:40:10.005 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.004+0000 7fa97e378640 0 -- 172.21.15.44:0/1487074939 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7fa974024970 msgr2=0x7fa97401a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:40:10.013 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.007+0000 7fa981f26800 20 add_watcher() i=0 2023-12-03T11:40:10.013 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.007+0000 7fa981f26800 20 add_watcher() i=1 2023-12-03T11:40:10.013 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.007+0000 7fa981f26800 20 add_watcher() i=2 2023-12-03T11:40:10.013 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.007+0000 7fa981f26800 20 add_watcher() i=3 2023-12-03T11:40:10.014 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.007+0000 7fa981f26800 20 add_watcher() i=4 2023-12-03T11:40:10.014 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.007+0000 7fa981f26800 20 add_watcher() i=5 2023-12-03T11:40:10.014 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.007+0000 7fa981f26800 20 add_watcher() i=6 2023-12-03T11:40:10.014 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.008+0000 7fa981f26800 20 add_watcher() i=7 2023-12-03T11:40:10.014 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.008+0000 7fa981f26800 2 all 8 watchers are set, enabling cache 2023-12-03T11:40:10.014 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.009+0000 7fa9437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:40:10.014 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.010+0000 7fa981f26800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:40:10.014 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.010+0000 7fa981f26800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:40:10.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.015+0000 7fa981f26800 5 note: GC not initialized 2023-12-03T11:40:10.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.016+0000 7fa8b27fc640 20 reqs_thread_entry: start 2023-12-03T11:40:10.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.016+0000 7fa981f26800 20 init_complete bucket index max shards: 1 2023-12-03T11:40:10.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.016+0000 7fa981f26800 20 Filter name: none 2023-12-03T11:40:10.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.016+0000 7fa8a3fff640 20 reqs_thread_entry: start 2023-12-03T11:40:10.017 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.016+0000 7fa981f26800 20 rados->read ofs=0 len=0 2023-12-03T11:40:10.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.017+0000 7fa981f26800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:40:10.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.017+0000 7fa981f26800 20 rados->read ofs=0 len=0 2023-12-03T11:40:10.018 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.017+0000 7fa981f26800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:40:10.019 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.017+0000 7fa981f26800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:40:10.019 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.017+0000 7fa981f26800 20 rados->read ofs=0 len=0 2023-12-03T11:40:10.019 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.017+0000 7fa981f26800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:40:10.019 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.017+0000 7fa981f26800 20 rados->read ofs=0 len=0 2023-12-03T11:40:10.019 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.018+0000 7fa981f26800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:40:10.019 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.018+0000 7fa981f26800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:40:10.020 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.019+0000 7fa981f26800 20 rados->read ofs=0 len=0 2023-12-03T11:40:10.020 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.019+0000 7fa981f26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:40:10.021 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.020+0000 7fa9437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:40:10.023 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.022+0000 7fa981f26800 20 remove_watcher() i=0 2023-12-03T11:40:10.023 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.022+0000 7fa981f26800 2 removed watcher, disabling cache 2023-12-03T11:40:10.024 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.023+0000 7fa981f26800 20 remove_watcher() i=1 2023-12-03T11:40:10.025 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.024+0000 7fa981f26800 20 remove_watcher() i=2 2023-12-03T11:40:10.026 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.025+0000 7fa981f26800 20 remove_watcher() i=3 2023-12-03T11:40:10.027 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.026+0000 7fa981f26800 20 remove_watcher() i=4 2023-12-03T11:40:10.029 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.027+0000 7fa981f26800 20 remove_watcher() i=5 2023-12-03T11:40:10.029 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.028+0000 7fa981f26800 20 remove_watcher() i=6 2023-12-03T11:40:10.030 INFO:tasks.workunit.client.0.smithi044.stderr:2023-12-03T11:40:10.029+0000 7fa981f26800 20 remove_watcher() i=7 2023-12-03T11:40:10.035 INFO:tasks.workunit.client.0.smithi044.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2023-12-03T11:40:10.035 INFO:tasks.workunit.client.0.smithi044.stderr:Deleting bucket a-bucket 2023-12-03T11:40:10.053 INFO:tasks.workunit.client.0.smithi044.stderr:Deleting bucket myver 2023-12-03T11:40:10.132 INFO:tasks.workunit.client.0.smithi044.stderr:Completed resharding tests 2023-12-03T11:40:10.133 INFO:tasks.workunit.client.0.smithi044.stdout:connected to http://localhost:80 2023-12-03T11:40:10.197 INFO:tasks.workunit.client.0.smithi044.stderr:+ deactivate 2023-12-03T11:40:10.198 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2023-12-03T11:40:10.198 INFO:tasks.workunit.client.0.smithi044.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-12-03T11:40:10.198 INFO:tasks.workunit.client.0.smithi044.stderr:+ export PATH 2023-12-03T11:40:10.198 INFO:tasks.workunit.client.0.smithi044.stderr:+ unset _OLD_VIRTUAL_PATH 2023-12-03T11:40:10.198 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n '' ']' 2023-12-03T11:40:10.198 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2023-12-03T11:40:10.198 INFO:tasks.workunit.client.0.smithi044.stderr:+ hash -r 2023-12-03T11:40:10.198 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n '' ']' 2023-12-03T11:40:10.198 INFO:tasks.workunit.client.0.smithi044.stderr:+ unset VIRTUAL_ENV 2023-12-03T11:40:10.198 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' '!' '' = nondestructive ']' 2023-12-03T11:40:10.198 INFO:tasks.workunit.client.0.smithi044.stderr:+ unset -f deactivate 2023-12-03T11:40:10.198 INFO:tasks.workunit.client.0.smithi044.stderr:+ echo OK. 2023-12-03T11:40:10.199 INFO:tasks.workunit.client.0.smithi044.stdout:OK. 2023-12-03T11:40:10.200 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:40:10.200 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:40:10.271 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2023-12-03T11:40:10.271 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-03T11:40:10.666 DEBUG:teuthology.parallel:result is None 2023-12-03T11:40:10.666 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:40:10.697 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:40:10.697 DEBUG:teuthology.orchestra.run.smithi044:> rmdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:40:10.753 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:40:10.753 INFO:teuthology.run_tasks:Running task s3tests-java... 2023-12-03T11:40:21.418 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2023-12-03T11:40:21.419 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2023-12-03T11:40:21.419 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2023-12-03T11:40:21.419 DEBUG:teuthology.orchestra.run.smithi044:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2023-12-03T11:40:21.439 INFO:teuthology.orchestra.run.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2023-12-03T11:40:28.361 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2023-12-03T11:40:28.361 DEBUG:teuthology.orchestra.run.smithi044:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2023-12-03T11:40:31.488 INFO:teuthology.orchestra.run.smithi044.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2023-12-03T11:40:32.089 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:16:20 ago on Sun 03 Dec 2023 11:24:12 AM UTC. 2023-12-03T11:40:32.266 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2023-12-03T11:40:32.274 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================================== 2023-12-03T11:40:32.274 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2023-12-03T11:40:32.274 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================================== 2023-12-03T11:40:32.274 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2023-12-03T11:40:32.274 INFO:teuthology.orchestra.run.smithi044.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 CentOS-AppStream 424 k 2023-12-03T11:40:32.274 INFO:teuthology.orchestra.run.smithi044.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 CentOS-AppStream 9.3 M 2023-12-03T11:40:32.274 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2023-12-03T11:40:32.274 INFO:teuthology.orchestra.run.smithi044.stdout: ModemManager-glib x86_64 1.20.2-1.el9 CentOS-BaseOS 334 k 2023-12-03T11:40:32.274 INFO:teuthology.orchestra.run.smithi044.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 CentOS-AppStream 625 k 2023-12-03T11:40:32.274 INFO:teuthology.orchestra.run.smithi044.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 CentOS-AppStream 11 M 2023-12-03T11:40:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: alsa-lib x86_64 1.2.9-1.el9 CentOS-AppStream 499 k 2023-12-03T11:40:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: at-spi2-atk x86_64 2.38.0-4.el9 CentOS-AppStream 86 k 2023-12-03T11:40:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: at-spi2-core x86_64 2.40.3-1.el9 CentOS-AppStream 176 k 2023-12-03T11:40:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: atk x86_64 2.36.0-5.el9 CentOS-AppStream 270 k 2023-12-03T11:40:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: avahi-glib x86_64 0.8-12.el9 appstream 15 k 2023-12-03T11:40:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: bluez-libs x86_64 5.64-1.el9 CentOS-BaseOS 83 k 2023-12-03T11:40:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: bubblewrap x86_64 0.4.1-6.el9 CentOS-BaseOS 49 k 2023-12-03T11:40:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: colord-libs x86_64 1.4.5-4.el9 CentOS-AppStream 228 k 2023-12-03T11:40:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: copy-jdk-configs noarch 4.0-3.el9 CentOS-AppStream 27 k 2023-12-03T11:40:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: cups-libs x86_64 1:2.3.3op2-22.el9 CentOS-BaseOS 262 k 2023-12-03T11:40:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 CentOS-AppStream 524 k 2023-12-03T11:40:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: exiv2-libs x86_64 0.27.5-2.el9 CentOS-AppStream 780 k 2023-12-03T11:40:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: fdk-aac-free x86_64 2.0.0-8.el9 CentOS-AppStream 324 k 2023-12-03T11:40:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2023-12-03T11:40:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: flatpak-selinux noarch 1.12.8-1.el9 CentOS-AppStream 20 k 2023-12-03T11:40:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: flatpak-session-helper x86_64 1.12.8-1.el9 CentOS-AppStream 73 k 2023-12-03T11:40:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: gdk-pixbuf2-modules x86_64 2.42.6-3.el9 CentOS-AppStream 84 k 2023-12-03T11:40:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: geoclue2 x86_64 2.6.0-7.el9 CentOS-AppStream 122 k 2023-12-03T11:40:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: giflib x86_64 5.2.1-9.el9 CentOS-AppStream 47 k 2023-12-03T11:40:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: graphene x86_64 1.10.6-2.el9 CentOS-AppStream 63 k 2023-12-03T11:40:32.277 INFO:teuthology.orchestra.run.smithi044.stdout: gsm x86_64 1.0.19-6.el9 CentOS-AppStream 33 k 2023-12-03T11:40:32.277 INFO:teuthology.orchestra.run.smithi044.stdout: gstreamer1 x86_64 1.22.1-2.el9 CentOS-AppStream 1.4 M 2023-12-03T11:40:32.277 INFO:teuthology.orchestra.run.smithi044.stdout: gstreamer1-plugins-base x86_64 1.22.1-1.el9 CentOS-AppStream 2.2 M 2023-12-03T11:40:32.277 INFO:teuthology.orchestra.run.smithi044.stdout: gtk-update-icon-cache x86_64 3.24.31-2.el9 CentOS-AppStream 34 k 2023-12-03T11:40:32.277 INFO:teuthology.orchestra.run.smithi044.stdout: gtk3 x86_64 3.24.31-2.el9 CentOS-AppStream 4.8 M 2023-12-03T11:40:32.277 INFO:teuthology.orchestra.run.smithi044.stdout: hicolor-icon-theme noarch 0.17-13.el9 CentOS-AppStream 65 k 2023-12-03T11:40:32.277 INFO:teuthology.orchestra.run.smithi044.stdout: iso-codes noarch 4.6.0-3.el9 CentOS-AppStream 3.3 M 2023-12-03T11:40:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 CentOS-AppStream 32 M 2023-12-03T11:40:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: javapackages-filesystem noarch 6.0.0-4.el9 CentOS-AppStream 10 k 2023-12-03T11:40:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: jbigkit-libs x86_64 2.1-23.el9 CentOS-AppStream 52 k 2023-12-03T11:40:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: lcms2 x86_64 2.12-3.el9 CentOS-AppStream 166 k 2023-12-03T11:40:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: libX11-xcb x86_64 1.7.0-8.el9 appstream 11 k 2023-12-03T11:40:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: libXcomposite x86_64 0.4.5-7.el9 CentOS-AppStream 23 k 2023-12-03T11:40:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: libXcursor x86_64 1.2.0-7.el9 CentOS-AppStream 30 k 2023-12-03T11:40:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: libXdamage x86_64 1.1.5-7.el9 CentOS-AppStream 22 k 2023-12-03T11:40:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: libXfixes x86_64 5.0.3-16.el9 CentOS-AppStream 19 k 2023-12-03T11:40:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: libXi x86_64 1.7.10-8.el9 CentOS-AppStream 38 k 2023-12-03T11:40:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: libXinerama x86_64 1.1.4-10.el9 CentOS-AppStream 14 k 2023-12-03T11:40:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: libXrandr x86_64 1.5.2-8.el9 CentOS-AppStream 27 k 2023-12-03T11:40:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: libXtst x86_64 1.2.3-16.el9 CentOS-AppStream 20 k 2023-12-03T11:40:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: libXv x86_64 1.0.11-16.el9 CentOS-AppStream 18 k 2023-12-03T11:40:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: libXxf86vm x86_64 1.1.4-18.el9 CentOS-AppStream 18 k 2023-12-03T11:40:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: libasyncns x86_64 0.8-22.el9 CentOS-AppStream 29 k 2023-12-03T11:40:32.280 INFO:teuthology.orchestra.run.smithi044.stdout: libcanberra x86_64 0.30-27.el9 CentOS-AppStream 85 k 2023-12-03T11:40:32.280 INFO:teuthology.orchestra.run.smithi044.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 CentOS-AppStream 31 k 2023-12-03T11:40:32.280 INFO:teuthology.orchestra.run.smithi044.stdout: libdrm x86_64 2.4.117-1.el9 CentOS-AppStream 158 k 2023-12-03T11:40:32.280 INFO:teuthology.orchestra.run.smithi044.stdout: libepoxy x86_64 1.5.5-4.el9 CentOS-AppStream 240 k 2023-12-03T11:40:32.280 INFO:teuthology.orchestra.run.smithi044.stdout: libexif x86_64 0.6.22-6.el9 CentOS-AppStream 431 k 2023-12-03T11:40:32.280 INFO:teuthology.orchestra.run.smithi044.stdout: libfontenc x86_64 1.1.3-17.el9 CentOS-AppStream 30 k 2023-12-03T11:40:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: libgexiv2 x86_64 0.12.3-1.el9 CentOS-AppStream 82 k 2023-12-03T11:40:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: libglvnd x86_64 1:1.3.4-1.el9 CentOS-AppStream 134 k 2023-12-03T11:40:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 CentOS-AppStream 36 k 2023-12-03T11:40:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 CentOS-AppStream 141 k 2023-12-03T11:40:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: libgsf x86_64 1.14.47-5.el9 CentOS-AppStream 245 k 2023-12-03T11:40:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: libgxps x86_64 0.3.2-3.el9 CentOS-AppStream 78 k 2023-12-03T11:40:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: libiptcdata x86_64 1.0.5-9.el9 CentOS-AppStream 61 k 2023-12-03T11:40:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: libldac x86_64 2.0.2.3-10.el9 CentOS-AppStream 40 k 2023-12-03T11:40:32.282 INFO:teuthology.orchestra.run.smithi044.stdout: libnotify x86_64 0.7.9-8.el9 CentOS-AppStream 43 k 2023-12-03T11:40:32.282 INFO:teuthology.orchestra.run.smithi044.stdout: libogg x86_64 2:1.3.4-6.el9 CentOS-AppStream 32 k 2023-12-03T11:40:32.282 INFO:teuthology.orchestra.run.smithi044.stdout: libosinfo x86_64 1.10.0-1.el9 CentOS-AppStream 312 k 2023-12-03T11:40:32.282 INFO:teuthology.orchestra.run.smithi044.stdout: libpciaccess x86_64 0.16-6.el9 CentOS-BaseOS 27 k 2023-12-03T11:40:32.282 INFO:teuthology.orchestra.run.smithi044.stdout: libsbc x86_64 1.4-9.el9 CentOS-AppStream 44 k 2023-12-03T11:40:32.282 INFO:teuthology.orchestra.run.smithi044.stdout: libsndfile x86_64 1.0.31-8.el9 CentOS-AppStream 205 k 2023-12-03T11:40:32.282 INFO:teuthology.orchestra.run.smithi044.stdout: libtheora x86_64 1:1.1.1-31.el9 CentOS-AppStream 163 k 2023-12-03T11:40:32.282 INFO:teuthology.orchestra.run.smithi044.stdout: libtiff x86_64 4.4.0-10.el9 CentOS-AppStream 196 k 2023-12-03T11:40:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: libtool-ltdl x86_64 2.4.6-45.el9 CentOS-AppStream 36 k 2023-12-03T11:40:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: libtracker-sparql x86_64 3.1.2-3.el9 CentOS-AppStream 316 k 2023-12-03T11:40:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: libvisual x86_64 1:0.4.0-34.el9 CentOS-AppStream 143 k 2023-12-03T11:40:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: libvorbis x86_64 1:1.3.7-5.el9 CentOS-AppStream 192 k 2023-12-03T11:40:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: libwayland-client x86_64 1.21.0-1.el9 CentOS-AppStream 32 k 2023-12-03T11:40:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: libwayland-cursor x86_64 1.21.0-1.el9 CentOS-AppStream 18 k 2023-12-03T11:40:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: libwayland-egl x86_64 1.21.0-1.el9 CentOS-AppStream 12 k 2023-12-03T11:40:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: libwayland-server x86_64 1.21.0-1.el9 CentOS-AppStream 41 k 2023-12-03T11:40:32.284 INFO:teuthology.orchestra.run.smithi044.stdout: libwebp x86_64 1.2.0-8.el9 CentOS-AppStream 276 k 2023-12-03T11:40:32.284 INFO:teuthology.orchestra.run.smithi044.stdout: libxkbcommon x86_64 1.0.3-4.el9 CentOS-AppStream 132 k 2023-12-03T11:40:32.284 INFO:teuthology.orchestra.run.smithi044.stdout: libxshmfence x86_64 1.3-10.el9 CentOS-AppStream 12 k 2023-12-03T11:40:32.284 INFO:teuthology.orchestra.run.smithi044.stdout: lksctp-tools x86_64 1.0.19-2.el9 CentOS-BaseOS 90 k 2023-12-03T11:40:32.284 INFO:teuthology.orchestra.run.smithi044.stdout: low-memory-monitor x86_64 2.1-4.el9 CentOS-AppStream 35 k 2023-12-03T11:40:32.284 INFO:teuthology.orchestra.run.smithi044.stdout: lua-posix x86_64 35.0-8.el9 CentOS-AppStream 131 k 2023-12-03T11:40:32.285 INFO:teuthology.orchestra.run.smithi044.stdout: mesa-libEGL x86_64 23.3.0~rc2-1.el9 CentOS-AppStream 126 k 2023-12-03T11:40:32.285 INFO:teuthology.orchestra.run.smithi044.stdout: mesa-libGL x86_64 23.3.0~rc2-1.el9 CentOS-AppStream 167 k 2023-12-03T11:40:32.285 INFO:teuthology.orchestra.run.smithi044.stdout: mesa-libgbm x86_64 23.3.0~rc2-1.el9 CentOS-AppStream 36 k 2023-12-03T11:40:32.285 INFO:teuthology.orchestra.run.smithi044.stdout: mesa-libglapi x86_64 23.3.0~rc2-1.el9 CentOS-AppStream 44 k 2023-12-03T11:40:32.285 INFO:teuthology.orchestra.run.smithi044.stdout: mesa-vulkan-drivers x86_64 23.3.0~rc2-1.el9 CentOS-AppStream 9.7 M 2023-12-03T11:40:32.286 INFO:teuthology.orchestra.run.smithi044.stdout: mkfontscale x86_64 1.2.1-3.el9 CentOS-AppStream 31 k 2023-12-03T11:40:32.286 INFO:teuthology.orchestra.run.smithi044.stdout: openjpeg2 x86_64 2.4.0-7.el9 CentOS-AppStream 162 k 2023-12-03T11:40:32.286 INFO:teuthology.orchestra.run.smithi044.stdout: opus x86_64 1.3.1-10.el9 CentOS-AppStream 199 k 2023-12-03T11:40:32.286 INFO:teuthology.orchestra.run.smithi044.stdout: orc x86_64 0.4.31-6.el9 CentOS-AppStream 183 k 2023-12-03T11:40:32.286 INFO:teuthology.orchestra.run.smithi044.stdout: osinfo-db noarch 20230518-1.el9 CentOS-AppStream 273 k 2023-12-03T11:40:32.287 INFO:teuthology.orchestra.run.smithi044.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 CentOS-AppStream 68 k 2023-12-03T11:40:32.287 INFO:teuthology.orchestra.run.smithi044.stdout: ostree-libs x86_64 2023.7-2.el9 CentOS-AppStream 477 k 2023-12-03T11:40:32.287 INFO:teuthology.orchestra.run.smithi044.stdout: pipewire-libs x86_64 0.3.67-2.el9 CentOS-AppStream 1.7 M 2023-12-03T11:40:32.287 INFO:teuthology.orchestra.run.smithi044.stdout: poppler x86_64 21.01.0-19.el9 CentOS-AppStream 1.1 M 2023-12-03T11:40:32.287 INFO:teuthology.orchestra.run.smithi044.stdout: poppler-data noarch 0.4.9-9.el9 CentOS-AppStream 1.8 M 2023-12-03T11:40:32.287 INFO:teuthology.orchestra.run.smithi044.stdout: poppler-glib x86_64 21.01.0-19.el9 CentOS-AppStream 151 k 2023-12-03T11:40:32.287 INFO:teuthology.orchestra.run.smithi044.stdout: pulseaudio-libs x86_64 15.0-2.el9 CentOS-AppStream 666 k 2023-12-03T11:40:32.287 INFO:teuthology.orchestra.run.smithi044.stdout: pulseaudio-utils x86_64 15.0-2.el9 CentOS-AppStream 72 k 2023-12-03T11:40:32.288 INFO:teuthology.orchestra.run.smithi044.stdout: rtkit x86_64 0.11-28.el9 CentOS-AppStream 55 k 2023-12-03T11:40:32.288 INFO:teuthology.orchestra.run.smithi044.stdout: sound-theme-freedesktop noarch 0.8-17.el9 CentOS-AppStream 377 k 2023-12-03T11:40:32.288 INFO:teuthology.orchestra.run.smithi044.stdout: totem-pl-parser x86_64 3.26.6-2.el9 CentOS-AppStream 130 k 2023-12-03T11:40:32.288 INFO:teuthology.orchestra.run.smithi044.stdout: ttmkfdir x86_64 3.0.9-65.el9 CentOS-AppStream 52 k 2023-12-03T11:40:32.288 INFO:teuthology.orchestra.run.smithi044.stdout: tzdata-java noarch 2023c-1.el9 CentOS-AppStream 149 k 2023-12-03T11:40:32.288 INFO:teuthology.orchestra.run.smithi044.stdout: upower x86_64 0.99.11-11.el9 CentOS-AppStream 168 k 2023-12-03T11:40:32.288 INFO:teuthology.orchestra.run.smithi044.stdout: vulkan-loader x86_64 1.3.250.1-1.el9 CentOS-AppStream 140 k 2023-12-03T11:40:32.288 INFO:teuthology.orchestra.run.smithi044.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 CentOS-AppStream 305 k 2023-12-03T11:40:32.288 INFO:teuthology.orchestra.run.smithi044.stdout: wireplumber x86_64 0.4.14-1.el9 CentOS-AppStream 83 k 2023-12-03T11:40:32.289 INFO:teuthology.orchestra.run.smithi044.stdout: wireplumber-libs x86_64 0.4.14-1.el9 CentOS-AppStream 337 k 2023-12-03T11:40:32.289 INFO:teuthology.orchestra.run.smithi044.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 CentOS-AppStream 41 k 2023-12-03T11:40:32.289 INFO:teuthology.orchestra.run.smithi044.stdout: xdg-desktop-portal x86_64 1.12.4-1.el9 CentOS-AppStream 365 k 2023-12-03T11:40:32.289 INFO:teuthology.orchestra.run.smithi044.stdout: xkeyboard-config noarch 2.33-2.el9 CentOS-AppStream 780 k 2023-12-03T11:40:32.289 INFO:teuthology.orchestra.run.smithi044.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 CentOS-AppStream 499 k 2023-12-03T11:40:32.289 INFO:teuthology.orchestra.run.smithi044.stdout:Installing weak dependencies: 2023-12-03T11:40:32.289 INFO:teuthology.orchestra.run.smithi044.stdout: dconf x86_64 0.40.0-6.el9 CentOS-AppStream 108 k 2023-12-03T11:40:32.289 INFO:teuthology.orchestra.run.smithi044.stdout: exiv2 x86_64 0.27.5-2.el9 CentOS-AppStream 978 k 2023-12-03T11:40:32.290 INFO:teuthology.orchestra.run.smithi044.stdout: flatpak x86_64 1.12.8-1.el9 CentOS-AppStream 1.7 M 2023-12-03T11:40:32.290 INFO:teuthology.orchestra.run.smithi044.stdout: gtk2 x86_64 2.24.33-8.el9 CentOS-AppStream 3.5 M 2023-12-03T11:40:32.290 INFO:teuthology.orchestra.run.smithi044.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 CentOS-AppStream 25 k 2023-12-03T11:40:32.290 INFO:teuthology.orchestra.run.smithi044.stdout: p11-kit-server x86_64 0.24.1-2.el9 CentOS-AppStream 198 k 2023-12-03T11:40:32.290 INFO:teuthology.orchestra.run.smithi044.stdout: pipewire x86_64 0.3.67-2.el9 CentOS-AppStream 86 k 2023-12-03T11:40:32.290 INFO:teuthology.orchestra.run.smithi044.stdout: pipewire-alsa x86_64 0.3.67-2.el9 CentOS-AppStream 55 k 2023-12-03T11:40:32.290 INFO:teuthology.orchestra.run.smithi044.stdout: pipewire-jack-audio-connection-kit x86_64 0.3.67-2.el9 CentOS-AppStream 126 k 2023-12-03T11:40:32.290 INFO:teuthology.orchestra.run.smithi044.stdout: pipewire-pulseaudio x86_64 0.3.67-2.el9 CentOS-AppStream 18 k 2023-12-03T11:40:32.290 INFO:teuthology.orchestra.run.smithi044.stdout: tracker x86_64 3.1.2-3.el9 CentOS-AppStream 537 k 2023-12-03T11:40:32.291 INFO:teuthology.orchestra.run.smithi044.stdout: tracker-miners x86_64 3.1.2-3.el9 CentOS-AppStream 887 k 2023-12-03T11:40:32.291 INFO:teuthology.orchestra.run.smithi044.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 CentOS-AppStream 130 k 2023-12-03T11:40:32.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:40:32.291 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2023-12-03T11:40:32.291 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================================== 2023-12-03T11:40:32.291 INFO:teuthology.orchestra.run.smithi044.stdout:Install 129 Packages 2023-12-03T11:40:32.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:40:32.292 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 102 M 2023-12-03T11:40:32.292 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 381 M 2023-12-03T11:40:32.292 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2023-12-03T11:40:32.745 INFO:teuthology.orchestra.run.smithi044.stdout:(1/129): alsa-lib-1.2.9-1.el9.x86_64.rpm 2.8 MB/s | 499 kB 00:00 2023-12-03T11:40:32.779 INFO:teuthology.orchestra.run.smithi044.stdout:(2/129): adwaita-cursor-theme-40.1.1-3.el9.noar 2.9 MB/s | 625 kB 00:00 2023-12-03T11:40:32.813 INFO:teuthology.orchestra.run.smithi044.stdout:(3/129): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.3 MB/s | 86 kB 00:00 2023-12-03T11:40:32.838 INFO:teuthology.orchestra.run.smithi044.stdout:(4/129): at-spi2-core-2.40.3-1.el9.x86_64.rpm 3.1 MB/s | 176 kB 00:00 2023-12-03T11:40:32.872 INFO:teuthology.orchestra.run.smithi044.stdout:(5/129): atk-2.36.0-5.el9.x86_64.rpm 4.7 MB/s | 270 kB 00:00 2023-12-03T11:40:32.897 INFO:teuthology.orchestra.run.smithi044.stdout:(6/129): colord-libs-1.4.5-4.el9.x86_64.rpm 4.0 MB/s | 228 kB 00:00 2023-12-03T11:40:33.031 INFO:teuthology.orchestra.run.smithi044.stdout:(7/129): adwaita-icon-theme-40.1.1-3.el9.noarch 23 MB/s | 11 MB 00:00 2023-12-03T11:40:33.050 INFO:teuthology.orchestra.run.smithi044.stdout:(8/129): copy-jdk-configs-4.0-3.el9.noarch.rpm 157 kB/s | 27 kB 00:00 2023-12-03T11:40:33.073 INFO:teuthology.orchestra.run.smithi044.stdout:(9/129): dconf-0.40.0-6.el9.x86_64.rpm 625 kB/s | 108 kB 00:00 2023-12-03T11:40:33.107 INFO:teuthology.orchestra.run.smithi044.stdout:(10/129): exempi-2.6.0-0.2.20211007gite23c213.e 8.7 MB/s | 524 kB 00:00 2023-12-03T11:40:33.149 INFO:teuthology.orchestra.run.smithi044.stdout:(11/129): exiv2-0.27.5-2.el9.x86_64.rpm 9.5 MB/s | 978 kB 00:00 2023-12-03T11:40:33.182 INFO:teuthology.orchestra.run.smithi044.stdout:(12/129): exiv2-libs-0.27.5-2.el9.x86_64.rpm 7.0 MB/s | 780 kB 00:00 2023-12-03T11:40:33.207 INFO:teuthology.orchestra.run.smithi044.stdout:(13/129): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 3.2 MB/s | 324 kB 00:00 2023-12-03T11:40:33.249 INFO:teuthology.orchestra.run.smithi044.stdout:(14/129): flatpak-1.12.8-1.el9.x86_64.rpm 17 MB/s | 1.7 MB 00:00 2023-12-03T11:40:33.275 INFO:teuthology.orchestra.run.smithi044.stdout:(15/129): flatpak-selinux-1.12.8-1.el9.noarch.r 314 kB/s | 20 kB 00:00 2023-12-03T11:40:33.300 INFO:teuthology.orchestra.run.smithi044.stdout:(16/129): flatpak-session-helper-1.12.8-1.el9.x 813 kB/s | 73 kB 00:00 2023-12-03T11:40:33.325 INFO:teuthology.orchestra.run.smithi044.stdout:(17/129): gdk-pixbuf2-modules-2.42.6-3.el9.x86_ 1.1 MB/s | 84 kB 00:00 2023-12-03T11:40:33.350 INFO:teuthology.orchestra.run.smithi044.stdout:(18/129): geoclue2-2.6.0-7.el9.x86_64.rpm 2.4 MB/s | 122 kB 00:00 2023-12-03T11:40:33.376 INFO:teuthology.orchestra.run.smithi044.stdout:(19/129): giflib-5.2.1-9.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2023-12-03T11:40:33.401 INFO:teuthology.orchestra.run.smithi044.stdout:(20/129): graphene-1.10.6-2.el9.x86_64.rpm 843 kB/s | 63 kB 00:00 2023-12-03T11:40:33.426 INFO:teuthology.orchestra.run.smithi044.stdout:(21/129): gsm-1.0.19-6.el9.x86_64.rpm 660 kB/s | 33 kB 00:00 2023-12-03T11:40:33.468 INFO:teuthology.orchestra.run.smithi044.stdout:(22/129): gstreamer1-1.22.1-2.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2023-12-03T11:40:33.518 INFO:teuthology.orchestra.run.smithi044.stdout:(23/129): gstreamer1-plugins-base-1.22.1-1.el9. 19 MB/s | 2.2 MB 00:00 2023-12-03T11:40:33.544 INFO:teuthology.orchestra.run.smithi044.stdout:(24/129): gtk-update-icon-cache-3.24.31-2.el9.x 472 kB/s | 34 kB 00:00 2023-12-03T11:40:33.602 INFO:teuthology.orchestra.run.smithi044.stdout:(25/129): gtk2-2.24.33-8.el9.x86_64.rpm 26 MB/s | 3.5 MB 00:00 2023-12-03T11:40:33.678 INFO:teuthology.orchestra.run.smithi044.stdout:(26/129): gtk3-3.24.31-2.el9.x86_64.rpm 31 MB/s | 4.8 MB 00:00 2023-12-03T11:40:33.744 INFO:teuthology.orchestra.run.smithi044.stdout:(27/129): hicolor-icon-theme-0.17-13.el9.noarch 332 kB/s | 65 kB 00:00 2023-12-03T11:40:33.803 INFO:teuthology.orchestra.run.smithi044.stdout:(28/129): iso-codes-4.6.0-3.el9.noarch.rpm 17 MB/s | 3.3 MB 00:00 2023-12-03T11:40:33.828 INFO:teuthology.orchestra.run.smithi044.stdout:(29/129): java-1.8.0-openjdk-1.8.0.362.b09-4.el 5.1 MB/s | 424 kB 00:00 2023-12-03T11:40:34.004 INFO:teuthology.orchestra.run.smithi044.stdout:(30/129): java-1.8.0-openjdk-devel-1.8.0.362.b0 36 MB/s | 9.3 MB 00:00 2023-12-03T11:40:34.071 INFO:teuthology.orchestra.run.smithi044.stdout:(31/129): javapackages-filesystem-6.0.0-4.el9.n 43 kB/s | 10 kB 00:00 2023-12-03T11:40:34.213 INFO:teuthology.orchestra.run.smithi044.stdout:(32/129): jbigkit-libs-2.1-23.el9.x86_64.rpm 252 kB/s | 52 kB 00:00 2023-12-03T11:40:34.238 INFO:teuthology.orchestra.run.smithi044.stdout:(33/129): lcms2-2.12-3.el9.x86_64.rpm 1.0 MB/s | 166 kB 00:00 2023-12-03T11:40:34.630 INFO:teuthology.orchestra.run.smithi044.stdout:(34/129): java-1.8.0-openjdk-headless-1.8.0.362 39 MB/s | 32 MB 00:00 2023-12-03T11:40:34.655 INFO:teuthology.orchestra.run.smithi044.stdout:(35/129): libXcomposite-0.4.5-7.el9.x86_64.rpm 52 kB/s | 23 kB 00:00 2023-12-03T11:40:34.680 INFO:teuthology.orchestra.run.smithi044.stdout:(36/129): libXcursor-1.2.0-7.el9.x86_64.rpm 67 kB/s | 30 kB 00:00 2023-12-03T11:40:34.706 INFO:teuthology.orchestra.run.smithi044.stdout:(37/129): libXdamage-1.1.5-7.el9.x86_64.rpm 290 kB/s | 22 kB 00:00 2023-12-03T11:40:34.739 INFO:teuthology.orchestra.run.smithi044.stdout:(38/129): libXfixes-5.0.3-16.el9.x86_64.rpm 320 kB/s | 19 kB 00:00 2023-12-03T11:40:34.764 INFO:teuthology.orchestra.run.smithi044.stdout:(39/129): libXi-1.7.10-8.el9.x86_64.rpm 461 kB/s | 38 kB 00:00 2023-12-03T11:40:34.790 INFO:teuthology.orchestra.run.smithi044.stdout:(40/129): libXinerama-1.1.4-10.el9.x86_64.rpm 167 kB/s | 14 kB 00:00 2023-12-03T11:40:34.823 INFO:teuthology.orchestra.run.smithi044.stdout:(41/129): libXrandr-1.5.2-8.el9.x86_64.rpm 326 kB/s | 27 kB 00:00 2023-12-03T11:40:34.849 INFO:teuthology.orchestra.run.smithi044.stdout:(42/129): libXtst-1.2.3-16.el9.x86_64.rpm 348 kB/s | 20 kB 00:00 2023-12-03T11:40:34.874 INFO:teuthology.orchestra.run.smithi044.stdout:(43/129): libXv-1.0.11-16.el9.x86_64.rpm 215 kB/s | 18 kB 00:00 2023-12-03T11:40:34.899 INFO:teuthology.orchestra.run.smithi044.stdout:(44/129): libXxf86vm-1.1.4-18.el9.x86_64.rpm 236 kB/s | 18 kB 00:00 2023-12-03T11:40:34.924 INFO:teuthology.orchestra.run.smithi044.stdout:(45/129): libasyncns-0.8-22.el9.x86_64.rpm 391 kB/s | 29 kB 00:00 2023-12-03T11:40:34.950 INFO:teuthology.orchestra.run.smithi044.stdout:(46/129): libcanberra-0.30-27.el9.x86_64.rpm 1.7 MB/s | 85 kB 00:00 2023-12-03T11:40:34.983 INFO:teuthology.orchestra.run.smithi044.stdout:(47/129): libcanberra-gtk2-0.30-27.el9.x86_64.r 297 kB/s | 25 kB 00:00 2023-12-03T11:40:35.009 INFO:teuthology.orchestra.run.smithi044.stdout:(48/129): libcanberra-gtk3-0.30-27.el9.x86_64.r 368 kB/s | 31 kB 00:00 2023-12-03T11:40:35.042 INFO:teuthology.orchestra.run.smithi044.stdout:(49/129): libdrm-2.4.117-1.el9.x86_64.rpm 2.6 MB/s | 158 kB 00:00 2023-12-03T11:40:35.076 INFO:teuthology.orchestra.run.smithi044.stdout:(50/129): libepoxy-1.5.5-4.el9.x86_64.rpm 2.6 MB/s | 240 kB 00:00 2023-12-03T11:40:35.109 INFO:teuthology.orchestra.run.smithi044.stdout:(51/129): libexif-0.6.22-6.el9.x86_64.rpm 4.2 MB/s | 431 kB 00:00 2023-12-03T11:40:35.134 INFO:teuthology.orchestra.run.smithi044.stdout:(52/129): libfontenc-1.1.3-17.el9.x86_64.rpm 520 kB/s | 30 kB 00:00 2023-12-03T11:40:35.160 INFO:teuthology.orchestra.run.smithi044.stdout:(53/129): libgexiv2-0.12.3-1.el9.x86_64.rpm 986 kB/s | 82 kB 00:00 2023-12-03T11:40:35.185 INFO:teuthology.orchestra.run.smithi044.stdout:(54/129): libglvnd-1.3.4-1.el9.x86_64.rpm 1.7 MB/s | 134 kB 00:00 2023-12-03T11:40:35.210 INFO:teuthology.orchestra.run.smithi044.stdout:(55/129): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 717 kB/s | 36 kB 00:00 2023-12-03T11:40:35.236 INFO:teuthology.orchestra.run.smithi044.stdout:(56/129): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.8 MB/s | 141 kB 00:00 2023-12-03T11:40:35.261 INFO:teuthology.orchestra.run.smithi044.stdout:(57/129): libgsf-1.14.47-5.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2023-12-03T11:40:35.286 INFO:teuthology.orchestra.run.smithi044.stdout:(58/129): libgxps-0.3.2-3.el9.x86_64.rpm 1.0 MB/s | 78 kB 00:00 2023-12-03T11:40:35.312 INFO:teuthology.orchestra.run.smithi044.stdout:(59/129): libiptcdata-1.0.5-9.el9.x86_64.rpm 808 kB/s | 61 kB 00:00 2023-12-03T11:40:35.337 INFO:teuthology.orchestra.run.smithi044.stdout:(60/129): libldac-2.0.2.3-10.el9.x86_64.rpm 536 kB/s | 40 kB 00:00 2023-12-03T11:40:35.362 INFO:teuthology.orchestra.run.smithi044.stdout:(61/129): libnotify-0.7.9-8.el9.x86_64.rpm 564 kB/s | 43 kB 00:00 2023-12-03T11:40:35.387 INFO:teuthology.orchestra.run.smithi044.stdout:(62/129): libogg-1.3.4-6.el9.x86_64.rpm 430 kB/s | 32 kB 00:00 2023-12-03T11:40:35.413 INFO:teuthology.orchestra.run.smithi044.stdout:(63/129): libosinfo-1.10.0-1.el9.x86_64.rpm 4.0 MB/s | 312 kB 00:00 2023-12-03T11:40:35.438 INFO:teuthology.orchestra.run.smithi044.stdout:(64/129): libsbc-1.4-9.el9.x86_64.rpm 581 kB/s | 44 kB 00:00 2023-12-03T11:40:35.471 INFO:teuthology.orchestra.run.smithi044.stdout:(65/129): libsndfile-1.0.31-8.el9.x86_64.rpm 2.4 MB/s | 205 kB 00:00 2023-12-03T11:40:35.497 INFO:teuthology.orchestra.run.smithi044.stdout:(66/129): libtheora-1.1.1-31.el9.x86_64.rpm 2.7 MB/s | 163 kB 00:00 2023-12-03T11:40:35.522 INFO:teuthology.orchestra.run.smithi044.stdout:(67/129): libtiff-4.4.0-10.el9.x86_64.rpm 2.3 MB/s | 196 kB 00:00 2023-12-03T11:40:35.547 INFO:teuthology.orchestra.run.smithi044.stdout:(68/129): libtool-ltdl-2.4.6-45.el9.x86_64.rpm 481 kB/s | 36 kB 00:00 2023-12-03T11:40:35.573 INFO:teuthology.orchestra.run.smithi044.stdout:(69/129): libtracker-sparql-3.1.2-3.el9.x86_64. 6.2 MB/s | 316 kB 00:00 2023-12-03T11:40:35.598 INFO:teuthology.orchestra.run.smithi044.stdout:(70/129): libvisual-0.4.0-34.el9.x86_64.rpm 1.9 MB/s | 143 kB 00:00 2023-12-03T11:40:35.626 INFO:teuthology.orchestra.run.smithi044.stdout:(71/129): libvorbis-1.3.7-5.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2023-12-03T11:40:35.657 INFO:teuthology.orchestra.run.smithi044.stdout:(72/129): libwayland-client-1.21.0-1.el9.x86_64 553 kB/s | 32 kB 00:00 2023-12-03T11:40:35.682 INFO:teuthology.orchestra.run.smithi044.stdout:(73/129): libwayland-cursor-1.21.0-1.el9.x86_64 220 kB/s | 18 kB 00:00 2023-12-03T11:40:35.708 INFO:teuthology.orchestra.run.smithi044.stdout:(74/129): libwayland-egl-1.21.0-1.el9.x86_64.rp 140 kB/s | 12 kB 00:00 2023-12-03T11:40:35.733 INFO:teuthology.orchestra.run.smithi044.stdout:(75/129): libwayland-server-1.21.0-1.el9.x86_64 811 kB/s | 41 kB 00:00 2023-12-03T11:40:35.758 INFO:teuthology.orchestra.run.smithi044.stdout:(76/129): libwebp-1.2.0-8.el9.x86_64.rpm 3.6 MB/s | 276 kB 00:00 2023-12-03T11:40:35.783 INFO:teuthology.orchestra.run.smithi044.stdout:(77/129): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.7 MB/s | 132 kB 00:00 2023-12-03T11:40:35.808 INFO:teuthology.orchestra.run.smithi044.stdout:(78/129): low-memory-monitor-2.1-4.el9.x86_64.r 699 kB/s | 35 kB 00:00 2023-12-03T11:40:35.834 INFO:teuthology.orchestra.run.smithi044.stdout:(79/129): libxshmfence-1.3-10.el9.x86_64.rpm 153 kB/s | 12 kB 00:00 2023-12-03T11:40:35.859 INFO:teuthology.orchestra.run.smithi044.stdout:(80/129): lua-posix-35.0-8.el9.x86_64.rpm 1.7 MB/s | 131 kB 00:00 2023-12-03T11:40:35.884 INFO:teuthology.orchestra.run.smithi044.stdout:(81/129): mesa-libEGL-23.3.0~rc2-1.el9.x86_64.r 1.6 MB/s | 126 kB 00:00 2023-12-03T11:40:35.901 INFO:teuthology.orchestra.run.smithi044.stdout:(82/129): mesa-libgbm-23.3.0~rc2-1.el9.x86_64.r 887 kB/s | 36 kB 00:00 2023-12-03T11:40:35.926 INFO:teuthology.orchestra.run.smithi044.stdout:(83/129): mesa-libGL-23.3.0~rc2-1.el9.x86_64.rp 2.5 MB/s | 167 kB 00:00 2023-12-03T11:40:35.943 INFO:teuthology.orchestra.run.smithi044.stdout:(84/129): mesa-libglapi-23.3.0~rc2-1.el9.x86_64 751 kB/s | 44 kB 00:00 2023-12-03T11:40:36.185 INFO:teuthology.orchestra.run.smithi044.stdout:(85/129): mesa-vulkan-drivers-23.3.0~rc2-1.el9. 34 MB/s | 9.7 MB 00:00 2023-12-03T11:40:36.210 INFO:teuthology.orchestra.run.smithi044.stdout:(86/129): mkfontscale-1.2.1-3.el9.x86_64.rpm 118 kB/s | 31 kB 00:00 2023-12-03T11:40:36.236 INFO:teuthology.orchestra.run.smithi044.stdout:(87/129): openjpeg2-2.4.0-7.el9.x86_64.rpm 561 kB/s | 162 kB 00:00 2023-12-03T11:40:36.261 INFO:teuthology.orchestra.run.smithi044.stdout:(88/129): opus-1.3.1-10.el9.x86_64.rpm 2.6 MB/s | 199 kB 00:00 2023-12-03T11:40:36.295 INFO:teuthology.orchestra.run.smithi044.stdout:(89/129): orc-0.4.31-6.el9.x86_64.rpm 3.1 MB/s | 183 kB 00:00 2023-12-03T11:40:36.320 INFO:teuthology.orchestra.run.smithi044.stdout:(90/129): osinfo-db-20230518-1.el9.noarch.rpm 3.2 MB/s | 273 kB 00:00 2023-12-03T11:40:36.345 INFO:teuthology.orchestra.run.smithi044.stdout:(91/129): osinfo-db-tools-1.10.0-1.el9.x86_64.r 824 kB/s | 68 kB 00:00 2023-12-03T11:40:36.370 INFO:teuthology.orchestra.run.smithi044.stdout:(92/129): ostree-libs-2023.7-2.el9.x86_64.rpm 9.3 MB/s | 477 kB 00:00 2023-12-03T11:40:36.395 INFO:teuthology.orchestra.run.smithi044.stdout:(93/129): p11-kit-server-0.24.1-2.el9.x86_64.rp 2.6 MB/s | 198 kB 00:00 2023-12-03T11:40:36.421 INFO:teuthology.orchestra.run.smithi044.stdout:(94/129): pipewire-0.3.67-2.el9.x86_64.rpm 1.1 MB/s | 86 kB 00:00 2023-12-03T11:40:36.438 INFO:teuthology.orchestra.run.smithi044.stdout:(95/129): pipewire-alsa-0.3.67-2.el9.x86_64.rpm 1.3 MB/s | 55 kB 00:00 2023-12-03T11:40:36.463 INFO:teuthology.orchestra.run.smithi044.stdout:(96/129): pipewire-jack-audio-connection-kit-0. 1.8 MB/s | 126 kB 00:00 2023-12-03T11:40:36.572 INFO:teuthology.orchestra.run.smithi044.stdout:(97/129): pipewire-libs-0.3.67-2.el9.x86_64.rpm 12 MB/s | 1.7 MB 00:00 2023-12-03T11:40:36.697 INFO:teuthology.orchestra.run.smithi044.stdout:(98/129): pipewire-pulseaudio-0.3.67-2.el9.x86_ 77 kB/s | 18 kB 00:00 2023-12-03T11:40:36.731 INFO:teuthology.orchestra.run.smithi044.stdout:(99/129): poppler-21.01.0-19.el9.x86_64.rpm 4.0 MB/s | 1.1 MB 00:00 2023-12-03T11:40:36.781 INFO:teuthology.orchestra.run.smithi044.stdout:(100/129): poppler-data-0.4.9-9.el9.noarch.rpm 8.8 MB/s | 1.8 MB 00:00 2023-12-03T11:40:36.806 INFO:teuthology.orchestra.run.smithi044.stdout:(101/129): poppler-glib-21.01.0-19.el9.x86_64.r 2.1 MB/s | 151 kB 00:00 2023-12-03T11:40:36.840 INFO:teuthology.orchestra.run.smithi044.stdout:(102/129): pulseaudio-libs-15.0-2.el9.x86_64.rp 6.2 MB/s | 666 kB 00:00 2023-12-03T11:40:36.865 INFO:teuthology.orchestra.run.smithi044.stdout:(103/129): pulseaudio-utils-15.0-2.el9.x86_64.r 870 kB/s | 72 kB 00:00 2023-12-03T11:40:36.891 INFO:teuthology.orchestra.run.smithi044.stdout:(104/129): rtkit-0.11-28.el9.x86_64.rpm 1.1 MB/s | 55 kB 00:00 2023-12-03T11:40:36.916 INFO:teuthology.orchestra.run.smithi044.stdout:(105/129): sound-theme-freedesktop-0.8-17.el9.n 4.9 MB/s | 377 kB 00:00 2023-12-03T11:40:36.941 INFO:teuthology.orchestra.run.smithi044.stdout:(106/129): totem-pl-parser-3.26.6-2.el9.x86_64. 1.7 MB/s | 130 kB 00:00 2023-12-03T11:40:36.966 INFO:teuthology.orchestra.run.smithi044.stdout:(107/129): tracker-3.1.2-3.el9.x86_64.rpm 11 MB/s | 537 kB 00:00 2023-12-03T11:40:37.008 INFO:teuthology.orchestra.run.smithi044.stdout:(108/129): tracker-miners-3.1.2-3.el9.x86_64.rp 9.5 MB/s | 887 kB 00:00 2023-12-03T11:40:37.059 INFO:teuthology.orchestra.run.smithi044.stdout:(109/129): ttmkfdir-3.0.9-65.el9.x86_64.rpm 449 kB/s | 52 kB 00:00 2023-12-03T11:40:37.109 INFO:teuthology.orchestra.run.smithi044.stdout:(110/129): tzdata-java-2023c-1.el9.noarch.rpm 1.0 MB/s | 149 kB 00:00 2023-12-03T11:40:37.134 INFO:teuthology.orchestra.run.smithi044.stdout:(111/129): upower-0.99.11-11.el9.x86_64.rpm 2.2 MB/s | 168 kB 00:00 2023-12-03T11:40:37.160 INFO:teuthology.orchestra.run.smithi044.stdout:(112/129): vulkan-loader-1.3.250.1-1.el9.x86_64 1.4 MB/s | 140 kB 00:00 2023-12-03T11:40:37.185 INFO:teuthology.orchestra.run.smithi044.stdout:(113/129): webrtc-audio-processing-0.3.1-8.el9. 4.0 MB/s | 305 kB 00:00 2023-12-03T11:40:37.219 INFO:teuthology.orchestra.run.smithi044.stdout:(114/129): wireplumber-0.4.14-1.el9.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2023-12-03T11:40:37.244 INFO:teuthology.orchestra.run.smithi044.stdout:(115/129): wireplumber-libs-0.4.14-1.el9.x86_64 4.0 MB/s | 337 kB 00:00 2023-12-03T11:40:37.269 INFO:teuthology.orchestra.run.smithi044.stdout:(116/129): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 499 kB/s | 41 kB 00:00 2023-12-03T11:40:37.294 INFO:teuthology.orchestra.run.smithi044.stdout:(117/129): xdg-desktop-portal-1.12.4-1.el9.x86_ 7.1 MB/s | 365 kB 00:00 2023-12-03T11:40:37.320 INFO:teuthology.orchestra.run.smithi044.stdout:(118/129): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.7 MB/s | 130 kB 00:00 2023-12-03T11:40:37.353 INFO:teuthology.orchestra.run.smithi044.stdout:(119/129): xkeyboard-config-2.33-2.el9.noarch.r 9.2 MB/s | 780 kB 00:00 2023-12-03T11:40:37.387 INFO:teuthology.orchestra.run.smithi044.stdout:(120/129): xorg-x11-fonts-Type1-7.5-33.el9.noar 5.4 MB/s | 499 kB 00:00 2023-12-03T11:40:37.421 INFO:teuthology.orchestra.run.smithi044.stdout:(121/129): ModemManager-glib-1.20.2-1.el9.x86_6 5.0 MB/s | 334 kB 00:00 2023-12-03T11:40:37.446 INFO:teuthology.orchestra.run.smithi044.stdout:(122/129): bluez-libs-5.64-1.el9.x86_64.rpm 910 kB/s | 83 kB 00:00 2023-12-03T11:40:37.471 INFO:teuthology.orchestra.run.smithi044.stdout:(123/129): bubblewrap-0.4.1-6.el9.x86_64.rpm 592 kB/s | 49 kB 00:00 2023-12-03T11:40:37.496 INFO:teuthology.orchestra.run.smithi044.stdout:(124/129): cups-libs-2.3.3op2-22.el9.x86_64.rpm 5.1 MB/s | 262 kB 00:00 2023-12-03T11:40:37.521 INFO:teuthology.orchestra.run.smithi044.stdout:(125/129): libpciaccess-0.16-6.el9.x86_64.rpm 355 kB/s | 27 kB 00:00 2023-12-03T11:40:37.547 INFO:teuthology.orchestra.run.smithi044.stdout:(126/129): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.2 MB/s | 90 kB 00:00 2023-12-03T11:40:37.639 INFO:teuthology.orchestra.run.smithi044.stdout:(127/129): libX11-xcb-1.7.0-8.el9.x86_64.rpm 119 kB/s | 11 kB 00:00 2023-12-03T11:40:37.664 INFO:teuthology.orchestra.run.smithi044.stdout:(128/129): avahi-glib-0.8-12.el9.x86_64.rpm 104 kB/s | 15 kB 00:00 2023-12-03T11:40:37.714 INFO:teuthology.orchestra.run.smithi044.stdout:(129/129): flac-libs-1.3.3-12.el9.x86_64.rpm 1.1 MB/s | 218 kB 00:00 2023-12-03T11:40:37.717 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2023-12-03T11:40:37.717 INFO:teuthology.orchestra.run.smithi044.stdout:Total 19 MB/s | 102 MB 00:05 2023-12-03T11:40:37.754 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2023-12-03T11:40:37.856 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2023-12-03T11:40:37.856 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2023-12-03T11:40:38.899 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2023-12-03T11:40:38.900 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2023-12-03T11:40:43.184 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2023-12-03T11:40:43.253 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2023-12-03T11:40:43.412 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2023-12-03T11:40:43.493 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libXi-1.7.10-8.el9.x86_64 1/129 2023-12-03T11:40:43.528 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 2/129 2023-12-03T11:40:43.566 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 3/129 2023-12-03T11:40:43.604 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 4/129 2023-12-03T11:40:43.721 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 5/129 2023-12-03T11:40:43.809 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : atk-2.36.0-5.el9.x86_64 6/129 2023-12-03T11:40:43.850 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : alsa-lib-1.2.9-1.el9.x86_64 7/129 2023-12-03T11:40:43.911 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libX11-xcb-1.7.0-8.el9.x86_64 8/129 2023-12-03T11:40:43.945 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cups-libs-1:2.3.3op2-22.el9.x86_64 9/129 2023-12-03T11:40:43.968 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : opus-1.3.1-10.el9.x86_64 10/129 2023-12-03T11:40:43.994 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 11/129 2023-12-03T11:40:44.029 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libtool-ltdl-2.4.6-45.el9.x86_64 12/129 2023-12-03T11:40:44.064 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 13/129 2023-12-03T11:40:44.156 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lcms2-2.12-3.el9.x86_64 14/129 2023-12-03T11:40:44.201 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 15/129 2023-12-03T11:40:44.231 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 16/129 2023-12-03T11:40:44.259 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 17/129 2023-12-03T11:40:44.284 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 18/129 2023-12-03T11:40:44.310 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 19/129 2023-12-03T11:40:44.344 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : mesa-libglapi-23.3.0~rc2-1.el9.x86_64 20/129 2023-12-03T11:40:44.369 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 21/129 2023-12-03T11:40:44.398 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 22/129 2023-12-03T11:40:44.429 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 23/129 2023-12-03T11:40:44.454 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 24/129 2023-12-03T11:40:44.569 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 25/129 2023-12-03T11:40:44.638 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 26/129 2023-12-03T11:40:44.687 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gtk-update-icon-cache-3.24.31-2.el9.x86_64 27/129 2023-12-03T11:40:44.721 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : dconf-0.40.0-6.el9.x86_64 28/129 2023-12-03T11:40:44.785 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 28/129 2023-12-03T11:40:44.822 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 29/129 2023-12-03T11:40:44.859 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 30/129 2023-12-03T11:40:44.891 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 31/129 2023-12-03T11:40:44.927 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 32/129 2023-12-03T11:40:44.968 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 33/129 2023-12-03T11:40:45.025 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 34/129 2023-12-03T11:40:45.062 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 35/129 2023-12-03T11:40:45.090 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 36/129 2023-12-03T11:40:45.131 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : avahi-glib-0.8-12.el9.x86_64 37/129 2023-12-03T11:40:45.167 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 38/129 2023-12-03T11:40:45.197 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libpciaccess-0.16-6.el9.x86_64 39/129 2023-12-03T11:40:45.226 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libdrm-2.4.117-1.el9.x86_64 40/129 2023-12-03T11:40:45.252 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : mesa-libgbm-23.3.0~rc2-1.el9.x86_64 41/129 2023-12-03T11:40:45.279 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 42/129 2023-12-03T11:40:45.307 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : mesa-libEGL-23.3.0~rc2-1.el9.x86_64 43/129 2023-12-03T11:40:45.544 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : vulkan-loader-1.3.250.1-1.el9.x86_64 44/129 2023-12-03T11:40:45.576 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : mesa-vulkan-drivers-23.3.0~rc2-1.el9.x86_64 45/129 2023-12-03T11:40:45.606 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : bubblewrap-0.4.1-6.el9.x86_64 46/129 2023-12-03T11:40:45.647 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : bluez-libs-5.64-1.el9.x86_64 47/129 2023-12-03T11:40:45.853 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 48/129 2023-12-03T11:40:45.895 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 49/129 2023-12-03T11:40:45.927 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 50/129 2023-12-03T11:40:45.966 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 51/129 2023-12-03T11:40:46.006 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 52/129 2023-12-03T11:40:46.036 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : upower-0.99.11-11.el9.x86_64 53/129 2023-12-03T11:40:46.049 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 53/129 2023-12-03T11:40:46.050 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2023-12-03T11:40:46.050 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:40:46.248 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : tzdata-java-2023c-1.el9.noarch 54/129 2023-12-03T11:40:46.334 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 55/129 2023-12-03T11:40:46.393 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 56/129 2023-12-03T11:40:46.418 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 57/129 2023-12-03T11:40:46.424 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 57/129 2023-12-03T11:40:46.850 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 58/129 2023-12-03T11:40:46.881 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rtkit-0.11-28.el9.x86_64 58/129 2023-12-03T11:40:46.894 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 58/129 2023-12-03T11:40:46.894 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2023-12-03T11:40:46.894 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:40:47.107 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 59/129 2023-12-03T11:40:47.140 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : p11-kit-server-0.24.1-2.el9.x86_64 60/129 2023-12-03T11:40:47.181 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ostree-libs-2023.7-2.el9.x86_64 61/129 2023-12-03T11:40:47.699 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 62/129 2023-12-03T11:40:47.792 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : osinfo-db-20230518-1.el9.noarch 63/129 2023-12-03T11:40:47.839 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 64/129 2023-12-03T11:40:47.888 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : orc-0.4.31-6.el9.x86_64 65/129 2023-12-03T11:40:47.951 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 66/129 2023-12-03T11:40:47.996 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-posix-35.0-8.el9.x86_64 67/129 2023-12-03T11:40:48.023 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 68/129 2023-12-03T11:40:48.045 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 69/129 2023-12-03T11:40:48.056 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 69/129 2023-12-03T11:40:48.057 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2023-12-03T11:40:48.057 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:40:48.106 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 70/129 2023-12-03T11:40:48.140 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 71/129 2023-12-03T11:40:48.168 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libsbc-1.4-9.el9.x86_64 72/129 2023-12-03T11:40:48.198 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 73/129 2023-12-03T11:40:48.624 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 74/129 2023-12-03T11:40:48.663 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 74/129 2023-12-03T11:40:48.682 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 74/129 2023-12-03T11:40:48.712 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 75/129 2023-12-03T11:40:48.774 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libiptcdata-1.0.5-9.el9.x86_64 76/129 2023-12-03T11:40:48.811 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 77/129 2023-12-03T11:40:48.837 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 78/129 2023-12-03T11:40:48.883 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 79/129 2023-12-03T11:40:48.910 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 80/129 2023-12-03T11:40:49.205 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 80/129 2023-12-03T11:40:49.245 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libexif-0.6.22-6.el9.x86_64 81/129 2023-12-03T11:40:49.273 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 82/129 2023-12-03T11:40:49.299 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libasyncns-0.8-22.el9.x86_64 83/129 2023-12-03T11:40:49.327 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 84/129 2023-12-03T11:40:49.360 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 85/129 2023-12-03T11:40:49.383 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : mesa-libGL-23.3.0~rc2-1.el9.x86_64 86/129 2023-12-03T11:40:49.411 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libXv-1.0.11-16.el9.x86_64 87/129 2023-12-03T11:40:49.439 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 88/129 2023-12-03T11:40:49.486 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libtiff-4.4.0-10.el9.x86_64 89/129 2023-12-03T11:40:49.523 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 90/129 2023-12-03T11:40:49.573 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 91/129 2023-12-03T11:40:49.615 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : poppler-21.01.0-19.el9.x86_64 92/129 2023-12-03T11:40:49.648 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : poppler-glib-21.01.0-19.el9.x86_64 93/129 2023-12-03T11:40:50.270 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 94/129 2023-12-03T11:40:50.317 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el 95/129 2023-12-03T11:40:51.025 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el 95/129 2023-12-03T11:40:51.078 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 96/129 2023-12-03T11:40:51.105 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gsm-1.0.19-6.el9.x86_64 97/129 2023-12-03T11:40:51.178 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 98/129 2023-12-03T11:40:51.221 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 99/129 2023-12-03T11:40:51.246 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcanberra-0.30-27.el9.x86_64 100/129 2023-12-03T11:40:51.270 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 100/129 2023-12-03T11:40:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : pulseaudio-utils-15.0-2.el9.x86_64 101/129 2023-12-03T11:40:51.412 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : graphene-1.10.6-2.el9.x86_64 102/129 2023-12-03T11:40:51.455 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gstreamer1-plugins-base-1.22.1-1.el9.x86_64 103/129 2023-12-03T11:40:51.481 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : giflib-5.2.1-9.el9.x86_64 104/129 2023-12-03T11:40:51.512 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flatpak-session-helper-1.12.8-1.el9.x86_64 105/129 2023-12-03T11:40:51.544 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flatpak-selinux-1.12.8-1.el9.noarch 106/129 2023-12-03T11:41:02.511 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: flatpak-selinux-1.12.8-1.el9.noarch 106/129 2023-12-03T11:41:02.543 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 107/129 2023-12-03T11:41:02.982 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: pipewire-0.3.67-2.el9.x86_64 108/129 2023-12-03T11:41:03.006 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : pipewire-0.3.67-2.el9.x86_64 108/129 2023-12-03T11:41:03.024 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: pipewire-0.3.67-2.el9.x86_64 108/129 2023-12-03T11:41:03.024 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2023-12-03T11:41:03.024 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:03.248 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : pipewire-libs-0.3.67-2.el9.x86_64 109/129 2023-12-03T11:41:03.325 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 110/129 2023-12-03T11:41:03.367 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 111/129 2023-12-03T11:41:03.800 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: flatpak-1.12.8-1.el9.x86_64 112/129 2023-12-03T11:41:04.006 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flatpak-1.12.8-1.el9.x86_64 112/129 2023-12-03T11:41:04.035 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xdg-desktop-portal-1.12.4-1.el9.x86_64 113/129 2023-12-03T11:41:04.069 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: xdg-desktop-portal-1.12.4-1.el9.x86_64 113/129 2023-12-03T11:41:04.118 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 114/129 2023-12-03T11:41:04.186 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 115/129 2023-12-03T11:41:04.223 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : tracker-3.1.2-3.el9.x86_64 116/129 2023-12-03T11:41:04.338 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 116/129 2023-12-03T11:41:04.378 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : tracker-miners-3.1.2-3.el9.x86_64 117/129 2023-12-03T11:41:04.470 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: tracker-miners-3.1.2-3.el9.x86_64 117/129 2023-12-03T11:41:07.424 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 118/129 2023-12-03T11:41:07.506 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 119/129 2023-12-03T11:41:07.549 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 120/129 2023-12-03T11:41:07.576 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 121/129 2023-12-03T11:41:07.788 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 121/129 2023-12-03T11:41:07.949 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gtk3-3.24.31-2.el9.x86_64 122/129 2023-12-03T11:41:07.990 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 123/129 2023-12-03T11:41:08.025 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 124/129 2023-12-03T11:41:08.064 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 125/129 2023-12-03T11:41:08.319 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 125/129 2023-12-03T11:41:08.368 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x 126/129 2023-12-03T11:41:08.380 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x 126/129 2023-12-03T11:41:08.426 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : pipewire-alsa-0.3.67-2.el9.x86_64 127/129 2023-12-03T11:41:08.456 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : pipewire-jack-audio-connection-kit-0.3.67-2.el9. 128/129 2023-12-03T11:41:08.479 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : pipewire-pulseaudio-0.3.67-2.el9.x86_64 129/129 2023-12-03T11:41:08.494 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: pipewire-pulseaudio-0.3.67-2.el9.x86_64 129/129 2023-12-03T11:41:08.494 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2023-12-03T11:41:08.494 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:08.525 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 129/129 2023-12-03T11:41:08.530 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 129/129 2023-12-03T11:41:08.560 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el 129/129 2023-12-03T11:41:08.570 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 129/129 2023-12-03T11:41:08.570 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2023-12-03T11:41:08.570 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2023-12-03T11:41:08.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:08.651 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 129/129 2023-12-03T11:41:08.727 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x 129/129 2023-12-03T11:41:12.410 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: pipewire-pulseaudio-0.3.67-2.el9.x86_64 129/129 2023-12-03T11:41:12.410 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 1/129 2023-12-03T11:41:12.410 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 2/129 2023-12-03T11:41:12.410 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : alsa-lib-1.2.9-1.el9.x86_64 3/129 2023-12-03T11:41:12.410 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 4/129 2023-12-03T11:41:12.410 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 5/129 2023-12-03T11:41:12.410 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : atk-2.36.0-5.el9.x86_64 6/129 2023-12-03T11:41:12.410 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 7/129 2023-12-03T11:41:12.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 8/129 2023-12-03T11:41:12.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 9/129 2023-12-03T11:41:12.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 10/129 2023-12-03T11:41:12.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 11/129 2023-12-03T11:41:12.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 12/129 2023-12-03T11:41:12.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 13/129 2023-12-03T11:41:12.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flatpak-1.12.8-1.el9.x86_64 14/129 2023-12-03T11:41:12.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flatpak-selinux-1.12.8-1.el9.noarch 15/129 2023-12-03T11:41:12.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flatpak-session-helper-1.12.8-1.el9.x86_64 16/129 2023-12-03T11:41:12.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 17/129 2023-12-03T11:41:12.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 18/129 2023-12-03T11:41:12.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 19/129 2023-12-03T11:41:12.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 20/129 2023-12-03T11:41:12.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 21/129 2023-12-03T11:41:12.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 22/129 2023-12-03T11:41:12.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gstreamer1-plugins-base-1.22.1-1.el9.x86_64 23/129 2023-12-03T11:41:12.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gtk-update-icon-cache-3.24.31-2.el9.x86_64 24/129 2023-12-03T11:41:12.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 25/129 2023-12-03T11:41:12.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gtk3-3.24.31-2.el9.x86_64 26/129 2023-12-03T11:41:12.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 27/129 2023-12-03T11:41:12.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 28/129 2023-12-03T11:41:12.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 29/129 2023-12-03T11:41:12.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x 30/129 2023-12-03T11:41:12.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el 31/129 2023-12-03T11:41:12.412 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 32/129 2023-12-03T11:41:12.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 33/129 2023-12-03T11:41:12.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lcms2-2.12-3.el9.x86_64 34/129 2023-12-03T11:41:12.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 35/129 2023-12-03T11:41:12.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 36/129 2023-12-03T11:41:12.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 37/129 2023-12-03T11:41:12.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 38/129 2023-12-03T11:41:12.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 39/129 2023-12-03T11:41:12.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 40/129 2023-12-03T11:41:12.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 41/129 2023-12-03T11:41:12.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 42/129 2023-12-03T11:41:12.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 43/129 2023-12-03T11:41:12.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 44/129 2023-12-03T11:41:12.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 45/129 2023-12-03T11:41:12.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 46/129 2023-12-03T11:41:12.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 47/129 2023-12-03T11:41:12.413 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 48/129 2023-12-03T11:41:12.414 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libdrm-2.4.117-1.el9.x86_64 49/129 2023-12-03T11:41:12.414 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 50/129 2023-12-03T11:41:12.414 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 51/129 2023-12-03T11:41:12.414 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 52/129 2023-12-03T11:41:12.414 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 53/129 2023-12-03T11:41:12.414 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 54/129 2023-12-03T11:41:12.414 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 55/129 2023-12-03T11:41:12.414 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 56/129 2023-12-03T11:41:12.414 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 57/129 2023-12-03T11:41:12.414 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 58/129 2023-12-03T11:41:12.414 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libiptcdata-1.0.5-9.el9.x86_64 59/129 2023-12-03T11:41:12.414 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 60/129 2023-12-03T11:41:12.414 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 61/129 2023-12-03T11:41:12.415 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 62/129 2023-12-03T11:41:12.415 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 63/129 2023-12-03T11:41:12.415 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libsbc-1.4-9.el9.x86_64 64/129 2023-12-03T11:41:12.415 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 65/129 2023-12-03T11:41:12.415 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 66/129 2023-12-03T11:41:12.415 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libtiff-4.4.0-10.el9.x86_64 67/129 2023-12-03T11:41:12.415 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libtool-ltdl-2.4.6-45.el9.x86_64 68/129 2023-12-03T11:41:12.415 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 69/129 2023-12-03T11:41:12.415 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 70/129 2023-12-03T11:41:12.415 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 71/129 2023-12-03T11:41:12.415 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 72/129 2023-12-03T11:41:12.415 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 73/129 2023-12-03T11:41:12.415 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 74/129 2023-12-03T11:41:12.416 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 75/129 2023-12-03T11:41:12.416 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 76/129 2023-12-03T11:41:12.416 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 77/129 2023-12-03T11:41:12.416 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 78/129 2023-12-03T11:41:12.416 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 79/129 2023-12-03T11:41:12.416 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 80/129 2023-12-03T11:41:12.416 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : mesa-libEGL-23.3.0~rc2-1.el9.x86_64 81/129 2023-12-03T11:41:12.416 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : mesa-libGL-23.3.0~rc2-1.el9.x86_64 82/129 2023-12-03T11:41:12.416 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : mesa-libgbm-23.3.0~rc2-1.el9.x86_64 83/129 2023-12-03T11:41:12.416 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : mesa-libglapi-23.3.0~rc2-1.el9.x86_64 84/129 2023-12-03T11:41:12.416 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : mesa-vulkan-drivers-23.3.0~rc2-1.el9.x86_64 85/129 2023-12-03T11:41:12.416 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 86/129 2023-12-03T11:41:12.416 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 87/129 2023-12-03T11:41:12.416 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : opus-1.3.1-10.el9.x86_64 88/129 2023-12-03T11:41:12.416 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : orc-0.4.31-6.el9.x86_64 89/129 2023-12-03T11:41:12.417 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : osinfo-db-20230518-1.el9.noarch 90/129 2023-12-03T11:41:12.417 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 91/129 2023-12-03T11:41:12.417 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ostree-libs-2023.7-2.el9.x86_64 92/129 2023-12-03T11:41:12.417 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : p11-kit-server-0.24.1-2.el9.x86_64 93/129 2023-12-03T11:41:12.417 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : pipewire-0.3.67-2.el9.x86_64 94/129 2023-12-03T11:41:12.417 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : pipewire-alsa-0.3.67-2.el9.x86_64 95/129 2023-12-03T11:41:12.417 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : pipewire-jack-audio-connection-kit-0.3.67-2.el9. 96/129 2023-12-03T11:41:12.417 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : pipewire-libs-0.3.67-2.el9.x86_64 97/129 2023-12-03T11:41:12.417 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : pipewire-pulseaudio-0.3.67-2.el9.x86_64 98/129 2023-12-03T11:41:12.417 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : poppler-21.01.0-19.el9.x86_64 99/129 2023-12-03T11:41:12.417 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 100/129 2023-12-03T11:41:12.417 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : poppler-glib-21.01.0-19.el9.x86_64 101/129 2023-12-03T11:41:12.417 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 102/129 2023-12-03T11:41:12.417 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : pulseaudio-utils-15.0-2.el9.x86_64 103/129 2023-12-03T11:41:12.417 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rtkit-0.11-28.el9.x86_64 104/129 2023-12-03T11:41:12.418 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 105/129 2023-12-03T11:41:12.418 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 106/129 2023-12-03T11:41:12.418 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 107/129 2023-12-03T11:41:12.418 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : tracker-miners-3.1.2-3.el9.x86_64 108/129 2023-12-03T11:41:12.418 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 109/129 2023-12-03T11:41:12.418 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : tzdata-java-2023c-1.el9.noarch 110/129 2023-12-03T11:41:12.418 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : upower-0.99.11-11.el9.x86_64 111/129 2023-12-03T11:41:12.418 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : vulkan-loader-1.3.250.1-1.el9.x86_64 112/129 2023-12-03T11:41:12.418 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 113/129 2023-12-03T11:41:12.418 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 114/129 2023-12-03T11:41:12.418 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 115/129 2023-12-03T11:41:12.418 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 116/129 2023-12-03T11:41:12.419 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xdg-desktop-portal-1.12.4-1.el9.x86_64 117/129 2023-12-03T11:41:12.419 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 118/129 2023-12-03T11:41:12.419 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 119/129 2023-12-03T11:41:12.419 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 120/129 2023-12-03T11:41:12.419 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 121/129 2023-12-03T11:41:12.419 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : bluez-libs-5.64-1.el9.x86_64 122/129 2023-12-03T11:41:12.419 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : bubblewrap-0.4.1-6.el9.x86_64 123/129 2023-12-03T11:41:12.419 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cups-libs-1:2.3.3op2-22.el9.x86_64 124/129 2023-12-03T11:41:12.419 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libpciaccess-0.16-6.el9.x86_64 125/129 2023-12-03T11:41:12.419 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 126/129 2023-12-03T11:41:12.419 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : avahi-glib-0.8-12.el9.x86_64 127/129 2023-12-03T11:41:12.419 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 128/129 2023-12-03T11:41:14.583 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libX11-xcb-1.7.0-8.el9.x86_64 129/129 2023-12-03T11:41:14.584 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:14.584 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2023-12-03T11:41:14.584 INFO:teuthology.orchestra.run.smithi044.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2023-12-03T11:41:14.584 INFO:teuthology.orchestra.run.smithi044.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2023-12-03T11:41:14.584 INFO:teuthology.orchestra.run.smithi044.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2023-12-03T11:41:14.584 INFO:teuthology.orchestra.run.smithi044.stdout: alsa-lib-1.2.9-1.el9.x86_64 2023-12-03T11:41:14.584 INFO:teuthology.orchestra.run.smithi044.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2023-12-03T11:41:14.584 INFO:teuthology.orchestra.run.smithi044.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2023-12-03T11:41:14.584 INFO:teuthology.orchestra.run.smithi044.stdout: atk-2.36.0-5.el9.x86_64 2023-12-03T11:41:14.584 INFO:teuthology.orchestra.run.smithi044.stdout: avahi-glib-0.8-12.el9.x86_64 2023-12-03T11:41:14.584 INFO:teuthology.orchestra.run.smithi044.stdout: bluez-libs-5.64-1.el9.x86_64 2023-12-03T11:41:14.584 INFO:teuthology.orchestra.run.smithi044.stdout: bubblewrap-0.4.1-6.el9.x86_64 2023-12-03T11:41:14.585 INFO:teuthology.orchestra.run.smithi044.stdout: colord-libs-1.4.5-4.el9.x86_64 2023-12-03T11:41:14.585 INFO:teuthology.orchestra.run.smithi044.stdout: copy-jdk-configs-4.0-3.el9.noarch 2023-12-03T11:41:14.585 INFO:teuthology.orchestra.run.smithi044.stdout: cups-libs-1:2.3.3op2-22.el9.x86_64 2023-12-03T11:41:14.585 INFO:teuthology.orchestra.run.smithi044.stdout: dconf-0.40.0-6.el9.x86_64 2023-12-03T11:41:14.585 INFO:teuthology.orchestra.run.smithi044.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2023-12-03T11:41:14.585 INFO:teuthology.orchestra.run.smithi044.stdout: exiv2-0.27.5-2.el9.x86_64 2023-12-03T11:41:14.585 INFO:teuthology.orchestra.run.smithi044.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2023-12-03T11:41:14.585 INFO:teuthology.orchestra.run.smithi044.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2023-12-03T11:41:14.585 INFO:teuthology.orchestra.run.smithi044.stdout: flac-libs-1.3.3-12.el9.x86_64 2023-12-03T11:41:14.585 INFO:teuthology.orchestra.run.smithi044.stdout: flatpak-1.12.8-1.el9.x86_64 2023-12-03T11:41:14.585 INFO:teuthology.orchestra.run.smithi044.stdout: flatpak-selinux-1.12.8-1.el9.noarch 2023-12-03T11:41:14.585 INFO:teuthology.orchestra.run.smithi044.stdout: flatpak-session-helper-1.12.8-1.el9.x86_64 2023-12-03T11:41:14.585 INFO:teuthology.orchestra.run.smithi044.stdout: gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 2023-12-03T11:41:14.585 INFO:teuthology.orchestra.run.smithi044.stdout: geoclue2-2.6.0-7.el9.x86_64 2023-12-03T11:41:14.585 INFO:teuthology.orchestra.run.smithi044.stdout: giflib-5.2.1-9.el9.x86_64 2023-12-03T11:41:14.586 INFO:teuthology.orchestra.run.smithi044.stdout: graphene-1.10.6-2.el9.x86_64 2023-12-03T11:41:14.586 INFO:teuthology.orchestra.run.smithi044.stdout: gsm-1.0.19-6.el9.x86_64 2023-12-03T11:41:14.586 INFO:teuthology.orchestra.run.smithi044.stdout: gstreamer1-1.22.1-2.el9.x86_64 2023-12-03T11:41:14.586 INFO:teuthology.orchestra.run.smithi044.stdout: gstreamer1-plugins-base-1.22.1-1.el9.x86_64 2023-12-03T11:41:14.586 INFO:teuthology.orchestra.run.smithi044.stdout: gtk-update-icon-cache-3.24.31-2.el9.x86_64 2023-12-03T11:41:14.586 INFO:teuthology.orchestra.run.smithi044.stdout: gtk2-2.24.33-8.el9.x86_64 2023-12-03T11:41:14.586 INFO:teuthology.orchestra.run.smithi044.stdout: gtk3-3.24.31-2.el9.x86_64 2023-12-03T11:41:14.586 INFO:teuthology.orchestra.run.smithi044.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2023-12-03T11:41:14.586 INFO:teuthology.orchestra.run.smithi044.stdout: iso-codes-4.6.0-3.el9.noarch 2023-12-03T11:41:14.586 INFO:teuthology.orchestra.run.smithi044.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2023-12-03T11:41:14.586 INFO:teuthology.orchestra.run.smithi044.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2023-12-03T11:41:14.586 INFO:teuthology.orchestra.run.smithi044.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2023-12-03T11:41:14.586 INFO:teuthology.orchestra.run.smithi044.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2023-12-03T11:41:14.586 INFO:teuthology.orchestra.run.smithi044.stdout: jbigkit-libs-2.1-23.el9.x86_64 2023-12-03T11:41:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: lcms2-2.12-3.el9.x86_64 2023-12-03T11:41:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: libX11-xcb-1.7.0-8.el9.x86_64 2023-12-03T11:41:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: libXcomposite-0.4.5-7.el9.x86_64 2023-12-03T11:41:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: libXcursor-1.2.0-7.el9.x86_64 2023-12-03T11:41:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: libXdamage-1.1.5-7.el9.x86_64 2023-12-03T11:41:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: libXfixes-5.0.3-16.el9.x86_64 2023-12-03T11:41:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: libXi-1.7.10-8.el9.x86_64 2023-12-03T11:41:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: libXinerama-1.1.4-10.el9.x86_64 2023-12-03T11:41:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: libXrandr-1.5.2-8.el9.x86_64 2023-12-03T11:41:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: libXtst-1.2.3-16.el9.x86_64 2023-12-03T11:41:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: libXv-1.0.11-16.el9.x86_64 2023-12-03T11:41:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2023-12-03T11:41:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: libasyncns-0.8-22.el9.x86_64 2023-12-03T11:41:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: libcanberra-0.30-27.el9.x86_64 2023-12-03T11:41:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2023-12-03T11:41:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2023-12-03T11:41:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: libdrm-2.4.117-1.el9.x86_64 2023-12-03T11:41:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: libepoxy-1.5.5-4.el9.x86_64 2023-12-03T11:41:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: libexif-0.6.22-6.el9.x86_64 2023-12-03T11:41:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: libfontenc-1.1.3-17.el9.x86_64 2023-12-03T11:41:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: libgexiv2-0.12.3-1.el9.x86_64 2023-12-03T11:41:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2023-12-03T11:41:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2023-12-03T11:41:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2023-12-03T11:41:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: libgsf-1.14.47-5.el9.x86_64 2023-12-03T11:41:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: libgxps-0.3.2-3.el9.x86_64 2023-12-03T11:41:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: libiptcdata-1.0.5-9.el9.x86_64 2023-12-03T11:41:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: libldac-2.0.2.3-10.el9.x86_64 2023-12-03T11:41:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: libnotify-0.7.9-8.el9.x86_64 2023-12-03T11:41:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: libogg-2:1.3.4-6.el9.x86_64 2023-12-03T11:41:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: libosinfo-1.10.0-1.el9.x86_64 2023-12-03T11:41:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: libpciaccess-0.16-6.el9.x86_64 2023-12-03T11:41:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: libsbc-1.4-9.el9.x86_64 2023-12-03T11:41:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: libsndfile-1.0.31-8.el9.x86_64 2023-12-03T11:41:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: libtheora-1:1.1.1-31.el9.x86_64 2023-12-03T11:41:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: libtiff-4.4.0-10.el9.x86_64 2023-12-03T11:41:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: libtool-ltdl-2.4.6-45.el9.x86_64 2023-12-03T11:41:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2023-12-03T11:41:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: libvisual-1:0.4.0-34.el9.x86_64 2023-12-03T11:41:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2023-12-03T11:41:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: libwayland-client-1.21.0-1.el9.x86_64 2023-12-03T11:41:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2023-12-03T11:41:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2023-12-03T11:41:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: libwayland-server-1.21.0-1.el9.x86_64 2023-12-03T11:41:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: libwebp-1.2.0-8.el9.x86_64 2023-12-03T11:41:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2023-12-03T11:41:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: libxshmfence-1.3-10.el9.x86_64 2023-12-03T11:41:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2023-12-03T11:41:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: low-memory-monitor-2.1-4.el9.x86_64 2023-12-03T11:41:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: lua-posix-35.0-8.el9.x86_64 2023-12-03T11:41:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: mesa-libEGL-23.3.0~rc2-1.el9.x86_64 2023-12-03T11:41:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: mesa-libGL-23.3.0~rc2-1.el9.x86_64 2023-12-03T11:41:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: mesa-libgbm-23.3.0~rc2-1.el9.x86_64 2023-12-03T11:41:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: mesa-libglapi-23.3.0~rc2-1.el9.x86_64 2023-12-03T11:41:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: mesa-vulkan-drivers-23.3.0~rc2-1.el9.x86_64 2023-12-03T11:41:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: mkfontscale-1.2.1-3.el9.x86_64 2023-12-03T11:41:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: openjpeg2-2.4.0-7.el9.x86_64 2023-12-03T11:41:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: opus-1.3.1-10.el9.x86_64 2023-12-03T11:41:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: orc-0.4.31-6.el9.x86_64 2023-12-03T11:41:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: osinfo-db-20230518-1.el9.noarch 2023-12-03T11:41:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2023-12-03T11:41:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: ostree-libs-2023.7-2.el9.x86_64 2023-12-03T11:41:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: p11-kit-server-0.24.1-2.el9.x86_64 2023-12-03T11:41:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: pipewire-0.3.67-2.el9.x86_64 2023-12-03T11:41:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: pipewire-alsa-0.3.67-2.el9.x86_64 2023-12-03T11:41:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: pipewire-jack-audio-connection-kit-0.3.67-2.el9.x86_64 2023-12-03T11:41:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: pipewire-libs-0.3.67-2.el9.x86_64 2023-12-03T11:41:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: pipewire-pulseaudio-0.3.67-2.el9.x86_64 2023-12-03T11:41:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: poppler-21.01.0-19.el9.x86_64 2023-12-03T11:41:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: poppler-data-0.4.9-9.el9.noarch 2023-12-03T11:41:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: poppler-glib-21.01.0-19.el9.x86_64 2023-12-03T11:41:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2023-12-03T11:41:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: pulseaudio-utils-15.0-2.el9.x86_64 2023-12-03T11:41:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: rtkit-0.11-28.el9.x86_64 2023-12-03T11:41:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2023-12-03T11:41:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2023-12-03T11:41:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: tracker-3.1.2-3.el9.x86_64 2023-12-03T11:41:14.592 INFO:teuthology.orchestra.run.smithi044.stdout: tracker-miners-3.1.2-3.el9.x86_64 2023-12-03T11:41:14.592 INFO:teuthology.orchestra.run.smithi044.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2023-12-03T11:41:14.592 INFO:teuthology.orchestra.run.smithi044.stdout: tzdata-java-2023c-1.el9.noarch 2023-12-03T11:41:14.592 INFO:teuthology.orchestra.run.smithi044.stdout: upower-0.99.11-11.el9.x86_64 2023-12-03T11:41:14.592 INFO:teuthology.orchestra.run.smithi044.stdout: vulkan-loader-1.3.250.1-1.el9.x86_64 2023-12-03T11:41:14.592 INFO:teuthology.orchestra.run.smithi044.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2023-12-03T11:41:14.592 INFO:teuthology.orchestra.run.smithi044.stdout: wireplumber-0.4.14-1.el9.x86_64 2023-12-03T11:41:14.592 INFO:teuthology.orchestra.run.smithi044.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2023-12-03T11:41:14.592 INFO:teuthology.orchestra.run.smithi044.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2023-12-03T11:41:14.592 INFO:teuthology.orchestra.run.smithi044.stdout: xdg-desktop-portal-1.12.4-1.el9.x86_64 2023-12-03T11:41:14.592 INFO:teuthology.orchestra.run.smithi044.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2023-12-03T11:41:14.592 INFO:teuthology.orchestra.run.smithi044.stdout: xkeyboard-config-2.33-2.el9.noarch 2023-12-03T11:41:14.593 INFO:teuthology.orchestra.run.smithi044.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2023-12-03T11:41:14.593 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:14.593 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2023-12-03T11:41:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: Gradle will be installed under /opt/gradle 2023-12-03T11:41:14.927 INFO:teuthology.orchestra.run.smithi044.stderr:--2023-12-03 11:41:14-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2023-12-03T11:41:15.069 INFO:teuthology.orchestra.run.smithi044.stderr:Resolving services.gradle.org (services.gradle.org)... 104.17.128.37, 104.17.129.37, 2606:4700::6811:8125, ... 2023-12-03T11:41:15.078 INFO:teuthology.orchestra.run.smithi044.stderr:Connecting to services.gradle.org (services.gradle.org)|104.17.128.37|:443... connected. 2023-12-03T11:41:15.158 INFO:teuthology.orchestra.run.smithi044.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2023-12-03T11:41:15.158 INFO:teuthology.orchestra.run.smithi044.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2023-12-03T11:41:15.158 INFO:teuthology.orchestra.run.smithi044.stderr:--2023-12-03 11:41:15-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2023-12-03T11:41:15.159 INFO:teuthology.orchestra.run.smithi044.stderr:Resolving github.com (github.com)... 140.82.114.4 2023-12-03T11:41:15.170 INFO:teuthology.orchestra.run.smithi044.stderr:Connecting to github.com (github.com)|140.82.114.4|:443... connected. 2023-12-03T11:41:15.323 INFO:teuthology.orchestra.run.smithi044.stderr:HTTP request sent, awaiting response... 302 Found 2023-12-03T11:41:15.323 INFO:teuthology.orchestra.run.smithi044.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20231203%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20231203T114115Z&X-Amz-Expires=300&X-Amz-Signature=50c31bb2f5ad80057426efe7491f998a8d1f952bc98dad0d25dd540e093464a2&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2023-12-03T11:41:15.323 INFO:teuthology.orchestra.run.smithi044.stderr:--2023-12-03 11:41:15-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20231203%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20231203T114115Z&X-Amz-Expires=300&X-Amz-Signature=50c31bb2f5ad80057426efe7491f998a8d1f952bc98dad0d25dd540e093464a2&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2023-12-03T11:41:15.323 INFO:teuthology.orchestra.run.smithi044.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.110.133, 185.199.108.133, 185.199.111.133, ... 2023-12-03T11:41:15.374 INFO:teuthology.orchestra.run.smithi044.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.110.133|:443... connected. 2023-12-03T11:41:15.694 INFO:teuthology.orchestra.run.smithi044.stderr:HTTP request sent, awaiting response... 200 OK 2023-12-03T11:41:15.694 INFO:teuthology.orchestra.run.smithi044.stderr:Length: 95129672 (91M) [application/octet-stream] 2023-12-03T11:41:15.694 INFO:teuthology.orchestra.run.smithi044.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2023-12-03T11:41:15.694 INFO:teuthology.orchestra.run.smithi044.stderr: 2023-12-03T11:41:15.850 INFO:teuthology.orchestra.run.smithi044.stderr: 0K .......... .......... .......... .......... .......... 0% 319K 4m51s 2023-12-03T11:41:15.900 INFO:teuthology.orchestra.run.smithi044.stderr: 50K .......... .......... .......... .......... .......... 0% 1004K 3m12s 2023-12-03T11:41:15.973 INFO:teuthology.orchestra.run.smithi044.stderr: 100K .......... .......... .......... .......... .......... 0% 683K 2m53s 2023-12-03T11:41:16.050 INFO:teuthology.orchestra.run.smithi044.stderr: 150K .......... .......... .......... .......... .......... 0% 646K 2m46s 2023-12-03T11:41:16.127 INFO:teuthology.orchestra.run.smithi044.stderr: 200K .......... .......... .......... .......... .......... 0% 648K 2m41s 2023-12-03T11:41:16.194 INFO:teuthology.orchestra.run.smithi044.stderr: 250K .......... .......... .......... .......... .......... 0% 753K 2m35s 2023-12-03T11:41:16.272 INFO:teuthology.orchestra.run.smithi044.stderr: 300K .......... .......... .......... .......... .......... 0% 641K 2m33s 2023-12-03T11:41:16.354 INFO:teuthology.orchestra.run.smithi044.stderr: 350K .......... .......... .......... .......... .......... 0% 1.03M 2m25s 2023-12-03T11:41:16.410 INFO:teuthology.orchestra.run.smithi044.stderr: 400K .......... .......... .......... .......... .......... 0% 552K 2m27s 2023-12-03T11:41:16.461 INFO:teuthology.orchestra.run.smithi044.stderr: 450K .......... .......... .......... .......... .......... 0% 982K 2m22s 2023-12-03T11:41:16.493 INFO:teuthology.orchestra.run.smithi044.stderr: 500K .......... .......... .......... .......... .......... 0% 1.50M 2m14s 2023-12-03T11:41:16.532 INFO:teuthology.orchestra.run.smithi044.stderr: 550K .......... .......... .......... .......... .......... 0% 1.26M 2m9s 2023-12-03T11:41:16.567 INFO:teuthology.orchestra.run.smithi044.stderr: 600K .......... .......... .......... .......... .......... 0% 1.39M 2m4s 2023-12-03T11:41:16.596 INFO:teuthology.orchestra.run.smithi044.stderr: 650K .......... .......... .......... .......... .......... 0% 1.66M 1m59s 2023-12-03T11:41:16.632 INFO:teuthology.orchestra.run.smithi044.stderr: 700K .......... .......... .......... .......... .......... 0% 1.38M 1m55s 2023-12-03T11:41:16.663 INFO:teuthology.orchestra.run.smithi044.stderr: 750K .......... .......... .......... .......... .......... 0% 1.58M 1m52s 2023-12-03T11:41:16.707 INFO:teuthology.orchestra.run.smithi044.stderr: 800K .......... .......... .......... .......... .......... 0% 1.44M 1m49s 2023-12-03T11:41:16.742 INFO:teuthology.orchestra.run.smithi044.stderr: 850K .......... .......... .......... .......... .......... 0% 1.07M 1m47s 2023-12-03T11:41:16.779 INFO:teuthology.orchestra.run.smithi044.stderr: 900K .......... .......... .......... .......... .......... 1% 1.35M 1m45s 2023-12-03T11:41:16.813 INFO:teuthology.orchestra.run.smithi044.stderr: 950K .......... .......... .......... .......... .......... 1% 1.44M 1m43s 2023-12-03T11:41:16.845 INFO:teuthology.orchestra.run.smithi044.stderr: 1000K .......... .......... .......... .......... .......... 1% 1.48M 1m41s 2023-12-03T11:41:16.887 INFO:teuthology.orchestra.run.smithi044.stderr: 1050K .......... .......... .......... .......... .......... 1% 1.48M 99s 2023-12-03T11:41:16.926 INFO:teuthology.orchestra.run.smithi044.stderr: 1100K .......... .......... .......... .......... .......... 1% 1.03M 98s 2023-12-03T11:41:16.956 INFO:teuthology.orchestra.run.smithi044.stderr: 1150K .......... .......... .......... .......... .......... 1% 1.60M 97s 2023-12-03T11:41:16.983 INFO:teuthology.orchestra.run.smithi044.stderr: 1200K .......... .......... .......... .......... .......... 1% 1.83M 95s 2023-12-03T11:41:17.010 INFO:teuthology.orchestra.run.smithi044.stderr: 1250K .......... .......... .......... .......... .......... 1% 1.83M 93s 2023-12-03T11:41:17.045 INFO:teuthology.orchestra.run.smithi044.stderr: 1300K .......... .......... .......... .......... .......... 1% 1.79M 91s 2023-12-03T11:41:17.075 INFO:teuthology.orchestra.run.smithi044.stderr: 1350K .......... .......... .......... .......... .......... 1% 1.30M 90s 2023-12-03T11:41:17.098 INFO:teuthology.orchestra.run.smithi044.stderr: 1400K .......... .......... .......... .......... .......... 1% 2.04M 89s 2023-12-03T11:41:17.123 INFO:teuthology.orchestra.run.smithi044.stderr: 1450K .......... .......... .......... .......... .......... 1% 1.96M 87s 2023-12-03T11:41:17.147 INFO:teuthology.orchestra.run.smithi044.stderr: 1500K .......... .......... .......... .......... .......... 1% 2.10M 86s 2023-12-03T11:41:17.179 INFO:teuthology.orchestra.run.smithi044.stderr: 1550K .......... .......... .......... .......... .......... 1% 1.53M 85s 2023-12-03T11:41:17.204 INFO:teuthology.orchestra.run.smithi044.stderr: 1600K .......... .......... .......... .......... .......... 1% 1.91M 84s 2023-12-03T11:41:17.226 INFO:teuthology.orchestra.run.smithi044.stderr: 1650K .......... .......... .......... .......... .......... 1% 2.24M 82s 2023-12-03T11:41:17.253 INFO:teuthology.orchestra.run.smithi044.stderr: 1700K .......... .......... .......... .......... .......... 1% 1.80M 81s 2023-12-03T11:41:17.278 INFO:teuthology.orchestra.run.smithi044.stderr: 1750K .......... .......... .......... .......... .......... 1% 1.99M 80s 2023-12-03T11:41:17.299 INFO:teuthology.orchestra.run.smithi044.stderr: 1800K .......... .......... .......... .......... .......... 1% 2.31M 79s 2023-12-03T11:41:17.323 INFO:teuthology.orchestra.run.smithi044.stderr: 1850K .......... .......... .......... .......... .......... 2% 2.00M 78s 2023-12-03T11:41:17.341 INFO:teuthology.orchestra.run.smithi044.stderr: 1900K .......... .......... .......... .......... .......... 2% 2.73M 77s 2023-12-03T11:41:17.368 INFO:teuthology.orchestra.run.smithi044.stderr: 1950K .......... .......... .......... .......... .......... 2% 1.83M 76s 2023-12-03T11:41:17.389 INFO:teuthology.orchestra.run.smithi044.stderr: 2000K .......... .......... .......... .......... .......... 2% 2.30M 75s 2023-12-03T11:41:17.405 INFO:teuthology.orchestra.run.smithi044.stderr: 2050K .......... .......... .......... .......... .......... 2% 2.96M 74s 2023-12-03T11:41:17.425 INFO:teuthology.orchestra.run.smithi044.stderr: 2100K .......... .......... .......... .......... .......... 2% 2.55M 73s 2023-12-03T11:41:17.439 INFO:teuthology.orchestra.run.smithi044.stderr: 2150K .......... .......... .......... .......... .......... 2% 3.39M 72s 2023-12-03T11:41:17.456 INFO:teuthology.orchestra.run.smithi044.stderr: 2200K .......... .......... .......... .......... .......... 2% 2.89M 71s 2023-12-03T11:41:17.475 INFO:teuthology.orchestra.run.smithi044.stderr: 2250K .......... .......... .......... .......... .......... 2% 2.53M 70s 2023-12-03T11:41:17.490 INFO:teuthology.orchestra.run.smithi044.stderr: 2300K .......... .......... .......... .......... .......... 2% 3.18M 69s 2023-12-03T11:41:17.510 INFO:teuthology.orchestra.run.smithi044.stderr: 2350K .......... .......... .......... .......... .......... 2% 2.52M 69s 2023-12-03T11:41:17.529 INFO:teuthology.orchestra.run.smithi044.stderr: 2400K .......... .......... .......... .......... .......... 2% 2.51M 68s 2023-12-03T11:41:17.555 INFO:teuthology.orchestra.run.smithi044.stderr: 2450K .......... .......... .......... .......... .......... 2% 2.40M 67s 2023-12-03T11:41:17.575 INFO:teuthology.orchestra.run.smithi044.stderr: 2500K .......... .......... .......... .......... .......... 2% 1.93M 67s 2023-12-03T11:41:17.591 INFO:teuthology.orchestra.run.smithi044.stderr: 2550K .......... .......... .......... .......... .......... 2% 2.93M 66s 2023-12-03T11:41:17.614 INFO:teuthology.orchestra.run.smithi044.stderr: 2600K .......... .......... .......... .......... .......... 2% 2.13M 65s 2023-12-03T11:41:17.633 INFO:teuthology.orchestra.run.smithi044.stderr: 2650K .......... .......... .......... .......... .......... 2% 2.64M 65s 2023-12-03T11:41:17.652 INFO:teuthology.orchestra.run.smithi044.stderr: 2700K .......... .......... .......... .......... .......... 2% 2.55M 64s 2023-12-03T11:41:17.669 INFO:teuthology.orchestra.run.smithi044.stderr: 2750K .......... .......... .......... .......... .......... 3% 3.08M 64s 2023-12-03T11:41:17.688 INFO:teuthology.orchestra.run.smithi044.stderr: 2800K .......... .......... .......... .......... .......... 3% 2.43M 63s 2023-12-03T11:41:17.710 INFO:teuthology.orchestra.run.smithi044.stderr: 2850K .......... .......... .......... .......... .......... 3% 2.93M 62s 2023-12-03T11:41:17.727 INFO:teuthology.orchestra.run.smithi044.stderr: 2900K .......... .......... .......... .......... .......... 3% 2.17M 62s 2023-12-03T11:41:17.739 INFO:teuthology.orchestra.run.smithi044.stderr: 2950K .......... .......... .......... .......... .......... 3% 4.04M 61s 2023-12-03T11:41:17.756 INFO:teuthology.orchestra.run.smithi044.stderr: 3000K .......... .......... .......... .......... .......... 3% 2.84M 61s 2023-12-03T11:41:17.769 INFO:teuthology.orchestra.run.smithi044.stderr: 3050K .......... .......... .......... .......... .......... 3% 3.80M 60s 2023-12-03T11:41:17.783 INFO:teuthology.orchestra.run.smithi044.stderr: 3100K .......... .......... .......... .......... .......... 3% 3.46M 60s 2023-12-03T11:41:17.799 INFO:teuthology.orchestra.run.smithi044.stderr: 3150K .......... .......... .......... .......... .......... 3% 3.16M 59s 2023-12-03T11:41:17.811 INFO:teuthology.orchestra.run.smithi044.stderr: 3200K .......... .......... .......... .......... .......... 3% 3.88M 58s 2023-12-03T11:41:17.823 INFO:teuthology.orchestra.run.smithi044.stderr: 3250K .......... .......... .......... .......... .......... 3% 4.06M 58s 2023-12-03T11:41:17.834 INFO:teuthology.orchestra.run.smithi044.stderr: 3300K .......... .......... .......... .......... .......... 3% 4.72M 57s 2023-12-03T11:41:17.845 INFO:teuthology.orchestra.run.smithi044.stderr: 3350K .......... .......... .......... .......... .......... 3% 4.25M 57s 2023-12-03T11:41:17.861 INFO:teuthology.orchestra.run.smithi044.stderr: 3400K .......... .......... .......... .......... .......... 3% 3.14M 56s 2023-12-03T11:41:17.872 INFO:teuthology.orchestra.run.smithi044.stderr: 3450K .......... .......... .......... .......... .......... 3% 4.25M 56s 2023-12-03T11:41:17.883 INFO:teuthology.orchestra.run.smithi044.stderr: 3500K .......... .......... .......... .......... .......... 3% 4.63M 55s 2023-12-03T11:41:17.894 INFO:teuthology.orchestra.run.smithi044.stderr: 3550K .......... .......... .......... .......... .......... 3% 4.24M 55s 2023-12-03T11:41:17.904 INFO:teuthology.orchestra.run.smithi044.stderr: 3600K .......... .......... .......... .......... .......... 3% 4.87M 54s 2023-12-03T11:41:17.917 INFO:teuthology.orchestra.run.smithi044.stderr: 3650K .......... .......... .......... .......... .......... 3% 3.92M 54s 2023-12-03T11:41:17.929 INFO:teuthology.orchestra.run.smithi044.stderr: 3700K .......... .......... .......... .......... .......... 4% 3.97M 53s 2023-12-03T11:41:17.940 INFO:teuthology.orchestra.run.smithi044.stderr: 3750K .......... .......... .......... .......... .......... 4% 4.62M 53s 2023-12-03T11:41:17.951 INFO:teuthology.orchestra.run.smithi044.stderr: 3800K .......... .......... .......... .......... .......... 4% 4.36M 52s 2023-12-03T11:41:17.961 INFO:teuthology.orchestra.run.smithi044.stderr: 3850K .......... .......... .......... .......... .......... 4% 4.92M 52s 2023-12-03T11:41:17.977 INFO:teuthology.orchestra.run.smithi044.stderr: 3900K .......... .......... .......... .......... .......... 4% 3.12M 51s 2023-12-03T11:41:17.985 INFO:teuthology.orchestra.run.smithi044.stderr: 3950K .......... .......... .......... .......... .......... 4% 5.69M 51s 2023-12-03T11:41:17.996 INFO:teuthology.orchestra.run.smithi044.stderr: 4000K .......... .......... .......... .......... .......... 4% 4.67M 51s 2023-12-03T11:41:18.008 INFO:teuthology.orchestra.run.smithi044.stderr: 4050K .......... .......... .......... .......... .......... 4% 4.11M 50s 2023-12-03T11:41:18.017 INFO:teuthology.orchestra.run.smithi044.stderr: 4100K .......... .......... .......... .......... .......... 4% 4.78M 50s 2023-12-03T11:41:18.032 INFO:teuthology.orchestra.run.smithi044.stderr: 4150K .......... .......... .......... .......... .......... 4% 3.41M 49s 2023-12-03T11:41:18.041 INFO:teuthology.orchestra.run.smithi044.stderr: 4200K .......... .......... .......... .......... .......... 4% 5.55M 49s 2023-12-03T11:41:18.050 INFO:teuthology.orchestra.run.smithi044.stderr: 4250K .......... .......... .......... .......... .......... 4% 5.16M 49s 2023-12-03T11:41:18.060 INFO:teuthology.orchestra.run.smithi044.stderr: 4300K .......... .......... .......... .......... .......... 4% 4.69M 48s 2023-12-03T11:41:18.070 INFO:teuthology.orchestra.run.smithi044.stderr: 4350K .......... .......... .......... .......... .......... 4% 5.39M 48s 2023-12-03T11:41:18.080 INFO:teuthology.orchestra.run.smithi044.stderr: 4400K .......... .......... .......... .......... .......... 4% 4.68M 47s 2023-12-03T11:41:18.088 INFO:teuthology.orchestra.run.smithi044.stderr: 4450K .......... .......... .......... .......... .......... 4% 5.84M 47s 2023-12-03T11:41:18.097 INFO:teuthology.orchestra.run.smithi044.stderr: 4500K .......... .......... .......... .......... .......... 4% 5.75M 47s 2023-12-03T11:41:18.108 INFO:teuthology.orchestra.run.smithi044.stderr: 4550K .......... .......... .......... .......... .......... 4% 4.52M 46s 2023-12-03T11:41:18.118 INFO:teuthology.orchestra.run.smithi044.stderr: 4600K .......... .......... .......... .......... .......... 5% 4.87M 46s 2023-12-03T11:41:18.127 INFO:teuthology.orchestra.run.smithi044.stderr: 4650K .......... .......... .......... .......... .......... 5% 5.10M 46s 2023-12-03T11:41:18.138 INFO:teuthology.orchestra.run.smithi044.stderr: 4700K .......... .......... .......... .......... .......... 5% 4.66M 45s 2023-12-03T11:41:18.148 INFO:teuthology.orchestra.run.smithi044.stderr: 4750K .......... .......... .......... .......... .......... 5% 4.90M 45s 2023-12-03T11:41:18.160 INFO:teuthology.orchestra.run.smithi044.stderr: 4800K .......... .......... .......... .......... .......... 5% 4.06M 45s 2023-12-03T11:41:18.168 INFO:teuthology.orchestra.run.smithi044.stderr: 4850K .......... .......... .......... .......... .......... 5% 6.19M 44s 2023-12-03T11:41:18.177 INFO:teuthology.orchestra.run.smithi044.stderr: 4900K .......... .......... .......... .......... .......... 5% 5.20M 44s 2023-12-03T11:41:18.186 INFO:teuthology.orchestra.run.smithi044.stderr: 4950K .......... .......... .......... .......... .......... 5% 5.42M 44s 2023-12-03T11:41:18.195 INFO:teuthology.orchestra.run.smithi044.stderr: 5000K .......... .......... .......... .......... .......... 5% 5.28M 44s 2023-12-03T11:41:18.209 INFO:teuthology.orchestra.run.smithi044.stderr: 5050K .......... .......... .......... .......... .......... 5% 3.48M 43s 2023-12-03T11:41:18.220 INFO:teuthology.orchestra.run.smithi044.stderr: 5100K .......... .......... .......... .......... .......... 5% 4.48M 43s 2023-12-03T11:41:18.231 INFO:teuthology.orchestra.run.smithi044.stderr: 5150K .......... .......... .......... .......... .......... 5% 4.42M 43s 2023-12-03T11:41:18.239 INFO:teuthology.orchestra.run.smithi044.stderr: 5200K .......... .......... .......... .......... .......... 5% 6.33M 43s 2023-12-03T11:41:18.248 INFO:teuthology.orchestra.run.smithi044.stderr: 5250K .......... .......... .......... .......... .......... 5% 5.54M 42s 2023-12-03T11:41:18.260 INFO:teuthology.orchestra.run.smithi044.stderr: 5300K .......... .......... .......... .......... .......... 5% 5.17M 42s 2023-12-03T11:41:18.270 INFO:teuthology.orchestra.run.smithi044.stderr: 5350K .......... .......... .......... .......... .......... 5% 3.73M 42s 2023-12-03T11:41:18.282 INFO:teuthology.orchestra.run.smithi044.stderr: 5400K .......... .......... .......... .......... .......... 5% 4.32M 42s 2023-12-03T11:41:18.291 INFO:teuthology.orchestra.run.smithi044.stderr: 5450K .......... .......... .......... .......... .......... 5% 5.05M 41s 2023-12-03T11:41:18.303 INFO:teuthology.orchestra.run.smithi044.stderr: 5500K .......... .......... .......... .......... .......... 5% 4.25M 41s 2023-12-03T11:41:18.311 INFO:teuthology.orchestra.run.smithi044.stderr: 5550K .......... .......... .......... .......... .......... 6% 5.91M 41s 2023-12-03T11:41:18.320 INFO:teuthology.orchestra.run.smithi044.stderr: 5600K .......... .......... .......... .......... .......... 6% 5.67M 41s 2023-12-03T11:41:18.328 INFO:teuthology.orchestra.run.smithi044.stderr: 5650K .......... .......... .......... .......... .......... 6% 5.89M 40s 2023-12-03T11:41:18.343 INFO:teuthology.orchestra.run.smithi044.stderr: 5700K .......... .......... .......... .......... .......... 6% 5.17M 40s 2023-12-03T11:41:18.352 INFO:teuthology.orchestra.run.smithi044.stderr: 5750K .......... .......... .......... .......... .......... 6% 3.39M 40s 2023-12-03T11:41:18.360 INFO:teuthology.orchestra.run.smithi044.stderr: 5800K .......... .......... .......... .......... .......... 6% 6.02M 40s 2023-12-03T11:41:18.370 INFO:teuthology.orchestra.run.smithi044.stderr: 5850K .......... .......... .......... .......... .......... 6% 4.68M 39s 2023-12-03T11:41:18.379 INFO:teuthology.orchestra.run.smithi044.stderr: 5900K .......... .......... .......... .......... .......... 6% 6.02M 39s 2023-12-03T11:41:18.386 INFO:teuthology.orchestra.run.smithi044.stderr: 5950K .......... .......... .......... .......... .......... 6% 6.99M 39s 2023-12-03T11:41:18.392 INFO:teuthology.orchestra.run.smithi044.stderr: 6000K .......... .......... .......... .......... .......... 6% 7.77M 39s 2023-12-03T11:41:18.403 INFO:teuthology.orchestra.run.smithi044.stderr: 6050K .......... .......... .......... .......... .......... 6% 4.48M 39s 2023-12-03T11:41:18.412 INFO:teuthology.orchestra.run.smithi044.stderr: 6100K .......... .......... .......... .......... .......... 6% 5.13M 38s 2023-12-03T11:41:18.419 INFO:teuthology.orchestra.run.smithi044.stderr: 6150K .......... .......... .......... .......... .......... 6% 7.35M 38s 2023-12-03T11:41:18.430 INFO:teuthology.orchestra.run.smithi044.stderr: 6200K .......... .......... .......... .......... .......... 6% 5.34M 38s 2023-12-03T11:41:18.439 INFO:teuthology.orchestra.run.smithi044.stderr: 6250K .......... .......... .......... .......... .......... 6% 4.49M 38s 2023-12-03T11:41:18.446 INFO:teuthology.orchestra.run.smithi044.stderr: 6300K .......... .......... .......... .......... .......... 6% 6.97M 38s 2023-12-03T11:41:18.454 INFO:teuthology.orchestra.run.smithi044.stderr: 6350K .......... .......... .......... .......... .......... 6% 6.26M 37s 2023-12-03T11:41:18.461 INFO:teuthology.orchestra.run.smithi044.stderr: 6400K .......... .......... .......... .......... .......... 6% 6.72M 37s 2023-12-03T11:41:18.470 INFO:teuthology.orchestra.run.smithi044.stderr: 6450K .......... .......... .......... .......... .......... 6% 5.53M 37s 2023-12-03T11:41:18.481 INFO:teuthology.orchestra.run.smithi044.stderr: 6500K .......... .......... .......... .......... .......... 7% 5.10M 37s 2023-12-03T11:41:18.489 INFO:teuthology.orchestra.run.smithi044.stderr: 6550K .......... .......... .......... .......... .......... 7% 5.21M 37s 2023-12-03T11:41:18.497 INFO:teuthology.orchestra.run.smithi044.stderr: 6600K .......... .......... .......... .......... .......... 7% 5.64M 36s 2023-12-03T11:41:18.507 INFO:teuthology.orchestra.run.smithi044.stderr: 6650K .......... .......... .......... .......... .......... 7% 5.90M 36s 2023-12-03T11:41:18.515 INFO:teuthology.orchestra.run.smithi044.stderr: 6700K .......... .......... .......... .......... .......... 7% 5.30M 36s 2023-12-03T11:41:18.522 INFO:teuthology.orchestra.run.smithi044.stderr: 6750K .......... .......... .......... .......... .......... 7% 6.85M 36s 2023-12-03T11:41:18.531 INFO:teuthology.orchestra.run.smithi044.stderr: 6800K .......... .......... .......... .......... .......... 7% 5.32M 36s 2023-12-03T11:41:18.540 INFO:teuthology.orchestra.run.smithi044.stderr: 6850K .......... .......... .......... .......... .......... 7% 5.64M 35s 2023-12-03T11:41:18.551 INFO:teuthology.orchestra.run.smithi044.stderr: 6900K .......... .......... .......... .......... .......... 7% 5.44M 35s 2023-12-03T11:41:18.560 INFO:teuthology.orchestra.run.smithi044.stderr: 6950K .......... .......... .......... .......... .......... 7% 4.35M 35s 2023-12-03T11:41:18.568 INFO:teuthology.orchestra.run.smithi044.stderr: 7000K .......... .......... .......... .......... .......... 7% 6.42M 35s 2023-12-03T11:41:18.574 INFO:teuthology.orchestra.run.smithi044.stderr: 7050K .......... .......... .......... .......... .......... 7% 7.94M 35s 2023-12-03T11:41:18.581 INFO:teuthology.orchestra.run.smithi044.stderr: 7100K .......... .......... .......... .......... .......... 7% 6.73M 35s 2023-12-03T11:41:18.590 INFO:teuthology.orchestra.run.smithi044.stderr: 7150K .......... .......... .......... .......... .......... 7% 5.54M 34s 2023-12-03T11:41:18.599 INFO:teuthology.orchestra.run.smithi044.stderr: 7200K .......... .......... .......... .......... .......... 7% 5.26M 34s 2023-12-03T11:41:18.607 INFO:teuthology.orchestra.run.smithi044.stderr: 7250K .......... .......... .......... .......... .......... 7% 6.20M 34s 2023-12-03T11:41:18.615 INFO:teuthology.orchestra.run.smithi044.stderr: 7300K .......... .......... .......... .......... .......... 7% 5.63M 34s 2023-12-03T11:41:18.624 INFO:teuthology.orchestra.run.smithi044.stderr: 7350K .......... .......... .......... .......... .......... 7% 5.98M 34s 2023-12-03T11:41:18.635 INFO:teuthology.orchestra.run.smithi044.stderr: 7400K .......... .......... .......... .......... .......... 8% 4.15M 34s 2023-12-03T11:41:18.642 INFO:teuthology.orchestra.run.smithi044.stderr: 7450K .......... .......... .......... .......... .......... 8% 7.85M 34s 2023-12-03T11:41:18.649 INFO:teuthology.orchestra.run.smithi044.stderr: 7500K .......... .......... .......... .......... .......... 8% 6.60M 33s 2023-12-03T11:41:18.656 INFO:teuthology.orchestra.run.smithi044.stderr: 7550K .......... .......... .......... .......... .......... 8% 7.46M 33s 2023-12-03T11:41:18.662 INFO:teuthology.orchestra.run.smithi044.stderr: 7600K .......... .......... .......... .......... .......... 8% 7.24M 33s 2023-12-03T11:41:18.673 INFO:teuthology.orchestra.run.smithi044.stderr: 7650K .......... .......... .......... .......... .......... 8% 4.46M 33s 2023-12-03T11:41:18.679 INFO:teuthology.orchestra.run.smithi044.stderr: 7700K .......... .......... .......... .......... .......... 8% 8.40M 33s 2023-12-03T11:41:18.687 INFO:teuthology.orchestra.run.smithi044.stderr: 7750K .......... .......... .......... .......... .......... 8% 6.53M 33s 2023-12-03T11:41:18.699 INFO:teuthology.orchestra.run.smithi044.stderr: 7800K .......... .......... .......... .......... .......... 8% 4.22M 33s 2023-12-03T11:41:18.706 INFO:teuthology.orchestra.run.smithi044.stderr: 7850K .......... .......... .......... .......... .......... 8% 6.44M 32s 2023-12-03T11:41:18.714 INFO:teuthology.orchestra.run.smithi044.stderr: 7900K .......... .......... .......... .......... .......... 8% 5.73M 32s 2023-12-03T11:41:18.720 INFO:teuthology.orchestra.run.smithi044.stderr: 7950K .......... .......... .......... .......... .......... 8% 9.71M 32s 2023-12-03T11:41:18.726 INFO:teuthology.orchestra.run.smithi044.stderr: 8000K .......... .......... .......... .......... .......... 8% 7.65M 32s 2023-12-03T11:41:18.731 INFO:teuthology.orchestra.run.smithi044.stderr: 8050K .......... .......... .......... .......... .......... 8% 8.46M 32s 2023-12-03T11:41:18.742 INFO:teuthology.orchestra.run.smithi044.stderr: 8100K .......... .......... .......... .......... .......... 8% 4.78M 32s 2023-12-03T11:41:18.749 INFO:teuthology.orchestra.run.smithi044.stderr: 8150K .......... .......... .......... .......... .......... 8% 9.76M 32s 2023-12-03T11:41:18.757 INFO:teuthology.orchestra.run.smithi044.stderr: 8200K .......... .......... .......... .......... .......... 8% 4.84M 31s 2023-12-03T11:41:18.763 INFO:teuthology.orchestra.run.smithi044.stderr: 8250K .......... .......... .......... .......... .......... 8% 7.71M 31s 2023-12-03T11:41:18.773 INFO:teuthology.orchestra.run.smithi044.stderr: 8300K .......... .......... .......... .......... .......... 8% 4.89M 31s 2023-12-03T11:41:18.781 INFO:teuthology.orchestra.run.smithi044.stderr: 8350K .......... .......... .......... .......... .......... 9% 6.24M 31s 2023-12-03T11:41:18.786 INFO:teuthology.orchestra.run.smithi044.stderr: 8400K .......... .......... .......... .......... .......... 9% 9.28M 31s 2023-12-03T11:41:18.793 INFO:teuthology.orchestra.run.smithi044.stderr: 8450K .......... .......... .......... .......... .......... 9% 7.35M 31s 2023-12-03T11:41:18.801 INFO:teuthology.orchestra.run.smithi044.stderr: 8500K .......... .......... .......... .......... .......... 9% 8.16M 31s 2023-12-03T11:41:18.809 INFO:teuthology.orchestra.run.smithi044.stderr: 8550K .......... .......... .......... .......... .......... 9% 4.91M 31s 2023-12-03T11:41:18.816 INFO:teuthology.orchestra.run.smithi044.stderr: 8600K .......... .......... .......... .......... .......... 9% 7.47M 30s 2023-12-03T11:41:18.821 INFO:teuthology.orchestra.run.smithi044.stderr: 8650K .......... .......... .......... .......... .......... 9% 8.39M 30s 2023-12-03T11:41:18.829 INFO:teuthology.orchestra.run.smithi044.stderr: 8700K .......... .......... .......... .......... .......... 9% 6.49M 30s 2023-12-03T11:41:18.840 INFO:teuthology.orchestra.run.smithi044.stderr: 8750K .......... .......... .......... .......... .......... 9% 4.58M 30s 2023-12-03T11:41:18.849 INFO:teuthology.orchestra.run.smithi044.stderr: 8800K .......... .......... .......... .......... .......... 9% 5.35M 30s 2023-12-03T11:41:18.853 INFO:teuthology.orchestra.run.smithi044.stderr: 8850K .......... .......... .......... .......... .......... 9% 11.1M 30s 2023-12-03T11:41:18.862 INFO:teuthology.orchestra.run.smithi044.stderr: 8900K .......... .......... .......... .......... .......... 9% 6.65M 30s 2023-12-03T11:41:18.866 INFO:teuthology.orchestra.run.smithi044.stderr: 8950K .......... .......... .......... .......... .......... 9% 8.59M 30s 2023-12-03T11:41:18.874 INFO:teuthology.orchestra.run.smithi044.stderr: 9000K .......... .......... .......... .......... .......... 9% 6.06M 29s 2023-12-03T11:41:18.882 INFO:teuthology.orchestra.run.smithi044.stderr: 9050K .......... .......... .......... .......... .......... 9% 6.14M 29s 2023-12-03T11:41:18.889 INFO:teuthology.orchestra.run.smithi044.stderr: 9100K .......... .......... .......... .......... .......... 9% 6.82M 29s 2023-12-03T11:41:18.894 INFO:teuthology.orchestra.run.smithi044.stderr: 9150K .......... .......... .......... .......... .......... 9% 9.32M 29s 2023-12-03T11:41:18.903 INFO:teuthology.orchestra.run.smithi044.stderr: 9200K .......... .......... .......... .......... .......... 9% 5.67M 29s 2023-12-03T11:41:18.912 INFO:teuthology.orchestra.run.smithi044.stderr: 9250K .......... .......... .......... .......... .......... 10% 5.73M 29s 2023-12-03T11:41:18.919 INFO:teuthology.orchestra.run.smithi044.stderr: 9300K .......... .......... .......... .......... .......... 10% 6.58M 29s 2023-12-03T11:41:18.925 INFO:teuthology.orchestra.run.smithi044.stderr: 9350K .......... .......... .......... .......... .......... 10% 8.01M 29s 2023-12-03T11:41:18.932 INFO:teuthology.orchestra.run.smithi044.stderr: 9400K .......... .......... .......... .......... .......... 10% 7.20M 29s 2023-12-03T11:41:18.938 INFO:teuthology.orchestra.run.smithi044.stderr: 9450K .......... .......... .......... .......... .......... 10% 8.28M 28s 2023-12-03T11:41:18.947 INFO:teuthology.orchestra.run.smithi044.stderr: 9500K .......... .......... .......... .......... .......... 10% 5.77M 28s 2023-12-03T11:41:18.955 INFO:teuthology.orchestra.run.smithi044.stderr: 9550K .......... .......... .......... .......... .......... 10% 5.90M 28s 2023-12-03T11:41:18.960 INFO:teuthology.orchestra.run.smithi044.stderr: 9600K .......... .......... .......... .......... .......... 10% 8.73M 28s 2023-12-03T11:41:18.966 INFO:teuthology.orchestra.run.smithi044.stderr: 9650K .......... .......... .......... .......... .......... 10% 7.94M 28s 2023-12-03T11:41:18.973 INFO:teuthology.orchestra.run.smithi044.stderr: 9700K .......... .......... .......... .......... .......... 10% 7.92M 28s 2023-12-03T11:41:18.982 INFO:teuthology.orchestra.run.smithi044.stderr: 9750K .......... .......... .......... .......... .......... 10% 5.22M 28s 2023-12-03T11:41:18.990 INFO:teuthology.orchestra.run.smithi044.stderr: 9800K .......... .......... .......... .......... .......... 10% 5.86M 28s 2023-12-03T11:41:18.996 INFO:teuthology.orchestra.run.smithi044.stderr: 9850K .......... .......... .......... .......... .......... 10% 7.83M 28s 2023-12-03T11:41:19.002 INFO:teuthology.orchestra.run.smithi044.stderr: 9900K .......... .......... .......... .......... .......... 10% 8.55M 28s 2023-12-03T11:41:19.008 INFO:teuthology.orchestra.run.smithi044.stderr: 9950K .......... .......... .......... .......... .......... 10% 8.30M 27s 2023-12-03T11:41:19.013 INFO:teuthology.orchestra.run.smithi044.stderr: 10000K .......... .......... .......... .......... .......... 10% 9.31M 27s 2023-12-03T11:41:19.020 INFO:teuthology.orchestra.run.smithi044.stderr: 10050K .......... .......... .......... .......... .......... 10% 7.27M 27s 2023-12-03T11:41:19.027 INFO:teuthology.orchestra.run.smithi044.stderr: 10100K .......... .......... .......... .......... .......... 10% 6.30M 27s 2023-12-03T11:41:19.034 INFO:teuthology.orchestra.run.smithi044.stderr: 10150K .......... .......... .......... .......... .......... 10% 7.10M 27s 2023-12-03T11:41:19.040 INFO:teuthology.orchestra.run.smithi044.stderr: 10200K .......... .......... .......... .......... .......... 11% 9.28M 27s 2023-12-03T11:41:19.047 INFO:teuthology.orchestra.run.smithi044.stderr: 10250K .......... .......... .......... .......... .......... 11% 7.30M 27s 2023-12-03T11:41:19.052 INFO:teuthology.orchestra.run.smithi044.stderr: 10300K .......... .......... .......... .......... .......... 11% 9.83M 27s 2023-12-03T11:41:19.058 INFO:teuthology.orchestra.run.smithi044.stderr: 10350K .......... .......... .......... .......... .......... 11% 6.90M 27s 2023-12-03T11:41:19.064 INFO:teuthology.orchestra.run.smithi044.stderr: 10400K .......... .......... .......... .......... .......... 11% 9.10M 27s 2023-12-03T11:41:19.069 INFO:teuthology.orchestra.run.smithi044.stderr: 10450K .......... .......... .......... .......... .......... 11% 9.24M 26s 2023-12-03T11:41:19.075 INFO:teuthology.orchestra.run.smithi044.stderr: 10500K .......... .......... .......... .......... .......... 11% 8.15M 26s 2023-12-03T11:41:19.082 INFO:teuthology.orchestra.run.smithi044.stderr: 10550K .......... .......... .......... .......... .......... 11% 7.49M 26s 2023-12-03T11:41:19.089 INFO:teuthology.orchestra.run.smithi044.stderr: 10600K .......... .......... .......... .......... .......... 11% 7.18M 26s 2023-12-03T11:41:19.096 INFO:teuthology.orchestra.run.smithi044.stderr: 10650K .......... .......... .......... .......... .......... 11% 9.14M 26s 2023-12-03T11:41:19.101 INFO:teuthology.orchestra.run.smithi044.stderr: 10700K .......... .......... .......... .......... .......... 11% 6.50M 26s 2023-12-03T11:41:19.107 INFO:teuthology.orchestra.run.smithi044.stderr: 10750K .......... .......... .......... .......... .......... 11% 9.29M 26s 2023-12-03T11:41:19.111 INFO:teuthology.orchestra.run.smithi044.stderr: 10800K .......... .......... .......... .......... .......... 11% 10.6M 26s 2023-12-03T11:41:19.117 INFO:teuthology.orchestra.run.smithi044.stderr: 10850K .......... .......... .......... .......... .......... 11% 9.00M 26s 2023-12-03T11:41:19.123 INFO:teuthology.orchestra.run.smithi044.stderr: 10900K .......... .......... .......... .......... .......... 11% 9.40M 26s 2023-12-03T11:41:19.130 INFO:teuthology.orchestra.run.smithi044.stderr: 10950K .......... .......... .......... .......... .......... 11% 5.83M 26s 2023-12-03T11:41:19.135 INFO:teuthology.orchestra.run.smithi044.stderr: 11000K .......... .......... .......... .......... .......... 11% 10.2M 25s 2023-12-03T11:41:19.140 INFO:teuthology.orchestra.run.smithi044.stderr: 11050K .......... .......... .......... .......... .......... 11% 9.09M 25s 2023-12-03T11:41:19.145 INFO:teuthology.orchestra.run.smithi044.stderr: 11100K .......... .......... .......... .......... .......... 12% 10.3M 25s 2023-12-03T11:41:19.150 INFO:teuthology.orchestra.run.smithi044.stderr: 11150K .......... .......... .......... .......... .......... 12% 11.2M 25s 2023-12-03T11:41:19.154 INFO:teuthology.orchestra.run.smithi044.stderr: 11200K .......... .......... .......... .......... .......... 12% 10.0M 25s 2023-12-03T11:41:19.161 INFO:teuthology.orchestra.run.smithi044.stderr: 11250K .......... .......... .......... .......... .......... 12% 6.76M 25s 2023-12-03T11:41:19.167 INFO:teuthology.orchestra.run.smithi044.stderr: 11300K .......... .......... .......... .......... .......... 12% 11.1M 25s 2023-12-03T11:41:19.173 INFO:teuthology.orchestra.run.smithi044.stderr: 11350K .......... .......... .......... .......... .......... 12% 7.06M 25s 2023-12-03T11:41:19.179 INFO:teuthology.orchestra.run.smithi044.stderr: 11400K .......... .......... .......... .......... .......... 12% 11.5M 25s 2023-12-03T11:41:19.183 INFO:teuthology.orchestra.run.smithi044.stderr: 11450K .......... .......... .......... .......... .......... 12% 8.12M 25s 2023-12-03T11:41:19.189 INFO:teuthology.orchestra.run.smithi044.stderr: 11500K .......... .......... .......... .......... .......... 12% 9.05M 25s 2023-12-03T11:41:19.194 INFO:teuthology.orchestra.run.smithi044.stderr: 11550K .......... .......... .......... .......... .......... 12% 8.12M 25s 2023-12-03T11:41:19.199 INFO:teuthology.orchestra.run.smithi044.stderr: 11600K .......... .......... .......... .......... .......... 12% 9.78M 24s 2023-12-03T11:41:19.205 INFO:teuthology.orchestra.run.smithi044.stderr: 11650K .......... .......... .......... .......... .......... 12% 8.70M 24s 2023-12-03T11:41:19.211 INFO:teuthology.orchestra.run.smithi044.stderr: 11700K .......... .......... .......... .......... .......... 12% 8.89M 24s 2023-12-03T11:41:19.216 INFO:teuthology.orchestra.run.smithi044.stderr: 11750K .......... .......... .......... .......... .......... 12% 9.77M 24s 2023-12-03T11:41:19.222 INFO:teuthology.orchestra.run.smithi044.stderr: 11800K .......... .......... .......... .......... .......... 12% 7.27M 24s 2023-12-03T11:41:19.230 INFO:teuthology.orchestra.run.smithi044.stderr: 11850K .......... .......... .......... .......... .......... 12% 7.01M 24s 2023-12-03T11:41:19.234 INFO:teuthology.orchestra.run.smithi044.stderr: 11900K .......... .......... .......... .......... .......... 12% 9.68M 24s 2023-12-03T11:41:19.241 INFO:teuthology.orchestra.run.smithi044.stderr: 11950K .......... .......... .......... .......... .......... 12% 6.91M 24s 2023-12-03T11:41:19.245 INFO:teuthology.orchestra.run.smithi044.stderr: 12000K .......... .......... .......... .......... .......... 12% 13.7M 24s 2023-12-03T11:41:19.251 INFO:teuthology.orchestra.run.smithi044.stderr: 12050K .......... .......... .......... .......... .......... 13% 7.83M 24s 2023-12-03T11:41:19.255 INFO:teuthology.orchestra.run.smithi044.stderr: 12100K .......... .......... .......... .......... .......... 13% 14.4M 24s 2023-12-03T11:41:19.263 INFO:teuthology.orchestra.run.smithi044.stderr: 12150K .......... .......... .......... .......... .......... 13% 5.97M 24s 2023-12-03T11:41:19.267 INFO:teuthology.orchestra.run.smithi044.stderr: 12200K .......... .......... .......... .......... .......... 13% 12.1M 24s 2023-12-03T11:41:19.273 INFO:teuthology.orchestra.run.smithi044.stderr: 12250K .......... .......... .......... .......... .......... 13% 8.26M 23s 2023-12-03T11:41:19.277 INFO:teuthology.orchestra.run.smithi044.stderr: 12300K .......... .......... .......... .......... .......... 13% 12.4M 23s 2023-12-03T11:41:19.284 INFO:teuthology.orchestra.run.smithi044.stderr: 12350K .......... .......... .......... .......... .......... 13% 6.83M 23s 2023-12-03T11:41:19.287 INFO:teuthology.orchestra.run.smithi044.stderr: 12400K .......... .......... .......... .......... .......... 13% 14.3M 23s 2023-12-03T11:41:19.293 INFO:teuthology.orchestra.run.smithi044.stderr: 12450K .......... .......... .......... .......... .......... 13% 9.25M 23s 2023-12-03T11:41:19.298 INFO:teuthology.orchestra.run.smithi044.stderr: 12500K .......... .......... .......... .......... .......... 13% 8.69M 23s 2023-12-03T11:41:19.304 INFO:teuthology.orchestra.run.smithi044.stderr: 12550K .......... .......... .......... .......... .......... 13% 8.41M 23s 2023-12-03T11:41:19.309 INFO:teuthology.orchestra.run.smithi044.stderr: 12600K .......... .......... .......... .......... .......... 13% 9.89M 23s 2023-12-03T11:41:19.313 INFO:teuthology.orchestra.run.smithi044.stderr: 12650K .......... .......... .......... .......... .......... 13% 12.6M 23s 2023-12-03T11:41:19.317 INFO:teuthology.orchestra.run.smithi044.stderr: 12700K .......... .......... .......... .......... .......... 13% 10.8M 23s 2023-12-03T11:41:19.322 INFO:teuthology.orchestra.run.smithi044.stderr: 12750K .......... .......... .......... .......... .......... 13% 11.8M 23s 2023-12-03T11:41:19.326 INFO:teuthology.orchestra.run.smithi044.stderr: 12800K .......... .......... .......... .......... .......... 13% 11.6M 23s 2023-12-03T11:41:19.331 INFO:teuthology.orchestra.run.smithi044.stderr: 12850K .......... .......... .......... .......... .......... 13% 10.3M 23s 2023-12-03T11:41:19.335 INFO:teuthology.orchestra.run.smithi044.stderr: 12900K .......... .......... .......... .......... .......... 13% 11.1M 22s 2023-12-03T11:41:19.342 INFO:teuthology.orchestra.run.smithi044.stderr: 12950K .......... .......... .......... .......... .......... 13% 6.93M 22s 2023-12-03T11:41:19.348 INFO:teuthology.orchestra.run.smithi044.stderr: 13000K .......... .......... .......... .......... .......... 14% 8.48M 22s 2023-12-03T11:41:19.351 INFO:teuthology.orchestra.run.smithi044.stderr: 13050K .......... .......... .......... .......... .......... 14% 14.9M 22s 2023-12-03T11:41:19.355 INFO:teuthology.orchestra.run.smithi044.stderr: 13100K .......... .......... .......... .......... .......... 14% 12.8M 22s 2023-12-03T11:41:19.359 INFO:teuthology.orchestra.run.smithi044.stderr: 13150K .......... .......... .......... .......... .......... 14% 10.2M 22s 2023-12-03T11:41:19.365 INFO:teuthology.orchestra.run.smithi044.stderr: 13200K .......... .......... .......... .......... .......... 14% 8.35M 22s 2023-12-03T11:41:19.370 INFO:teuthology.orchestra.run.smithi044.stderr: 13250K .......... .......... .......... .......... .......... 14% 12.9M 22s 2023-12-03T11:41:19.373 INFO:teuthology.orchestra.run.smithi044.stderr: 13300K .......... .......... .......... .......... .......... 14% 11.8M 22s 2023-12-03T11:41:19.377 INFO:teuthology.orchestra.run.smithi044.stderr: 13350K .......... .......... .......... .......... .......... 14% 11.5M 22s 2023-12-03T11:41:19.382 INFO:teuthology.orchestra.run.smithi044.stderr: 13400K .......... .......... .......... .......... .......... 14% 10.3M 22s 2023-12-03T11:41:19.386 INFO:teuthology.orchestra.run.smithi044.stderr: 13450K .......... .......... .......... .......... .......... 14% 15.7M 22s 2023-12-03T11:41:19.390 INFO:teuthology.orchestra.run.smithi044.stderr: 13500K .......... .......... .......... .......... .......... 14% 16.0M 22s 2023-12-03T11:41:19.394 INFO:teuthology.orchestra.run.smithi044.stderr: 13550K .......... .......... .......... .......... .......... 14% 9.14M 22s 2023-12-03T11:41:19.398 INFO:teuthology.orchestra.run.smithi044.stderr: 13600K .......... .......... .......... .......... .......... 14% 12.5M 22s 2023-12-03T11:41:19.402 INFO:teuthology.orchestra.run.smithi044.stderr: 13650K .......... .......... .......... .......... .......... 14% 10.0M 21s 2023-12-03T11:41:19.407 INFO:teuthology.orchestra.run.smithi044.stderr: 13700K .......... .......... .......... .......... .......... 14% 10.6M 21s 2023-12-03T11:41:19.413 INFO:teuthology.orchestra.run.smithi044.stderr: 13750K .......... .......... .......... .......... .......... 14% 9.89M 21s 2023-12-03T11:41:19.417 INFO:teuthology.orchestra.run.smithi044.stderr: 13800K .......... .......... .......... .......... .......... 14% 8.82M 21s 2023-12-03T11:41:19.423 INFO:teuthology.orchestra.run.smithi044.stderr: 13850K .......... .......... .......... .......... .......... 14% 9.73M 21s 2023-12-03T11:41:19.428 INFO:teuthology.orchestra.run.smithi044.stderr: 13900K .......... .......... .......... .......... .......... 15% 9.34M 21s 2023-12-03T11:41:19.432 INFO:teuthology.orchestra.run.smithi044.stderr: 13950K .......... .......... .......... .......... .......... 15% 12.2M 21s 2023-12-03T11:41:19.435 INFO:teuthology.orchestra.run.smithi044.stderr: 14000K .......... .......... .......... .......... .......... 15% 14.1M 21s 2023-12-03T11:41:19.439 INFO:teuthology.orchestra.run.smithi044.stderr: 14050K .......... .......... .......... .......... .......... 15% 12.6M 21s 2023-12-03T11:41:19.443 INFO:teuthology.orchestra.run.smithi044.stderr: 14100K .......... .......... .......... .......... .......... 15% 13.9M 21s 2023-12-03T11:41:19.447 INFO:teuthology.orchestra.run.smithi044.stderr: 14150K .......... .......... .......... .......... .......... 15% 9.94M 21s 2023-12-03T11:41:19.451 INFO:teuthology.orchestra.run.smithi044.stderr: 14200K .......... .......... .......... .......... .......... 15% 12.4M 21s 2023-12-03T11:41:19.454 INFO:teuthology.orchestra.run.smithi044.stderr: 14250K .......... .......... .......... .......... .......... 15% 16.2M 21s 2023-12-03T11:41:19.459 INFO:teuthology.orchestra.run.smithi044.stderr: 14300K .......... .......... .......... .......... .......... 15% 11.6M 21s 2023-12-03T11:41:19.464 INFO:teuthology.orchestra.run.smithi044.stderr: 14350K .......... .......... .......... .......... .......... 15% 8.42M 21s 2023-12-03T11:41:19.470 INFO:teuthology.orchestra.run.smithi044.stderr: 14400K .......... .......... .......... .......... .......... 15% 9.96M 21s 2023-12-03T11:41:19.476 INFO:teuthology.orchestra.run.smithi044.stderr: 14450K .......... .......... .......... .......... .......... 15% 7.72M 20s 2023-12-03T11:41:19.480 INFO:teuthology.orchestra.run.smithi044.stderr: 14500K .......... .......... .......... .......... .......... 15% 10.6M 20s 2023-12-03T11:41:19.482 INFO:teuthology.orchestra.run.smithi044.stderr: 14550K .......... .......... .......... .......... .......... 15% 22.4M 20s 2023-12-03T11:41:19.488 INFO:teuthology.orchestra.run.smithi044.stderr: 14600K .......... .......... .......... .......... .......... 15% 9.00M 20s 2023-12-03T11:41:19.494 INFO:teuthology.orchestra.run.smithi044.stderr: 14650K .......... .......... .......... .......... .......... 15% 7.36M 20s 2023-12-03T11:41:19.498 INFO:teuthology.orchestra.run.smithi044.stderr: 14700K .......... .......... .......... .......... .......... 15% 13.7M 20s 2023-12-03T11:41:19.500 INFO:teuthology.orchestra.run.smithi044.stderr: 14750K .......... .......... .......... .......... .......... 15% 21.1M 20s 2023-12-03T11:41:19.504 INFO:teuthology.orchestra.run.smithi044.stderr: 14800K .......... .......... .......... .......... .......... 15% 15.0M 20s 2023-12-03T11:41:19.508 INFO:teuthology.orchestra.run.smithi044.stderr: 14850K .......... .......... .......... .......... .......... 16% 11.4M 20s 2023-12-03T11:41:19.512 INFO:teuthology.orchestra.run.smithi044.stderr: 14900K .......... .......... .......... .......... .......... 16% 11.9M 20s 2023-12-03T11:41:19.515 INFO:teuthology.orchestra.run.smithi044.stderr: 14950K .......... .......... .......... .......... .......... 16% 14.2M 20s 2023-12-03T11:41:19.520 INFO:teuthology.orchestra.run.smithi044.stderr: 15000K .......... .......... .......... .......... .......... 16% 11.9M 20s 2023-12-03T11:41:19.523 INFO:teuthology.orchestra.run.smithi044.stderr: 15050K .......... .......... .......... .......... .......... 16% 13.2M 20s 2023-12-03T11:41:19.527 INFO:teuthology.orchestra.run.smithi044.stderr: 15100K .......... .......... .......... .......... .......... 16% 12.4M 20s 2023-12-03T11:41:19.533 INFO:teuthology.orchestra.run.smithi044.stderr: 15150K .......... .......... .......... .......... .......... 16% 8.20M 20s 2023-12-03T11:41:19.538 INFO:teuthology.orchestra.run.smithi044.stderr: 15200K .......... .......... .......... .......... .......... 16% 10.4M 20s 2023-12-03T11:41:19.543 INFO:teuthology.orchestra.run.smithi044.stderr: 15250K .......... .......... .......... .......... .......... 16% 10.1M 20s 2023-12-03T11:41:19.549 INFO:teuthology.orchestra.run.smithi044.stderr: 15300K .......... .......... .......... .......... .......... 16% 8.76M 19s 2023-12-03T11:41:19.553 INFO:teuthology.orchestra.run.smithi044.stderr: 15350K .......... .......... .......... .......... .......... 16% 11.4M 19s 2023-12-03T11:41:19.558 INFO:teuthology.orchestra.run.smithi044.stderr: 15400K .......... .......... .......... .......... .......... 16% 9.02M 19s 2023-12-03T11:41:19.564 INFO:teuthology.orchestra.run.smithi044.stderr: 15450K .......... .......... .......... .......... .......... 16% 8.12M 19s 2023-12-03T11:41:19.568 INFO:teuthology.orchestra.run.smithi044.stderr: 15500K .......... .......... .......... .......... .......... 16% 13.2M 19s 2023-12-03T11:41:19.573 INFO:teuthology.orchestra.run.smithi044.stderr: 15550K .......... .......... .......... .......... .......... 16% 10.3M 19s 2023-12-03T11:41:19.576 INFO:teuthology.orchestra.run.smithi044.stderr: 15600K .......... .......... .......... .......... .......... 16% 14.9M 19s 2023-12-03T11:41:19.579 INFO:teuthology.orchestra.run.smithi044.stderr: 15650K .......... .......... .......... .......... .......... 16% 14.3M 19s 2023-12-03T11:41:19.585 INFO:teuthology.orchestra.run.smithi044.stderr: 15700K .......... .......... .......... .......... .......... 16% 13.8M 19s 2023-12-03T11:41:19.586 INFO:teuthology.orchestra.run.smithi044.stderr: 15750K .......... .......... .......... .......... .......... 17% 17.9M 19s 2023-12-03T11:41:19.589 INFO:teuthology.orchestra.run.smithi044.stderr: 15800K .......... .......... .......... .......... .......... 17% 14.6M 19s 2023-12-03T11:41:19.593 INFO:teuthology.orchestra.run.smithi044.stderr: 15850K .......... .......... .......... .......... .......... 17% 12.4M 19s 2023-12-03T11:41:19.598 INFO:teuthology.orchestra.run.smithi044.stderr: 15900K .......... .......... .......... .......... .......... 17% 15.6M 19s 2023-12-03T11:41:19.603 INFO:teuthology.orchestra.run.smithi044.stderr: 15950K .......... .......... .......... .......... .......... 17% 7.44M 19s 2023-12-03T11:41:19.608 INFO:teuthology.orchestra.run.smithi044.stderr: 16000K .......... .......... .......... .......... .......... 17% 9.29M 19s 2023-12-03T11:41:19.612 INFO:teuthology.orchestra.run.smithi044.stderr: 16050K .......... .......... .......... .......... .......... 17% 11.8M 19s 2023-12-03T11:41:19.617 INFO:teuthology.orchestra.run.smithi044.stderr: 16100K .......... .......... .......... .......... .......... 17% 10.3M 19s 2023-12-03T11:41:19.619 INFO:teuthology.orchestra.run.smithi044.stderr: 16150K .......... .......... .......... .......... .......... 17% 18.6M 19s 2023-12-03T11:41:19.623 INFO:teuthology.orchestra.run.smithi044.stderr: 16200K .......... .......... .......... .......... .......... 17% 11.0M 19s 2023-12-03T11:41:19.629 INFO:teuthology.orchestra.run.smithi044.stderr: 16250K .......... .......... .......... .......... .......... 17% 8.43M 18s 2023-12-03T11:41:19.635 INFO:teuthology.orchestra.run.smithi044.stderr: 16300K .......... .......... .......... .......... .......... 17% 9.08M 18s 2023-12-03T11:41:19.639 INFO:teuthology.orchestra.run.smithi044.stderr: 16350K .......... .......... .......... .......... .......... 17% 12.0M 18s 2023-12-03T11:41:19.642 INFO:teuthology.orchestra.run.smithi044.stderr: 16400K .......... .......... .......... .......... .......... 17% 15.9M 18s 2023-12-03T11:41:19.645 INFO:teuthology.orchestra.run.smithi044.stderr: 16450K .......... .......... .......... .......... .......... 17% 13.7M 18s 2023-12-03T11:41:19.649 INFO:teuthology.orchestra.run.smithi044.stderr: 16500K .......... .......... .......... .......... .......... 17% 15.1M 18s 2023-12-03T11:41:19.653 INFO:teuthology.orchestra.run.smithi044.stderr: 16550K .......... .......... .......... .......... .......... 17% 10.5M 18s 2023-12-03T11:41:19.656 INFO:teuthology.orchestra.run.smithi044.stderr: 16600K .......... .......... .......... .......... .......... 17% 19.4M 18s 2023-12-03T11:41:19.660 INFO:teuthology.orchestra.run.smithi044.stderr: 16650K .......... .......... .......... .......... .......... 17% 12.8M 18s 2023-12-03T11:41:19.664 INFO:teuthology.orchestra.run.smithi044.stderr: 16700K .......... .......... .......... .......... .......... 18% 12.4M 18s 2023-12-03T11:41:19.668 INFO:teuthology.orchestra.run.smithi044.stderr: 16750K .......... .......... .......... .......... .......... 18% 12.0M 18s 2023-12-03T11:41:19.672 INFO:teuthology.orchestra.run.smithi044.stderr: 16800K .......... .......... .......... .......... .......... 18% 11.3M 18s 2023-12-03T11:41:19.677 INFO:teuthology.orchestra.run.smithi044.stderr: 16850K .......... .......... .......... .......... .......... 18% 9.20M 18s 2023-12-03T11:41:19.682 INFO:teuthology.orchestra.run.smithi044.stderr: 16900K .......... .......... .......... .......... .......... 18% 12.5M 18s 2023-12-03T11:41:19.686 INFO:teuthology.orchestra.run.smithi044.stderr: 16950K .......... .......... .......... .......... .......... 18% 9.28M 18s 2023-12-03T11:41:19.689 INFO:teuthology.orchestra.run.smithi044.stderr: 17000K .......... .......... .......... .......... .......... 18% 16.3M 18s 2023-12-03T11:41:19.694 INFO:teuthology.orchestra.run.smithi044.stderr: 17050K .......... .......... .......... .......... .......... 18% 10.8M 18s 2023-12-03T11:41:19.701 INFO:teuthology.orchestra.run.smithi044.stderr: 17100K .......... .......... .......... .......... .......... 18% 7.16M 18s 2023-12-03T11:41:19.706 INFO:teuthology.orchestra.run.smithi044.stderr: 17150K .......... .......... .......... .......... .......... 18% 8.69M 18s 2023-12-03T11:41:19.709 INFO:teuthology.orchestra.run.smithi044.stderr: 17200K .......... .......... .......... .......... .......... 18% 17.1M 18s 2023-12-03T11:41:19.713 INFO:teuthology.orchestra.run.smithi044.stderr: 17250K .......... .......... .......... .......... .......... 18% 13.2M 18s 2023-12-03T11:41:19.716 INFO:teuthology.orchestra.run.smithi044.stderr: 17300K .......... .......... .......... .......... .......... 18% 15.0M 18s 2023-12-03T11:41:19.719 INFO:teuthology.orchestra.run.smithi044.stderr: 17350K .......... .......... .......... .......... .......... 18% 15.3M 17s 2023-12-03T11:41:19.725 INFO:teuthology.orchestra.run.smithi044.stderr: 17400K .......... .......... .......... .......... .......... 18% 10.2M 17s 2023-12-03T11:41:19.727 INFO:teuthology.orchestra.run.smithi044.stderr: 17450K .......... .......... .......... .......... .......... 18% 15.4M 17s 2023-12-03T11:41:19.732 INFO:teuthology.orchestra.run.smithi044.stderr: 17500K .......... .......... .......... .......... .......... 18% 11.5M 17s 2023-12-03T11:41:19.735 INFO:teuthology.orchestra.run.smithi044.stderr: 17550K .......... .......... .......... .......... .......... 18% 15.6M 17s 2023-12-03T11:41:19.739 INFO:teuthology.orchestra.run.smithi044.stderr: 17600K .......... .......... .......... .......... .......... 18% 12.6M 17s 2023-12-03T11:41:19.743 INFO:teuthology.orchestra.run.smithi044.stderr: 17650K .......... .......... .......... .......... .......... 19% 14.1M 17s 2023-12-03T11:41:19.748 INFO:teuthology.orchestra.run.smithi044.stderr: 17700K .......... .......... .......... .......... .......... 19% 8.12M 17s 2023-12-03T11:41:19.754 INFO:teuthology.orchestra.run.smithi044.stderr: 17750K .......... .......... .......... .......... .......... 19% 8.38M 17s 2023-12-03T11:41:19.758 INFO:teuthology.orchestra.run.smithi044.stderr: 17800K .......... .......... .......... .......... .......... 19% 14.0M 17s 2023-12-03T11:41:19.764 INFO:teuthology.orchestra.run.smithi044.stderr: 17850K .......... .......... .......... .......... .......... 19% 8.31M 17s 2023-12-03T11:41:19.768 INFO:teuthology.orchestra.run.smithi044.stderr: 17900K .......... .......... .......... .......... .......... 19% 15.0M 17s 2023-12-03T11:41:19.771 INFO:teuthology.orchestra.run.smithi044.stderr: 17950K .......... .......... .......... .......... .......... 19% 12.3M 17s 2023-12-03T11:41:19.777 INFO:teuthology.orchestra.run.smithi044.stderr: 18000K .......... .......... .......... .......... .......... 19% 7.56M 17s 2023-12-03T11:41:19.784 INFO:teuthology.orchestra.run.smithi044.stderr: 18050K .......... .......... .......... .......... .......... 19% 7.47M 17s 2023-12-03T11:41:19.791 INFO:teuthology.orchestra.run.smithi044.stderr: 18100K .......... .......... .......... .......... .......... 19% 8.68M 17s 2023-12-03T11:41:19.792 INFO:teuthology.orchestra.run.smithi044.stderr: 18150K .......... .......... .......... .......... .......... 19% 15.0M 17s 2023-12-03T11:41:19.796 INFO:teuthology.orchestra.run.smithi044.stderr: 18200K .......... .......... .......... .......... .......... 19% 13.6M 17s 2023-12-03T11:41:19.800 INFO:teuthology.orchestra.run.smithi044.stderr: 18250K .......... .......... .......... .......... .......... 19% 12.9M 17s 2023-12-03T11:41:19.805 INFO:teuthology.orchestra.run.smithi044.stderr: 18300K .......... .......... .......... .......... .......... 19% 10.6M 17s 2023-12-03T11:41:19.809 INFO:teuthology.orchestra.run.smithi044.stderr: 18350K .......... .......... .......... .......... .......... 19% 9.82M 17s 2023-12-03T11:41:19.813 INFO:teuthology.orchestra.run.smithi044.stderr: 18400K .......... .......... .......... .......... .......... 19% 12.7M 17s 2023-12-03T11:41:19.818 INFO:teuthology.orchestra.run.smithi044.stderr: 18450K .......... .......... .......... .......... .......... 19% 9.84M 17s 2023-12-03T11:41:19.821 INFO:teuthology.orchestra.run.smithi044.stderr: 18500K .......... .......... .......... .......... .......... 19% 19.9M 17s 2023-12-03T11:41:19.824 INFO:teuthology.orchestra.run.smithi044.stderr: 18550K .......... .......... .......... .......... .......... 20% 13.1M 17s 2023-12-03T11:41:19.828 INFO:teuthology.orchestra.run.smithi044.stderr: 18600K .......... .......... .......... .......... .......... 20% 12.4M 16s 2023-12-03T11:41:19.835 INFO:teuthology.orchestra.run.smithi044.stderr: 18650K .......... .......... .......... .......... .......... 20% 7.97M 16s 2023-12-03T11:41:19.841 INFO:teuthology.orchestra.run.smithi044.stderr: 18700K .......... .......... .......... .......... .......... 20% 7.61M 16s 2023-12-03T11:41:19.845 INFO:teuthology.orchestra.run.smithi044.stderr: 18750K .......... .......... .......... .......... .......... 20% 11.4M 16s 2023-12-03T11:41:19.851 INFO:teuthology.orchestra.run.smithi044.stderr: 18800K .......... .......... .......... .......... .......... 20% 8.42M 16s 2023-12-03T11:41:19.854 INFO:teuthology.orchestra.run.smithi044.stderr: 18850K .......... .......... .......... .......... .......... 20% 14.5M 16s 2023-12-03T11:41:19.858 INFO:teuthology.orchestra.run.smithi044.stderr: 18900K .......... .......... .......... .......... .......... 20% 12.5M 16s 2023-12-03T11:41:19.864 INFO:teuthology.orchestra.run.smithi044.stderr: 18950K .......... .......... .......... .......... .......... 20% 8.61M 16s 2023-12-03T11:41:19.871 INFO:teuthology.orchestra.run.smithi044.stderr: 19000K .......... .......... .......... .......... .......... 20% 7.21M 16s 2023-12-03T11:41:19.875 INFO:teuthology.orchestra.run.smithi044.stderr: 19050K .......... .......... .......... .......... .......... 20% 11.8M 16s 2023-12-03T11:41:19.879 INFO:teuthology.orchestra.run.smithi044.stderr: 19100K .......... .......... .......... .......... .......... 20% 12.3M 16s 2023-12-03T11:41:19.885 INFO:teuthology.orchestra.run.smithi044.stderr: 19150K .......... .......... .......... .......... .......... 20% 11.1M 16s 2023-12-03T11:41:19.887 INFO:teuthology.orchestra.run.smithi044.stderr: 19200K .......... .......... .......... .......... .......... 20% 13.7M 16s 2023-12-03T11:41:19.890 INFO:teuthology.orchestra.run.smithi044.stderr: 19250K .......... .......... .......... .......... .......... 20% 12.8M 16s 2023-12-03T11:41:19.893 INFO:teuthology.orchestra.run.smithi044.stderr: 19300K .......... .......... .......... .......... .......... 20% 16.5M 16s 2023-12-03T11:41:19.898 INFO:teuthology.orchestra.run.smithi044.stderr: 19350K .......... .......... .......... .......... .......... 20% 11.4M 16s 2023-12-03T11:41:19.903 INFO:teuthology.orchestra.run.smithi044.stderr: 19400K .......... .......... .......... .......... .......... 20% 8.88M 16s 2023-12-03T11:41:19.906 INFO:teuthology.orchestra.run.smithi044.stderr: 19450K .......... .......... .......... .......... .......... 20% 17.3M 16s 2023-12-03T11:41:19.909 INFO:teuthology.orchestra.run.smithi044.stderr: 19500K .......... .......... .......... .......... .......... 21% 15.2M 16s 2023-12-03T11:41:19.913 INFO:teuthology.orchestra.run.smithi044.stderr: 19550K .......... .......... .......... .......... .......... 21% 14.0M 16s 2023-12-03T11:41:19.920 INFO:teuthology.orchestra.run.smithi044.stderr: 19600K .......... .......... .......... .......... .......... 21% 8.06M 16s 2023-12-03T11:41:19.922 INFO:teuthology.orchestra.run.smithi044.stderr: 19650K .......... .......... .......... .......... .......... 21% 15.5M 16s 2023-12-03T11:41:19.930 INFO:teuthology.orchestra.run.smithi044.stderr: 19700K .......... .......... .......... .......... .......... 21% 6.57M 16s 2023-12-03T11:41:19.932 INFO:teuthology.orchestra.run.smithi044.stderr: 19750K .......... .......... .......... .......... .......... 21% 21.5M 16s 2023-12-03T11:41:19.936 INFO:teuthology.orchestra.run.smithi044.stderr: 19800K .......... .......... .......... .......... .......... 21% 10.1M 16s 2023-12-03T11:41:19.941 INFO:teuthology.orchestra.run.smithi044.stderr: 19850K .......... .......... .......... .......... .......... 21% 10.1M 16s 2023-12-03T11:41:19.944 INFO:teuthology.orchestra.run.smithi044.stderr: 19900K .......... .......... .......... .......... .......... 21% 16.5M 16s 2023-12-03T11:41:19.949 INFO:teuthology.orchestra.run.smithi044.stderr: 19950K .......... .......... .......... .......... .......... 21% 11.2M 16s 2023-12-03T11:41:19.957 INFO:teuthology.orchestra.run.smithi044.stderr: 20000K .......... .......... .......... .......... .......... 21% 6.02M 15s 2023-12-03T11:41:19.961 INFO:teuthology.orchestra.run.smithi044.stderr: 20050K .......... .......... .......... .......... .......... 21% 12.2M 15s 2023-12-03T11:41:19.964 INFO:teuthology.orchestra.run.smithi044.stderr: 20100K .......... .......... .......... .......... .......... 21% 16.5M 15s 2023-12-03T11:41:19.968 INFO:teuthology.orchestra.run.smithi044.stderr: 20150K .......... .......... .......... .......... .......... 21% 12.9M 15s 2023-12-03T11:41:19.970 INFO:teuthology.orchestra.run.smithi044.stderr: 20200K .......... .......... .......... .......... .......... 21% 17.6M 15s 2023-12-03T11:41:19.974 INFO:teuthology.orchestra.run.smithi044.stderr: 20250K .......... .......... .......... .......... .......... 21% 15.4M 15s 2023-12-03T11:41:19.978 INFO:teuthology.orchestra.run.smithi044.stderr: 20300K .......... .......... .......... .......... .......... 21% 14.5M 15s 2023-12-03T11:41:19.981 INFO:teuthology.orchestra.run.smithi044.stderr: 20350K .......... .......... .......... .......... .......... 21% 12.3M 15s 2023-12-03T11:41:19.983 INFO:teuthology.orchestra.run.smithi044.stderr: 20400K .......... .......... .......... .......... .......... 22% 18.6M 15s 2023-12-03T11:41:19.987 INFO:teuthology.orchestra.run.smithi044.stderr: 20450K .......... .......... .......... .......... .......... 22% 19.8M 15s 2023-12-03T11:41:19.990 INFO:teuthology.orchestra.run.smithi044.stderr: 20500K .......... .......... .......... .......... .......... 22% 11.4M 15s 2023-12-03T11:41:19.996 INFO:teuthology.orchestra.run.smithi044.stderr: 20550K .......... .......... .......... .......... .......... 22% 8.85M 15s 2023-12-03T11:41:19.998 INFO:teuthology.orchestra.run.smithi044.stderr: 20600K .......... .......... .......... .......... .......... 22% 19.7M 15s 2023-12-03T11:41:20.002 INFO:teuthology.orchestra.run.smithi044.stderr: 20650K .......... .......... .......... .......... .......... 22% 14.5M 15s 2023-12-03T11:41:20.005 INFO:teuthology.orchestra.run.smithi044.stderr: 20700K .......... .......... .......... .......... .......... 22% 16.4M 15s 2023-12-03T11:41:20.009 INFO:teuthology.orchestra.run.smithi044.stderr: 20750K .......... .......... .......... .......... .......... 22% 10.7M 15s 2023-12-03T11:41:20.012 INFO:teuthology.orchestra.run.smithi044.stderr: 20800K .......... .......... .......... .......... .......... 22% 17.2M 15s 2023-12-03T11:41:20.015 INFO:teuthology.orchestra.run.smithi044.stderr: 20850K .......... .......... .......... .......... .......... 22% 15.6M 15s 2023-12-03T11:41:20.019 INFO:teuthology.orchestra.run.smithi044.stderr: 20900K .......... .......... .......... .......... .......... 22% 11.3M 15s 2023-12-03T11:41:20.026 INFO:teuthology.orchestra.run.smithi044.stderr: 20950K .......... .......... .......... .......... .......... 22% 20.5M 15s 2023-12-03T11:41:20.031 INFO:teuthology.orchestra.run.smithi044.stderr: 21000K .......... .......... .......... .......... .......... 22% 5.11M 15s 2023-12-03T11:41:20.037 INFO:teuthology.orchestra.run.smithi044.stderr: 21050K .......... .......... .......... .......... .......... 22% 8.49M 15s 2023-12-03T11:41:20.047 INFO:teuthology.orchestra.run.smithi044.stderr: 21100K .......... .......... .......... .......... .......... 22% 5.93M 15s 2023-12-03T11:41:20.047 INFO:teuthology.orchestra.run.smithi044.stderr: 21150K .......... .......... .......... .......... .......... 22% 81.9M 15s 2023-12-03T11:41:20.047 INFO:teuthology.orchestra.run.smithi044.stderr: 21200K .......... .......... .......... .......... .......... 22% 67.9M 15s 2023-12-03T11:41:20.049 INFO:teuthology.orchestra.run.smithi044.stderr: 21250K .......... .......... .......... .......... .......... 22% 63.3M 15s 2023-12-03T11:41:20.049 INFO:teuthology.orchestra.run.smithi044.stderr: 21300K .......... .......... .......... .......... .......... 22% 36.6M 15s 2023-12-03T11:41:20.051 INFO:teuthology.orchestra.run.smithi044.stderr: 21350K .......... .......... .......... .......... .......... 23% 18.1M 15s 2023-12-03T11:41:20.055 INFO:teuthology.orchestra.run.smithi044.stderr: 21400K .......... .......... .......... .......... .......... 23% 13.3M 15s 2023-12-03T11:41:20.059 INFO:teuthology.orchestra.run.smithi044.stderr: 21450K .......... .......... .......... .......... .......... 23% 15.1M 14s 2023-12-03T11:41:20.106 INFO:teuthology.orchestra.run.smithi044.stderr: 21500K .......... .......... .......... .......... .......... 23% 6.95M 14s 2023-12-03T11:41:20.107 INFO:teuthology.orchestra.run.smithi044.stderr: 21550K .......... .......... .......... .......... .......... 23% 1.52M 15s 2023-12-03T11:41:20.107 INFO:teuthology.orchestra.run.smithi044.stderr: 21600K .......... .......... .......... .......... .......... 23% 177M 14s 2023-12-03T11:41:20.107 INFO:teuthology.orchestra.run.smithi044.stderr: 21650K .......... .......... .......... .......... .......... 23% 271M 14s 2023-12-03T11:41:20.107 INFO:teuthology.orchestra.run.smithi044.stderr: 21700K .......... .......... .......... .......... .......... 23% 227M 14s 2023-12-03T11:41:20.107 INFO:teuthology.orchestra.run.smithi044.stderr: 21750K .......... .......... .......... .......... .......... 23% 306M 14s 2023-12-03T11:41:20.107 INFO:teuthology.orchestra.run.smithi044.stderr: 21800K .......... .......... .......... .......... .......... 23% 298M 14s 2023-12-03T11:41:20.107 INFO:teuthology.orchestra.run.smithi044.stderr: 21850K .......... .......... .......... .......... .......... 23% 275M 14s 2023-12-03T11:41:20.107 INFO:teuthology.orchestra.run.smithi044.stderr: 21900K .......... .......... .......... .......... .......... 23% 232M 14s 2023-12-03T11:41:20.107 INFO:teuthology.orchestra.run.smithi044.stderr: 21950K .......... .......... .......... .......... .......... 23% 309M 14s 2023-12-03T11:41:20.107 INFO:teuthology.orchestra.run.smithi044.stderr: 22000K .......... .......... .......... .......... .......... 23% 27.7M 14s 2023-12-03T11:41:20.107 INFO:teuthology.orchestra.run.smithi044.stderr: 22050K .......... .......... .......... .......... .......... 23% 69.0M 14s 2023-12-03T11:41:20.112 INFO:teuthology.orchestra.run.smithi044.stderr: 22100K .......... .......... .......... .......... .......... 23% 4.74M 14s 2023-12-03T11:41:20.115 INFO:teuthology.orchestra.run.smithi044.stderr: 22150K .......... .......... .......... .......... .......... 23% 15.4M 14s 2023-12-03T11:41:20.123 INFO:teuthology.orchestra.run.smithi044.stderr: 22200K .......... .......... .......... .......... .......... 23% 6.20M 14s 2023-12-03T11:41:20.126 INFO:teuthology.orchestra.run.smithi044.stderr: 22250K .......... .......... .......... .......... .......... 24% 15.5M 14s 2023-12-03T11:41:20.129 INFO:teuthology.orchestra.run.smithi044.stderr: 22300K .......... .......... .......... .......... .......... 24% 15.9M 14s 2023-12-03T11:41:20.134 INFO:teuthology.orchestra.run.smithi044.stderr: 22350K .......... .......... .......... .......... .......... 24% 11.2M 14s 2023-12-03T11:41:20.137 INFO:teuthology.orchestra.run.smithi044.stderr: 22400K .......... .......... .......... .......... .......... 24% 17.7M 14s 2023-12-03T11:41:20.140 INFO:teuthology.orchestra.run.smithi044.stderr: 22450K .......... .......... .......... .......... .......... 24% 15.6M 14s 2023-12-03T11:41:20.143 INFO:teuthology.orchestra.run.smithi044.stderr: 22500K .......... .......... .......... .......... .......... 24% 14.6M 14s 2023-12-03T11:41:20.149 INFO:teuthology.orchestra.run.smithi044.stderr: 22550K .......... .......... .......... .......... .......... 24% 10.4M 14s 2023-12-03T11:41:20.149 INFO:teuthology.orchestra.run.smithi044.stderr: 22600K .......... .......... .......... .......... .......... 24% 40.4M 14s 2023-12-03T11:41:20.176 INFO:teuthology.orchestra.run.smithi044.stderr: 22650K .......... .......... .......... .......... .......... 24% 1.82M 14s 2023-12-03T11:41:20.180 INFO:teuthology.orchestra.run.smithi044.stderr: 22700K .......... .......... .......... .......... .......... 24% 12.7M 14s 2023-12-03T11:41:20.183 INFO:teuthology.orchestra.run.smithi044.stderr: 22750K .......... .......... .......... .......... .......... 24% 16.9M 14s 2023-12-03T11:41:20.183 INFO:teuthology.orchestra.run.smithi044.stderr: 22800K .......... .......... .......... .......... .......... 24% 48.0M 14s 2023-12-03T11:41:20.188 INFO:teuthology.orchestra.run.smithi044.stderr: 22850K .......... .......... .......... .......... .......... 24% 9.73M 14s 2023-12-03T11:41:20.190 INFO:teuthology.orchestra.run.smithi044.stderr: 22900K .......... .......... .......... .......... .......... 24% 32.9M 14s 2023-12-03T11:41:20.192 INFO:teuthology.orchestra.run.smithi044.stderr: 22950K .......... .......... .......... .......... .......... 24% 31.2M 14s 2023-12-03T11:41:20.195 INFO:teuthology.orchestra.run.smithi044.stderr: 23000K .......... .......... .......... .......... .......... 24% 15.0M 14s 2023-12-03T11:41:20.198 INFO:teuthology.orchestra.run.smithi044.stderr: 23050K .......... .......... .......... .......... .......... 24% 15.0M 14s 2023-12-03T11:41:20.202 INFO:teuthology.orchestra.run.smithi044.stderr: 23100K .......... .......... .......... .......... .......... 24% 11.1M 14s 2023-12-03T11:41:20.206 INFO:teuthology.orchestra.run.smithi044.stderr: 23150K .......... .......... .......... .......... .......... 24% 15.2M 14s 2023-12-03T11:41:20.207 INFO:teuthology.orchestra.run.smithi044.stderr: 23200K .......... .......... .......... .......... .......... 25% 25.0M 14s 2023-12-03T11:41:20.211 INFO:teuthology.orchestra.run.smithi044.stderr: 23250K .......... .......... .......... .......... .......... 25% 18.9M 13s 2023-12-03T11:41:20.217 INFO:teuthology.orchestra.run.smithi044.stderr: 23300K .......... .......... .......... .......... .......... 25% 8.20M 13s 2023-12-03T11:41:20.217 INFO:teuthology.orchestra.run.smithi044.stderr: 23350K .......... .......... .......... .......... .......... 25% 67.1M 13s 2023-12-03T11:41:20.218 INFO:teuthology.orchestra.run.smithi044.stderr: 23400K .......... .......... .......... .......... .......... 25% 58.9M 13s 2023-12-03T11:41:20.221 INFO:teuthology.orchestra.run.smithi044.stderr: 23450K .......... .......... .......... .......... .......... 25% 13.0M 13s 2023-12-03T11:41:20.227 INFO:teuthology.orchestra.run.smithi044.stderr: 23500K .......... .......... .......... .......... .......... 25% 9.51M 13s 2023-12-03T11:41:20.228 INFO:teuthology.orchestra.run.smithi044.stderr: 23550K .......... .......... .......... .......... .......... 25% 24.4M 13s 2023-12-03T11:41:20.232 INFO:teuthology.orchestra.run.smithi044.stderr: 23600K .......... .......... .......... .......... .......... 25% 15.6M 13s 2023-12-03T11:41:20.234 INFO:teuthology.orchestra.run.smithi044.stderr: 23650K .......... .......... .......... .......... .......... 25% 17.9M 13s 2023-12-03T11:41:20.237 INFO:teuthology.orchestra.run.smithi044.stderr: 23700K .......... .......... .......... .......... .......... 25% 17.8M 13s 2023-12-03T11:41:20.243 INFO:teuthology.orchestra.run.smithi044.stderr: 23750K .......... .......... .......... .......... .......... 25% 7.92M 13s 2023-12-03T11:41:20.248 INFO:teuthology.orchestra.run.smithi044.stderr: 23800K .......... .......... .......... .......... .......... 25% 9.78M 13s 2023-12-03T11:41:20.261 INFO:teuthology.orchestra.run.smithi044.stderr: 23850K .......... .......... .......... .......... .......... 25% 3.89M 13s 2023-12-03T11:41:20.266 INFO:teuthology.orchestra.run.smithi044.stderr: 23900K .......... .......... .......... .......... .......... 25% 9.40M 13s 2023-12-03T11:41:20.269 INFO:teuthology.orchestra.run.smithi044.stderr: 23950K .......... .......... .......... .......... .......... 25% 18.3M 13s 2023-12-03T11:41:20.271 INFO:teuthology.orchestra.run.smithi044.stderr: 24000K .......... .......... .......... .......... .......... 25% 17.5M 13s 2023-12-03T11:41:20.276 INFO:teuthology.orchestra.run.smithi044.stderr: 24050K .......... .......... .......... .......... .......... 25% 11.7M 13s 2023-12-03T11:41:20.279 INFO:teuthology.orchestra.run.smithi044.stderr: 24100K .......... .......... .......... .......... .......... 25% 15.6M 13s 2023-12-03T11:41:20.282 INFO:teuthology.orchestra.run.smithi044.stderr: 24150K .......... .......... .......... .......... .......... 26% 13.6M 13s 2023-12-03T11:41:20.285 INFO:teuthology.orchestra.run.smithi044.stderr: 24200K .......... .......... .......... .......... .......... 26% 17.0M 13s 2023-12-03T11:41:20.291 INFO:teuthology.orchestra.run.smithi044.stderr: 24250K .......... .......... .......... .......... .......... 26% 16.3M 13s 2023-12-03T11:41:20.297 INFO:teuthology.orchestra.run.smithi044.stderr: 24300K .......... .......... .......... .......... .......... 26% 5.75M 13s 2023-12-03T11:41:20.301 INFO:teuthology.orchestra.run.smithi044.stderr: 24350K .......... .......... .......... .......... .......... 26% 11.9M 13s 2023-12-03T11:41:20.304 INFO:teuthology.orchestra.run.smithi044.stderr: 24400K .......... .......... .......... .......... .......... 26% 18.6M 13s 2023-12-03T11:41:20.312 INFO:teuthology.orchestra.run.smithi044.stderr: 24450K .......... .......... .......... .......... .......... 26% 7.17M 13s 2023-12-03T11:41:20.312 INFO:teuthology.orchestra.run.smithi044.stderr: 24500K .......... .......... .......... .......... .......... 26% 95.1M 13s 2023-12-03T11:41:20.312 INFO:teuthology.orchestra.run.smithi044.stderr: 24550K .......... .......... .......... .......... .......... 26% 65.5M 13s 2023-12-03T11:41:20.313 INFO:teuthology.orchestra.run.smithi044.stderr: 24600K .......... .......... .......... .......... .......... 26% 29.9M 13s 2023-12-03T11:41:20.316 INFO:teuthology.orchestra.run.smithi044.stderr: 24650K .......... .......... .......... .......... .......... 26% 20.0M 13s 2023-12-03T11:41:20.319 INFO:teuthology.orchestra.run.smithi044.stderr: 24700K .......... .......... .......... .......... .......... 26% 13.3M 13s 2023-12-03T11:41:20.323 INFO:teuthology.orchestra.run.smithi044.stderr: 24750K .......... .......... .......... .......... .......... 26% 15.5M 13s 2023-12-03T11:41:20.326 INFO:teuthology.orchestra.run.smithi044.stderr: 24800K .......... .......... .......... .......... .......... 26% 14.0M 13s 2023-12-03T11:41:20.328 INFO:teuthology.orchestra.run.smithi044.stderr: 24850K .......... .......... .......... .......... .......... 26% 18.1M 13s 2023-12-03T11:41:20.332 INFO:teuthology.orchestra.run.smithi044.stderr: 24900K .......... .......... .......... .......... .......... 26% 15.7M 13s 2023-12-03T11:41:20.340 INFO:teuthology.orchestra.run.smithi044.stderr: 24950K .......... .......... .......... .......... .......... 26% 6.29M 13s 2023-12-03T11:41:20.348 INFO:teuthology.orchestra.run.smithi044.stderr: 25000K .......... .......... .......... .......... .......... 26% 5.59M 13s 2023-12-03T11:41:20.362 INFO:teuthology.orchestra.run.smithi044.stderr: 25050K .......... .......... .......... .......... .......... 27% 3.49M 13s 2023-12-03T11:41:20.365 INFO:teuthology.orchestra.run.smithi044.stderr: 25100K .......... .......... .......... .......... .......... 27% 31.3M 13s 2023-12-03T11:41:20.365 INFO:teuthology.orchestra.run.smithi044.stderr: 25150K .......... .......... .......... .......... .......... 27% 66.5M 13s 2023-12-03T11:41:20.367 INFO:teuthology.orchestra.run.smithi044.stderr: 25200K .......... .......... .......... .......... .......... 27% 22.5M 13s 2023-12-03T11:41:20.370 INFO:teuthology.orchestra.run.smithi044.stderr: 25250K .......... .......... .......... .......... .......... 27% 17.8M 12s 2023-12-03T11:41:20.376 INFO:teuthology.orchestra.run.smithi044.stderr: 25300K .......... .......... .......... .......... .......... 27% 6.91M 12s 2023-12-03T11:41:20.381 INFO:teuthology.orchestra.run.smithi044.stderr: 25350K .......... .......... .......... .......... .......... 27% 10.9M 12s 2023-12-03T11:41:20.386 INFO:teuthology.orchestra.run.smithi044.stderr: 25400K .......... .......... .......... .......... .......... 27% 9.01M 12s 2023-12-03T11:41:20.389 INFO:teuthology.orchestra.run.smithi044.stderr: 25450K .......... .......... .......... .......... .......... 27% 16.6M 12s 2023-12-03T11:41:20.391 INFO:teuthology.orchestra.run.smithi044.stderr: 25500K .......... .......... .......... .......... .......... 27% 24.4M 12s 2023-12-03T11:41:20.398 INFO:teuthology.orchestra.run.smithi044.stderr: 25550K .......... .......... .......... .......... .......... 27% 6.69M 12s 2023-12-03T11:41:20.405 INFO:teuthology.orchestra.run.smithi044.stderr: 25600K .......... .......... .......... .......... .......... 27% 7.13M 12s 2023-12-03T11:41:20.410 INFO:teuthology.orchestra.run.smithi044.stderr: 25650K .......... .......... .......... .......... .......... 27% 10.1M 12s 2023-12-03T11:41:20.419 INFO:teuthology.orchestra.run.smithi044.stderr: 25700K .......... .......... .......... .......... .......... 27% 5.70M 12s 2023-12-03T11:41:20.421 INFO:teuthology.orchestra.run.smithi044.stderr: 25750K .......... .......... .......... .......... .......... 27% 30.9M 12s 2023-12-03T11:41:20.424 INFO:teuthology.orchestra.run.smithi044.stderr: 25800K .......... .......... .......... .......... .......... 27% 12.2M 12s 2023-12-03T11:41:20.429 INFO:teuthology.orchestra.run.smithi044.stderr: 25850K .......... .......... .......... .......... .......... 27% 11.7M 12s 2023-12-03T11:41:20.431 INFO:teuthology.orchestra.run.smithi044.stderr: 25900K .......... .......... .......... .......... .......... 27% 22.2M 12s 2023-12-03T11:41:20.435 INFO:teuthology.orchestra.run.smithi044.stderr: 25950K .......... .......... .......... .......... .......... 27% 11.5M 12s 2023-12-03T11:41:20.437 INFO:teuthology.orchestra.run.smithi044.stderr: 26000K .......... .......... .......... .......... .......... 28% 19.9M 12s 2023-12-03T11:41:20.440 INFO:teuthology.orchestra.run.smithi044.stderr: 26050K .......... .......... .......... .......... .......... 28% 18.0M 12s 2023-12-03T11:41:20.444 INFO:teuthology.orchestra.run.smithi044.stderr: 26100K .......... .......... .......... .......... .......... 28% 12.6M 12s 2023-12-03T11:41:20.446 INFO:teuthology.orchestra.run.smithi044.stderr: 26150K .......... .......... .......... .......... .......... 28% 18.9M 12s 2023-12-03T11:41:20.453 INFO:teuthology.orchestra.run.smithi044.stderr: 26200K .......... .......... .......... .......... .......... 28% 8.05M 12s 2023-12-03T11:41:20.454 INFO:teuthology.orchestra.run.smithi044.stderr: 26250K .......... .......... .......... .......... .......... 28% 105M 12s 2023-12-03T11:41:20.458 INFO:teuthology.orchestra.run.smithi044.stderr: 26300K .......... .......... .......... .......... .......... 28% 9.58M 12s 2023-12-03T11:41:20.470 INFO:teuthology.orchestra.run.smithi044.stderr: 26350K .......... .......... .......... .......... .......... 28% 4.01M 12s 2023-12-03T11:41:20.474 INFO:teuthology.orchestra.run.smithi044.stderr: 26400K .......... .......... .......... .......... .......... 28% 16.5M 12s 2023-12-03T11:41:20.476 INFO:teuthology.orchestra.run.smithi044.stderr: 26450K .......... .......... .......... .......... .......... 28% 22.9M 12s 2023-12-03T11:41:20.479 INFO:teuthology.orchestra.run.smithi044.stderr: 26500K .......... .......... .......... .......... .......... 28% 14.4M 12s 2023-12-03T11:41:20.480 INFO:teuthology.orchestra.run.smithi044.stderr: 26550K .......... .......... .......... .......... .......... 28% 29.6M 12s 2023-12-03T11:41:20.485 INFO:teuthology.orchestra.run.smithi044.stderr: 26600K .......... .......... .......... .......... .......... 28% 12.0M 12s 2023-12-03T11:41:20.488 INFO:teuthology.orchestra.run.smithi044.stderr: 26650K .......... .......... .......... .......... .......... 28% 13.3M 12s 2023-12-03T11:41:20.492 INFO:teuthology.orchestra.run.smithi044.stderr: 26700K .......... .......... .......... .......... .......... 28% 13.6M 12s 2023-12-03T11:41:20.498 INFO:teuthology.orchestra.run.smithi044.stderr: 26750K .......... .......... .......... .......... .......... 28% 9.15M 12s 2023-12-03T11:41:20.499 INFO:teuthology.orchestra.run.smithi044.stderr: 26800K .......... .......... .......... .......... .......... 28% 21.7M 12s 2023-12-03T11:41:20.502 INFO:teuthology.orchestra.run.smithi044.stderr: 26850K .......... .......... .......... .......... .......... 28% 16.0M 12s 2023-12-03T11:41:20.509 INFO:teuthology.orchestra.run.smithi044.stderr: 26900K .......... .......... .......... .......... .......... 29% 7.17M 12s 2023-12-03T11:41:20.515 INFO:teuthology.orchestra.run.smithi044.stderr: 26950K .......... .......... .......... .......... .......... 29% 8.39M 12s 2023-12-03T11:41:20.517 INFO:teuthology.orchestra.run.smithi044.stderr: 27000K .......... .......... .......... .......... .......... 29% 20.9M 12s 2023-12-03T11:41:20.525 INFO:teuthology.orchestra.run.smithi044.stderr: 27050K .......... .......... .......... .......... .......... 29% 7.11M 12s 2023-12-03T11:41:20.527 INFO:teuthology.orchestra.run.smithi044.stderr: 27100K .......... .......... .......... .......... .......... 29% 26.2M 12s 2023-12-03T11:41:20.529 INFO:teuthology.orchestra.run.smithi044.stderr: 27150K .......... .......... .......... .......... .......... 29% 14.3M 12s 2023-12-03T11:41:20.530 INFO:teuthology.orchestra.run.smithi044.stderr: 27200K .......... .......... .......... .......... .......... 29% 52.5M 12s 2023-12-03T11:41:20.535 INFO:teuthology.orchestra.run.smithi044.stderr: 27250K .......... .......... .......... .......... .......... 29% 12.6M 12s 2023-12-03T11:41:20.536 INFO:teuthology.orchestra.run.smithi044.stderr: 27300K .......... .......... .......... .......... .......... 29% 24.9M 12s 2023-12-03T11:41:20.539 INFO:teuthology.orchestra.run.smithi044.stderr: 27350K .......... .......... .......... .......... .......... 29% 21.8M 12s 2023-12-03T11:41:20.542 INFO:teuthology.orchestra.run.smithi044.stderr: 27400K .......... .......... .......... .......... .......... 29% 14.2M 12s 2023-12-03T11:41:20.548 INFO:teuthology.orchestra.run.smithi044.stderr: 27450K .......... .......... .......... .......... .......... 29% 19.6M 12s 2023-12-03T11:41:20.548 INFO:teuthology.orchestra.run.smithi044.stderr: 27500K .......... .......... .......... .......... .......... 29% 15.9M 12s 2023-12-03T11:41:20.551 INFO:teuthology.orchestra.run.smithi044.stderr: 27550K .......... .......... .......... .......... .......... 29% 17.4M 11s 2023-12-03T11:41:20.553 INFO:teuthology.orchestra.run.smithi044.stderr: 27600K .......... .......... .......... .......... .......... 29% 20.3M 11s 2023-12-03T11:41:20.557 INFO:teuthology.orchestra.run.smithi044.stderr: 27650K .......... .......... .......... .......... .......... 29% 12.2M 11s 2023-12-03T11:41:20.559 INFO:teuthology.orchestra.run.smithi044.stderr: 27700K .......... .......... .......... .......... .......... 29% 18.4M 11s 2023-12-03T11:41:20.566 INFO:teuthology.orchestra.run.smithi044.stderr: 27750K .......... .......... .......... .......... .......... 29% 7.18M 11s 2023-12-03T11:41:20.569 INFO:teuthology.orchestra.run.smithi044.stderr: 27800K .......... .......... .......... .......... .......... 29% 17.5M 11s 2023-12-03T11:41:20.573 INFO:teuthology.orchestra.run.smithi044.stderr: 27850K .......... .......... .......... .......... .......... 30% 17.1M 11s 2023-12-03T11:41:20.575 INFO:teuthology.orchestra.run.smithi044.stderr: 27900K .......... .......... .......... .......... .......... 30% 14.1M 11s 2023-12-03T11:41:20.579 INFO:teuthology.orchestra.run.smithi044.stderr: 27950K .......... .......... .......... .......... .......... 30% 12.7M 11s 2023-12-03T11:41:20.581 INFO:teuthology.orchestra.run.smithi044.stderr: 28000K .......... .......... .......... .......... .......... 30% 27.8M 11s 2023-12-03T11:41:20.585 INFO:teuthology.orchestra.run.smithi044.stderr: 28050K .......... .......... .......... .......... .......... 30% 12.7M 11s 2023-12-03T11:41:20.587 INFO:teuthology.orchestra.run.smithi044.stderr: 28100K .......... .......... .......... .......... .......... 30% 22.3M 11s 2023-12-03T11:41:20.591 INFO:teuthology.orchestra.run.smithi044.stderr: 28150K .......... .......... .......... .......... .......... 30% 12.9M 11s 2023-12-03T11:41:20.592 INFO:teuthology.orchestra.run.smithi044.stderr: 28200K .......... .......... .......... .......... .......... 30% 45.9M 11s 2023-12-03T11:41:20.597 INFO:teuthology.orchestra.run.smithi044.stderr: 28250K .......... .......... .......... .......... .......... 30% 10.3M 11s 2023-12-03T11:41:20.602 INFO:teuthology.orchestra.run.smithi044.stderr: 28300K .......... .......... .......... .......... .......... 30% 8.74M 11s 2023-12-03T11:41:20.606 INFO:teuthology.orchestra.run.smithi044.stderr: 28350K .......... .......... .......... .......... .......... 30% 22.6M 11s 2023-12-03T11:41:20.608 INFO:teuthology.orchestra.run.smithi044.stderr: 28400K .......... .......... .......... .......... .......... 30% 13.7M 11s 2023-12-03T11:41:20.614 INFO:teuthology.orchestra.run.smithi044.stderr: 28450K .......... .......... .......... .......... .......... 30% 8.94M 11s 2023-12-03T11:41:20.617 INFO:teuthology.orchestra.run.smithi044.stderr: 28500K .......... .......... .......... .......... .......... 30% 13.6M 11s 2023-12-03T11:41:20.621 INFO:teuthology.orchestra.run.smithi044.stderr: 28550K .......... .......... .......... .......... .......... 30% 16.5M 11s 2023-12-03T11:41:20.621 INFO:teuthology.orchestra.run.smithi044.stderr: 28600K .......... .......... .......... .......... .......... 30% 95.1M 11s 2023-12-03T11:41:20.626 INFO:teuthology.orchestra.run.smithi044.stderr: 28650K .......... .......... .......... .......... .......... 30% 10.3M 11s 2023-12-03T11:41:20.626 INFO:teuthology.orchestra.run.smithi044.stderr: 28700K .......... .......... .......... .......... .......... 30% 113M 11s 2023-12-03T11:41:20.629 INFO:teuthology.orchestra.run.smithi044.stderr: 28750K .......... .......... .......... .......... .......... 31% 14.2M 11s 2023-12-03T11:41:20.632 INFO:teuthology.orchestra.run.smithi044.stderr: 28800K .......... .......... .......... .......... .......... 31% 17.3M 11s 2023-12-03T11:41:20.635 INFO:teuthology.orchestra.run.smithi044.stderr: 28850K .......... .......... .......... .......... .......... 31% 15.3M 11s 2023-12-03T11:41:20.640 INFO:teuthology.orchestra.run.smithi044.stderr: 28900K .......... .......... .......... .......... .......... 31% 11.1M 11s 2023-12-03T11:41:20.640 INFO:teuthology.orchestra.run.smithi044.stderr: 28950K .......... .......... .......... .......... .......... 31% 87.1M 11s 2023-12-03T11:41:20.644 INFO:teuthology.orchestra.run.smithi044.stderr: 29000K .......... .......... .......... .......... .......... 31% 11.8M 11s 2023-12-03T11:41:20.645 INFO:teuthology.orchestra.run.smithi044.stderr: 29050K .......... .......... .......... .......... .......... 31% 45.5M 11s 2023-12-03T11:41:20.648 INFO:teuthology.orchestra.run.smithi044.stderr: 29100K .......... .......... .......... .......... .......... 31% 18.6M 11s 2023-12-03T11:41:20.649 INFO:teuthology.orchestra.run.smithi044.stderr: 29150K .......... .......... .......... .......... .......... 31% 52.9M 11s 2023-12-03T11:41:20.656 INFO:teuthology.orchestra.run.smithi044.stderr: 29200K .......... .......... .......... .......... .......... 31% 6.99M 11s 2023-12-03T11:41:20.657 INFO:teuthology.orchestra.run.smithi044.stderr: 29250K .......... .......... .......... .......... .......... 31% 98.5M 11s 2023-12-03T11:41:20.662 INFO:teuthology.orchestra.run.smithi044.stderr: 29300K .......... .......... .......... .......... .......... 31% 10.9M 11s 2023-12-03T11:41:20.665 INFO:teuthology.orchestra.run.smithi044.stderr: 29350K .......... .......... .......... .......... .......... 31% 14.1M 11s 2023-12-03T11:41:20.668 INFO:teuthology.orchestra.run.smithi044.stderr: 29400K .......... .......... .......... .......... .......... 31% 12.3M 11s 2023-12-03T11:41:20.670 INFO:teuthology.orchestra.run.smithi044.stderr: 29450K .......... .......... .......... .......... .......... 31% 38.2M 11s 2023-12-03T11:41:20.673 INFO:teuthology.orchestra.run.smithi044.stderr: 29500K .......... .......... .......... .......... .......... 31% 13.6M 11s 2023-12-03T11:41:20.677 INFO:teuthology.orchestra.run.smithi044.stderr: 29550K .......... .......... .......... .......... .......... 31% 13.6M 11s 2023-12-03T11:41:20.680 INFO:teuthology.orchestra.run.smithi044.stderr: 29600K .......... .......... .......... .......... .......... 31% 16.6M 11s 2023-12-03T11:41:20.680 INFO:teuthology.orchestra.run.smithi044.stderr: 29650K .......... .......... .......... .......... .......... 31% 97.6M 11s 2023-12-03T11:41:20.683 INFO:teuthology.orchestra.run.smithi044.stderr: 29700K .......... .......... .......... .......... .......... 32% 16.9M 11s 2023-12-03T11:41:20.691 INFO:teuthology.orchestra.run.smithi044.stderr: 29750K .......... .......... .......... .......... .......... 32% 6.52M 11s 2023-12-03T11:41:20.692 INFO:teuthology.orchestra.run.smithi044.stderr: 29800K .......... .......... .......... .......... .......... 32% 131M 11s 2023-12-03T11:41:20.695 INFO:teuthology.orchestra.run.smithi044.stderr: 29850K .......... .......... .......... .......... .......... 32% 12.8M 11s 2023-12-03T11:41:20.702 INFO:teuthology.orchestra.run.smithi044.stderr: 29900K .......... .......... .......... .......... .......... 32% 7.99M 11s 2023-12-03T11:41:20.702 INFO:teuthology.orchestra.run.smithi044.stderr: 29950K .......... .......... .......... .......... .......... 32% 63.0M 11s 2023-12-03T11:41:20.704 INFO:teuthology.orchestra.run.smithi044.stderr: 30000K .......... .......... .......... .......... .......... 32% 18.1M 10s 2023-12-03T11:41:20.709 INFO:teuthology.orchestra.run.smithi044.stderr: 30050K .......... .......... .......... .......... .......... 32% 11.5M 10s 2023-12-03T11:41:20.709 INFO:teuthology.orchestra.run.smithi044.stderr: 30100K .......... .......... .......... .......... .......... 32% 50.9M 10s 2023-12-03T11:41:20.715 INFO:teuthology.orchestra.run.smithi044.stderr: 30150K .......... .......... .......... .......... .......... 32% 9.76M 10s 2023-12-03T11:41:20.718 INFO:teuthology.orchestra.run.smithi044.stderr: 30200K .......... .......... .......... .......... .......... 32% 17.9M 10s 2023-12-03T11:41:20.720 INFO:teuthology.orchestra.run.smithi044.stderr: 30250K .......... .......... .......... .......... .......... 32% 22.2M 10s 2023-12-03T11:41:20.721 INFO:teuthology.orchestra.run.smithi044.stderr: 30300K .......... .......... .......... .......... .......... 32% 33.8M 10s 2023-12-03T11:41:20.724 INFO:teuthology.orchestra.run.smithi044.stderr: 30350K .......... .......... .......... .......... .......... 32% 17.1M 10s 2023-12-03T11:41:20.728 INFO:teuthology.orchestra.run.smithi044.stderr: 30400K .......... .......... .......... .......... .......... 32% 11.5M 10s 2023-12-03T11:41:20.731 INFO:teuthology.orchestra.run.smithi044.stderr: 30450K .......... .......... .......... .......... .......... 32% 22.8M 10s 2023-12-03T11:41:20.731 INFO:teuthology.orchestra.run.smithi044.stderr: 30500K .......... .......... .......... .......... .......... 32% 64.0M 10s 2023-12-03T11:41:20.733 INFO:teuthology.orchestra.run.smithi044.stderr: 30550K .......... .......... .......... .......... .......... 32% 21.0M 10s 2023-12-03T11:41:20.736 INFO:teuthology.orchestra.run.smithi044.stderr: 30600K .......... .......... .......... .......... .......... 32% 24.5M 10s 2023-12-03T11:41:20.736 INFO:teuthology.orchestra.run.smithi044.stderr: 30650K .......... .......... .......... .......... .......... 33% 53.7M 10s 2023-12-03T11:41:20.741 INFO:teuthology.orchestra.run.smithi044.stderr: 30700K .......... .......... .......... .......... .......... 33% 12.8M 10s 2023-12-03T11:41:20.743 INFO:teuthology.orchestra.run.smithi044.stderr: 30750K .......... .......... .......... .......... .......... 33% 18.9M 10s 2023-12-03T11:41:20.743 INFO:teuthology.orchestra.run.smithi044.stderr: 30800K .......... .......... .......... .......... .......... 33% 94.3M 10s 2023-12-03T11:41:20.746 INFO:teuthology.orchestra.run.smithi044.stderr: 30850K .......... .......... .......... .......... .......... 33% 16.3M 10s 2023-12-03T11:41:20.749 INFO:teuthology.orchestra.run.smithi044.stderr: 30900K .......... .......... .......... .......... .......... 33% 21.3M 10s 2023-12-03T11:41:20.749 INFO:teuthology.orchestra.run.smithi044.stderr: 30950K .......... .......... .......... .......... .......... 33% 92.2M 10s 2023-12-03T11:41:20.752 INFO:teuthology.orchestra.run.smithi044.stderr: 31000K .......... .......... .......... .......... .......... 33% 16.2M 10s 2023-12-03T11:41:20.753 INFO:teuthology.orchestra.run.smithi044.stderr: 31050K .......... .......... .......... .......... .......... 33% 61.9M 10s 2023-12-03T11:41:20.755 INFO:teuthology.orchestra.run.smithi044.stderr: 31100K .......... .......... .......... .......... .......... 33% 18.9M 10s 2023-12-03T11:41:20.758 INFO:teuthology.orchestra.run.smithi044.stderr: 31150K .......... .......... .......... .......... .......... 33% 22.2M 10s 2023-12-03T11:41:20.761 INFO:teuthology.orchestra.run.smithi044.stderr: 31200K .......... .......... .......... .......... .......... 33% 13.6M 10s 2023-12-03T11:41:20.765 INFO:teuthology.orchestra.run.smithi044.stderr: 31250K .......... .......... .......... .......... .......... 33% 14.6M 10s 2023-12-03T11:41:20.768 INFO:teuthology.orchestra.run.smithi044.stderr: 31300K .......... .......... .......... .......... .......... 33% 14.7M 10s 2023-12-03T11:41:20.771 INFO:teuthology.orchestra.run.smithi044.stderr: 31350K .......... .......... .......... .......... .......... 33% 25.9M 10s 2023-12-03T11:41:20.771 INFO:teuthology.orchestra.run.smithi044.stderr: 31400K .......... .......... .......... .......... .......... 33% 83.8M 10s 2023-12-03T11:41:20.771 INFO:teuthology.orchestra.run.smithi044.stderr: 31450K .......... .......... .......... .......... .......... 33% 62.7M 10s 2023-12-03T11:41:20.772 INFO:teuthology.orchestra.run.smithi044.stderr: 31500K .......... .......... .......... .......... .......... 33% 68.5M 10s 2023-12-03T11:41:20.773 INFO:teuthology.orchestra.run.smithi044.stderr: 31550K .......... .......... .......... .......... .......... 34% 27.9M 10s 2023-12-03T11:41:20.778 INFO:teuthology.orchestra.run.smithi044.stderr: 31600K .......... .......... .......... .......... .......... 34% 11.4M 10s 2023-12-03T11:41:20.781 INFO:teuthology.orchestra.run.smithi044.stderr: 31650K .......... .......... .......... .......... .......... 34% 18.9M 10s 2023-12-03T11:41:20.782 INFO:teuthology.orchestra.run.smithi044.stderr: 31700K .......... .......... .......... .......... .......... 34% 24.4M 10s 2023-12-03T11:41:20.786 INFO:teuthology.orchestra.run.smithi044.stderr: 31750K .......... .......... .......... .......... .......... 34% 12.7M 10s 2023-12-03T11:41:20.788 INFO:teuthology.orchestra.run.smithi044.stderr: 31800K .......... .......... .......... .......... .......... 34% 28.0M 10s 2023-12-03T11:41:20.792 INFO:teuthology.orchestra.run.smithi044.stderr: 31850K .......... .......... .......... .......... .......... 34% 11.6M 10s 2023-12-03T11:41:20.795 INFO:teuthology.orchestra.run.smithi044.stderr: 31900K .......... .......... .......... .......... .......... 34% 18.4M 10s 2023-12-03T11:41:20.800 INFO:teuthology.orchestra.run.smithi044.stderr: 31950K .......... .......... .......... .......... .......... 34% 9.94M 10s 2023-12-03T11:41:20.804 INFO:teuthology.orchestra.run.smithi044.stderr: 32000K .......... .......... .......... .......... .......... 34% 11.2M 10s 2023-12-03T11:41:20.820 INFO:teuthology.orchestra.run.smithi044.stderr: 32050K .......... .......... .......... .......... .......... 34% 4.91M 10s 2023-12-03T11:41:20.820 INFO:teuthology.orchestra.run.smithi044.stderr: 32100K .......... .......... .......... .......... .......... 34% 108M 10s 2023-12-03T11:41:20.820 INFO:teuthology.orchestra.run.smithi044.stderr: 32150K .......... .......... .......... .......... .......... 34% 69.8M 10s 2023-12-03T11:41:20.820 INFO:teuthology.orchestra.run.smithi044.stderr: 32200K .......... .......... .......... .......... .......... 34% 70.0M 10s 2023-12-03T11:41:20.820 INFO:teuthology.orchestra.run.smithi044.stderr: 32250K .......... .......... .......... .......... .......... 34% 86.4M 10s 2023-12-03T11:41:20.820 INFO:teuthology.orchestra.run.smithi044.stderr: 32300K .......... .......... .......... .......... .......... 34% 80.1M 10s 2023-12-03T11:41:20.820 INFO:teuthology.orchestra.run.smithi044.stderr: 32350K .......... .......... .......... .......... .......... 34% 92.6M 10s 2023-12-03T11:41:20.820 INFO:teuthology.orchestra.run.smithi044.stderr: 32400K .......... .......... .......... .......... .......... 34% 80.0M 10s 2023-12-03T11:41:20.820 INFO:teuthology.orchestra.run.smithi044.stderr: 32450K .......... .......... .......... .......... .......... 34% 38.5M 10s 2023-12-03T11:41:20.822 INFO:teuthology.orchestra.run.smithi044.stderr: 32500K .......... .......... .......... .......... .......... 35% 25.4M 10s 2023-12-03T11:41:20.832 INFO:teuthology.orchestra.run.smithi044.stderr: 32550K .......... .......... .......... .......... .......... 35% 15.1M 9s 2023-12-03T11:41:20.832 INFO:teuthology.orchestra.run.smithi044.stderr: 32600K .......... .......... .......... .......... .......... 35% 8.10M 9s 2023-12-03T11:41:20.832 INFO:teuthology.orchestra.run.smithi044.stderr: 32650K .......... .......... .......... .......... .......... 35% 83.6M 9s 2023-12-03T11:41:20.832 INFO:teuthology.orchestra.run.smithi044.stderr: 32700K .......... .......... .......... .......... .......... 35% 73.1M 9s 2023-12-03T11:41:20.833 INFO:teuthology.orchestra.run.smithi044.stderr: 32750K .......... .......... .......... .......... .......... 35% 48.4M 9s 2023-12-03T11:41:20.834 INFO:teuthology.orchestra.run.smithi044.stderr: 32800K .......... .......... .......... .......... .......... 35% 28.0M 9s 2023-12-03T11:41:20.836 INFO:teuthology.orchestra.run.smithi044.stderr: 32850K .......... .......... .......... .......... .......... 35% 27.4M 9s 2023-12-03T11:41:20.839 INFO:teuthology.orchestra.run.smithi044.stderr: 32900K .......... .......... .......... .......... .......... 35% 20.3M 9s 2023-12-03T11:41:20.842 INFO:teuthology.orchestra.run.smithi044.stderr: 32950K .......... .......... .......... .......... .......... 35% 25.9M 9s 2023-12-03T11:41:20.843 INFO:teuthology.orchestra.run.smithi044.stderr: 33000K .......... .......... .......... .......... .......... 35% 18.0M 9s 2023-12-03T11:41:20.846 INFO:teuthology.orchestra.run.smithi044.stderr: 33050K .......... .......... .......... .......... .......... 35% 23.8M 9s 2023-12-03T11:41:20.847 INFO:teuthology.orchestra.run.smithi044.stderr: 33100K .......... .......... .......... .......... .......... 35% 29.0M 9s 2023-12-03T11:41:20.850 INFO:teuthology.orchestra.run.smithi044.stderr: 33150K .......... .......... .......... .......... .......... 35% 20.0M 9s 2023-12-03T11:41:20.851 INFO:teuthology.orchestra.run.smithi044.stderr: 33200K .......... .......... .......... .......... .......... 35% 30.4M 9s 2023-12-03T11:41:20.853 INFO:teuthology.orchestra.run.smithi044.stderr: 33250K .......... .......... .......... .......... .......... 35% 22.7M 9s 2023-12-03T11:41:20.855 INFO:teuthology.orchestra.run.smithi044.stderr: 33300K .......... .......... .......... .......... .......... 35% 44.2M 9s 2023-12-03T11:41:20.857 INFO:teuthology.orchestra.run.smithi044.stderr: 33350K .......... .......... .......... .......... .......... 35% 17.9M 9s 2023-12-03T11:41:20.859 INFO:teuthology.orchestra.run.smithi044.stderr: 33400K .......... .......... .......... .......... .......... 36% 21.5M 9s 2023-12-03T11:41:20.862 INFO:teuthology.orchestra.run.smithi044.stderr: 33450K .......... .......... .......... .......... .......... 36% 22.8M 9s 2023-12-03T11:41:20.872 INFO:teuthology.orchestra.run.smithi044.stderr: 33500K .......... .......... .......... .......... .......... 36% 5.21M 9s 2023-12-03T11:41:20.872 INFO:teuthology.orchestra.run.smithi044.stderr: 33550K .......... .......... .......... .......... .......... 36% 111M 9s 2023-12-03T11:41:20.873 INFO:teuthology.orchestra.run.smithi044.stderr: 33600K .......... .......... .......... .......... .......... 36% 33.3M 9s 2023-12-03T11:41:20.877 INFO:teuthology.orchestra.run.smithi044.stderr: 33650K .......... .......... .......... .......... .......... 36% 11.9M 9s 2023-12-03T11:41:20.886 INFO:teuthology.orchestra.run.smithi044.stderr: 33700K .......... .......... .......... .......... .......... 36% 5.36M 9s 2023-12-03T11:41:20.889 INFO:teuthology.orchestra.run.smithi044.stderr: 33750K .......... .......... .......... .......... .......... 36% 16.7M 9s 2023-12-03T11:41:20.891 INFO:teuthology.orchestra.run.smithi044.stderr: 33800K .......... .......... .......... .......... .......... 36% 33.4M 9s 2023-12-03T11:41:20.893 INFO:teuthology.orchestra.run.smithi044.stderr: 33850K .......... .......... .......... .......... .......... 36% 18.7M 9s 2023-12-03T11:41:20.895 INFO:teuthology.orchestra.run.smithi044.stderr: 33900K .......... .......... .......... .......... .......... 36% 28.4M 9s 2023-12-03T11:41:20.897 INFO:teuthology.orchestra.run.smithi044.stderr: 33950K .......... .......... .......... .......... .......... 36% 24.1M 9s 2023-12-03T11:41:20.899 INFO:teuthology.orchestra.run.smithi044.stderr: 34000K .......... .......... .......... .......... .......... 36% 22.1M 9s 2023-12-03T11:41:20.900 INFO:teuthology.orchestra.run.smithi044.stderr: 34050K .......... .......... .......... .......... .......... 36% 33.9M 9s 2023-12-03T11:41:20.902 INFO:teuthology.orchestra.run.smithi044.stderr: 34100K .......... .......... .......... .......... .......... 36% 33.0M 9s 2023-12-03T11:41:20.905 INFO:teuthology.orchestra.run.smithi044.stderr: 34150K .......... .......... .......... .......... .......... 36% 23.9M 9s 2023-12-03T11:41:20.906 INFO:teuthology.orchestra.run.smithi044.stderr: 34200K .......... .......... .......... .......... .......... 36% 20.9M 9s 2023-12-03T11:41:20.908 INFO:teuthology.orchestra.run.smithi044.stderr: 34250K .......... .......... .......... .......... .......... 36% 24.5M 9s 2023-12-03T11:41:20.910 INFO:teuthology.orchestra.run.smithi044.stderr: 34300K .......... .......... .......... .......... .......... 36% 30.8M 9s 2023-12-03T11:41:20.911 INFO:teuthology.orchestra.run.smithi044.stderr: 34350K .......... .......... .......... .......... .......... 37% 34.0M 9s 2023-12-03T11:41:20.913 INFO:teuthology.orchestra.run.smithi044.stderr: 34400K .......... .......... .......... .......... .......... 37% 20.5M 9s 2023-12-03T11:41:20.916 INFO:teuthology.orchestra.run.smithi044.stderr: 34450K .......... .......... .......... .......... .......... 37% 25.8M 9s 2023-12-03T11:41:20.917 INFO:teuthology.orchestra.run.smithi044.stderr: 34500K .......... .......... .......... .......... .......... 37% 33.6M 9s 2023-12-03T11:41:20.919 INFO:teuthology.orchestra.run.smithi044.stderr: 34550K .......... .......... .......... .......... .......... 37% 22.8M 9s 2023-12-03T11:41:20.920 INFO:teuthology.orchestra.run.smithi044.stderr: 34600K .......... .......... .......... .......... .......... 37% 34.5M 9s 2023-12-03T11:41:20.922 INFO:teuthology.orchestra.run.smithi044.stderr: 34650K .......... .......... .......... .......... .......... 37% 26.0M 9s 2023-12-03T11:41:20.926 INFO:teuthology.orchestra.run.smithi044.stderr: 34700K .......... .......... .......... .......... .......... 37% 14.9M 9s 2023-12-03T11:41:20.927 INFO:teuthology.orchestra.run.smithi044.stderr: 34750K .......... .......... .......... .......... .......... 37% 97.0M 9s 2023-12-03T11:41:20.928 INFO:teuthology.orchestra.run.smithi044.stderr: 34800K .......... .......... .......... .......... .......... 37% 27.6M 9s 2023-12-03T11:41:20.929 INFO:teuthology.orchestra.run.smithi044.stderr: 34850K .......... .......... .......... .......... .......... 37% 34.4M 9s 2023-12-03T11:41:20.931 INFO:teuthology.orchestra.run.smithi044.stderr: 34900K .......... .......... .......... .......... .......... 37% 27.5M 9s 2023-12-03T11:41:20.933 INFO:teuthology.orchestra.run.smithi044.stderr: 34950K .......... .......... .......... .......... .......... 37% 31.8M 9s 2023-12-03T11:41:20.935 INFO:teuthology.orchestra.run.smithi044.stderr: 35000K .......... .......... .......... .......... .......... 37% 21.7M 9s 2023-12-03T11:41:20.936 INFO:teuthology.orchestra.run.smithi044.stderr: 35050K .......... .......... .......... .......... .......... 37% 36.6M 9s 2023-12-03T11:41:20.939 INFO:teuthology.orchestra.run.smithi044.stderr: 35100K .......... .......... .......... .......... .......... 37% 20.4M 9s 2023-12-03T11:41:20.940 INFO:teuthology.orchestra.run.smithi044.stderr: 35150K .......... .......... .......... .......... .......... 37% 26.3M 9s 2023-12-03T11:41:20.943 INFO:teuthology.orchestra.run.smithi044.stderr: 35200K .......... .......... .......... .......... .......... 37% 23.2M 9s 2023-12-03T11:41:20.955 INFO:teuthology.orchestra.run.smithi044.stderr: 35250K .......... .......... .......... .......... .......... 37% 4.12M 9s 2023-12-03T11:41:20.958 INFO:teuthology.orchestra.run.smithi044.stderr: 35300K .......... .......... .......... .......... .......... 38% 16.0M 9s 2023-12-03T11:41:20.962 INFO:teuthology.orchestra.run.smithi044.stderr: 35350K .......... .......... .......... .......... .......... 38% 12.2M 9s 2023-12-03T11:41:20.975 INFO:teuthology.orchestra.run.smithi044.stderr: 35400K .......... .......... .......... .......... .......... 38% 3.60M 9s 2023-12-03T11:41:20.981 INFO:teuthology.orchestra.run.smithi044.stderr: 35450K .......... .......... .......... .......... .......... 38% 28.5M 9s 2023-12-03T11:41:20.981 INFO:teuthology.orchestra.run.smithi044.stderr: 35500K .......... .......... .......... .......... .......... 38% 105M 9s 2023-12-03T11:41:20.981 INFO:teuthology.orchestra.run.smithi044.stderr: 35550K .......... .......... .......... .......... .......... 38% 77.5M 9s 2023-12-03T11:41:20.981 INFO:teuthology.orchestra.run.smithi044.stderr: 35600K .......... .......... .......... .......... .......... 38% 79.2M 8s 2023-12-03T11:41:20.981 INFO:teuthology.orchestra.run.smithi044.stderr: 35650K .......... .......... .......... .......... .......... 38% 41.6M 8s 2023-12-03T11:41:20.981 INFO:teuthology.orchestra.run.smithi044.stderr: 35700K .......... .......... .......... .......... .......... 38% 43.9M 8s 2023-12-03T11:41:20.983 INFO:teuthology.orchestra.run.smithi044.stderr: 35750K .......... .......... .......... .......... .......... 38% 20.7M 8s 2023-12-03T11:41:20.985 INFO:teuthology.orchestra.run.smithi044.stderr: 35800K .......... .......... .......... .......... .......... 38% 21.7M 8s 2023-12-03T11:41:20.988 INFO:teuthology.orchestra.run.smithi044.stderr: 35850K .......... .......... .......... .......... .......... 38% 22.2M 8s 2023-12-03T11:41:20.992 INFO:teuthology.orchestra.run.smithi044.stderr: 35900K .......... .......... .......... .......... .......... 38% 12.1M 8s 2023-12-03T11:41:20.996 INFO:teuthology.orchestra.run.smithi044.stderr: 35950K .......... .......... .......... .......... .......... 38% 12.4M 8s 2023-12-03T11:41:20.997 INFO:teuthology.orchestra.run.smithi044.stderr: 36000K .......... .......... .......... .......... .......... 38% 93.0M 8s 2023-12-03T11:41:21.000 INFO:teuthology.orchestra.run.smithi044.stderr: 36050K .......... .......... .......... .......... .......... 38% 15.4M 8s 2023-12-03T11:41:21.002 INFO:teuthology.orchestra.run.smithi044.stderr: 36100K .......... .......... .......... .......... .......... 38% 21.7M 8s 2023-12-03T11:41:21.004 INFO:teuthology.orchestra.run.smithi044.stderr: 36150K .......... .......... .......... .......... .......... 38% 28.3M 8s 2023-12-03T11:41:21.008 INFO:teuthology.orchestra.run.smithi044.stderr: 36200K .......... .......... .......... .......... .......... 39% 32.4M 8s 2023-12-03T11:41:21.008 INFO:teuthology.orchestra.run.smithi044.stderr: 36250K .......... .......... .......... .......... .......... 39% 16.7M 8s 2023-12-03T11:41:21.010 INFO:teuthology.orchestra.run.smithi044.stderr: 36300K .......... .......... .......... .......... .......... 39% 20.2M 8s 2023-12-03T11:41:21.013 INFO:teuthology.orchestra.run.smithi044.stderr: 36350K .......... .......... .......... .......... .......... 39% 20.1M 8s 2023-12-03T11:41:21.014 INFO:teuthology.orchestra.run.smithi044.stderr: 36400K .......... .......... .......... .......... .......... 39% 25.7M 8s 2023-12-03T11:41:21.018 INFO:teuthology.orchestra.run.smithi044.stderr: 36450K .......... .......... .......... .......... .......... 39% 13.7M 8s 2023-12-03T11:41:21.019 INFO:teuthology.orchestra.run.smithi044.stderr: 36500K .......... .......... .......... .......... .......... 39% 36.8M 8s 2023-12-03T11:41:21.024 INFO:teuthology.orchestra.run.smithi044.stderr: 36550K .......... .......... .......... .......... .......... 39% 13.2M 8s 2023-12-03T11:41:21.024 INFO:teuthology.orchestra.run.smithi044.stderr: 36600K .......... .......... .......... .......... .......... 39% 101M 8s 2023-12-03T11:41:21.026 INFO:teuthology.orchestra.run.smithi044.stderr: 36650K .......... .......... .......... .......... .......... 39% 44.0M 8s 2023-12-03T11:41:21.026 INFO:teuthology.orchestra.run.smithi044.stderr: 36700K .......... .......... .......... .......... .......... 39% 96.0M 8s 2023-12-03T11:41:21.030 INFO:teuthology.orchestra.run.smithi044.stderr: 36750K .......... .......... .......... .......... .......... 39% 15.0M 8s 2023-12-03T11:41:21.030 INFO:teuthology.orchestra.run.smithi044.stderr: 36800K .......... .......... .......... .......... .......... 39% 103M 8s 2023-12-03T11:41:21.032 INFO:teuthology.orchestra.run.smithi044.stderr: 36850K .......... .......... .......... .......... .......... 39% 19.9M 8s 2023-12-03T11:41:21.032 INFO:teuthology.orchestra.run.smithi044.stderr: 36900K .......... .......... .......... .......... .......... 39% 118M 8s 2023-12-03T11:41:21.035 INFO:teuthology.orchestra.run.smithi044.stderr: 36950K .......... .......... .......... .......... .......... 39% 17.7M 8s 2023-12-03T11:41:21.038 INFO:teuthology.orchestra.run.smithi044.stderr: 37000K .......... .......... .......... .......... .......... 39% 13.6M 8s 2023-12-03T11:41:21.045 INFO:teuthology.orchestra.run.smithi044.stderr: 37050K .......... .......... .......... .......... .......... 39% 7.00M 8s 2023-12-03T11:41:21.049 INFO:teuthology.orchestra.run.smithi044.stderr: 37100K .......... .......... .......... .......... .......... 39% 13.8M 8s 2023-12-03T11:41:21.052 INFO:teuthology.orchestra.run.smithi044.stderr: 37150K .......... .......... .......... .......... .......... 40% 15.5M 8s 2023-12-03T11:41:21.060 INFO:teuthology.orchestra.run.smithi044.stderr: 37200K .......... .......... .......... .......... .......... 40% 6.44M 8s 2023-12-03T11:41:21.063 INFO:teuthology.orchestra.run.smithi044.stderr: 37250K .......... .......... .......... .......... .......... 40% 13.4M 8s 2023-12-03T11:41:21.065 INFO:teuthology.orchestra.run.smithi044.stderr: 37300K .......... .......... .......... .......... .......... 40% 24.0M 8s 2023-12-03T11:41:21.071 INFO:teuthology.orchestra.run.smithi044.stderr: 37350K .......... .......... .......... .......... .......... 40% 17.0M 8s 2023-12-03T11:41:21.071 INFO:teuthology.orchestra.run.smithi044.stderr: 37400K .......... .......... .......... .......... .......... 40% 32.0M 8s 2023-12-03T11:41:21.071 INFO:teuthology.orchestra.run.smithi044.stderr: 37450K .......... .......... .......... .......... .......... 40% 61.3M 8s 2023-12-03T11:41:21.075 INFO:teuthology.orchestra.run.smithi044.stderr: 37500K .......... .......... .......... .......... .......... 40% 13.9M 8s 2023-12-03T11:41:21.075 INFO:teuthology.orchestra.run.smithi044.stderr: 37550K .......... .......... .......... .......... .......... 40% 81.5M 8s 2023-12-03T11:41:21.077 INFO:teuthology.orchestra.run.smithi044.stderr: 37600K .......... .......... .......... .......... .......... 40% 28.4M 8s 2023-12-03T11:41:21.080 INFO:teuthology.orchestra.run.smithi044.stderr: 37650K .......... .......... .......... .......... .......... 40% 14.2M 8s 2023-12-03T11:41:21.085 INFO:teuthology.orchestra.run.smithi044.stderr: 37700K .......... .......... .......... .......... .......... 40% 14.4M 8s 2023-12-03T11:41:21.085 INFO:teuthology.orchestra.run.smithi044.stderr: 37750K .......... .......... .......... .......... .......... 40% 41.7M 8s 2023-12-03T11:41:21.088 INFO:teuthology.orchestra.run.smithi044.stderr: 37800K .......... .......... .......... .......... .......... 40% 21.5M 8s 2023-12-03T11:41:21.092 INFO:teuthology.orchestra.run.smithi044.stderr: 37850K .......... .......... .......... .......... .......... 40% 12.0M 8s 2023-12-03T11:41:21.092 INFO:teuthology.orchestra.run.smithi044.stderr: 37900K .......... .......... .......... .......... .......... 40% 98.2M 8s 2023-12-03T11:41:21.093 INFO:teuthology.orchestra.run.smithi044.stderr: 37950K .......... .......... .......... .......... .......... 40% 22.4M 8s 2023-12-03T11:41:21.095 INFO:teuthology.orchestra.run.smithi044.stderr: 38000K .......... .......... .......... .......... .......... 40% 29.8M 8s 2023-12-03T11:41:21.096 INFO:teuthology.orchestra.run.smithi044.stderr: 38050K .......... .......... .......... .......... .......... 41% 34.2M 8s 2023-12-03T11:41:21.100 INFO:teuthology.orchestra.run.smithi044.stderr: 38100K .......... .......... .......... .......... .......... 41% 12.7M 8s 2023-12-03T11:41:21.103 INFO:teuthology.orchestra.run.smithi044.stderr: 38150K .......... .......... .......... .......... .......... 41% 14.4M 8s 2023-12-03T11:41:21.105 INFO:teuthology.orchestra.run.smithi044.stderr: 38200K .......... .......... .......... .......... .......... 41% 36.5M 8s 2023-12-03T11:41:21.109 INFO:teuthology.orchestra.run.smithi044.stderr: 38250K .......... .......... .......... .......... .......... 41% 15.3M 8s 2023-12-03T11:41:21.109 INFO:teuthology.orchestra.run.smithi044.stderr: 38300K .......... .......... .......... .......... .......... 41% 51.3M 8s 2023-12-03T11:41:21.113 INFO:teuthology.orchestra.run.smithi044.stderr: 38350K .......... .......... .......... .......... .......... 41% 14.3M 8s 2023-12-03T11:41:21.116 INFO:teuthology.orchestra.run.smithi044.stderr: 38400K .......... .......... .......... .......... .......... 41% 13.3M 8s 2023-12-03T11:41:21.117 INFO:teuthology.orchestra.run.smithi044.stderr: 38450K .......... .......... .......... .......... .......... 41% 60.0M 8s 2023-12-03T11:41:21.120 INFO:teuthology.orchestra.run.smithi044.stderr: 38500K .......... .......... .......... .......... .......... 41% 20.2M 8s 2023-12-03T11:41:21.121 INFO:teuthology.orchestra.run.smithi044.stderr: 38550K .......... .......... .......... .......... .......... 41% 110M 8s 2023-12-03T11:41:21.123 INFO:teuthology.orchestra.run.smithi044.stderr: 38600K .......... .......... .......... .......... .......... 41% 17.3M 8s 2023-12-03T11:41:21.125 INFO:teuthology.orchestra.run.smithi044.stderr: 38650K .......... .......... .......... .......... .......... 41% 31.2M 8s 2023-12-03T11:41:21.128 INFO:teuthology.orchestra.run.smithi044.stderr: 38700K .......... .......... .......... .......... .......... 41% 16.1M 8s 2023-12-03T11:41:21.128 INFO:teuthology.orchestra.run.smithi044.stderr: 38750K .......... .......... .......... .......... .......... 41% 94.3M 8s 2023-12-03T11:41:21.130 INFO:teuthology.orchestra.run.smithi044.stderr: 38800K .......... .......... .......... .......... .......... 41% 23.8M 8s 2023-12-03T11:41:21.133 INFO:teuthology.orchestra.run.smithi044.stderr: 38850K .......... .......... .......... .......... .......... 41% 14.5M 8s 2023-12-03T11:41:21.134 INFO:teuthology.orchestra.run.smithi044.stderr: 38900K .......... .......... .......... .......... .......... 41% 33.5M 8s 2023-12-03T11:41:21.136 INFO:teuthology.orchestra.run.smithi044.stderr: 38950K .......... .......... .......... .......... .......... 41% 31.6M 8s 2023-12-03T11:41:21.137 INFO:teuthology.orchestra.run.smithi044.stderr: 39000K .......... .......... .......... .......... .......... 42% 51.7M 8s 2023-12-03T11:41:21.141 INFO:teuthology.orchestra.run.smithi044.stderr: 39050K .......... .......... .......... .......... .......... 42% 11.5M 7s 2023-12-03T11:41:21.150 INFO:teuthology.orchestra.run.smithi044.stderr: 39100K .......... .......... .......... .......... .......... 42% 5.50M 7s 2023-12-03T11:41:21.155 INFO:teuthology.orchestra.run.smithi044.stderr: 39150K .......... .......... .......... .......... .......... 42% 11.8M 7s 2023-12-03T11:41:21.155 INFO:teuthology.orchestra.run.smithi044.stderr: 39200K .......... .......... .......... .......... .......... 42% 70.0M 7s 2023-12-03T11:41:21.158 INFO:teuthology.orchestra.run.smithi044.stderr: 39250K .......... .......... .......... .......... .......... 42% 14.1M 7s 2023-12-03T11:41:21.161 INFO:teuthology.orchestra.run.smithi044.stderr: 39300K .......... .......... .......... .......... .......... 42% 18.8M 7s 2023-12-03T11:41:21.162 INFO:teuthology.orchestra.run.smithi044.stderr: 39350K .......... .......... .......... .......... .......... 42% 41.8M 7s 2023-12-03T11:41:21.164 INFO:teuthology.orchestra.run.smithi044.stderr: 39400K .......... .......... .......... .......... .......... 42% 26.6M 7s 2023-12-03T11:41:21.168 INFO:teuthology.orchestra.run.smithi044.stderr: 39450K .......... .......... .......... .......... .......... 42% 16.5M 7s 2023-12-03T11:41:21.168 INFO:teuthology.orchestra.run.smithi044.stderr: 39500K .......... .......... .......... .......... .......... 42% 92.9M 7s 2023-12-03T11:41:21.172 INFO:teuthology.orchestra.run.smithi044.stderr: 39550K .......... .......... .......... .......... .......... 42% 11.4M 7s 2023-12-03T11:41:21.172 INFO:teuthology.orchestra.run.smithi044.stderr: 39600K .......... .......... .......... .......... .......... 42% 79.3M 7s 2023-12-03T11:41:21.175 INFO:teuthology.orchestra.run.smithi044.stderr: 39650K .......... .......... .......... .......... .......... 42% 16.3M 7s 2023-12-03T11:41:21.180 INFO:teuthology.orchestra.run.smithi044.stderr: 39700K .......... .......... .......... .......... .......... 42% 12.4M 7s 2023-12-03T11:41:21.180 INFO:teuthology.orchestra.run.smithi044.stderr: 39750K .......... .......... .......... .......... .......... 42% 110M 7s 2023-12-03T11:41:21.183 INFO:teuthology.orchestra.run.smithi044.stderr: 39800K .......... .......... .......... .......... .......... 42% 15.0M 7s 2023-12-03T11:41:21.187 INFO:teuthology.orchestra.run.smithi044.stderr: 39850K .......... .......... .......... .......... .......... 42% 15.1M 7s 2023-12-03T11:41:21.187 INFO:teuthology.orchestra.run.smithi044.stderr: 39900K .......... .......... .......... .......... .......... 43% 108M 7s 2023-12-03T11:41:21.188 INFO:teuthology.orchestra.run.smithi044.stderr: 39950K .......... .......... .......... .......... .......... 43% 29.9M 7s 2023-12-03T11:41:21.192 INFO:teuthology.orchestra.run.smithi044.stderr: 40000K .......... .......... .......... .......... .......... 43% 14.6M 7s 2023-12-03T11:41:21.195 INFO:teuthology.orchestra.run.smithi044.stderr: 40050K .......... .......... .......... .......... .......... 43% 16.3M 7s 2023-12-03T11:41:21.199 INFO:teuthology.orchestra.run.smithi044.stderr: 40100K .......... .......... .......... .......... .......... 43% 12.4M 7s 2023-12-03T11:41:21.201 INFO:teuthology.orchestra.run.smithi044.stderr: 40150K .......... .......... .......... .......... .......... 43% 29.2M 7s 2023-12-03T11:41:21.202 INFO:teuthology.orchestra.run.smithi044.stderr: 40200K .......... .......... .......... .......... .......... 43% 32.9M 7s 2023-12-03T11:41:21.204 INFO:teuthology.orchestra.run.smithi044.stderr: 40250K .......... .......... .......... .......... .......... 43% 24.4M 7s 2023-12-03T11:41:21.206 INFO:teuthology.orchestra.run.smithi044.stderr: 40300K .......... .......... .......... .......... .......... 43% 17.6M 7s 2023-12-03T11:41:21.209 INFO:teuthology.orchestra.run.smithi044.stderr: 40350K .......... .......... .......... .......... .......... 43% 21.6M 7s 2023-12-03T11:41:21.214 INFO:teuthology.orchestra.run.smithi044.stderr: 40400K .......... .......... .......... .......... .......... 43% 12.4M 7s 2023-12-03T11:41:21.214 INFO:teuthology.orchestra.run.smithi044.stderr: 40450K .......... .......... .......... .......... .......... 43% 86.3M 7s 2023-12-03T11:41:21.215 INFO:teuthology.orchestra.run.smithi044.stderr: 40500K .......... .......... .......... .......... .......... 43% 25.8M 7s 2023-12-03T11:41:21.217 INFO:teuthology.orchestra.run.smithi044.stderr: 40550K .......... .......... .......... .......... .......... 43% 19.9M 7s 2023-12-03T11:41:21.223 INFO:teuthology.orchestra.run.smithi044.stderr: 40600K .......... .......... .......... .......... .......... 43% 11.7M 7s 2023-12-03T11:41:21.223 INFO:teuthology.orchestra.run.smithi044.stderr: 40650K .......... .......... .......... .......... .......... 43% 96.2M 7s 2023-12-03T11:41:21.225 INFO:teuthology.orchestra.run.smithi044.stderr: 40700K .......... .......... .......... .......... .......... 43% 18.8M 7s 2023-12-03T11:41:21.229 INFO:teuthology.orchestra.run.smithi044.stderr: 40750K .......... .......... .......... .......... .......... 43% 15.6M 7s 2023-12-03T11:41:21.230 INFO:teuthology.orchestra.run.smithi044.stderr: 40800K .......... .......... .......... .......... .......... 43% 50.9M 7s 2023-12-03T11:41:21.230 INFO:teuthology.orchestra.run.smithi044.stderr: 40850K .......... .......... .......... .......... .......... 44% 35.6M 7s 2023-12-03T11:41:21.232 INFO:teuthology.orchestra.run.smithi044.stderr: 40900K .......... .......... .......... .......... .......... 44% 30.1M 7s 2023-12-03T11:41:21.237 INFO:teuthology.orchestra.run.smithi044.stderr: 40950K .......... .......... .......... .......... .......... 44% 10.4M 7s 2023-12-03T11:41:21.240 INFO:teuthology.orchestra.run.smithi044.stderr: 41000K .......... .......... .......... .......... .......... 44% 27.1M 7s 2023-12-03T11:41:21.240 INFO:teuthology.orchestra.run.smithi044.stderr: 41050K .......... .......... .......... .......... .......... 44% 80.9M 7s 2023-12-03T11:41:21.244 INFO:teuthology.orchestra.run.smithi044.stderr: 41100K .......... .......... .......... .......... .......... 44% 9.67M 7s 2023-12-03T11:41:21.245 INFO:teuthology.orchestra.run.smithi044.stderr: 41150K .......... .......... .......... .......... .......... 44% 34.7M 7s 2023-12-03T11:41:21.249 INFO:teuthology.orchestra.run.smithi044.stderr: 41200K .......... .......... .......... .......... .......... 44% 17.6M 7s 2023-12-03T11:41:21.249 INFO:teuthology.orchestra.run.smithi044.stderr: 41250K .......... .......... .......... .......... .......... 44% 89.4M 7s 2023-12-03T11:41:21.250 INFO:teuthology.orchestra.run.smithi044.stderr: 41300K .......... .......... .......... .......... .......... 44% 34.2M 7s 2023-12-03T11:41:21.252 INFO:teuthology.orchestra.run.smithi044.stderr: 41350K .......... .......... .......... .......... .......... 44% 44.1M 7s 2023-12-03T11:41:21.252 INFO:teuthology.orchestra.run.smithi044.stderr: 41400K .......... .......... .......... .......... .......... 44% 69.8M 7s 2023-12-03T11:41:21.254 INFO:teuthology.orchestra.run.smithi044.stderr: 41450K .......... .......... .......... .......... .......... 44% 25.7M 7s 2023-12-03T11:41:21.255 INFO:teuthology.orchestra.run.smithi044.stderr: 41500K .......... .......... .......... .......... .......... 44% 54.9M 7s 2023-12-03T11:41:21.257 INFO:teuthology.orchestra.run.smithi044.stderr: 41550K .......... .......... .......... .......... .......... 44% 28.3M 7s 2023-12-03T11:41:21.260 INFO:teuthology.orchestra.run.smithi044.stderr: 41600K .......... .......... .......... .......... .......... 44% 18.2M 7s 2023-12-03T11:41:21.260 INFO:teuthology.orchestra.run.smithi044.stderr: 41650K .......... .......... .......... .......... .......... 44% 83.8M 7s 2023-12-03T11:41:21.262 INFO:teuthology.orchestra.run.smithi044.stderr: 41700K .......... .......... .......... .......... .......... 44% 38.5M 7s 2023-12-03T11:41:21.262 INFO:teuthology.orchestra.run.smithi044.stderr: 41750K .......... .......... .......... .......... .......... 44% 47.7M 7s 2023-12-03T11:41:21.265 INFO:teuthology.orchestra.run.smithi044.stderr: 41800K .......... .......... .......... .......... .......... 45% 22.6M 7s 2023-12-03T11:41:21.265 INFO:teuthology.orchestra.run.smithi044.stderr: 41850K .......... .......... .......... .......... .......... 45% 86.4M 7s 2023-12-03T11:41:21.266 INFO:teuthology.orchestra.run.smithi044.stderr: 41900K .......... .......... .......... .......... .......... 45% 48.8M 7s 2023-12-03T11:41:21.269 INFO:teuthology.orchestra.run.smithi044.stderr: 41950K .......... .......... .......... .......... .......... 45% 18.9M 7s 2023-12-03T11:41:21.270 INFO:teuthology.orchestra.run.smithi044.stderr: 42000K .......... .......... .......... .......... .......... 45% 32.0M 7s 2023-12-03T11:41:21.271 INFO:teuthology.orchestra.run.smithi044.stderr: 42050K .......... .......... .......... .......... .......... 45% 69.7M 7s 2023-12-03T11:41:21.273 INFO:teuthology.orchestra.run.smithi044.stderr: 42100K .......... .......... .......... .......... .......... 45% 18.4M 7s 2023-12-03T11:41:21.275 INFO:teuthology.orchestra.run.smithi044.stderr: 42150K .......... .......... .......... .......... .......... 45% 28.7M 7s 2023-12-03T11:41:21.279 INFO:teuthology.orchestra.run.smithi044.stderr: 42200K .......... .......... .......... .......... .......... 45% 10.9M 7s 2023-12-03T11:41:21.281 INFO:teuthology.orchestra.run.smithi044.stderr: 42250K .......... .......... .......... .......... .......... 45% 26.3M 7s 2023-12-03T11:41:21.283 INFO:teuthology.orchestra.run.smithi044.stderr: 42300K .......... .......... .......... .......... .......... 45% 28.5M 7s 2023-12-03T11:41:21.285 INFO:teuthology.orchestra.run.smithi044.stderr: 42350K .......... .......... .......... .......... .......... 45% 19.4M 7s 2023-12-03T11:41:21.287 INFO:teuthology.orchestra.run.smithi044.stderr: 42400K .......... .......... .......... .......... .......... 45% 27.1M 7s 2023-12-03T11:41:21.292 INFO:teuthology.orchestra.run.smithi044.stderr: 42450K .......... .......... .......... .......... .......... 45% 10.7M 7s 2023-12-03T11:41:21.294 INFO:teuthology.orchestra.run.smithi044.stderr: 42500K .......... .......... .......... .......... .......... 45% 28.0M 7s 2023-12-03T11:41:21.295 INFO:teuthology.orchestra.run.smithi044.stderr: 42550K .......... .......... .......... .......... .......... 45% 29.2M 7s 2023-12-03T11:41:21.299 INFO:teuthology.orchestra.run.smithi044.stderr: 42600K .......... .......... .......... .......... .......... 45% 14.4M 7s 2023-12-03T11:41:21.307 INFO:teuthology.orchestra.run.smithi044.stderr: 42650K .......... .......... .......... .......... .......... 45% 6.52M 7s 2023-12-03T11:41:21.315 INFO:teuthology.orchestra.run.smithi044.stderr: 42700K .......... .......... .......... .......... .......... 46% 14.1M 7s 2023-12-03T11:41:21.315 INFO:teuthology.orchestra.run.smithi044.stderr: 42750K .......... .......... .......... .......... .......... 46% 86.3M 7s 2023-12-03T11:41:21.315 INFO:teuthology.orchestra.run.smithi044.stderr: 42800K .......... .......... .......... .......... .......... 46% 68.5M 7s 2023-12-03T11:41:21.315 INFO:teuthology.orchestra.run.smithi044.stderr: 42850K .......... .......... .......... .......... .......... 46% 79.3M 7s 2023-12-03T11:41:21.315 INFO:teuthology.orchestra.run.smithi044.stderr: 42900K .......... .......... .......... .......... .......... 46% 99.8M 7s 2023-12-03T11:41:21.315 INFO:teuthology.orchestra.run.smithi044.stderr: 42950K .......... .......... .......... .......... .......... 46% 36.3M 7s 2023-12-03T11:41:21.316 INFO:teuthology.orchestra.run.smithi044.stderr: 43000K .......... .......... .......... .......... .......... 46% 30.1M 7s 2023-12-03T11:41:21.317 INFO:teuthology.orchestra.run.smithi044.stderr: 43050K .......... .......... .......... .......... .......... 46% 22.9M 6s 2023-12-03T11:41:21.319 INFO:teuthology.orchestra.run.smithi044.stderr: 43100K .......... .......... .......... .......... .......... 46% 25.3M 6s 2023-12-03T11:41:21.321 INFO:teuthology.orchestra.run.smithi044.stderr: 43150K .......... .......... .......... .......... .......... 46% 29.0M 6s 2023-12-03T11:41:21.322 INFO:teuthology.orchestra.run.smithi044.stderr: 43200K .......... .......... .......... .......... .......... 46% 26.3M 6s 2023-12-03T11:41:21.326 INFO:teuthology.orchestra.run.smithi044.stderr: 43250K .......... .......... .......... .......... .......... 46% 13.5M 6s 2023-12-03T11:41:21.329 INFO:teuthology.orchestra.run.smithi044.stderr: 43300K .......... .......... .......... .......... .......... 46% 18.0M 6s 2023-12-03T11:41:21.330 INFO:teuthology.orchestra.run.smithi044.stderr: 43350K .......... .......... .......... .......... .......... 46% 32.8M 6s 2023-12-03T11:41:21.332 INFO:teuthology.orchestra.run.smithi044.stderr: 43400K .......... .......... .......... .......... .......... 46% 30.2M 6s 2023-12-03T11:41:21.333 INFO:teuthology.orchestra.run.smithi044.stderr: 43450K .......... .......... .......... .......... .......... 46% 35.5M 6s 2023-12-03T11:41:21.336 INFO:teuthology.orchestra.run.smithi044.stderr: 43500K .......... .......... .......... .......... .......... 46% 22.8M 6s 2023-12-03T11:41:21.337 INFO:teuthology.orchestra.run.smithi044.stderr: 43550K .......... .......... .......... .......... .......... 46% 25.0M 6s 2023-12-03T11:41:21.339 INFO:teuthology.orchestra.run.smithi044.stderr: 43600K .......... .......... .......... .......... .......... 46% 32.1M 6s 2023-12-03T11:41:21.341 INFO:teuthology.orchestra.run.smithi044.stderr: 43650K .......... .......... .......... .......... .......... 47% 25.7M 6s 2023-12-03T11:41:21.342 INFO:teuthology.orchestra.run.smithi044.stderr: 43700K .......... .......... .......... .......... .......... 47% 33.3M 6s 2023-12-03T11:41:21.345 INFO:teuthology.orchestra.run.smithi044.stderr: 43750K .......... .......... .......... .......... .......... 47% 22.4M 6s 2023-12-03T11:41:21.346 INFO:teuthology.orchestra.run.smithi044.stderr: 43800K .......... .......... .......... .......... .......... 47% 39.9M 6s 2023-12-03T11:41:21.348 INFO:teuthology.orchestra.run.smithi044.stderr: 43850K .......... .......... .......... .......... .......... 47% 25.3M 6s 2023-12-03T11:41:21.350 INFO:teuthology.orchestra.run.smithi044.stderr: 43900K .......... .......... .......... .......... .......... 47% 24.8M 6s 2023-12-03T11:41:21.351 INFO:teuthology.orchestra.run.smithi044.stderr: 43950K .......... .......... .......... .......... .......... 47% 43.9M 6s 2023-12-03T11:41:21.352 INFO:teuthology.orchestra.run.smithi044.stderr: 44000K .......... .......... .......... .......... .......... 47% 29.4M 6s 2023-12-03T11:41:21.354 INFO:teuthology.orchestra.run.smithi044.stderr: 44050K .......... .......... .......... .......... .......... 47% 42.6M 6s 2023-12-03T11:41:21.356 INFO:teuthology.orchestra.run.smithi044.stderr: 44100K .......... .......... .......... .......... .......... 47% 28.5M 6s 2023-12-03T11:41:21.358 INFO:teuthology.orchestra.run.smithi044.stderr: 44150K .......... .......... .......... .......... .......... 47% 30.7M 6s 2023-12-03T11:41:21.359 INFO:teuthology.orchestra.run.smithi044.stderr: 44200K .......... .......... .......... .......... .......... 47% 23.0M 6s 2023-12-03T11:41:21.363 INFO:teuthology.orchestra.run.smithi044.stderr: 44250K .......... .......... .......... .......... .......... 47% 15.0M 6s 2023-12-03T11:41:21.363 INFO:teuthology.orchestra.run.smithi044.stderr: 44300K .......... .......... .......... .......... .......... 47% 79.0M 6s 2023-12-03T11:41:21.365 INFO:teuthology.orchestra.run.smithi044.stderr: 44350K .......... .......... .......... .......... .......... 47% 38.0M 6s 2023-12-03T11:41:21.365 INFO:teuthology.orchestra.run.smithi044.stderr: 44400K .......... .......... .......... .......... .......... 47% 43.2M 6s 2023-12-03T11:41:21.367 INFO:teuthology.orchestra.run.smithi044.stderr: 44450K .......... .......... .......... .......... .......... 47% 26.7M 6s 2023-12-03T11:41:21.368 INFO:teuthology.orchestra.run.smithi044.stderr: 44500K .......... .......... .......... .......... .......... 47% 41.7M 6s 2023-12-03T11:41:21.370 INFO:teuthology.orchestra.run.smithi044.stderr: 44550K .......... .......... .......... .......... .......... 48% 28.2M 6s 2023-12-03T11:41:21.373 INFO:teuthology.orchestra.run.smithi044.stderr: 44600K .......... .......... .......... .......... .......... 48% 14.7M 6s 2023-12-03T11:41:21.375 INFO:teuthology.orchestra.run.smithi044.stderr: 44650K .......... .......... .......... .......... .......... 48% 47.4M 6s 2023-12-03T11:41:21.377 INFO:teuthology.orchestra.run.smithi044.stderr: 44700K .......... .......... .......... .......... .......... 48% 18.1M 6s 2023-12-03T11:41:21.378 INFO:teuthology.orchestra.run.smithi044.stderr: 44750K .......... .......... .......... .......... .......... 48% 38.7M 6s 2023-12-03T11:41:21.381 INFO:teuthology.orchestra.run.smithi044.stderr: 44800K .......... .......... .......... .......... .......... 48% 19.1M 6s 2023-12-03T11:41:21.389 INFO:teuthology.orchestra.run.smithi044.stderr: 44850K .......... .......... .......... .......... .......... 48% 6.27M 6s 2023-12-03T11:41:21.393 INFO:teuthology.orchestra.run.smithi044.stderr: 44900K .......... .......... .......... .......... .......... 48% 11.3M 6s 2023-12-03T11:41:21.395 INFO:teuthology.orchestra.run.smithi044.stderr: 44950K .......... .......... .......... .......... .......... 48% 24.7M 6s 2023-12-03T11:41:21.396 INFO:teuthology.orchestra.run.smithi044.stderr: 45000K .......... .......... .......... .......... .......... 48% 40.3M 6s 2023-12-03T11:41:21.399 INFO:teuthology.orchestra.run.smithi044.stderr: 45050K .......... .......... .......... .......... .......... 48% 21.6M 6s 2023-12-03T11:41:21.400 INFO:teuthology.orchestra.run.smithi044.stderr: 45100K .......... .......... .......... .......... .......... 48% 38.3M 6s 2023-12-03T11:41:21.402 INFO:teuthology.orchestra.run.smithi044.stderr: 45150K .......... .......... .......... .......... .......... 48% 23.5M 6s 2023-12-03T11:41:21.403 INFO:teuthology.orchestra.run.smithi044.stderr: 45200K .......... .......... .......... .......... .......... 48% 36.8M 6s 2023-12-03T11:41:21.405 INFO:teuthology.orchestra.run.smithi044.stderr: 45250K .......... .......... .......... .......... .......... 48% 26.1M 6s 2023-12-03T11:41:21.406 INFO:teuthology.orchestra.run.smithi044.stderr: 45300K .......... .......... .......... .......... .......... 48% 39.8M 6s 2023-12-03T11:41:21.408 INFO:teuthology.orchestra.run.smithi044.stderr: 45350K .......... .......... .......... .......... .......... 48% 23.0M 6s 2023-12-03T11:41:21.411 INFO:teuthology.orchestra.run.smithi044.stderr: 45400K .......... .......... .......... .......... .......... 48% 20.4M 6s 2023-12-03T11:41:21.412 INFO:teuthology.orchestra.run.smithi044.stderr: 45450K .......... .......... .......... .......... .......... 48% 48.4M 6s 2023-12-03T11:41:21.414 INFO:teuthology.orchestra.run.smithi044.stderr: 45500K .......... .......... .......... .......... .......... 49% 22.3M 6s 2023-12-03T11:41:21.415 INFO:teuthology.orchestra.run.smithi044.stderr: 45550K .......... .......... .......... .......... .......... 49% 36.0M 6s 2023-12-03T11:41:21.418 INFO:teuthology.orchestra.run.smithi044.stderr: 45600K .......... .......... .......... .......... .......... 49% 21.5M 6s 2023-12-03T11:41:21.420 INFO:teuthology.orchestra.run.smithi044.stderr: 45650K .......... .......... .......... .......... .......... 49% 25.6M 6s 2023-12-03T11:41:21.421 INFO:teuthology.orchestra.run.smithi044.stderr: 45700K .......... .......... .......... .......... .......... 49% 40.1M 6s 2023-12-03T11:41:21.423 INFO:teuthology.orchestra.run.smithi044.stderr: 45750K .......... .......... .......... .......... .......... 49% 21.5M 6s 2023-12-03T11:41:21.425 INFO:teuthology.orchestra.run.smithi044.stderr: 45800K .......... .......... .......... .......... .......... 49% 29.0M 6s 2023-12-03T11:41:21.427 INFO:teuthology.orchestra.run.smithi044.stderr: 45850K .......... .......... .......... .......... .......... 49% 19.9M 6s 2023-12-03T11:41:21.431 INFO:teuthology.orchestra.run.smithi044.stderr: 45900K .......... .......... .......... .......... .......... 49% 24.5M 6s 2023-12-03T11:41:21.431 INFO:teuthology.orchestra.run.smithi044.stderr: 45950K .......... .......... .......... .......... .......... 49% 34.3M 6s 2023-12-03T11:41:21.434 INFO:teuthology.orchestra.run.smithi044.stderr: 46000K .......... .......... .......... .......... .......... 49% 16.7M 6s 2023-12-03T11:41:21.435 INFO:teuthology.orchestra.run.smithi044.stderr: 46050K .......... .......... .......... .......... .......... 49% 45.1M 6s 2023-12-03T11:41:21.437 INFO:teuthology.orchestra.run.smithi044.stderr: 46100K .......... .......... .......... .......... .......... 49% 22.8M 6s 2023-12-03T11:41:21.438 INFO:teuthology.orchestra.run.smithi044.stderr: 46150K .......... .......... .......... .......... .......... 49% 37.4M 6s 2023-12-03T11:41:21.440 INFO:teuthology.orchestra.run.smithi044.stderr: 46200K .......... .......... .......... .......... .......... 49% 27.6M 6s 2023-12-03T11:41:21.442 INFO:teuthology.orchestra.run.smithi044.stderr: 46250K .......... .......... .......... .......... .......... 49% 32.1M 6s 2023-12-03T11:41:21.443 INFO:teuthology.orchestra.run.smithi044.stderr: 46300K .......... .......... .......... .......... .......... 49% 28.8M 6s 2023-12-03T11:41:21.444 INFO:teuthology.orchestra.run.smithi044.stderr: 46350K .......... .......... .......... .......... .......... 49% 39.9M 6s 2023-12-03T11:41:21.447 INFO:teuthology.orchestra.run.smithi044.stderr: 46400K .......... .......... .......... .......... .......... 49% 20.3M 6s 2023-12-03T11:41:21.449 INFO:teuthology.orchestra.run.smithi044.stderr: 46450K .......... .......... .......... .......... .......... 50% 25.4M 6s 2023-12-03T11:41:21.450 INFO:teuthology.orchestra.run.smithi044.stderr: 46500K .......... .......... .......... .......... .......... 50% 37.4M 6s 2023-12-03T11:41:21.452 INFO:teuthology.orchestra.run.smithi044.stderr: 46550K .......... .......... .......... .......... .......... 50% 18.5M 6s 2023-12-03T11:41:21.454 INFO:teuthology.orchestra.run.smithi044.stderr: 46600K .......... .......... .......... .......... .......... 50% 39.0M 6s 2023-12-03T11:41:21.456 INFO:teuthology.orchestra.run.smithi044.stderr: 46650K .......... .......... .......... .......... .......... 50% 25.2M 6s 2023-12-03T11:41:21.458 INFO:teuthology.orchestra.run.smithi044.stderr: 46700K .......... .......... .......... .......... .......... 50% 24.3M 6s 2023-12-03T11:41:21.459 INFO:teuthology.orchestra.run.smithi044.stderr: 46750K .......... .......... .......... .......... .......... 50% 45.2M 6s 2023-12-03T11:41:21.461 INFO:teuthology.orchestra.run.smithi044.stderr: 46800K .......... .......... .......... .......... .......... 50% 24.4M 6s 2023-12-03T11:41:21.462 INFO:teuthology.orchestra.run.smithi044.stderr: 46850K .......... .......... .......... .......... .......... 50% 34.7M 6s 2023-12-03T11:41:21.466 INFO:teuthology.orchestra.run.smithi044.stderr: 46900K .......... .......... .......... .......... .......... 50% 18.1M 6s 2023-12-03T11:41:21.466 INFO:teuthology.orchestra.run.smithi044.stderr: 46950K .......... .......... .......... .......... .......... 50% 61.4M 6s 2023-12-03T11:41:21.469 INFO:teuthology.orchestra.run.smithi044.stderr: 47000K .......... .......... .......... .......... .......... 50% 17.6M 6s 2023-12-03T11:41:21.470 INFO:teuthology.orchestra.run.smithi044.stderr: 47050K .......... .......... .......... .......... .......... 50% 31.3M 6s 2023-12-03T11:41:21.480 INFO:teuthology.orchestra.run.smithi044.stderr: 47100K .......... .......... .......... .......... .......... 50% 5.01M 6s 2023-12-03T11:41:21.481 INFO:teuthology.orchestra.run.smithi044.stderr: 47150K .......... .......... .......... .......... .......... 50% 51.0M 6s 2023-12-03T11:41:21.486 INFO:teuthology.orchestra.run.smithi044.stderr: 47200K .......... .......... .......... .......... .......... 50% 11.4M 6s 2023-12-03T11:41:21.487 INFO:teuthology.orchestra.run.smithi044.stderr: 47250K .......... .......... .......... .......... .......... 50% 23.7M 6s 2023-12-03T11:41:21.488 INFO:teuthology.orchestra.run.smithi044.stderr: 47300K .......... .......... .......... .......... .......... 50% 38.7M 6s 2023-12-03T11:41:21.490 INFO:teuthology.orchestra.run.smithi044.stderr: 47350K .......... .......... .......... .......... .......... 51% 22.7M 6s 2023-12-03T11:41:21.492 INFO:teuthology.orchestra.run.smithi044.stderr: 47400K .......... .......... .......... .......... .......... 51% 45.2M 6s 2023-12-03T11:41:21.493 INFO:teuthology.orchestra.run.smithi044.stderr: 47450K .......... .......... .......... .......... .......... 51% 25.3M 6s 2023-12-03T11:41:21.497 INFO:teuthology.orchestra.run.smithi044.stderr: 47500K .......... .......... .......... .......... .......... 51% 26.1M 6s 2023-12-03T11:41:21.497 INFO:teuthology.orchestra.run.smithi044.stderr: 47550K .......... .......... .......... .......... .......... 51% 72.0M 6s 2023-12-03T11:41:21.498 INFO:teuthology.orchestra.run.smithi044.stderr: 47600K .......... .......... .......... .......... .......... 51% 30.0M 6s 2023-12-03T11:41:21.499 INFO:teuthology.orchestra.run.smithi044.stderr: 47650K .......... .......... .......... .......... .......... 51% 38.2M 6s 2023-12-03T11:41:21.501 INFO:teuthology.orchestra.run.smithi044.stderr: 47700K .......... .......... .......... .......... .......... 51% 31.0M 5s 2023-12-03T11:41:21.503 INFO:teuthology.orchestra.run.smithi044.stderr: 47750K .......... .......... .......... .......... .......... 51% 26.1M 5s 2023-12-03T11:41:21.504 INFO:teuthology.orchestra.run.smithi044.stderr: 47800K .......... .......... .......... .......... .......... 51% 36.6M 5s 2023-12-03T11:41:21.506 INFO:teuthology.orchestra.run.smithi044.stderr: 47850K .......... .......... .......... .......... .......... 51% 23.7M 5s 2023-12-03T11:41:21.507 INFO:teuthology.orchestra.run.smithi044.stderr: 47900K .......... .......... .......... .......... .......... 51% 37.0M 5s 2023-12-03T11:41:21.509 INFO:teuthology.orchestra.run.smithi044.stderr: 47950K .......... .......... .......... .......... .......... 51% 25.0M 5s 2023-12-03T11:41:21.511 INFO:teuthology.orchestra.run.smithi044.stderr: 48000K .......... .......... .......... .......... .......... 51% 26.4M 5s 2023-12-03T11:41:21.513 INFO:teuthology.orchestra.run.smithi044.stderr: 48050K .......... .......... .......... .......... .......... 51% 28.8M 5s 2023-12-03T11:41:21.514 INFO:teuthology.orchestra.run.smithi044.stderr: 48100K .......... .......... .......... .......... .......... 51% 50.4M 5s 2023-12-03T11:41:21.517 INFO:teuthology.orchestra.run.smithi044.stderr: 48150K .......... .......... .......... .......... .......... 51% 20.6M 5s 2023-12-03T11:41:21.518 INFO:teuthology.orchestra.run.smithi044.stderr: 48200K .......... .......... .......... .......... .......... 51% 70.5M 5s 2023-12-03T11:41:21.519 INFO:teuthology.orchestra.run.smithi044.stderr: 48250K .......... .......... .......... .......... .......... 51% 26.0M 5s 2023-12-03T11:41:21.521 INFO:teuthology.orchestra.run.smithi044.stderr: 48300K .......... .......... .......... .......... .......... 52% 21.1M 5s 2023-12-03T11:41:21.522 INFO:teuthology.orchestra.run.smithi044.stderr: 48350K .......... .......... .......... .......... .......... 52% 33.2M 5s 2023-12-03T11:41:21.525 INFO:teuthology.orchestra.run.smithi044.stderr: 48400K .......... .......... .......... .......... .......... 52% 21.8M 5s 2023-12-03T11:41:21.526 INFO:teuthology.orchestra.run.smithi044.stderr: 48450K .......... .......... .......... .......... .......... 52% 35.2M 5s 2023-12-03T11:41:21.528 INFO:teuthology.orchestra.run.smithi044.stderr: 48500K .......... .......... .......... .......... .......... 52% 25.6M 5s 2023-12-03T11:41:21.529 INFO:teuthology.orchestra.run.smithi044.stderr: 48550K .......... .......... .......... .......... .......... 52% 32.3M 5s 2023-12-03T11:41:21.532 INFO:teuthology.orchestra.run.smithi044.stderr: 48600K .......... .......... .......... .......... .......... 52% 27.0M 5s 2023-12-03T11:41:21.533 INFO:teuthology.orchestra.run.smithi044.stderr: 48650K .......... .......... .......... .......... .......... 52% 27.7M 5s 2023-12-03T11:41:21.536 INFO:teuthology.orchestra.run.smithi044.stderr: 48700K .......... .......... .......... .......... .......... 52% 29.3M 5s 2023-12-03T11:41:21.537 INFO:teuthology.orchestra.run.smithi044.stderr: 48750K .......... .......... .......... .......... .......... 52% 26.4M 5s 2023-12-03T11:41:21.538 INFO:teuthology.orchestra.run.smithi044.stderr: 48800K .......... .......... .......... .......... .......... 52% 28.5M 5s 2023-12-03T11:41:21.539 INFO:teuthology.orchestra.run.smithi044.stderr: 48850K .......... .......... .......... .......... .......... 52% 42.3M 5s 2023-12-03T11:41:21.543 INFO:teuthology.orchestra.run.smithi044.stderr: 48900K .......... .......... .......... .......... .......... 52% 17.1M 5s 2023-12-03T11:41:21.543 INFO:teuthology.orchestra.run.smithi044.stderr: 48950K .......... .......... .......... .......... .......... 52% 70.2M 5s 2023-12-03T11:41:21.545 INFO:teuthology.orchestra.run.smithi044.stderr: 49000K .......... .......... .......... .......... .......... 52% 25.2M 5s 2023-12-03T11:41:21.547 INFO:teuthology.orchestra.run.smithi044.stderr: 49050K .......... .......... .......... .......... .......... 52% 22.3M 5s 2023-12-03T11:41:21.548 INFO:teuthology.orchestra.run.smithi044.stderr: 49100K .......... .......... .......... .......... .......... 52% 42.5M 5s 2023-12-03T11:41:21.550 INFO:teuthology.orchestra.run.smithi044.stderr: 49150K .......... .......... .......... .......... .......... 52% 26.2M 5s 2023-12-03T11:41:21.552 INFO:teuthology.orchestra.run.smithi044.stderr: 49200K .......... .......... .......... .......... .......... 53% 31.3M 5s 2023-12-03T11:41:21.554 INFO:teuthology.orchestra.run.smithi044.stderr: 49250K .......... .......... .......... .......... .......... 53% 25.6M 5s 2023-12-03T11:41:21.556 INFO:teuthology.orchestra.run.smithi044.stderr: 49300K .......... .......... .......... .......... .......... 53% 28.3M 5s 2023-12-03T11:41:21.558 INFO:teuthology.orchestra.run.smithi044.stderr: 49350K .......... .......... .......... .......... .......... 53% 24.5M 5s 2023-12-03T11:41:21.560 INFO:teuthology.orchestra.run.smithi044.stderr: 49400K .......... .......... .......... .......... .......... 53% 37.5M 5s 2023-12-03T11:41:21.561 INFO:teuthology.orchestra.run.smithi044.stderr: 49450K .......... .......... .......... .......... .......... 53% 23.0M 5s 2023-12-03T11:41:21.569 INFO:teuthology.orchestra.run.smithi044.stderr: 49500K .......... .......... .......... .......... .......... 53% 6.24M 5s 2023-12-03T11:41:21.570 INFO:teuthology.orchestra.run.smithi044.stderr: 49550K .......... .......... .......... .......... .......... 53% 42.5M 5s 2023-12-03T11:41:21.574 INFO:teuthology.orchestra.run.smithi044.stderr: 49600K .......... .......... .......... .......... .......... 53% 12.8M 5s 2023-12-03T11:41:21.574 INFO:teuthology.orchestra.run.smithi044.stderr: 49650K .......... .......... .......... .......... .......... 53% 42.3M 5s 2023-12-03T11:41:21.576 INFO:teuthology.orchestra.run.smithi044.stderr: 49700K .......... .......... .......... .......... .......... 53% 29.8M 5s 2023-12-03T11:41:21.579 INFO:teuthology.orchestra.run.smithi044.stderr: 49750K .......... .......... .......... .......... .......... 53% 36.1M 5s 2023-12-03T11:41:21.580 INFO:teuthology.orchestra.run.smithi044.stderr: 49800K .......... .......... .......... .......... .......... 53% 28.5M 5s 2023-12-03T11:41:21.581 INFO:teuthology.orchestra.run.smithi044.stderr: 49850K .......... .......... .......... .......... .......... 53% 28.2M 5s 2023-12-03T11:41:21.582 INFO:teuthology.orchestra.run.smithi044.stderr: 49900K .......... .......... .......... .......... .......... 53% 36.9M 5s 2023-12-03T11:41:21.584 INFO:teuthology.orchestra.run.smithi044.stderr: 49950K .......... .......... .......... .......... .......... 53% 32.7M 5s 2023-12-03T11:41:21.585 INFO:teuthology.orchestra.run.smithi044.stderr: 50000K .......... .......... .......... .......... .......... 53% 39.9M 5s 2023-12-03T11:41:21.587 INFO:teuthology.orchestra.run.smithi044.stderr: 50050K .......... .......... .......... .......... .......... 53% 28.4M 5s 2023-12-03T11:41:21.589 INFO:teuthology.orchestra.run.smithi044.stderr: 50100K .......... .......... .......... .......... .......... 53% 25.6M 5s 2023-12-03T11:41:21.590 INFO:teuthology.orchestra.run.smithi044.stderr: 50150K .......... .......... .......... .......... .......... 54% 47.8M 5s 2023-12-03T11:41:21.591 INFO:teuthology.orchestra.run.smithi044.stderr: 50200K .......... .......... .......... .......... .......... 54% 27.6M 5s 2023-12-03T11:41:21.593 INFO:teuthology.orchestra.run.smithi044.stderr: 50250K .......... .......... .......... .......... .......... 54% 41.1M 5s 2023-12-03T11:41:21.595 INFO:teuthology.orchestra.run.smithi044.stderr: 50300K .......... .......... .......... .......... .......... 54% 26.8M 5s 2023-12-03T11:41:21.596 INFO:teuthology.orchestra.run.smithi044.stderr: 50350K .......... .......... .......... .......... .......... 54% 42.4M 5s 2023-12-03T11:41:21.597 INFO:teuthology.orchestra.run.smithi044.stderr: 50400K .......... .......... .......... .......... .......... 54% 28.1M 5s 2023-12-03T11:41:21.601 INFO:teuthology.orchestra.run.smithi044.stderr: 50450K .......... .......... .......... .......... .......... 54% 11.1M 5s 2023-12-03T11:41:21.604 INFO:teuthology.orchestra.run.smithi044.stderr: 50500K .......... .......... .......... .......... .......... 54% 63.6M 5s 2023-12-03T11:41:21.604 INFO:teuthology.orchestra.run.smithi044.stderr: 50550K .......... .......... .......... .......... .......... 54% 205M 5s 2023-12-03T11:41:21.609 INFO:teuthology.orchestra.run.smithi044.stderr: 50600K .......... .......... .......... .......... .......... 54% 9.27M 5s 2023-12-03T11:41:21.609 INFO:teuthology.orchestra.run.smithi044.stderr: 50650K .......... .......... .......... .......... .......... 54% 108M 5s 2023-12-03T11:41:21.613 INFO:teuthology.orchestra.run.smithi044.stderr: 50700K .......... .......... .......... .......... .......... 54% 11.5M 5s 2023-12-03T11:41:21.631 INFO:teuthology.orchestra.run.smithi044.stderr: 50750K .......... .......... .......... .......... .......... 54% 11.5M 5s 2023-12-03T11:41:21.631 INFO:teuthology.orchestra.run.smithi044.stderr: 50800K .......... .......... .......... .......... .......... 54% 111M 5s 2023-12-03T11:41:21.631 INFO:teuthology.orchestra.run.smithi044.stderr: 50850K .......... .......... .......... .......... .......... 54% 108M 5s 2023-12-03T11:41:21.631 INFO:teuthology.orchestra.run.smithi044.stderr: 50900K .......... .......... .......... .......... .......... 54% 106M 5s 2023-12-03T11:41:21.631 INFO:teuthology.orchestra.run.smithi044.stderr: 50950K .......... .......... .......... .......... .......... 54% 99.3M 5s 2023-12-03T11:41:21.631 INFO:teuthology.orchestra.run.smithi044.stderr: 51000K .......... .......... .......... .......... .......... 54% 83.1M 5s 2023-12-03T11:41:21.631 INFO:teuthology.orchestra.run.smithi044.stderr: 51050K .......... .......... .......... .......... .......... 55% 106M 5s 2023-12-03T11:41:21.631 INFO:teuthology.orchestra.run.smithi044.stderr: 51100K .......... .......... .......... .......... .......... 55% 89.5M 5s 2023-12-03T11:41:21.631 INFO:teuthology.orchestra.run.smithi044.stderr: 51150K .......... .......... .......... .......... .......... 55% 135M 5s 2023-12-03T11:41:21.631 INFO:teuthology.orchestra.run.smithi044.stderr: 51200K .......... .......... .......... .......... .......... 55% 93.8M 5s 2023-12-03T11:41:21.631 INFO:teuthology.orchestra.run.smithi044.stderr: 51250K .......... .......... .......... .......... .......... 55% 33.7M 5s 2023-12-03T11:41:21.631 INFO:teuthology.orchestra.run.smithi044.stderr: 51300K .......... .......... .......... .......... .......... 55% 84.1M 5s 2023-12-03T11:41:21.631 INFO:teuthology.orchestra.run.smithi044.stderr: 51350K .......... .......... .......... .......... .......... 55% 22.9M 5s 2023-12-03T11:41:21.631 INFO:teuthology.orchestra.run.smithi044.stderr: 51400K .......... .......... .......... .......... .......... 55% 27.3M 5s 2023-12-03T11:41:21.632 INFO:teuthology.orchestra.run.smithi044.stderr: 51450K .......... .......... .......... .......... .......... 55% 36.0M 5s 2023-12-03T11:41:21.632 INFO:teuthology.orchestra.run.smithi044.stderr: 51500K .......... .......... .......... .......... .......... 55% 48.0M 5s 2023-12-03T11:41:21.633 INFO:teuthology.orchestra.run.smithi044.stderr: 51550K .......... .......... .......... .......... .......... 55% 29.4M 5s 2023-12-03T11:41:21.633 INFO:teuthology.orchestra.run.smithi044.stderr: 51600K .......... .......... .......... .......... .......... 55% 28.5M 5s 2023-12-03T11:41:21.637 INFO:teuthology.orchestra.run.smithi044.stderr: 51650K .......... .......... .......... .......... .......... 55% 17.9M 5s 2023-12-03T11:41:21.637 INFO:teuthology.orchestra.run.smithi044.stderr: 51700K .......... .......... .......... .......... .......... 55% 107M 5s 2023-12-03T11:41:21.647 INFO:teuthology.orchestra.run.smithi044.stderr: 51750K .......... .......... .......... .......... .......... 55% 8.25M 5s 2023-12-03T11:41:21.647 INFO:teuthology.orchestra.run.smithi044.stderr: 51800K .......... .......... .......... .......... .......... 55% 157M 5s 2023-12-03T11:41:21.647 INFO:teuthology.orchestra.run.smithi044.stderr: 51850K .......... .......... .......... .......... .......... 55% 105M 5s 2023-12-03T11:41:21.647 INFO:teuthology.orchestra.run.smithi044.stderr: 51900K .......... .......... .......... .......... .......... 55% 84.7M 5s 2023-12-03T11:41:21.647 INFO:teuthology.orchestra.run.smithi044.stderr: 51950K .......... .......... .......... .......... .......... 55% 28.8M 5s 2023-12-03T11:41:21.647 INFO:teuthology.orchestra.run.smithi044.stderr: 52000K .......... .......... .......... .......... .......... 56% 30.8M 5s 2023-12-03T11:41:21.653 INFO:teuthology.orchestra.run.smithi044.stderr: 52050K .......... .......... .......... .......... .......... 56% 7.94M 5s 2023-12-03T11:41:21.655 INFO:teuthology.orchestra.run.smithi044.stderr: 52100K .......... .......... .......... .......... .......... 56% 22.4M 5s 2023-12-03T11:41:21.658 INFO:teuthology.orchestra.run.smithi044.stderr: 52150K .......... .......... .......... .......... .......... 56% 20.5M 5s 2023-12-03T11:41:21.659 INFO:teuthology.orchestra.run.smithi044.stderr: 52200K .......... .......... .......... .......... .......... 56% 25.6M 5s 2023-12-03T11:41:21.660 INFO:teuthology.orchestra.run.smithi044.stderr: 52250K .......... .......... .......... .......... .......... 56% 68.8M 5s 2023-12-03T11:41:21.662 INFO:teuthology.orchestra.run.smithi044.stderr: 52300K .......... .......... .......... .......... .......... 56% 40.2M 5s 2023-12-03T11:41:21.663 INFO:teuthology.orchestra.run.smithi044.stderr: 52350K .......... .......... .......... .......... .......... 56% 26.7M 5s 2023-12-03T11:41:21.665 INFO:teuthology.orchestra.run.smithi044.stderr: 52400K .......... .......... .......... .......... .......... 56% 29.0M 5s 2023-12-03T11:41:21.666 INFO:teuthology.orchestra.run.smithi044.stderr: 52450K .......... .......... .......... .......... .......... 56% 35.5M 5s 2023-12-03T11:41:21.667 INFO:teuthology.orchestra.run.smithi044.stderr: 52500K .......... .......... .......... .......... .......... 56% 33.9M 5s 2023-12-03T11:41:21.669 INFO:teuthology.orchestra.run.smithi044.stderr: 52550K .......... .......... .......... .......... .......... 56% 40.3M 5s 2023-12-03T11:41:21.671 INFO:teuthology.orchestra.run.smithi044.stderr: 52600K .......... .......... .......... .......... .......... 56% 24.9M 5s 2023-12-03T11:41:21.673 INFO:teuthology.orchestra.run.smithi044.stderr: 52650K .......... .......... .......... .......... .......... 56% 24.8M 5s 2023-12-03T11:41:21.674 INFO:teuthology.orchestra.run.smithi044.stderr: 52700K .......... .......... .......... .......... .......... 56% 46.9M 5s 2023-12-03T11:41:21.675 INFO:teuthology.orchestra.run.smithi044.stderr: 52750K .......... .......... .......... .......... .......... 56% 27.8M 5s 2023-12-03T11:41:21.677 INFO:teuthology.orchestra.run.smithi044.stderr: 52800K .......... .......... .......... .......... .......... 56% 34.0M 5s 2023-12-03T11:41:21.679 INFO:teuthology.orchestra.run.smithi044.stderr: 52850K .......... .......... .......... .......... .......... 56% 25.1M 5s 2023-12-03T11:41:21.681 INFO:teuthology.orchestra.run.smithi044.stderr: 52900K .......... .......... .......... .......... .......... 56% 27.0M 5s 2023-12-03T11:41:21.681 INFO:teuthology.orchestra.run.smithi044.stderr: 52950K .......... .......... .......... .......... .......... 57% 66.3M 5s 2023-12-03T11:41:21.685 INFO:teuthology.orchestra.run.smithi044.stderr: 53000K .......... .......... .......... .......... .......... 57% 14.2M 5s 2023-12-03T11:41:21.687 INFO:teuthology.orchestra.run.smithi044.stderr: 53050K .......... .......... .......... .......... .......... 57% 18.7M 4s 2023-12-03T11:41:21.689 INFO:teuthology.orchestra.run.smithi044.stderr: 53100K .......... .......... .......... .......... .......... 57% 24.0M 4s 2023-12-03T11:41:21.691 INFO:teuthology.orchestra.run.smithi044.stderr: 53150K .......... .......... .......... .......... .......... 57% 36.6M 4s 2023-12-03T11:41:21.695 INFO:teuthology.orchestra.run.smithi044.stderr: 53200K .......... .......... .......... .......... .......... 57% 13.5M 4s 2023-12-03T11:41:21.695 INFO:teuthology.orchestra.run.smithi044.stderr: 53250K .......... .......... .......... .......... .......... 57% 43.8M 4s 2023-12-03T11:41:21.701 INFO:teuthology.orchestra.run.smithi044.stderr: 53300K .......... .......... .......... .......... .......... 57% 8.98M 4s 2023-12-03T11:41:21.704 INFO:teuthology.orchestra.run.smithi044.stderr: 53350K .......... .......... .......... .......... .......... 57% 17.0M 4s 2023-12-03T11:41:21.705 INFO:teuthology.orchestra.run.smithi044.stderr: 53400K .......... .......... .......... .......... .......... 57% 31.8M 4s 2023-12-03T11:41:21.708 INFO:teuthology.orchestra.run.smithi044.stderr: 53450K .......... .......... .......... .......... .......... 57% 22.7M 4s 2023-12-03T11:41:21.709 INFO:teuthology.orchestra.run.smithi044.stderr: 53500K .......... .......... .......... .......... .......... 57% 34.1M 4s 2023-12-03T11:41:21.711 INFO:teuthology.orchestra.run.smithi044.stderr: 53550K .......... .......... .......... .......... .......... 57% 21.8M 4s 2023-12-03T11:41:21.713 INFO:teuthology.orchestra.run.smithi044.stderr: 53600K .......... .......... .......... .......... .......... 57% 30.3M 4s 2023-12-03T11:41:21.715 INFO:teuthology.orchestra.run.smithi044.stderr: 53650K .......... .......... .......... .......... .......... 57% 18.6M 4s 2023-12-03T11:41:21.718 INFO:teuthology.orchestra.run.smithi044.stderr: 53700K .......... .......... .......... .......... .......... 57% 19.3M 4s 2023-12-03T11:41:21.719 INFO:teuthology.orchestra.run.smithi044.stderr: 53750K .......... .......... .......... .......... .......... 57% 48.5M 4s 2023-12-03T11:41:21.722 INFO:teuthology.orchestra.run.smithi044.stderr: 53800K .......... .......... .......... .......... .......... 57% 17.6M 4s 2023-12-03T11:41:21.723 INFO:teuthology.orchestra.run.smithi044.stderr: 53850K .......... .......... .......... .......... .......... 58% 31.9M 4s 2023-12-03T11:41:21.726 INFO:teuthology.orchestra.run.smithi044.stderr: 53900K .......... .......... .......... .......... .......... 58% 20.6M 4s 2023-12-03T11:41:21.727 INFO:teuthology.orchestra.run.smithi044.stderr: 53950K .......... .......... .......... .......... .......... 58% 43.4M 4s 2023-12-03T11:41:21.729 INFO:teuthology.orchestra.run.smithi044.stderr: 54000K .......... .......... .......... .......... .......... 58% 20.2M 4s 2023-12-03T11:41:21.732 INFO:teuthology.orchestra.run.smithi044.stderr: 54050K .......... .......... .......... .......... .......... 58% 20.1M 4s 2023-12-03T11:41:21.733 INFO:teuthology.orchestra.run.smithi044.stderr: 54100K .......... .......... .......... .......... .......... 58% 31.8M 4s 2023-12-03T11:41:21.736 INFO:teuthology.orchestra.run.smithi044.stderr: 54150K .......... .......... .......... .......... .......... 58% 21.2M 4s 2023-12-03T11:41:21.738 INFO:teuthology.orchestra.run.smithi044.stderr: 54200K .......... .......... .......... .......... .......... 58% 21.4M 4s 2023-12-03T11:41:21.740 INFO:teuthology.orchestra.run.smithi044.stderr: 54250K .......... .......... .......... .......... .......... 58% 27.0M 4s 2023-12-03T11:41:21.741 INFO:teuthology.orchestra.run.smithi044.stderr: 54300K .......... .......... .......... .......... .......... 58% 38.2M 4s 2023-12-03T11:41:21.743 INFO:teuthology.orchestra.run.smithi044.stderr: 54350K .......... .......... .......... .......... .......... 58% 18.4M 4s 2023-12-03T11:41:21.746 INFO:teuthology.orchestra.run.smithi044.stderr: 54400K .......... .......... .......... .......... .......... 58% 18.8M 4s 2023-12-03T11:41:21.747 INFO:teuthology.orchestra.run.smithi044.stderr: 54450K .......... .......... .......... .......... .......... 58% 37.5M 4s 2023-12-03T11:41:21.750 INFO:teuthology.orchestra.run.smithi044.stderr: 54500K .......... .......... .......... .......... .......... 58% 20.7M 4s 2023-12-03T11:41:21.751 INFO:teuthology.orchestra.run.smithi044.stderr: 54550K .......... .......... .......... .......... .......... 58% 32.1M 4s 2023-12-03T11:41:21.754 INFO:teuthology.orchestra.run.smithi044.stderr: 54600K .......... .......... .......... .......... .......... 58% 19.6M 4s 2023-12-03T11:41:21.755 INFO:teuthology.orchestra.run.smithi044.stderr: 54650K .......... .......... .......... .......... .......... 58% 45.9M 4s 2023-12-03T11:41:21.758 INFO:teuthology.orchestra.run.smithi044.stderr: 54700K .......... .......... .......... .......... .......... 58% 18.0M 4s 2023-12-03T11:41:21.760 INFO:teuthology.orchestra.run.smithi044.stderr: 54750K .......... .......... .......... .......... .......... 58% 17.3M 4s 2023-12-03T11:41:21.762 INFO:teuthology.orchestra.run.smithi044.stderr: 54800K .......... .......... .......... .......... .......... 59% 38.4M 4s 2023-12-03T11:41:21.764 INFO:teuthology.orchestra.run.smithi044.stderr: 54850K .......... .......... .......... .......... .......... 59% 23.2M 4s 2023-12-03T11:41:21.766 INFO:teuthology.orchestra.run.smithi044.stderr: 54900K .......... .......... .......... .......... .......... 59% 25.4M 4s 2023-12-03T11:41:21.767 INFO:teuthology.orchestra.run.smithi044.stderr: 54950K .......... .......... .......... .......... .......... 59% 31.1M 4s 2023-12-03T11:41:21.769 INFO:teuthology.orchestra.run.smithi044.stderr: 55000K .......... .......... .......... .......... .......... 59% 37.8M 4s 2023-12-03T11:41:21.772 INFO:teuthology.orchestra.run.smithi044.stderr: 55050K .......... .......... .......... .......... .......... 59% 21.5M 4s 2023-12-03T11:41:21.773 INFO:teuthology.orchestra.run.smithi044.stderr: 55100K .......... .......... .......... .......... .......... 59% 41.9M 4s 2023-12-03T11:41:21.775 INFO:teuthology.orchestra.run.smithi044.stderr: 55150K .......... .......... .......... .......... .......... 59% 20.9M 4s 2023-12-03T11:41:21.779 INFO:teuthology.orchestra.run.smithi044.stderr: 55200K .......... .......... .......... .......... .......... 59% 26.1M 4s 2023-12-03T11:41:21.779 INFO:teuthology.orchestra.run.smithi044.stderr: 55250K .......... .......... .......... .......... .......... 59% 36.5M 4s 2023-12-03T11:41:21.780 INFO:teuthology.orchestra.run.smithi044.stderr: 55300K .......... .......... .......... .......... .......... 59% 23.3M 4s 2023-12-03T11:41:21.781 INFO:teuthology.orchestra.run.smithi044.stderr: 55350K .......... .......... .......... .......... .......... 59% 34.2M 4s 2023-12-03T11:41:21.784 INFO:teuthology.orchestra.run.smithi044.stderr: 55400K .......... .......... .......... .......... .......... 59% 24.2M 4s 2023-12-03T11:41:21.786 INFO:teuthology.orchestra.run.smithi044.stderr: 55450K .......... .......... .......... .......... .......... 59% 22.4M 4s 2023-12-03T11:41:21.786 INFO:teuthology.orchestra.run.smithi044.stderr: 55500K .......... .......... .......... .......... .......... 59% 52.9M 4s 2023-12-03T11:41:21.788 INFO:teuthology.orchestra.run.smithi044.stderr: 55550K .......... .......... .......... .......... .......... 59% 30.3M 4s 2023-12-03T11:41:21.790 INFO:teuthology.orchestra.run.smithi044.stderr: 55600K .......... .......... .......... .......... .......... 59% 23.9M 4s 2023-12-03T11:41:21.791 INFO:teuthology.orchestra.run.smithi044.stderr: 55650K .......... .......... .......... .......... .......... 59% 31.9M 4s 2023-12-03T11:41:21.793 INFO:teuthology.orchestra.run.smithi044.stderr: 55700K .......... .......... .......... .......... .......... 60% 39.4M 4s 2023-12-03T11:41:21.797 INFO:teuthology.orchestra.run.smithi044.stderr: 55750K .......... .......... .......... .......... .......... 60% 10.9M 4s 2023-12-03T11:41:21.800 INFO:teuthology.orchestra.run.smithi044.stderr: 55800K .......... .......... .......... .......... .......... 60% 19.2M 4s 2023-12-03T11:41:21.801 INFO:teuthology.orchestra.run.smithi044.stderr: 55850K .......... .......... .......... .......... .......... 60% 40.2M 4s 2023-12-03T11:41:21.805 INFO:teuthology.orchestra.run.smithi044.stderr: 55900K .......... .......... .......... .......... .......... 60% 11.9M 4s 2023-12-03T11:41:21.806 INFO:teuthology.orchestra.run.smithi044.stderr: 55950K .......... .......... .......... .......... .......... 60% 36.4M 4s 2023-12-03T11:41:21.812 INFO:teuthology.orchestra.run.smithi044.stderr: 56000K .......... .......... .......... .......... .......... 60% 8.95M 4s 2023-12-03T11:41:21.815 INFO:teuthology.orchestra.run.smithi044.stderr: 56050K .......... .......... .......... .......... .......... 60% 15.2M 4s 2023-12-03T11:41:21.818 INFO:teuthology.orchestra.run.smithi044.stderr: 56100K .......... .......... .......... .......... .......... 60% 19.6M 4s 2023-12-03T11:41:21.819 INFO:teuthology.orchestra.run.smithi044.stderr: 56150K .......... .......... .......... .......... .......... 60% 31.9M 4s 2023-12-03T11:41:21.822 INFO:teuthology.orchestra.run.smithi044.stderr: 56200K .......... .......... .......... .......... .......... 60% 17.6M 4s 2023-12-03T11:41:21.825 INFO:teuthology.orchestra.run.smithi044.stderr: 56250K .......... .......... .......... .......... .......... 60% 25.4M 4s 2023-12-03T11:41:21.826 INFO:teuthology.orchestra.run.smithi044.stderr: 56300K .......... .......... .......... .......... .......... 60% 20.2M 4s 2023-12-03T11:41:21.830 INFO:teuthology.orchestra.run.smithi044.stderr: 56350K .......... .......... .......... .......... .......... 60% 15.1M 4s 2023-12-03T11:41:21.835 INFO:teuthology.orchestra.run.smithi044.stderr: 56400K .......... .......... .......... .......... .......... 60% 22.1M 4s 2023-12-03T11:41:21.836 INFO:teuthology.orchestra.run.smithi044.stderr: 56450K .......... .......... .......... .......... .......... 60% 16.6M 4s 2023-12-03T11:41:21.839 INFO:teuthology.orchestra.run.smithi044.stderr: 56500K .......... .......... .......... .......... .......... 60% 31.3M 4s 2023-12-03T11:41:21.840 INFO:teuthology.orchestra.run.smithi044.stderr: 56550K .......... .......... .......... .......... .......... 60% 11.8M 4s 2023-12-03T11:41:21.842 INFO:teuthology.orchestra.run.smithi044.stderr: 56600K .......... .......... .......... .......... .......... 60% 32.3M 4s 2023-12-03T11:41:21.845 INFO:teuthology.orchestra.run.smithi044.stderr: 56650K .......... .......... .......... .......... .......... 61% 13.7M 4s 2023-12-03T11:41:21.848 INFO:teuthology.orchestra.run.smithi044.stderr: 56700K .......... .......... .......... .......... .......... 61% 17.4M 4s 2023-12-03T11:41:21.850 INFO:teuthology.orchestra.run.smithi044.stderr: 56750K .......... .......... .......... .......... .......... 61% 27.8M 4s 2023-12-03T11:41:21.853 INFO:teuthology.orchestra.run.smithi044.stderr: 56800K .......... .......... .......... .......... .......... 61% 17.5M 4s 2023-12-03T11:41:21.859 INFO:teuthology.orchestra.run.smithi044.stderr: 56850K .......... .......... .......... .......... .......... 61% 13.2M 4s 2023-12-03T11:41:21.859 INFO:teuthology.orchestra.run.smithi044.stderr: 56900K .......... .......... .......... .......... .......... 61% 63.6M 4s 2023-12-03T11:41:21.861 INFO:teuthology.orchestra.run.smithi044.stderr: 56950K .......... .......... .......... .......... .......... 61% 13.4M 4s 2023-12-03T11:41:21.863 INFO:teuthology.orchestra.run.smithi044.stderr: 57000K .......... .......... .......... .......... .......... 61% 21.6M 4s 2023-12-03T11:41:21.865 INFO:teuthology.orchestra.run.smithi044.stderr: 57050K .......... .......... .......... .......... .......... 61% 26.8M 4s 2023-12-03T11:41:21.869 INFO:teuthology.orchestra.run.smithi044.stderr: 57100K .......... .......... .......... .......... .......... 61% 13.8M 4s 2023-12-03T11:41:21.871 INFO:teuthology.orchestra.run.smithi044.stderr: 57150K .......... .......... .......... .......... .......... 61% 22.8M 4s 2023-12-03T11:41:21.872 INFO:teuthology.orchestra.run.smithi044.stderr: 57200K .......... .......... .......... .......... .......... 61% 31.0M 4s 2023-12-03T11:41:21.876 INFO:teuthology.orchestra.run.smithi044.stderr: 57250K .......... .......... .......... .......... .......... 61% 15.2M 4s 2023-12-03T11:41:21.878 INFO:teuthology.orchestra.run.smithi044.stderr: 57300K .......... .......... .......... .......... .......... 61% 23.5M 4s 2023-12-03T11:41:21.881 INFO:teuthology.orchestra.run.smithi044.stderr: 57350K .......... .......... .......... .......... .......... 61% 14.0M 4s 2023-12-03T11:41:21.884 INFO:teuthology.orchestra.run.smithi044.stderr: 57400K .......... .......... .......... .......... .......... 61% 26.7M 4s 2023-12-03T11:41:21.888 INFO:teuthology.orchestra.run.smithi044.stderr: 57450K .......... .......... .......... .......... .......... 61% 16.8M 4s 2023-12-03T11:41:21.888 INFO:teuthology.orchestra.run.smithi044.stderr: 57500K .......... .......... .......... .......... .......... 61% 63.2M 4s 2023-12-03T11:41:21.889 INFO:teuthology.orchestra.run.smithi044.stderr: 57550K .......... .......... .......... .......... .......... 62% 18.2M 4s 2023-12-03T11:41:21.893 INFO:teuthology.orchestra.run.smithi044.stderr: 57600K .......... .......... .......... .......... .......... 62% 40.6M 4s 2023-12-03T11:41:21.893 INFO:teuthology.orchestra.run.smithi044.stderr: 57650K .......... .......... .......... .......... .......... 62% 24.1M 4s 2023-12-03T11:41:21.899 INFO:teuthology.orchestra.run.smithi044.stderr: 57700K .......... .......... .......... .......... .......... 62% 21.9M 4s 2023-12-03T11:41:21.899 INFO:teuthology.orchestra.run.smithi044.stderr: 57750K .......... .......... .......... .......... .......... 62% 30.3M 4s 2023-12-03T11:41:21.899 INFO:teuthology.orchestra.run.smithi044.stderr: 57800K .......... .......... .......... .......... .......... 62% 19.2M 4s 2023-12-03T11:41:21.905 INFO:teuthology.orchestra.run.smithi044.stderr: 57850K .......... .......... .......... .......... .......... 62% 45.2M 4s 2023-12-03T11:41:21.905 INFO:teuthology.orchestra.run.smithi044.stderr: 57900K .......... .......... .......... .......... .......... 62% 19.3M 4s 2023-12-03T11:41:21.905 INFO:teuthology.orchestra.run.smithi044.stderr: 57950K .......... .......... .......... .......... .......... 62% 42.2M 4s 2023-12-03T11:41:21.908 INFO:teuthology.orchestra.run.smithi044.stderr: 58000K .......... .......... .......... .......... .......... 62% 22.2M 4s 2023-12-03T11:41:21.909 INFO:teuthology.orchestra.run.smithi044.stderr: 58050K .......... .......... .......... .......... .......... 62% 62.8M 4s 2023-12-03T11:41:21.909 INFO:teuthology.orchestra.run.smithi044.stderr: 58100K .......... .......... .......... .......... .......... 62% 26.5M 4s 2023-12-03T11:41:21.910 INFO:teuthology.orchestra.run.smithi044.stderr: 58150K .......... .......... .......... .......... .......... 62% 39.0M 4s 2023-12-03T11:41:21.912 INFO:teuthology.orchestra.run.smithi044.stderr: 58200K .......... .......... .......... .......... .......... 62% 25.3M 4s 2023-12-03T11:41:21.914 INFO:teuthology.orchestra.run.smithi044.stderr: 58250K .......... .......... .......... .......... .......... 62% 27.3M 4s 2023-12-03T11:41:21.916 INFO:teuthology.orchestra.run.smithi044.stderr: 58300K .......... .......... .......... .......... .......... 62% 34.7M 4s 2023-12-03T11:41:21.919 INFO:teuthology.orchestra.run.smithi044.stderr: 58350K .......... .......... .......... .......... .......... 62% 20.1M 4s 2023-12-03T11:41:21.919 INFO:teuthology.orchestra.run.smithi044.stderr: 58400K .......... .......... .......... .......... .......... 62% 56.4M 4s 2023-12-03T11:41:21.921 INFO:teuthology.orchestra.run.smithi044.stderr: 58450K .......... .......... .......... .......... .......... 62% 26.6M 4s 2023-12-03T11:41:21.923 INFO:teuthology.orchestra.run.smithi044.stderr: 58500K .......... .......... .......... .......... .......... 63% 40.9M 4s 2023-12-03T11:41:21.924 INFO:teuthology.orchestra.run.smithi044.stderr: 58550K .......... .......... .......... .......... .......... 63% 17.2M 4s 2023-12-03T11:41:21.930 INFO:teuthology.orchestra.run.smithi044.stderr: 58600K .......... .......... .......... .......... .......... 63% 9.33M 4s 2023-12-03T11:41:21.933 INFO:teuthology.orchestra.run.smithi044.stderr: 58650K .......... .......... .......... .......... .......... 63% 36.0M 4s 2023-12-03T11:41:21.933 INFO:teuthology.orchestra.run.smithi044.stderr: 58700K .......... .......... .......... .......... .......... 63% 33.9M 4s 2023-12-03T11:41:21.935 INFO:teuthology.orchestra.run.smithi044.stderr: 58750K .......... .......... .......... .......... .......... 63% 15.8M 4s 2023-12-03T11:41:21.937 INFO:teuthology.orchestra.run.smithi044.stderr: 58800K .......... .......... .......... .......... .......... 63% 33.8M 4s 2023-12-03T11:41:21.943 INFO:teuthology.orchestra.run.smithi044.stderr: 58850K .......... .......... .......... .......... .......... 63% 9.94M 4s 2023-12-03T11:41:21.945 INFO:teuthology.orchestra.run.smithi044.stderr: 58900K .......... .......... .......... .......... .......... 63% 17.8M 4s 2023-12-03T11:41:21.947 INFO:teuthology.orchestra.run.smithi044.stderr: 58950K .......... .......... .......... .......... .......... 63% 19.9M 4s 2023-12-03T11:41:21.948 INFO:teuthology.orchestra.run.smithi044.stderr: 59000K .......... .......... .......... .......... .......... 63% 35.5M 4s 2023-12-03T11:41:21.950 INFO:teuthology.orchestra.run.smithi044.stderr: 59050K .......... .......... .......... .......... .......... 63% 20.4M 4s 2023-12-03T11:41:21.952 INFO:teuthology.orchestra.run.smithi044.stderr: 59100K .......... .......... .......... .......... .......... 63% 24.2M 4s 2023-12-03T11:41:21.954 INFO:teuthology.orchestra.run.smithi044.stderr: 59150K .......... .......... .......... .......... .......... 63% 22.4M 4s 2023-12-03T11:41:21.956 INFO:teuthology.orchestra.run.smithi044.stderr: 59200K .......... .......... .......... .......... .......... 63% 28.0M 4s 2023-12-03T11:41:21.959 INFO:teuthology.orchestra.run.smithi044.stderr: 59250K .......... .......... .......... .......... .......... 63% 27.0M 4s 2023-12-03T11:41:21.962 INFO:teuthology.orchestra.run.smithi044.stderr: 59300K .......... .......... .......... .......... .......... 63% 13.8M 4s 2023-12-03T11:41:21.964 INFO:teuthology.orchestra.run.smithi044.stderr: 59350K .......... .......... .......... .......... .......... 63% 18.8M 4s 2023-12-03T11:41:21.968 INFO:teuthology.orchestra.run.smithi044.stderr: 59400K .......... .......... .......... .......... .......... 63% 13.7M 4s 2023-12-03T11:41:21.970 INFO:teuthology.orchestra.run.smithi044.stderr: 59450K .......... .......... .......... .......... .......... 64% 33.2M 4s 2023-12-03T11:41:21.971 INFO:teuthology.orchestra.run.smithi044.stderr: 59500K .......... .......... .......... .......... .......... 64% 24.1M 4s 2023-12-03T11:41:21.973 INFO:teuthology.orchestra.run.smithi044.stderr: 59550K .......... .......... .......... .......... .......... 64% 24.4M 4s 2023-12-03T11:41:21.975 INFO:teuthology.orchestra.run.smithi044.stderr: 59600K .......... .......... .......... .......... .......... 64% 20.1M 4s 2023-12-03T11:41:21.977 INFO:teuthology.orchestra.run.smithi044.stderr: 59650K .......... .......... .......... .......... .......... 64% 25.4M 3s 2023-12-03T11:41:21.980 INFO:teuthology.orchestra.run.smithi044.stderr: 59700K .......... .......... .......... .......... .......... 64% 19.5M 3s 2023-12-03T11:41:21.983 INFO:teuthology.orchestra.run.smithi044.stderr: 59750K .......... .......... .......... .......... .......... 64% 17.4M 3s 2023-12-03T11:41:21.985 INFO:teuthology.orchestra.run.smithi044.stderr: 59800K .......... .......... .......... .......... .......... 64% 24.2M 3s 2023-12-03T11:41:21.989 INFO:teuthology.orchestra.run.smithi044.stderr: 59850K .......... .......... .......... .......... .......... 64% 24.2M 3s 2023-12-03T11:41:21.989 INFO:teuthology.orchestra.run.smithi044.stderr: 59900K .......... .......... .......... .......... .......... 64% 23.0M 3s 2023-12-03T11:41:21.995 INFO:teuthology.orchestra.run.smithi044.stderr: 59950K .......... .......... .......... .......... .......... 64% 30.7M 3s 2023-12-03T11:41:21.995 INFO:teuthology.orchestra.run.smithi044.stderr: 60000K .......... .......... .......... .......... .......... 64% 15.1M 3s 2023-12-03T11:41:21.996 INFO:teuthology.orchestra.run.smithi044.stderr: 60050K .......... .......... .......... .......... .......... 64% 27.4M 3s 2023-12-03T11:41:21.997 INFO:teuthology.orchestra.run.smithi044.stderr: 60100K .......... .......... .......... .......... .......... 64% 32.8M 3s 2023-12-03T11:41:22.000 INFO:teuthology.orchestra.run.smithi044.stderr: 60150K .......... .......... .......... .......... .......... 64% 16.1M 3s 2023-12-03T11:41:22.002 INFO:teuthology.orchestra.run.smithi044.stderr: 60200K .......... .......... .......... .......... .......... 64% 28.4M 3s 2023-12-03T11:41:22.005 INFO:teuthology.orchestra.run.smithi044.stderr: 60250K .......... .......... .......... .......... .......... 64% 17.3M 3s 2023-12-03T11:41:22.006 INFO:teuthology.orchestra.run.smithi044.stderr: 60300K .......... .......... .......... .......... .......... 64% 31.9M 3s 2023-12-03T11:41:22.008 INFO:teuthology.orchestra.run.smithi044.stderr: 60350K .......... .......... .......... .......... .......... 65% 26.6M 3s 2023-12-03T11:41:22.010 INFO:teuthology.orchestra.run.smithi044.stderr: 60400K .......... .......... .......... .......... .......... 65% 30.0M 3s 2023-12-03T11:41:22.011 INFO:teuthology.orchestra.run.smithi044.stderr: 60450K .......... .......... .......... .......... .......... 65% 29.9M 3s 2023-12-03T11:41:22.014 INFO:teuthology.orchestra.run.smithi044.stderr: 60500K .......... .......... .......... .......... .......... 65% 30.3M 3s 2023-12-03T11:41:22.015 INFO:teuthology.orchestra.run.smithi044.stderr: 60550K .......... .......... .......... .......... .......... 65% 25.1M 3s 2023-12-03T11:41:22.019 INFO:teuthology.orchestra.run.smithi044.stderr: 60600K .......... .......... .......... .......... .......... 65% 19.9M 3s 2023-12-03T11:41:22.019 INFO:teuthology.orchestra.run.smithi044.stderr: 60650K .......... .......... .......... .......... .......... 65% 79.6M 3s 2023-12-03T11:41:22.021 INFO:teuthology.orchestra.run.smithi044.stderr: 60700K .......... .......... .......... .......... .......... 65% 24.9M 3s 2023-12-03T11:41:22.022 INFO:teuthology.orchestra.run.smithi044.stderr: 60750K .......... .......... .......... .......... .......... 65% 28.0M 3s 2023-12-03T11:41:22.023 INFO:teuthology.orchestra.run.smithi044.stderr: 60800K .......... .......... .......... .......... .......... 65% 29.2M 3s 2023-12-03T11:41:22.024 INFO:teuthology.orchestra.run.smithi044.stderr: 60850K .......... .......... .......... .......... .......... 65% 43.7M 3s 2023-12-03T11:41:22.027 INFO:teuthology.orchestra.run.smithi044.stderr: 60900K .......... .......... .......... .......... .......... 65% 22.1M 3s 2023-12-03T11:41:22.028 INFO:teuthology.orchestra.run.smithi044.stderr: 60950K .......... .......... .......... .......... .......... 65% 28.8M 3s 2023-12-03T11:41:22.030 INFO:teuthology.orchestra.run.smithi044.stderr: 61000K .......... .......... .......... .......... .......... 65% 33.0M 3s 2023-12-03T11:41:22.032 INFO:teuthology.orchestra.run.smithi044.stderr: 61050K .......... .......... .......... .......... .......... 65% 24.6M 3s 2023-12-03T11:41:22.033 INFO:teuthology.orchestra.run.smithi044.stderr: 61100K .......... .......... .......... .......... .......... 65% 30.8M 3s 2023-12-03T11:41:22.035 INFO:teuthology.orchestra.run.smithi044.stderr: 61150K .......... .......... .......... .......... .......... 65% 37.2M 3s 2023-12-03T11:41:22.036 INFO:teuthology.orchestra.run.smithi044.stderr: 61200K .......... .......... .......... .......... .......... 65% 39.8M 3s 2023-12-03T11:41:22.038 INFO:teuthology.orchestra.run.smithi044.stderr: 61250K .......... .......... .......... .......... .......... 65% 24.1M 3s 2023-12-03T11:41:22.040 INFO:teuthology.orchestra.run.smithi044.stderr: 61300K .......... .......... .......... .......... .......... 66% 28.7M 3s 2023-12-03T11:41:22.041 INFO:teuthology.orchestra.run.smithi044.stderr: 61350K .......... .......... .......... .......... .......... 66% 47.5M 3s 2023-12-03T11:41:22.042 INFO:teuthology.orchestra.run.smithi044.stderr: 61400K .......... .......... .......... .......... .......... 66% 25.8M 3s 2023-12-03T11:41:22.044 INFO:teuthology.orchestra.run.smithi044.stderr: 61450K .......... .......... .......... .......... .......... 66% 40.6M 3s 2023-12-03T11:41:22.046 INFO:teuthology.orchestra.run.smithi044.stderr: 61500K .......... .......... .......... .......... .......... 66% 24.8M 3s 2023-12-03T11:41:22.047 INFO:teuthology.orchestra.run.smithi044.stderr: 61550K .......... .......... .......... .......... .......... 66% 33.9M 3s 2023-12-03T11:41:22.048 INFO:teuthology.orchestra.run.smithi044.stderr: 61600K .......... .......... .......... .......... .......... 66% 38.4M 3s 2023-12-03T11:41:22.051 INFO:teuthology.orchestra.run.smithi044.stderr: 61650K .......... .......... .......... .......... .......... 66% 27.4M 3s 2023-12-03T11:41:22.051 INFO:teuthology.orchestra.run.smithi044.stderr: 61700K .......... .......... .......... .......... .......... 66% 35.4M 3s 2023-12-03T11:41:22.054 INFO:teuthology.orchestra.run.smithi044.stderr: 61750K .......... .......... .......... .......... .......... 66% 21.7M 3s 2023-12-03T11:41:22.055 INFO:teuthology.orchestra.run.smithi044.stderr: 61800K .......... .......... .......... .......... .......... 66% 39.8M 3s 2023-12-03T11:41:22.058 INFO:teuthology.orchestra.run.smithi044.stderr: 61850K .......... .......... .......... .......... .......... 66% 16.8M 3s 2023-12-03T11:41:22.061 INFO:teuthology.orchestra.run.smithi044.stderr: 61900K .......... .......... .......... .......... .......... 66% 20.8M 3s 2023-12-03T11:41:22.062 INFO:teuthology.orchestra.run.smithi044.stderr: 61950K .......... .......... .......... .......... .......... 66% 24.6M 3s 2023-12-03T11:41:22.065 INFO:teuthology.orchestra.run.smithi044.stderr: 62000K .......... .......... .......... .......... .......... 66% 25.8M 3s 2023-12-03T11:41:22.065 INFO:teuthology.orchestra.run.smithi044.stderr: 62050K .......... .......... .......... .......... .......... 66% 131M 3s 2023-12-03T11:41:22.067 INFO:teuthology.orchestra.run.smithi044.stderr: 62100K .......... .......... .......... .......... .......... 66% 19.8M 3s 2023-12-03T11:41:22.069 INFO:teuthology.orchestra.run.smithi044.stderr: 62150K .......... .......... .......... .......... .......... 66% 35.7M 3s 2023-12-03T11:41:22.070 INFO:teuthology.orchestra.run.smithi044.stderr: 62200K .......... .......... .......... .......... .......... 67% 38.4M 3s 2023-12-03T11:41:22.071 INFO:teuthology.orchestra.run.smithi044.stderr: 62250K .......... .......... .......... .......... .......... 67% 29.1M 3s 2023-12-03T11:41:22.074 INFO:teuthology.orchestra.run.smithi044.stderr: 62300K .......... .......... .......... .......... .......... 67% 19.9M 3s 2023-12-03T11:41:22.077 INFO:teuthology.orchestra.run.smithi044.stderr: 62350K .......... .......... .......... .......... .......... 67% 23.5M 3s 2023-12-03T11:41:22.077 INFO:teuthology.orchestra.run.smithi044.stderr: 62400K .......... .......... .......... .......... .......... 67% 70.9M 3s 2023-12-03T11:41:22.079 INFO:teuthology.orchestra.run.smithi044.stderr: 62450K .......... .......... .......... .......... .......... 67% 19.1M 3s 2023-12-03T11:41:22.080 INFO:teuthology.orchestra.run.smithi044.stderr: 62500K .......... .......... .......... .......... .......... 67% 35.9M 3s 2023-12-03T11:41:22.083 INFO:teuthology.orchestra.run.smithi044.stderr: 62550K .......... .......... .......... .......... .......... 67% 20.7M 3s 2023-12-03T11:41:22.084 INFO:teuthology.orchestra.run.smithi044.stderr: 62600K .......... .......... .......... .......... .......... 67% 39.6M 3s 2023-12-03T11:41:22.087 INFO:teuthology.orchestra.run.smithi044.stderr: 62650K .......... .......... .......... .......... .......... 67% 21.8M 3s 2023-12-03T11:41:22.089 INFO:teuthology.orchestra.run.smithi044.stderr: 62700K .......... .......... .......... .......... .......... 67% 24.5M 3s 2023-12-03T11:41:22.089 INFO:teuthology.orchestra.run.smithi044.stderr: 62750K .......... .......... .......... .......... .......... 67% 92.6M 3s 2023-12-03T11:41:22.092 INFO:teuthology.orchestra.run.smithi044.stderr: 62800K .......... .......... .......... .......... .......... 67% 17.6M 3s 2023-12-03T11:41:22.093 INFO:teuthology.orchestra.run.smithi044.stderr: 62850K .......... .......... .......... .......... .......... 67% 37.9M 3s 2023-12-03T11:41:22.095 INFO:teuthology.orchestra.run.smithi044.stderr: 62900K .......... .......... .......... .......... .......... 67% 23.8M 3s 2023-12-03T11:41:22.097 INFO:teuthology.orchestra.run.smithi044.stderr: 62950K .......... .......... .......... .......... .......... 67% 23.5M 3s 2023-12-03T11:41:22.098 INFO:teuthology.orchestra.run.smithi044.stderr: 63000K .......... .......... .......... .......... .......... 67% 38.8M 3s 2023-12-03T11:41:22.101 INFO:teuthology.orchestra.run.smithi044.stderr: 63050K .......... .......... .......... .......... .......... 67% 19.5M 3s 2023-12-03T11:41:22.103 INFO:teuthology.orchestra.run.smithi044.stderr: 63100K .......... .......... .......... .......... .......... 67% 29.5M 3s 2023-12-03T11:41:22.104 INFO:teuthology.orchestra.run.smithi044.stderr: 63150K .......... .......... .......... .......... .......... 68% 33.3M 3s 2023-12-03T11:41:22.106 INFO:teuthology.orchestra.run.smithi044.stderr: 63200K .......... .......... .......... .......... .......... 68% 19.0M 3s 2023-12-03T11:41:22.109 INFO:teuthology.orchestra.run.smithi044.stderr: 63250K .......... .......... .......... .......... .......... 68% 22.4M 3s 2023-12-03T11:41:22.111 INFO:teuthology.orchestra.run.smithi044.stderr: 63300K .......... .......... .......... .......... .......... 68% 29.2M 3s 2023-12-03T11:41:22.112 INFO:teuthology.orchestra.run.smithi044.stderr: 63350K .......... .......... .......... .......... .......... 68% 31.2M 3s 2023-12-03T11:41:22.114 INFO:teuthology.orchestra.run.smithi044.stderr: 63400K .......... .......... .......... .......... .......... 68% 34.2M 3s 2023-12-03T11:41:22.116 INFO:teuthology.orchestra.run.smithi044.stderr: 63450K .......... .......... .......... .......... .......... 68% 28.1M 3s 2023-12-03T11:41:22.117 INFO:teuthology.orchestra.run.smithi044.stderr: 63500K .......... .......... .......... .......... .......... 68% 33.4M 3s 2023-12-03T11:41:22.118 INFO:teuthology.orchestra.run.smithi044.stderr: 63550K .......... .......... .......... .......... .......... 68% 43.2M 3s 2023-12-03T11:41:22.120 INFO:teuthology.orchestra.run.smithi044.stderr: 63600K .......... .......... .......... .......... .......... 68% 21.8M 3s 2023-12-03T11:41:22.122 INFO:teuthology.orchestra.run.smithi044.stderr: 63650K .......... .......... .......... .......... .......... 68% 28.0M 3s 2023-12-03T11:41:22.123 INFO:teuthology.orchestra.run.smithi044.stderr: 63700K .......... .......... .......... .......... .......... 68% 41.5M 3s 2023-12-03T11:41:22.125 INFO:teuthology.orchestra.run.smithi044.stderr: 63750K .......... .......... .......... .......... .......... 68% 25.1M 3s 2023-12-03T11:41:22.126 INFO:teuthology.orchestra.run.smithi044.stderr: 63800K .......... .......... .......... .......... .......... 68% 36.5M 3s 2023-12-03T11:41:22.128 INFO:teuthology.orchestra.run.smithi044.stderr: 63850K .......... .......... .......... .......... .......... 68% 26.9M 3s 2023-12-03T11:41:22.129 INFO:teuthology.orchestra.run.smithi044.stderr: 63900K .......... .......... .......... .......... .......... 68% 38.8M 3s 2023-12-03T11:41:22.131 INFO:teuthology.orchestra.run.smithi044.stderr: 63950K .......... .......... .......... .......... .......... 68% 23.1M 3s 2023-12-03T11:41:22.133 INFO:teuthology.orchestra.run.smithi044.stderr: 64000K .......... .......... .......... .......... .......... 68% 38.5M 3s 2023-12-03T11:41:22.134 INFO:teuthology.orchestra.run.smithi044.stderr: 64050K .......... .......... .......... .......... .......... 68% 26.0M 3s 2023-12-03T11:41:22.137 INFO:teuthology.orchestra.run.smithi044.stderr: 64100K .......... .......... .......... .......... .......... 69% 23.7M 3s 2023-12-03T11:41:22.137 INFO:teuthology.orchestra.run.smithi044.stderr: 64150K .......... .......... .......... .......... .......... 69% 44.7M 3s 2023-12-03T11:41:22.140 INFO:teuthology.orchestra.run.smithi044.stderr: 64200K .......... .......... .......... .......... .......... 69% 23.1M 3s 2023-12-03T11:41:22.141 INFO:teuthology.orchestra.run.smithi044.stderr: 64250K .......... .......... .......... .......... .......... 69% 39.4M 3s 2023-12-03T11:41:22.143 INFO:teuthology.orchestra.run.smithi044.stderr: 64300K .......... .......... .......... .......... .......... 69% 24.8M 3s 2023-12-03T11:41:22.144 INFO:teuthology.orchestra.run.smithi044.stderr: 64350K .......... .......... .......... .......... .......... 69% 42.4M 3s 2023-12-03T11:41:22.146 INFO:teuthology.orchestra.run.smithi044.stderr: 64400K .......... .......... .......... .......... .......... 69% 26.3M 3s 2023-12-03T11:41:22.147 INFO:teuthology.orchestra.run.smithi044.stderr: 64450K .......... .......... .......... .......... .......... 69% 37.9M 3s 2023-12-03T11:41:22.149 INFO:teuthology.orchestra.run.smithi044.stderr: 64500K .......... .......... .......... .......... .......... 69% 26.1M 3s 2023-12-03T11:41:22.151 INFO:teuthology.orchestra.run.smithi044.stderr: 64550K .......... .......... .......... .......... .......... 69% 25.8M 3s 2023-12-03T11:41:22.152 INFO:teuthology.orchestra.run.smithi044.stderr: 64600K .......... .......... .......... .......... .......... 69% 39.0M 3s 2023-12-03T11:41:22.154 INFO:teuthology.orchestra.run.smithi044.stderr: 64650K .......... .......... .......... .......... .......... 69% 24.7M 3s 2023-12-03T11:41:22.156 INFO:teuthology.orchestra.run.smithi044.stderr: 64700K .......... .......... .......... .......... .......... 69% 45.8M 3s 2023-12-03T11:41:22.157 INFO:teuthology.orchestra.run.smithi044.stderr: 64750K .......... .......... .......... .......... .......... 69% 30.2M 3s 2023-12-03T11:41:22.159 INFO:teuthology.orchestra.run.smithi044.stderr: 64800K .......... .......... .......... .......... .......... 69% 46.9M 3s 2023-12-03T11:41:22.161 INFO:teuthology.orchestra.run.smithi044.stderr: 64850K .......... .......... .......... .......... .......... 69% 23.2M 3s 2023-12-03T11:41:22.162 INFO:teuthology.orchestra.run.smithi044.stderr: 64900K .......... .......... .......... .......... .......... 69% 27.1M 3s 2023-12-03T11:41:22.163 INFO:teuthology.orchestra.run.smithi044.stderr: 64950K .......... .......... .......... .......... .......... 69% 42.6M 3s 2023-12-03T11:41:22.165 INFO:teuthology.orchestra.run.smithi044.stderr: 65000K .......... .......... .......... .......... .......... 70% 27.6M 3s 2023-12-03T11:41:22.166 INFO:teuthology.orchestra.run.smithi044.stderr: 65050K .......... .......... .......... .......... .......... 70% 42.5M 3s 2023-12-03T11:41:22.168 INFO:teuthology.orchestra.run.smithi044.stderr: 65100K .......... .......... .......... .......... .......... 70% 25.1M 3s 2023-12-03T11:41:22.172 INFO:teuthology.orchestra.run.smithi044.stderr: 65150K .......... .......... .......... .......... .......... 70% 25.0M 3s 2023-12-03T11:41:22.173 INFO:teuthology.orchestra.run.smithi044.stderr: 65200K .......... .......... .......... .......... .......... 70% 38.7M 3s 2023-12-03T11:41:22.177 INFO:teuthology.orchestra.run.smithi044.stderr: 65250K .......... .......... .......... .......... .......... 70% 26.9M 3s 2023-12-03T11:41:22.177 INFO:teuthology.orchestra.run.smithi044.stderr: 65300K .......... .......... .......... .......... .......... 70% 39.8M 3s 2023-12-03T11:41:22.177 INFO:teuthology.orchestra.run.smithi044.stderr: 65350K .......... .......... .......... .......... .......... 70% 26.4M 3s 2023-12-03T11:41:22.179 INFO:teuthology.orchestra.run.smithi044.stderr: 65400K .......... .......... .......... .......... .......... 70% 36.9M 3s 2023-12-03T11:41:22.180 INFO:teuthology.orchestra.run.smithi044.stderr: 65450K .......... .......... .......... .......... .......... 70% 22.3M 3s 2023-12-03T11:41:22.182 INFO:teuthology.orchestra.run.smithi044.stderr: 65500K .......... .......... .......... .......... .......... 70% 21.6M 3s 2023-12-03T11:41:22.182 INFO:teuthology.orchestra.run.smithi044.stderr: 65550K .......... .......... .......... .......... .......... 70% 69.5M 3s 2023-12-03T11:41:22.185 INFO:teuthology.orchestra.run.smithi044.stderr: 65600K .......... .......... .......... .......... .......... 70% 20.1M 3s 2023-12-03T11:41:22.186 INFO:teuthology.orchestra.run.smithi044.stderr: 65650K .......... .......... .......... .......... .......... 70% 44.6M 3s 2023-12-03T11:41:22.188 INFO:teuthology.orchestra.run.smithi044.stderr: 65700K .......... .......... .......... .......... .......... 70% 23.8M 3s 2023-12-03T11:41:22.190 INFO:teuthology.orchestra.run.smithi044.stderr: 65750K .......... .......... .......... .......... .......... 70% 30.8M 3s 2023-12-03T11:41:22.191 INFO:teuthology.orchestra.run.smithi044.stderr: 65800K .......... .......... .......... .......... .......... 70% 26.7M 3s 2023-12-03T11:41:22.193 INFO:teuthology.orchestra.run.smithi044.stderr: 65850K .......... .......... .......... .......... .......... 70% 28.0M 3s 2023-12-03T11:41:22.195 INFO:teuthology.orchestra.run.smithi044.stderr: 65900K .......... .......... .......... .......... .......... 70% 29.2M 3s 2023-12-03T11:41:22.197 INFO:teuthology.orchestra.run.smithi044.stderr: 65950K .......... .......... .......... .......... .......... 71% 21.8M 3s 2023-12-03T11:41:22.198 INFO:teuthology.orchestra.run.smithi044.stderr: 66000K .......... .......... .......... .......... .......... 71% 64.3M 3s 2023-12-03T11:41:22.200 INFO:teuthology.orchestra.run.smithi044.stderr: 66050K .......... .......... .......... .......... .......... 71% 27.3M 3s 2023-12-03T11:41:22.201 INFO:teuthology.orchestra.run.smithi044.stderr: 66100K .......... .......... .......... .......... .......... 71% 29.7M 3s 2023-12-03T11:41:22.203 INFO:teuthology.orchestra.run.smithi044.stderr: 66150K .......... .......... .......... .......... .......... 71% 25.5M 3s 2023-12-03T11:41:22.205 INFO:teuthology.orchestra.run.smithi044.stderr: 66200K .......... .......... .......... .......... .......... 71% 22.4M 3s 2023-12-03T11:41:22.208 INFO:teuthology.orchestra.run.smithi044.stderr: 66250K .......... .......... .......... .......... .......... 71% 30.6M 3s 2023-12-03T11:41:22.209 INFO:teuthology.orchestra.run.smithi044.stderr: 66300K .......... .......... .......... .......... .......... 71% 31.0M 3s 2023-12-03T11:41:22.211 INFO:teuthology.orchestra.run.smithi044.stderr: 66350K .......... .......... .......... .......... .......... 71% 33.2M 3s 2023-12-03T11:41:22.212 INFO:teuthology.orchestra.run.smithi044.stderr: 66400K .......... .......... .......... .......... .......... 71% 28.2M 3s 2023-12-03T11:41:22.214 INFO:teuthology.orchestra.run.smithi044.stderr: 66450K .......... .......... .......... .......... .......... 71% 22.2M 3s 2023-12-03T11:41:22.215 INFO:teuthology.orchestra.run.smithi044.stderr: 66500K .......... .......... .......... .......... .......... 71% 36.6M 3s 2023-12-03T11:41:22.216 INFO:teuthology.orchestra.run.smithi044.stderr: 66550K .......... .......... .......... .......... .......... 71% 48.2M 3s 2023-12-03T11:41:22.218 INFO:teuthology.orchestra.run.smithi044.stderr: 66600K .......... .......... .......... .......... .......... 71% 26.6M 3s 2023-12-03T11:41:22.219 INFO:teuthology.orchestra.run.smithi044.stderr: 66650K .......... .......... .......... .......... .......... 71% 57.0M 3s 2023-12-03T11:41:22.221 INFO:teuthology.orchestra.run.smithi044.stderr: 66700K .......... .......... .......... .......... .......... 71% 25.2M 3s 2023-12-03T11:41:22.223 INFO:teuthology.orchestra.run.smithi044.stderr: 66750K .......... .......... .......... .......... .......... 71% 26.2M 3s 2023-12-03T11:41:22.224 INFO:teuthology.orchestra.run.smithi044.stderr: 66800K .......... .......... .......... .......... .......... 71% 44.9M 3s 2023-12-03T11:41:22.227 INFO:teuthology.orchestra.run.smithi044.stderr: 66850K .......... .......... .......... .......... .......... 72% 20.9M 3s 2023-12-03T11:41:22.227 INFO:teuthology.orchestra.run.smithi044.stderr: 66900K .......... .......... .......... .......... .......... 72% 55.3M 3s 2023-12-03T11:41:22.229 INFO:teuthology.orchestra.run.smithi044.stderr: 66950K .......... .......... .......... .......... .......... 72% 28.1M 3s 2023-12-03T11:41:22.233 INFO:teuthology.orchestra.run.smithi044.stderr: 67000K .......... .......... .......... .......... .......... 72% 29.9M 3s 2023-12-03T11:41:22.233 INFO:teuthology.orchestra.run.smithi044.stderr: 67050K .......... .......... .......... .......... .......... 72% 46.3M 3s 2023-12-03T11:41:22.234 INFO:teuthology.orchestra.run.smithi044.stderr: 67100K .......... .......... .......... .......... .......... 72% 24.8M 3s 2023-12-03T11:41:22.235 INFO:teuthology.orchestra.run.smithi044.stderr: 67150K .......... .......... .......... .......... .......... 72% 39.8M 3s 2023-12-03T11:41:22.238 INFO:teuthology.orchestra.run.smithi044.stderr: 67200K .......... .......... .......... .......... .......... 72% 19.7M 2s 2023-12-03T11:41:22.239 INFO:teuthology.orchestra.run.smithi044.stderr: 67250K .......... .......... .......... .......... .......... 72% 33.6M 2s 2023-12-03T11:41:22.241 INFO:teuthology.orchestra.run.smithi044.stderr: 67300K .......... .......... .......... .......... .......... 72% 28.8M 2s 2023-12-03T11:41:22.242 INFO:teuthology.orchestra.run.smithi044.stderr: 67350K .......... .......... .......... .......... .......... 72% 39.6M 2s 2023-12-03T11:41:22.248 INFO:teuthology.orchestra.run.smithi044.stderr: 67400K .......... .......... .......... .......... .......... 72% 26.2M 2s 2023-12-03T11:41:22.248 INFO:teuthology.orchestra.run.smithi044.stderr: 67450K .......... .......... .......... .......... .......... 72% 24.2M 2s 2023-12-03T11:41:22.248 INFO:teuthology.orchestra.run.smithi044.stderr: 67500K .......... .......... .......... .......... .......... 72% 41.5M 2s 2023-12-03T11:41:22.249 INFO:teuthology.orchestra.run.smithi044.stderr: 67550K .......... .......... .......... .......... .......... 72% 25.2M 2s 2023-12-03T11:41:22.252 INFO:teuthology.orchestra.run.smithi044.stderr: 67600K .......... .......... .......... .......... .......... 72% 27.5M 2s 2023-12-03T11:41:22.252 INFO:teuthology.orchestra.run.smithi044.stderr: 67650K .......... .......... .......... .......... .......... 72% 71.9M 2s 2023-12-03T11:41:22.253 INFO:teuthology.orchestra.run.smithi044.stderr: 67700K .......... .......... .......... .......... .......... 72% 28.2M 2s 2023-12-03T11:41:22.254 INFO:teuthology.orchestra.run.smithi044.stderr: 67750K .......... .......... .......... .......... .......... 72% 44.0M 2s 2023-12-03T11:41:22.256 INFO:teuthology.orchestra.run.smithi044.stderr: 67800K .......... .......... .......... .......... .......... 73% 29.3M 2s 2023-12-03T11:41:22.257 INFO:teuthology.orchestra.run.smithi044.stderr: 67850K .......... .......... .......... .......... .......... 73% 44.9M 2s 2023-12-03T11:41:22.258 INFO:teuthology.orchestra.run.smithi044.stderr: 67900K .......... .......... .......... .......... .......... 73% 27.5M 2s 2023-12-03T11:41:22.260 INFO:teuthology.orchestra.run.smithi044.stderr: 67950K .......... .......... .......... .......... .......... 73% 37.5M 2s 2023-12-03T11:41:22.261 INFO:teuthology.orchestra.run.smithi044.stderr: 68000K .......... .......... .......... .......... .......... 73% 32.1M 2s 2023-12-03T11:41:22.263 INFO:teuthology.orchestra.run.smithi044.stderr: 68050K .......... .......... .......... .......... .......... 73% 30.8M 2s 2023-12-03T11:41:22.264 INFO:teuthology.orchestra.run.smithi044.stderr: 68100K .......... .......... .......... .......... .......... 73% 48.4M 2s 2023-12-03T11:41:22.266 INFO:teuthology.orchestra.run.smithi044.stderr: 68150K .......... .......... .......... .......... .......... 73% 31.2M 2s 2023-12-03T11:41:22.267 INFO:teuthology.orchestra.run.smithi044.stderr: 68200K .......... .......... .......... .......... .......... 73% 32.1M 2s 2023-12-03T11:41:22.269 INFO:teuthology.orchestra.run.smithi044.stderr: 68250K .......... .......... .......... .......... .......... 73% 32.1M 2s 2023-12-03T11:41:22.269 INFO:teuthology.orchestra.run.smithi044.stderr: 68300K .......... .......... .......... .......... .......... 73% 77.7M 2s 2023-12-03T11:41:22.270 INFO:teuthology.orchestra.run.smithi044.stderr: 68350K .......... .......... .......... .......... .......... 73% 30.8M 2s 2023-12-03T11:41:22.272 INFO:teuthology.orchestra.run.smithi044.stderr: 68400K .......... .......... .......... .......... .......... 73% 43.6M 2s 2023-12-03T11:41:22.274 INFO:teuthology.orchestra.run.smithi044.stderr: 68450K .......... .......... .......... .......... .......... 73% 24.1M 2s 2023-12-03T11:41:22.276 INFO:teuthology.orchestra.run.smithi044.stderr: 68500K .......... .......... .......... .......... .......... 73% 31.2M 2s 2023-12-03T11:41:22.277 INFO:teuthology.orchestra.run.smithi044.stderr: 68550K .......... .......... .......... .......... .......... 73% 31.5M 2s 2023-12-03T11:41:22.278 INFO:teuthology.orchestra.run.smithi044.stderr: 68600K .......... .......... .......... .......... .......... 73% 41.9M 2s 2023-12-03T11:41:22.279 INFO:teuthology.orchestra.run.smithi044.stderr: 68650K .......... .......... .......... .......... .......... 73% 47.4M 2s 2023-12-03T11:41:22.281 INFO:teuthology.orchestra.run.smithi044.stderr: 68700K .......... .......... .......... .......... .......... 74% 24.8M 2s 2023-12-03T11:41:22.284 INFO:teuthology.orchestra.run.smithi044.stderr: 68750K .......... .......... .......... .......... .......... 74% 28.4M 2s 2023-12-03T11:41:22.284 INFO:teuthology.orchestra.run.smithi044.stderr: 68800K .......... .......... .......... .......... .......... 74% 55.2M 2s 2023-12-03T11:41:22.286 INFO:teuthology.orchestra.run.smithi044.stderr: 68850K .......... .......... .......... .......... .......... 74% 24.5M 2s 2023-12-03T11:41:22.288 INFO:teuthology.orchestra.run.smithi044.stderr: 68900K .......... .......... .......... .......... .......... 74% 27.0M 2s 2023-12-03T11:41:22.289 INFO:teuthology.orchestra.run.smithi044.stderr: 68950K .......... .......... .......... .......... .......... 74% 41.7M 2s 2023-12-03T11:41:22.290 INFO:teuthology.orchestra.run.smithi044.stderr: 69000K .......... .......... .......... .......... .......... 74% 51.9M 2s 2023-12-03T11:41:22.291 INFO:teuthology.orchestra.run.smithi044.stderr: 69050K .......... .......... .......... .......... .......... 74% 34.0M 2s 2023-12-03T11:41:22.293 INFO:teuthology.orchestra.run.smithi044.stderr: 69100K .......... .......... .......... .......... .......... 74% 23.4M 2s 2023-12-03T11:41:22.294 INFO:teuthology.orchestra.run.smithi044.stderr: 69150K .......... .......... .......... .......... .......... 74% 49.0M 2s 2023-12-03T11:41:22.295 INFO:teuthology.orchestra.run.smithi044.stderr: 69200K .......... .......... .......... .......... .......... 74% 36.6M 2s 2023-12-03T11:41:22.297 INFO:teuthology.orchestra.run.smithi044.stderr: 69250K .......... .......... .......... .......... .......... 74% 32.7M 2s 2023-12-03T11:41:22.299 INFO:teuthology.orchestra.run.smithi044.stderr: 69300K .......... .......... .......... .......... .......... 74% 22.6M 2s 2023-12-03T11:41:22.301 INFO:teuthology.orchestra.run.smithi044.stderr: 69350K .......... .......... .......... .......... .......... 74% 29.1M 2s 2023-12-03T11:41:22.302 INFO:teuthology.orchestra.run.smithi044.stderr: 69400K .......... .......... .......... .......... .......... 74% 64.1M 2s 2023-12-03T11:41:22.304 INFO:teuthology.orchestra.run.smithi044.stderr: 69450K .......... .......... .......... .......... .......... 74% 22.1M 2s 2023-12-03T11:41:22.304 INFO:teuthology.orchestra.run.smithi044.stderr: 69500K .......... .......... .......... .......... .......... 74% 73.3M 2s 2023-12-03T11:41:22.306 INFO:teuthology.orchestra.run.smithi044.stderr: 69550K .......... .......... .......... .......... .......... 74% 32.1M 2s 2023-12-03T11:41:22.307 INFO:teuthology.orchestra.run.smithi044.stderr: 69600K .......... .......... .......... .......... .......... 74% 91.6M 2s 2023-12-03T11:41:22.308 INFO:teuthology.orchestra.run.smithi044.stderr: 69650K .......... .......... .......... .......... .......... 75% 36.2M 2s 2023-12-03T11:41:22.310 INFO:teuthology.orchestra.run.smithi044.stderr: 69700K .......... .......... .......... .......... .......... 75% 24.5M 2s 2023-12-03T11:41:22.311 INFO:teuthology.orchestra.run.smithi044.stderr: 69750K .......... .......... .......... .......... .......... 75% 74.6M 2s 2023-12-03T11:41:22.313 INFO:teuthology.orchestra.run.smithi044.stderr: 69800K .......... .......... .......... .......... .......... 75% 21.3M 2s 2023-12-03T11:41:22.314 INFO:teuthology.orchestra.run.smithi044.stderr: 69850K .......... .......... .......... .......... .......... 75% 51.5M 2s 2023-12-03T11:41:22.315 INFO:teuthology.orchestra.run.smithi044.stderr: 69900K .......... .......... .......... .......... .......... 75% 32.2M 2s 2023-12-03T11:41:22.316 INFO:teuthology.orchestra.run.smithi044.stderr: 69950K .......... .......... .......... .......... .......... 75% 48.7M 2s 2023-12-03T11:41:22.317 INFO:teuthology.orchestra.run.smithi044.stderr: 70000K .......... .......... .......... .......... .......... 75% 39.0M 2s 2023-12-03T11:41:22.319 INFO:teuthology.orchestra.run.smithi044.stderr: 70050K .......... .......... .......... .......... .......... 75% 35.1M 2s 2023-12-03T11:41:22.320 INFO:teuthology.orchestra.run.smithi044.stderr: 70100K .......... .......... .......... .......... .......... 75% 43.9M 2s 2023-12-03T11:41:22.322 INFO:teuthology.orchestra.run.smithi044.stderr: 70150K .......... .......... .......... .......... .......... 75% 45.6M 2s 2023-12-03T11:41:22.322 INFO:teuthology.orchestra.run.smithi044.stderr: 70200K .......... .......... .......... .......... .......... 75% 36.4M 2s 2023-12-03T11:41:22.324 INFO:teuthology.orchestra.run.smithi044.stderr: 70250K .......... .......... .......... .......... .......... 75% 26.4M 2s 2023-12-03T11:41:22.326 INFO:teuthology.orchestra.run.smithi044.stderr: 70300K .......... .......... .......... .......... .......... 75% 37.6M 2s 2023-12-03T11:41:22.327 INFO:teuthology.orchestra.run.smithi044.stderr: 70350K .......... .......... .......... .......... .......... 75% 45.5M 2s 2023-12-03T11:41:22.328 INFO:teuthology.orchestra.run.smithi044.stderr: 70400K .......... .......... .......... .......... .......... 75% 39.5M 2s 2023-12-03T11:41:22.329 INFO:teuthology.orchestra.run.smithi044.stderr: 70450K .......... .......... .......... .......... .......... 75% 34.2M 2s 2023-12-03T11:41:22.330 INFO:teuthology.orchestra.run.smithi044.stderr: 70500K .......... .......... .......... .......... .......... 75% 51.8M 2s 2023-12-03T11:41:22.332 INFO:teuthology.orchestra.run.smithi044.stderr: 70550K .......... .......... .......... .......... .......... 75% 23.9M 2s 2023-12-03T11:41:22.335 INFO:teuthology.orchestra.run.smithi044.stderr: 70600K .......... .......... .......... .......... .......... 76% 22.4M 2s 2023-12-03T11:41:22.335 INFO:teuthology.orchestra.run.smithi044.stderr: 70650K .......... .......... .......... .......... .......... 76% 43.5M 2s 2023-12-03T11:41:22.337 INFO:teuthology.orchestra.run.smithi044.stderr: 70700K .......... .......... .......... .......... .......... 76% 30.8M 2s 2023-12-03T11:41:22.338 INFO:teuthology.orchestra.run.smithi044.stderr: 70750K .......... .......... .......... .......... .......... 76% 40.9M 2s 2023-12-03T11:41:22.340 INFO:teuthology.orchestra.run.smithi044.stderr: 70800K .......... .......... .......... .......... .......... 76% 29.8M 2s 2023-12-03T11:41:22.342 INFO:teuthology.orchestra.run.smithi044.stderr: 70850K .......... .......... .......... .......... .......... 76% 25.7M 2s 2023-12-03T11:41:22.343 INFO:teuthology.orchestra.run.smithi044.stderr: 70900K .......... .......... .......... .......... .......... 76% 68.6M 2s 2023-12-03T11:41:22.344 INFO:teuthology.orchestra.run.smithi044.stderr: 70950K .......... .......... .......... .......... .......... 76% 29.6M 2s 2023-12-03T11:41:22.345 INFO:teuthology.orchestra.run.smithi044.stderr: 71000K .......... .......... .......... .......... .......... 76% 57.6M 2s 2023-12-03T11:41:22.347 INFO:teuthology.orchestra.run.smithi044.stderr: 71050K .......... .......... .......... .......... .......... 76% 29.7M 2s 2023-12-03T11:41:22.348 INFO:teuthology.orchestra.run.smithi044.stderr: 71100K .......... .......... .......... .......... .......... 76% 37.5M 2s 2023-12-03T11:41:22.349 INFO:teuthology.orchestra.run.smithi044.stderr: 71150K .......... .......... .......... .......... .......... 76% 43.5M 2s 2023-12-03T11:41:22.351 INFO:teuthology.orchestra.run.smithi044.stderr: 71200K .......... .......... .......... .......... .......... 76% 34.0M 2s 2023-12-03T11:41:22.351 INFO:teuthology.orchestra.run.smithi044.stderr: 71250K .......... .......... .......... .......... .......... 76% 63.7M 2s 2023-12-03T11:41:22.353 INFO:teuthology.orchestra.run.smithi044.stderr: 71300K .......... .......... .......... .......... .......... 76% 26.0M 2s 2023-12-03T11:41:22.354 INFO:teuthology.orchestra.run.smithi044.stderr: 71350K .......... .......... .......... .......... .......... 76% 62.4M 2s 2023-12-03T11:41:22.356 INFO:teuthology.orchestra.run.smithi044.stderr: 71400K .......... .......... .......... .......... .......... 76% 29.5M 2s 2023-12-03T11:41:22.356 INFO:teuthology.orchestra.run.smithi044.stderr: 71450K .......... .......... .......... .......... .......... 76% 49.8M 2s 2023-12-03T11:41:22.359 INFO:teuthology.orchestra.run.smithi044.stderr: 71500K .......... .......... .......... .......... .......... 77% 29.6M 2s 2023-12-03T11:41:22.360 INFO:teuthology.orchestra.run.smithi044.stderr: 71550K .......... .......... .......... .......... .......... 77% 30.9M 2s 2023-12-03T11:41:22.361 INFO:teuthology.orchestra.run.smithi044.stderr: 71600K .......... .......... .......... .......... .......... 77% 66.7M 2s 2023-12-03T11:41:22.363 INFO:teuthology.orchestra.run.smithi044.stderr: 71650K .......... .......... .......... .......... .......... 77% 27.4M 2s 2023-12-03T11:41:22.363 INFO:teuthology.orchestra.run.smithi044.stderr: 71700K .......... .......... .......... .......... .......... 77% 59.9M 2s 2023-12-03T11:41:22.365 INFO:teuthology.orchestra.run.smithi044.stderr: 71750K .......... .......... .......... .......... .......... 77% 32.2M 2s 2023-12-03T11:41:22.366 INFO:teuthology.orchestra.run.smithi044.stderr: 71800K .......... .......... .......... .......... .......... 77% 40.8M 2s 2023-12-03T11:41:22.367 INFO:teuthology.orchestra.run.smithi044.stderr: 71850K .......... .......... .......... .......... .......... 77% 48.1M 2s 2023-12-03T11:41:22.368 INFO:teuthology.orchestra.run.smithi044.stderr: 71900K .......... .......... .......... .......... .......... 77% 56.7M 2s 2023-12-03T11:41:22.370 INFO:teuthology.orchestra.run.smithi044.stderr: 71950K .......... .......... .......... .......... .......... 77% 30.9M 2s 2023-12-03T11:41:22.371 INFO:teuthology.orchestra.run.smithi044.stderr: 72000K .......... .......... .......... .......... .......... 77% 34.4M 2s 2023-12-03T11:41:22.372 INFO:teuthology.orchestra.run.smithi044.stderr: 72050K .......... .......... .......... .......... .......... 77% 52.3M 2s 2023-12-03T11:41:22.374 INFO:teuthology.orchestra.run.smithi044.stderr: 72100K .......... .......... .......... .......... .......... 77% 30.0M 2s 2023-12-03T11:41:22.374 INFO:teuthology.orchestra.run.smithi044.stderr: 72150K .......... .......... .......... .......... .......... 77% 44.5M 2s 2023-12-03T11:41:22.376 INFO:teuthology.orchestra.run.smithi044.stderr: 72200K .......... .......... .......... .......... .......... 77% 27.9M 2s 2023-12-03T11:41:22.378 INFO:teuthology.orchestra.run.smithi044.stderr: 72250K .......... .......... .......... .......... .......... 77% 57.6M 2s 2023-12-03T11:41:22.378 INFO:teuthology.orchestra.run.smithi044.stderr: 72300K .......... .......... .......... .......... .......... 77% 37.7M 2s 2023-12-03T11:41:22.380 INFO:teuthology.orchestra.run.smithi044.stderr: 72350K .......... .......... .......... .......... .......... 77% 29.0M 2s 2023-12-03T11:41:22.382 INFO:teuthology.orchestra.run.smithi044.stderr: 72400K .......... .......... .......... .......... .......... 77% 25.1M 2s 2023-12-03T11:41:22.383 INFO:teuthology.orchestra.run.smithi044.stderr: 72450K .......... .......... .......... .......... .......... 78% 53.4M 2s 2023-12-03T11:41:22.384 INFO:teuthology.orchestra.run.smithi044.stderr: 72500K .......... .......... .......... .......... .......... 78% 50.3M 2s 2023-12-03T11:41:22.385 INFO:teuthology.orchestra.run.smithi044.stderr: 72550K .......... .......... .......... .......... .......... 78% 32.1M 2s 2023-12-03T11:41:22.387 INFO:teuthology.orchestra.run.smithi044.stderr: 72600K .......... .......... .......... .......... .......... 78% 25.8M 2s 2023-12-03T11:41:22.388 INFO:teuthology.orchestra.run.smithi044.stderr: 72650K .......... .......... .......... .......... .......... 78% 48.6M 2s 2023-12-03T11:41:22.390 INFO:teuthology.orchestra.run.smithi044.stderr: 72700K .......... .......... .......... .......... .......... 78% 35.7M 2s 2023-12-03T11:41:22.391 INFO:teuthology.orchestra.run.smithi044.stderr: 72750K .......... .......... .......... .......... .......... 78% 40.3M 2s 2023-12-03T11:41:22.392 INFO:teuthology.orchestra.run.smithi044.stderr: 72800K .......... .......... .......... .......... .......... 78% 35.8M 2s 2023-12-03T11:41:22.395 INFO:teuthology.orchestra.run.smithi044.stderr: 72850K .......... .......... .......... .......... .......... 78% 27.4M 2s 2023-12-03T11:41:22.396 INFO:teuthology.orchestra.run.smithi044.stderr: 72900K .......... .......... .......... .......... .......... 78% 29.3M 2s 2023-12-03T11:41:22.398 INFO:teuthology.orchestra.run.smithi044.stderr: 72950K .......... .......... .......... .......... .......... 78% 24.1M 2s 2023-12-03T11:41:22.398 INFO:teuthology.orchestra.run.smithi044.stderr: 73000K .......... .......... .......... .......... .......... 78% 76.9M 2s 2023-12-03T11:41:22.399 INFO:teuthology.orchestra.run.smithi044.stderr: 73050K .......... .......... .......... .......... .......... 78% 53.1M 2s 2023-12-03T11:41:22.401 INFO:teuthology.orchestra.run.smithi044.stderr: 73100K .......... .......... .......... .......... .......... 78% 37.4M 2s 2023-12-03T11:41:22.402 INFO:teuthology.orchestra.run.smithi044.stderr: 73150K .......... .......... .......... .......... .......... 78% 35.4M 2s 2023-12-03T11:41:22.404 INFO:teuthology.orchestra.run.smithi044.stderr: 73200K .......... .......... .......... .......... .......... 78% 31.5M 2s 2023-12-03T11:41:22.405 INFO:teuthology.orchestra.run.smithi044.stderr: 73250K .......... .......... .......... .......... .......... 78% 39.6M 2s 2023-12-03T11:41:22.406 INFO:teuthology.orchestra.run.smithi044.stderr: 73300K .......... .......... .......... .......... .......... 78% 66.2M 2s 2023-12-03T11:41:22.408 INFO:teuthology.orchestra.run.smithi044.stderr: 73350K .......... .......... .......... .......... .......... 79% 22.5M 2s 2023-12-03T11:41:22.409 INFO:teuthology.orchestra.run.smithi044.stderr: 73400K .......... .......... .......... .......... .......... 79% 36.9M 2s 2023-12-03T11:41:22.411 INFO:teuthology.orchestra.run.smithi044.stderr: 73450K .......... .......... .......... .......... .......... 79% 51.8M 2s 2023-12-03T11:41:22.412 INFO:teuthology.orchestra.run.smithi044.stderr: 73500K .......... .......... .......... .......... .......... 79% 22.8M 2s 2023-12-03T11:41:22.413 INFO:teuthology.orchestra.run.smithi044.stderr: 73550K .......... .......... .......... .......... .......... 79% 58.2M 2s 2023-12-03T11:41:22.415 INFO:teuthology.orchestra.run.smithi044.stderr: 73600K .......... .......... .......... .......... .......... 79% 41.1M 2s 2023-12-03T11:41:22.416 INFO:teuthology.orchestra.run.smithi044.stderr: 73650K .......... .......... .......... .......... .......... 79% 34.3M 2s 2023-12-03T11:41:22.416 INFO:teuthology.orchestra.run.smithi044.stderr: 73700K .......... .......... .......... .......... .......... 79% 55.2M 2s 2023-12-03T11:41:22.417 INFO:teuthology.orchestra.run.smithi044.stderr: 73750K .......... .......... .......... .......... .......... 79% 44.8M 2s 2023-12-03T11:41:22.420 INFO:teuthology.orchestra.run.smithi044.stderr: 73800K .......... .......... .......... .......... .......... 79% 23.0M 2s 2023-12-03T11:41:22.421 INFO:teuthology.orchestra.run.smithi044.stderr: 73850K .......... .......... .......... .......... .......... 79% 38.4M 2s 2023-12-03T11:41:22.423 INFO:teuthology.orchestra.run.smithi044.stderr: 73900K .......... .......... .......... .......... .......... 79% 32.2M 2s 2023-12-03T11:41:22.423 INFO:teuthology.orchestra.run.smithi044.stderr: 73950K .......... .......... .......... .......... .......... 79% 40.0M 2s 2023-12-03T11:41:22.426 INFO:teuthology.orchestra.run.smithi044.stderr: 74000K .......... .......... .......... .......... .......... 79% 31.7M 2s 2023-12-03T11:41:22.428 INFO:teuthology.orchestra.run.smithi044.stderr: 74050K .......... .......... .......... .......... .......... 79% 19.7M 2s 2023-12-03T11:41:22.432 INFO:teuthology.orchestra.run.smithi044.stderr: 74100K .......... .......... .......... .......... .......... 79% 12.3M 2s 2023-12-03T11:41:22.435 INFO:teuthology.orchestra.run.smithi044.stderr: 74150K .......... .......... .......... .......... .......... 79% 40.7M 2s 2023-12-03T11:41:22.435 INFO:teuthology.orchestra.run.smithi044.stderr: 74200K .......... .......... .......... .......... .......... 79% 93.0M 2s 2023-12-03T11:41:22.435 INFO:teuthology.orchestra.run.smithi044.stderr: 74250K .......... .......... .......... .......... .......... 79% 38.7M 2s 2023-12-03T11:41:22.437 INFO:teuthology.orchestra.run.smithi044.stderr: 74300K .......... .......... .......... .......... .......... 80% 29.2M 2s 2023-12-03T11:41:22.439 INFO:teuthology.orchestra.run.smithi044.stderr: 74350K .......... .......... .......... .......... .......... 80% 28.0M 2s 2023-12-03T11:41:22.439 INFO:teuthology.orchestra.run.smithi044.stderr: 74400K .......... .......... .......... .......... .......... 80% 76.7M 2s 2023-12-03T11:41:22.440 INFO:teuthology.orchestra.run.smithi044.stderr: 74450K .......... .......... .......... .......... .......... 80% 30.3M 2s 2023-12-03T11:41:22.441 INFO:teuthology.orchestra.run.smithi044.stderr: 74500K .......... .......... .......... .......... .......... 80% 54.7M 2s 2023-12-03T11:41:22.443 INFO:teuthology.orchestra.run.smithi044.stderr: 74550K .......... .......... .......... .......... .......... 80% 29.5M 2s 2023-12-03T11:41:22.445 INFO:teuthology.orchestra.run.smithi044.stderr: 74600K .......... .......... .......... .......... .......... 80% 35.9M 2s 2023-12-03T11:41:22.445 INFO:teuthology.orchestra.run.smithi044.stderr: 74650K .......... .......... .......... .......... .......... 80% 46.6M 2s 2023-12-03T11:41:22.447 INFO:teuthology.orchestra.run.smithi044.stderr: 74700K .......... .......... .......... .......... .......... 80% 50.0M 2s 2023-12-03T11:41:22.452 INFO:teuthology.orchestra.run.smithi044.stderr: 74750K .......... .......... .......... .......... .......... 80% 28.5M 2s 2023-12-03T11:41:22.452 INFO:teuthology.orchestra.run.smithi044.stderr: 74800K .......... .......... .......... .......... .......... 80% 30.2M 2s 2023-12-03T11:41:22.452 INFO:teuthology.orchestra.run.smithi044.stderr: 74850K .......... .......... .......... .......... .......... 80% 78.1M 2s 2023-12-03T11:41:22.452 INFO:teuthology.orchestra.run.smithi044.stderr: 74900K .......... .......... .......... .......... .......... 80% 41.3M 2s 2023-12-03T11:41:22.453 INFO:teuthology.orchestra.run.smithi044.stderr: 74950K .......... .......... .......... .......... .......... 80% 40.2M 2s 2023-12-03T11:41:22.456 INFO:teuthology.orchestra.run.smithi044.stderr: 75000K .......... .......... .......... .......... .......... 80% 30.8M 2s 2023-12-03T11:41:22.456 INFO:teuthology.orchestra.run.smithi044.stderr: 75050K .......... .......... .......... .......... .......... 80% 32.2M 2s 2023-12-03T11:41:22.456 INFO:teuthology.orchestra.run.smithi044.stderr: 75100K .......... .......... .......... .......... .......... 80% 72.3M 2s 2023-12-03T11:41:22.458 INFO:teuthology.orchestra.run.smithi044.stderr: 75150K .......... .......... .......... .......... .......... 80% 36.8M 2s 2023-12-03T11:41:22.460 INFO:teuthology.orchestra.run.smithi044.stderr: 75200K .......... .......... .......... .......... .......... 81% 29.2M 2s 2023-12-03T11:41:22.462 INFO:teuthology.orchestra.run.smithi044.stderr: 75250K .......... .......... .......... .......... .......... 81% 26.0M 2s 2023-12-03T11:41:22.463 INFO:teuthology.orchestra.run.smithi044.stderr: 75300K .......... .......... .......... .......... .......... 81% 42.4M 2s 2023-12-03T11:41:22.463 INFO:teuthology.orchestra.run.smithi044.stderr: 75350K .......... .......... .......... .......... .......... 81% 41.3M 2s 2023-12-03T11:41:22.465 INFO:teuthology.orchestra.run.smithi044.stderr: 75400K .......... .......... .......... .......... .......... 81% 70.0M 2s 2023-12-03T11:41:22.466 INFO:teuthology.orchestra.run.smithi044.stderr: 75450K .......... .......... .......... .......... .......... 81% 36.5M 2s 2023-12-03T11:41:22.467 INFO:teuthology.orchestra.run.smithi044.stderr: 75500K .......... .......... .......... .......... .......... 81% 28.3M 2s 2023-12-03T11:41:22.469 INFO:teuthology.orchestra.run.smithi044.stderr: 75550K .......... .......... .......... .......... .......... 81% 30.8M 2s 2023-12-03T11:41:22.470 INFO:teuthology.orchestra.run.smithi044.stderr: 75600K .......... .......... .......... .......... .......... 81% 85.8M 2s 2023-12-03T11:41:22.471 INFO:teuthology.orchestra.run.smithi044.stderr: 75650K .......... .......... .......... .......... .......... 81% 41.4M 2s 2023-12-03T11:41:22.473 INFO:teuthology.orchestra.run.smithi044.stderr: 75700K .......... .......... .......... .......... .......... 81% 27.5M 2s 2023-12-03T11:41:22.475 INFO:teuthology.orchestra.run.smithi044.stderr: 75750K .......... .......... .......... .......... .......... 81% 28.4M 2s 2023-12-03T11:41:22.475 INFO:teuthology.orchestra.run.smithi044.stderr: 75800K .......... .......... .......... .......... .......... 81% 76.0M 2s 2023-12-03T11:41:22.476 INFO:teuthology.orchestra.run.smithi044.stderr: 75850K .......... .......... .......... .......... .......... 81% 38.0M 2s 2023-12-03T11:41:22.478 INFO:teuthology.orchestra.run.smithi044.stderr: 75900K .......... .......... .......... .......... .......... 81% 30.2M 2s 2023-12-03T11:41:22.479 INFO:teuthology.orchestra.run.smithi044.stderr: 75950K .......... .......... .......... .......... .......... 81% 45.2M 2s 2023-12-03T11:41:22.481 INFO:teuthology.orchestra.run.smithi044.stderr: 76000K .......... .......... .......... .......... .......... 81% 33.2M 2s 2023-12-03T11:41:22.482 INFO:teuthology.orchestra.run.smithi044.stderr: 76050K .......... .......... .......... .......... .......... 81% 27.6M 1s 2023-12-03T11:41:22.483 INFO:teuthology.orchestra.run.smithi044.stderr: 76100K .......... .......... .......... .......... .......... 81% 52.9M 1s 2023-12-03T11:41:22.484 INFO:teuthology.orchestra.run.smithi044.stderr: 76150K .......... .......... .......... .......... .......... 82% 34.4M 1s 2023-12-03T11:41:22.486 INFO:teuthology.orchestra.run.smithi044.stderr: 76200K .......... .......... .......... .......... .......... 82% 31.5M 1s 2023-12-03T11:41:22.487 INFO:teuthology.orchestra.run.smithi044.stderr: 76250K .......... .......... .......... .......... .......... 82% 75.2M 1s 2023-12-03T11:41:22.489 INFO:teuthology.orchestra.run.smithi044.stderr: 76300K .......... .......... .......... .......... .......... 82% 24.0M 1s 2023-12-03T11:41:22.490 INFO:teuthology.orchestra.run.smithi044.stderr: 76350K .......... .......... .......... .......... .......... 82% 34.4M 1s 2023-12-03T11:41:22.491 INFO:teuthology.orchestra.run.smithi044.stderr: 76400K .......... .......... .......... .......... .......... 82% 41.1M 1s 2023-12-03T11:41:22.494 INFO:teuthology.orchestra.run.smithi044.stderr: 76450K .......... .......... .......... .......... .......... 82% 23.2M 1s 2023-12-03T11:41:22.496 INFO:teuthology.orchestra.run.smithi044.stderr: 76500K .......... .......... .......... .......... .......... 82% 65.7M 1s 2023-12-03T11:41:22.496 INFO:teuthology.orchestra.run.smithi044.stderr: 76550K .......... .......... .......... .......... .......... 82% 26.5M 1s 2023-12-03T11:41:22.498 INFO:teuthology.orchestra.run.smithi044.stderr: 76600K .......... .......... .......... .......... .......... 82% 34.1M 1s 2023-12-03T11:41:22.500 INFO:teuthology.orchestra.run.smithi044.stderr: 76650K .......... .......... .......... .......... .......... 82% 24.4M 1s 2023-12-03T11:41:22.501 INFO:teuthology.orchestra.run.smithi044.stderr: 76700K .......... .......... .......... .......... .......... 82% 39.9M 1s 2023-12-03T11:41:22.503 INFO:teuthology.orchestra.run.smithi044.stderr: 76750K .......... .......... .......... .......... .......... 82% 48.6M 1s 2023-12-03T11:41:22.503 INFO:teuthology.orchestra.run.smithi044.stderr: 76800K .......... .......... .......... .......... .......... 82% 55.9M 1s 2023-12-03T11:41:22.505 INFO:teuthology.orchestra.run.smithi044.stderr: 76850K .......... .......... .......... .......... .......... 82% 33.0M 1s 2023-12-03T11:41:22.508 INFO:teuthology.orchestra.run.smithi044.stderr: 76900K .......... .......... .......... .......... .......... 82% 27.1M 1s 2023-12-03T11:41:22.509 INFO:teuthology.orchestra.run.smithi044.stderr: 76950K .......... .......... .......... .......... .......... 82% 23.8M 1s 2023-12-03T11:41:22.509 INFO:teuthology.orchestra.run.smithi044.stderr: 77000K .......... .......... .......... .......... .......... 82% 68.0M 1s 2023-12-03T11:41:22.511 INFO:teuthology.orchestra.run.smithi044.stderr: 77050K .......... .......... .......... .......... .......... 82% 25.7M 1s 2023-12-03T11:41:22.513 INFO:teuthology.orchestra.run.smithi044.stderr: 77100K .......... .......... .......... .......... .......... 83% 29.7M 1s 2023-12-03T11:41:22.515 INFO:teuthology.orchestra.run.smithi044.stderr: 77150K .......... .......... .......... .......... .......... 83% 22.7M 1s 2023-12-03T11:41:22.515 INFO:teuthology.orchestra.run.smithi044.stderr: 77200K .......... .......... .......... .......... .......... 83% 114M 1s 2023-12-03T11:41:22.516 INFO:teuthology.orchestra.run.smithi044.stderr: 77250K .......... .......... .......... .......... .......... 83% 34.1M 1s 2023-12-03T11:41:22.517 INFO:teuthology.orchestra.run.smithi044.stderr: 77300K .......... .......... .......... .......... .......... 83% 56.0M 1s 2023-12-03T11:41:22.518 INFO:teuthology.orchestra.run.smithi044.stderr: 77350K .......... .......... .......... .......... .......... 83% 36.8M 1s 2023-12-03T11:41:22.519 INFO:teuthology.orchestra.run.smithi044.stderr: 77400K .......... .......... .......... .......... .......... 83% 54.8M 1s 2023-12-03T11:41:22.521 INFO:teuthology.orchestra.run.smithi044.stderr: 77450K .......... .......... .......... .......... .......... 83% 24.1M 1s 2023-12-03T11:41:22.522 INFO:teuthology.orchestra.run.smithi044.stderr: 77500K .......... .......... .......... .......... .......... 83% 57.2M 1s 2023-12-03T11:41:22.524 INFO:teuthology.orchestra.run.smithi044.stderr: 77550K .......... .......... .......... .......... .......... 83% 27.4M 1s 2023-12-03T11:41:22.527 INFO:teuthology.orchestra.run.smithi044.stderr: 77600K .......... .......... .......... .......... .......... 83% 26.4M 1s 2023-12-03T11:41:22.527 INFO:teuthology.orchestra.run.smithi044.stderr: 77650K .......... .......... .......... .......... .......... 83% 36.8M 1s 2023-12-03T11:41:22.527 INFO:teuthology.orchestra.run.smithi044.stderr: 77700K .......... .......... .......... .......... .......... 83% 127M 1s 2023-12-03T11:41:22.531 INFO:teuthology.orchestra.run.smithi044.stderr: 77750K .......... .......... .......... .......... .......... 83% 18.8M 1s 2023-12-03T11:41:22.533 INFO:teuthology.orchestra.run.smithi044.stderr: 77800K .......... .......... .......... .......... .......... 83% 24.1M 1s 2023-12-03T11:41:22.536 INFO:teuthology.orchestra.run.smithi044.stderr: 77850K .......... .......... .......... .......... .......... 83% 11.1M 1s 2023-12-03T11:41:22.540 INFO:teuthology.orchestra.run.smithi044.stderr: 77900K .......... .......... .......... .......... .......... 83% 30.4M 1s 2023-12-03T11:41:22.540 INFO:teuthology.orchestra.run.smithi044.stderr: 77950K .......... .......... .......... .......... .......... 83% 31.0M 1s 2023-12-03T11:41:22.541 INFO:teuthology.orchestra.run.smithi044.stderr: 78000K .......... .......... .......... .......... .......... 84% 56.8M 1s 2023-12-03T11:41:22.543 INFO:teuthology.orchestra.run.smithi044.stderr: 78050K .......... .......... .......... .......... .......... 84% 20.9M 1s 2023-12-03T11:41:22.543 INFO:teuthology.orchestra.run.smithi044.stderr: 78100K .......... .......... .......... .......... .......... 84% 71.7M 1s 2023-12-03T11:41:22.546 INFO:teuthology.orchestra.run.smithi044.stderr: 78150K .......... .......... .......... .......... .......... 84% 25.6M 1s 2023-12-03T11:41:22.547 INFO:teuthology.orchestra.run.smithi044.stderr: 78200K .......... .......... .......... .......... .......... 84% 24.7M 1s 2023-12-03T11:41:22.549 INFO:teuthology.orchestra.run.smithi044.stderr: 78250K .......... .......... .......... .......... .......... 84% 34.7M 1s 2023-12-03T11:41:22.551 INFO:teuthology.orchestra.run.smithi044.stderr: 78300K .......... .......... .......... .......... .......... 84% 22.1M 1s 2023-12-03T11:41:22.551 INFO:teuthology.orchestra.run.smithi044.stderr: 78350K .......... .......... .......... .......... .......... 84% 56.8M 1s 2023-12-03T11:41:22.554 INFO:teuthology.orchestra.run.smithi044.stderr: 78400K .......... .......... .......... .......... .......... 84% 21.6M 1s 2023-12-03T11:41:22.556 INFO:teuthology.orchestra.run.smithi044.stderr: 78450K .......... .......... .......... .......... .......... 84% 30.6M 1s 2023-12-03T11:41:22.557 INFO:teuthology.orchestra.run.smithi044.stderr: 78500K .......... .......... .......... .......... .......... 84% 50.8M 1s 2023-12-03T11:41:22.558 INFO:teuthology.orchestra.run.smithi044.stderr: 78550K .......... .......... .......... .......... .......... 84% 33.1M 1s 2023-12-03T11:41:22.559 INFO:teuthology.orchestra.run.smithi044.stderr: 78600K .......... .......... .......... .......... .......... 84% 54.5M 1s 2023-12-03T11:41:22.560 INFO:teuthology.orchestra.run.smithi044.stderr: 78650K .......... .......... .......... .......... .......... 84% 48.5M 1s 2023-12-03T11:41:22.562 INFO:teuthology.orchestra.run.smithi044.stderr: 78700K .......... .......... .......... .......... .......... 84% 29.2M 1s 2023-12-03T11:41:22.564 INFO:teuthology.orchestra.run.smithi044.stderr: 78750K .......... .......... .......... .......... .......... 84% 22.7M 1s 2023-12-03T11:41:22.566 INFO:teuthology.orchestra.run.smithi044.stderr: 78800K .......... .......... .......... .......... .......... 84% 36.6M 1s 2023-12-03T11:41:22.567 INFO:teuthology.orchestra.run.smithi044.stderr: 78850K .......... .......... .......... .......... .......... 84% 29.3M 1s 2023-12-03T11:41:22.568 INFO:teuthology.orchestra.run.smithi044.stderr: 78900K .......... .......... .......... .......... .......... 84% 47.2M 1s 2023-12-03T11:41:22.570 INFO:teuthology.orchestra.run.smithi044.stderr: 78950K .......... .......... .......... .......... .......... 85% 26.0M 1s 2023-12-03T11:41:22.572 INFO:teuthology.orchestra.run.smithi044.stderr: 79000K .......... .......... .......... .......... .......... 85% 22.5M 1s 2023-12-03T11:41:22.572 INFO:teuthology.orchestra.run.smithi044.stderr: 79050K .......... .......... .......... .......... .......... 85% 68.9M 1s 2023-12-03T11:41:22.575 INFO:teuthology.orchestra.run.smithi044.stderr: 79100K .......... .......... .......... .......... .......... 85% 22.8M 1s 2023-12-03T11:41:22.576 INFO:teuthology.orchestra.run.smithi044.stderr: 79150K .......... .......... .......... .......... .......... 85% 39.5M 1s 2023-12-03T11:41:22.578 INFO:teuthology.orchestra.run.smithi044.stderr: 79200K .......... .......... .......... .......... .......... 85% 23.8M 1s 2023-12-03T11:41:22.580 INFO:teuthology.orchestra.run.smithi044.stderr: 79250K .......... .......... .......... .......... .......... 85% 31.7M 1s 2023-12-03T11:41:22.580 INFO:teuthology.orchestra.run.smithi044.stderr: 79300K .......... .......... .......... .......... .......... 85% 50.6M 1s 2023-12-03T11:41:22.583 INFO:teuthology.orchestra.run.smithi044.stderr: 79350K .......... .......... .......... .......... .......... 85% 21.1M 1s 2023-12-03T11:41:22.586 INFO:teuthology.orchestra.run.smithi044.stderr: 79400K .......... .......... .......... .......... .......... 85% 34.1M 1s 2023-12-03T11:41:22.586 INFO:teuthology.orchestra.run.smithi044.stderr: 79450K .......... .......... .......... .......... .......... 85% 28.5M 1s 2023-12-03T11:41:22.589 INFO:teuthology.orchestra.run.smithi044.stderr: 79500K .......... .......... .......... .......... .......... 85% 20.2M 1s 2023-12-03T11:41:22.589 INFO:teuthology.orchestra.run.smithi044.stderr: 79550K .......... .......... .......... .......... .......... 85% 63.5M 1s 2023-12-03T11:41:22.591 INFO:teuthology.orchestra.run.smithi044.stderr: 79600K .......... .......... .......... .......... .......... 85% 31.7M 1s 2023-12-03T11:41:22.593 INFO:teuthology.orchestra.run.smithi044.stderr: 79650K .......... .......... .......... .......... .......... 85% 23.0M 1s 2023-12-03T11:41:22.595 INFO:teuthology.orchestra.run.smithi044.stderr: 79700K .......... .......... .......... .......... .......... 85% 24.6M 1s 2023-12-03T11:41:22.597 INFO:teuthology.orchestra.run.smithi044.stderr: 79750K .......... .......... .......... .......... .......... 85% 29.7M 1s 2023-12-03T11:41:22.597 INFO:teuthology.orchestra.run.smithi044.stderr: 79800K .......... .......... .......... .......... .......... 85% 56.9M 1s 2023-12-03T11:41:22.608 INFO:teuthology.orchestra.run.smithi044.stderr: 79850K .......... .......... .......... .......... .......... 86% 10.1M 1s 2023-12-03T11:41:22.608 INFO:teuthology.orchestra.run.smithi044.stderr: 79900K .......... .......... .......... .......... .......... 86% 101M 1s 2023-12-03T11:41:22.608 INFO:teuthology.orchestra.run.smithi044.stderr: 79950K .......... .......... .......... .......... .......... 86% 174M 1s 2023-12-03T11:41:22.608 INFO:teuthology.orchestra.run.smithi044.stderr: 80000K .......... .......... .......... .......... .......... 86% 131M 1s 2023-12-03T11:41:22.608 INFO:teuthology.orchestra.run.smithi044.stderr: 80050K .......... .......... .......... .......... .......... 86% 52.4M 1s 2023-12-03T11:41:22.608 INFO:teuthology.orchestra.run.smithi044.stderr: 80100K .......... .......... .......... .......... .......... 86% 24.2M 1s 2023-12-03T11:41:22.609 INFO:teuthology.orchestra.run.smithi044.stderr: 80150K .......... .......... .......... .......... .......... 86% 21.9M 1s 2023-12-03T11:41:22.611 INFO:teuthology.orchestra.run.smithi044.stderr: 80200K .......... .......... .......... .......... .......... 86% 27.1M 1s 2023-12-03T11:41:22.613 INFO:teuthology.orchestra.run.smithi044.stderr: 80250K .......... .......... .......... .......... .......... 86% 35.7M 1s 2023-12-03T11:41:22.613 INFO:teuthology.orchestra.run.smithi044.stderr: 80300K .......... .......... .......... .......... .......... 86% 99.8M 1s 2023-12-03T11:41:22.616 INFO:teuthology.orchestra.run.smithi044.stderr: 80350K .......... .......... .......... .......... .......... 86% 16.8M 1s 2023-12-03T11:41:22.618 INFO:teuthology.orchestra.run.smithi044.stderr: 80400K .......... .......... .......... .......... .......... 86% 19.7M 1s 2023-12-03T11:41:22.620 INFO:teuthology.orchestra.run.smithi044.stderr: 80450K .......... .......... .......... .......... .......... 86% 27.5M 1s 2023-12-03T11:41:22.620 INFO:teuthology.orchestra.run.smithi044.stderr: 80500K .......... .......... .......... .......... .......... 86% 59.3M 1s 2023-12-03T11:41:22.623 INFO:teuthology.orchestra.run.smithi044.stderr: 80550K .......... .......... .......... .......... .......... 86% 19.8M 1s 2023-12-03T11:41:22.625 INFO:teuthology.orchestra.run.smithi044.stderr: 80600K .......... .......... .......... .......... .......... 86% 28.5M 1s 2023-12-03T11:41:22.626 INFO:teuthology.orchestra.run.smithi044.stderr: 80650K .......... .......... .......... .......... .......... 86% 28.4M 1s 2023-12-03T11:41:22.628 INFO:teuthology.orchestra.run.smithi044.stderr: 80700K .......... .......... .......... .......... .......... 86% 24.8M 1s 2023-12-03T11:41:22.629 INFO:teuthology.orchestra.run.smithi044.stderr: 80750K .......... .......... .......... .......... .......... 86% 62.1M 1s 2023-12-03T11:41:22.631 INFO:teuthology.orchestra.run.smithi044.stderr: 80800K .......... .......... .......... .......... .......... 87% 26.9M 1s 2023-12-03T11:41:22.633 INFO:teuthology.orchestra.run.smithi044.stderr: 80850K .......... .......... .......... .......... .......... 87% 21.9M 1s 2023-12-03T11:41:22.633 INFO:teuthology.orchestra.run.smithi044.stderr: 80900K .......... .......... .......... .......... .......... 87% 77.8M 1s 2023-12-03T11:41:22.636 INFO:teuthology.orchestra.run.smithi044.stderr: 80950K .......... .......... .......... .......... .......... 87% 19.3M 1s 2023-12-03T11:41:22.638 INFO:teuthology.orchestra.run.smithi044.stderr: 81000K .......... .......... .......... .......... .......... 87% 28.2M 1s 2023-12-03T11:41:22.641 INFO:teuthology.orchestra.run.smithi044.stderr: 81050K .......... .......... .......... .......... .......... 87% 20.1M 1s 2023-12-03T11:41:22.642 INFO:teuthology.orchestra.run.smithi044.stderr: 81100K .......... .......... .......... .......... .......... 87% 44.9M 1s 2023-12-03T11:41:22.642 INFO:teuthology.orchestra.run.smithi044.stderr: 81150K .......... .......... .......... .......... .......... 87% 39.3M 1s 2023-12-03T11:41:22.644 INFO:teuthology.orchestra.run.smithi044.stderr: 81200K .......... .......... .......... .......... .......... 87% 29.8M 1s 2023-12-03T11:41:22.645 INFO:teuthology.orchestra.run.smithi044.stderr: 81250K .......... .......... .......... .......... .......... 87% 56.3M 1s 2023-12-03T11:41:22.647 INFO:teuthology.orchestra.run.smithi044.stderr: 81300K .......... .......... .......... .......... .......... 87% 27.8M 1s 2023-12-03T11:41:22.649 INFO:teuthology.orchestra.run.smithi044.stderr: 81350K .......... .......... .......... .......... .......... 87% 23.8M 1s 2023-12-03T11:41:22.652 INFO:teuthology.orchestra.run.smithi044.stderr: 81400K .......... .......... .......... .......... .......... 87% 76.5M 1s 2023-12-03T11:41:22.652 INFO:teuthology.orchestra.run.smithi044.stderr: 81450K .......... .......... .......... .......... .......... 87% 22.4M 1s 2023-12-03T11:41:22.653 INFO:teuthology.orchestra.run.smithi044.stderr: 81500K .......... .......... .......... .......... .......... 87% 34.5M 1s 2023-12-03T11:41:22.658 INFO:teuthology.orchestra.run.smithi044.stderr: 81550K .......... .......... .......... .......... .......... 87% 28.9M 1s 2023-12-03T11:41:22.659 INFO:teuthology.orchestra.run.smithi044.stderr: 81600K .......... .......... .......... .......... .......... 87% 70.3M 1s 2023-12-03T11:41:22.659 INFO:teuthology.orchestra.run.smithi044.stderr: 81650K .......... .......... .......... .......... .......... 87% 18.0M 1s 2023-12-03T11:41:22.661 INFO:teuthology.orchestra.run.smithi044.stderr: 81700K .......... .......... .......... .......... .......... 87% 16.7M 1s 2023-12-03T11:41:22.664 INFO:teuthology.orchestra.run.smithi044.stderr: 81750K .......... .......... .......... .......... .......... 88% 14.5M 1s 2023-12-03T11:41:22.668 INFO:teuthology.orchestra.run.smithi044.stderr: 81800K .......... .......... .......... .......... .......... 88% 18.3M 1s 2023-12-03T11:41:22.668 INFO:teuthology.orchestra.run.smithi044.stderr: 81850K .......... .......... .......... .......... .......... 88% 76.8M 1s 2023-12-03T11:41:22.669 INFO:teuthology.orchestra.run.smithi044.stderr: 81900K .......... .......... .......... .......... .......... 88% 36.1M 1s 2023-12-03T11:41:22.672 INFO:teuthology.orchestra.run.smithi044.stderr: 81950K .......... .......... .......... .......... .......... 88% 18.5M 1s 2023-12-03T11:41:22.674 INFO:teuthology.orchestra.run.smithi044.stderr: 82000K .......... .......... .......... .......... .......... 88% 23.7M 1s 2023-12-03T11:41:22.676 INFO:teuthology.orchestra.run.smithi044.stderr: 82050K .......... .......... .......... .......... .......... 88% 22.0M 1s 2023-12-03T11:41:22.679 INFO:teuthology.orchestra.run.smithi044.stderr: 82100K .......... .......... .......... .......... .......... 88% 66.5M 1s 2023-12-03T11:41:22.679 INFO:teuthology.orchestra.run.smithi044.stderr: 82150K .......... .......... .......... .......... .......... 88% 24.2M 1s 2023-12-03T11:41:22.681 INFO:teuthology.orchestra.run.smithi044.stderr: 82200K .......... .......... .......... .......... .......... 88% 19.3M 1s 2023-12-03T11:41:22.683 INFO:teuthology.orchestra.run.smithi044.stderr: 82250K .......... .......... .......... .......... .......... 88% 25.1M 1s 2023-12-03T11:41:22.686 INFO:teuthology.orchestra.run.smithi044.stderr: 82300K .......... .......... .......... .......... .......... 88% 20.1M 1s 2023-12-03T11:41:22.687 INFO:teuthology.orchestra.run.smithi044.stderr: 82350K .......... .......... .......... .......... .......... 88% 45.9M 1s 2023-12-03T11:41:22.688 INFO:teuthology.orchestra.run.smithi044.stderr: 82400K .......... .......... .......... .......... .......... 88% 37.6M 1s 2023-12-03T11:41:22.693 INFO:teuthology.orchestra.run.smithi044.stderr: 82450K .......... .......... .......... .......... .......... 88% 31.6M 1s 2023-12-03T11:41:22.693 INFO:teuthology.orchestra.run.smithi044.stderr: 82500K .......... .......... .......... .......... .......... 88% 25.1M 1s 2023-12-03T11:41:22.694 INFO:teuthology.orchestra.run.smithi044.stderr: 82550K .......... .......... .......... .......... .......... 88% 21.1M 1s 2023-12-03T11:41:22.694 INFO:teuthology.orchestra.run.smithi044.stderr: 82600K .......... .......... .......... .......... .......... 88% 81.0M 1s 2023-12-03T11:41:22.697 INFO:teuthology.orchestra.run.smithi044.stderr: 82650K .......... .......... .......... .......... .......... 89% 25.0M 1s 2023-12-03T11:41:22.698 INFO:teuthology.orchestra.run.smithi044.stderr: 82700K .......... .......... .......... .......... .......... 89% 26.6M 1s 2023-12-03T11:41:22.701 INFO:teuthology.orchestra.run.smithi044.stderr: 82750K .......... .......... .......... .......... .......... 89% 21.0M 1s 2023-12-03T11:41:22.704 INFO:teuthology.orchestra.run.smithi044.stderr: 82800K .......... .......... .......... .......... .......... 89% 21.6M 1s 2023-12-03T11:41:22.704 INFO:teuthology.orchestra.run.smithi044.stderr: 82850K .......... .......... .......... .......... .......... 89% 71.0M 1s 2023-12-03T11:41:22.707 INFO:teuthology.orchestra.run.smithi044.stderr: 82900K .......... .......... .......... .......... .......... 89% 19.7M 1s 2023-12-03T11:41:22.708 INFO:teuthology.orchestra.run.smithi044.stderr: 82950K .......... .......... .......... .......... .......... 89% 22.3M 1s 2023-12-03T11:41:22.711 INFO:teuthology.orchestra.run.smithi044.stderr: 83000K .......... .......... .......... .......... .......... 89% 42.5M 1s 2023-12-03T11:41:22.711 INFO:teuthology.orchestra.run.smithi044.stderr: 83050K .......... .......... .......... .......... .......... 89% 29.8M 1s 2023-12-03T11:41:22.714 INFO:teuthology.orchestra.run.smithi044.stderr: 83100K .......... .......... .......... .......... .......... 89% 18.0M 1s 2023-12-03T11:41:22.716 INFO:teuthology.orchestra.run.smithi044.stderr: 83150K .......... .......... .......... .......... .......... 89% 35.2M 1s 2023-12-03T11:41:22.717 INFO:teuthology.orchestra.run.smithi044.stderr: 83200K .......... .......... .......... .......... .......... 89% 19.3M 1s 2023-12-03T11:41:22.718 INFO:teuthology.orchestra.run.smithi044.stderr: 83250K .......... .......... .......... .......... .......... 89% 57.9M 1s 2023-12-03T11:41:22.721 INFO:teuthology.orchestra.run.smithi044.stderr: 83300K .......... .......... .......... .......... .......... 89% 22.7M 1s 2023-12-03T11:41:22.722 INFO:teuthology.orchestra.run.smithi044.stderr: 83350K .......... .......... .......... .......... .......... 89% 28.5M 1s 2023-12-03T11:41:22.726 INFO:teuthology.orchestra.run.smithi044.stderr: 83400K .......... .......... .......... .......... .......... 89% 19.0M 1s 2023-12-03T11:41:22.727 INFO:teuthology.orchestra.run.smithi044.stderr: 83450K .......... .......... .......... .......... .......... 89% 21.2M 1s 2023-12-03T11:41:22.728 INFO:teuthology.orchestra.run.smithi044.stderr: 83500K .......... .......... .......... .......... .......... 89% 58.7M 1s 2023-12-03T11:41:22.730 INFO:teuthology.orchestra.run.smithi044.stderr: 83550K .......... .......... .......... .......... .......... 89% 22.3M 1s 2023-12-03T11:41:22.733 INFO:teuthology.orchestra.run.smithi044.stderr: 83600K .......... .......... .......... .......... .......... 90% 19.6M 1s 2023-12-03T11:41:22.735 INFO:teuthology.orchestra.run.smithi044.stderr: 83650K .......... .......... .......... .......... .......... 90% 32.2M 1s 2023-12-03T11:41:22.741 INFO:teuthology.orchestra.run.smithi044.stderr: 83700K .......... .......... .......... .......... .......... 90% 8.47M 1s 2023-12-03T11:41:22.741 INFO:teuthology.orchestra.run.smithi044.stderr: 83750K .......... .......... .......... .......... .......... 90% 74.7M 1s 2023-12-03T11:41:22.742 INFO:teuthology.orchestra.run.smithi044.stderr: 83800K .......... .......... .......... .......... .......... 90% 45.0M 1s 2023-12-03T11:41:22.744 INFO:teuthology.orchestra.run.smithi044.stderr: 83850K .......... .......... .......... .......... .......... 90% 30.2M 1s 2023-12-03T11:41:22.745 INFO:teuthology.orchestra.run.smithi044.stderr: 83900K .......... .......... .......... .......... .......... 90% 30.2M 1s 2023-12-03T11:41:22.747 INFO:teuthology.orchestra.run.smithi044.stderr: 83950K .......... .......... .......... .......... .......... 90% 27.3M 1s 2023-12-03T11:41:22.748 INFO:teuthology.orchestra.run.smithi044.stderr: 84000K .......... .......... .......... .......... .......... 90% 49.1M 1s 2023-12-03T11:41:22.749 INFO:teuthology.orchestra.run.smithi044.stderr: 84050K .......... .......... .......... .......... .......... 90% 30.3M 1s 2023-12-03T11:41:22.750 INFO:teuthology.orchestra.run.smithi044.stderr: 84100K .......... .......... .......... .......... .......... 90% 44.3M 1s 2023-12-03T11:41:22.752 INFO:teuthology.orchestra.run.smithi044.stderr: 84150K .......... .......... .......... .......... .......... 90% 29.7M 1s 2023-12-03T11:41:22.755 INFO:teuthology.orchestra.run.smithi044.stderr: 84200K .......... .......... .......... .......... .......... 90% 25.4M 1s 2023-12-03T11:41:22.755 INFO:teuthology.orchestra.run.smithi044.stderr: 84250K .......... .......... .......... .......... .......... 90% 51.4M 1s 2023-12-03T11:41:22.757 INFO:teuthology.orchestra.run.smithi044.stderr: 84300K .......... .......... .......... .......... .......... 90% 22.9M 1s 2023-12-03T11:41:22.760 INFO:teuthology.orchestra.run.smithi044.stderr: 84350K .......... .......... .......... .......... .......... 90% 27.2M 1s 2023-12-03T11:41:22.761 INFO:teuthology.orchestra.run.smithi044.stderr: 84400K .......... .......... .......... .......... .......... 90% 21.9M 1s 2023-12-03T11:41:22.763 INFO:teuthology.orchestra.run.smithi044.stderr: 84450K .......... .......... .......... .......... .......... 90% 44.1M 1s 2023-12-03T11:41:22.764 INFO:teuthology.orchestra.run.smithi044.stderr: 84500K .......... .......... .......... .......... .......... 91% 26.1M 1s 2023-12-03T11:41:22.766 INFO:teuthology.orchestra.run.smithi044.stderr: 84550K .......... .......... .......... .......... .......... 91% 28.2M 1s 2023-12-03T11:41:22.768 INFO:teuthology.orchestra.run.smithi044.stderr: 84600K .......... .......... .......... .......... .......... 91% 32.1M 1s 2023-12-03T11:41:22.769 INFO:teuthology.orchestra.run.smithi044.stderr: 84650K .......... .......... .......... .......... .......... 91% 60.8M 1s 2023-12-03T11:41:22.771 INFO:teuthology.orchestra.run.smithi044.stderr: 84700K .......... .......... .......... .......... .......... 91% 23.3M 1s 2023-12-03T11:41:22.773 INFO:teuthology.orchestra.run.smithi044.stderr: 84750K .......... .......... .......... .......... .......... 91% 21.3M 1s 2023-12-03T11:41:22.776 INFO:teuthology.orchestra.run.smithi044.stderr: 84800K .......... .......... .......... .......... .......... 91% 25.9M 1s 2023-12-03T11:41:22.780 INFO:teuthology.orchestra.run.smithi044.stderr: 84850K .......... .......... .......... .......... .......... 91% 21.8M 1s 2023-12-03T11:41:22.780 INFO:teuthology.orchestra.run.smithi044.stderr: 84900K .......... .......... .......... .......... .......... 91% 68.8M 1s 2023-12-03T11:41:22.780 INFO:teuthology.orchestra.run.smithi044.stderr: 84950K .......... .......... .......... .......... .......... 91% 21.7M 1s 2023-12-03T11:41:22.792 INFO:teuthology.orchestra.run.smithi044.stderr: 85000K .......... .......... .......... .......... .......... 91% 37.2M 1s 2023-12-03T11:41:22.792 INFO:teuthology.orchestra.run.smithi044.stderr: 85050K .......... .......... .......... .......... .......... 91% 37.4M 1s 2023-12-03T11:41:22.792 INFO:teuthology.orchestra.run.smithi044.stderr: 85100K .......... .......... .......... .......... .......... 91% 28.4M 1s 2023-12-03T11:41:22.792 INFO:teuthology.orchestra.run.smithi044.stderr: 85150K .......... .......... .......... .......... .......... 91% 66.6M 1s 2023-12-03T11:41:22.793 INFO:teuthology.orchestra.run.smithi044.stderr: 85200K .......... .......... .......... .......... .......... 91% 33.2M 1s 2023-12-03T11:41:22.793 INFO:teuthology.orchestra.run.smithi044.stderr: 85250K .......... .......... .......... .......... .......... 91% 25.2M 1s 2023-12-03T11:41:22.793 INFO:teuthology.orchestra.run.smithi044.stderr: 85300K .......... .......... .......... .......... .......... 91% 23.8M 1s 2023-12-03T11:41:22.797 INFO:teuthology.orchestra.run.smithi044.stderr: 85350K .......... .......... .......... .......... .......... 91% 22.0M 1s 2023-12-03T11:41:22.797 INFO:teuthology.orchestra.run.smithi044.stderr: 85400K .......... .......... .......... .......... .......... 91% 75.7M 1s 2023-12-03T11:41:22.797 INFO:teuthology.orchestra.run.smithi044.stderr: 85450K .......... .......... .......... .......... .......... 92% 29.1M 1s 2023-12-03T11:41:22.797 INFO:teuthology.orchestra.run.smithi044.stderr: 85500K .......... .......... .......... .......... .......... 92% 25.1M 1s 2023-12-03T11:41:22.799 INFO:teuthology.orchestra.run.smithi044.stderr: 85550K .......... .......... .......... .......... .......... 92% 25.1M 1s 2023-12-03T11:41:22.800 INFO:teuthology.orchestra.run.smithi044.stderr: 85600K .......... .......... .......... .......... .......... 92% 44.9M 1s 2023-12-03T11:41:22.804 INFO:teuthology.orchestra.run.smithi044.stderr: 85650K .......... .......... .......... .......... .......... 92% 10.9M 1s 2023-12-03T11:41:22.807 INFO:teuthology.orchestra.run.smithi044.stderr: 85700K .......... .......... .......... .......... .......... 92% 39.4M 1s 2023-12-03T11:41:22.809 INFO:teuthology.orchestra.run.smithi044.stderr: 85750K .......... .......... .......... .......... .......... 92% 21.7M 1s 2023-12-03T11:41:22.811 INFO:teuthology.orchestra.run.smithi044.stderr: 85800K .......... .......... .......... .......... .......... 92% 24.8M 1s 2023-12-03T11:41:22.811 INFO:teuthology.orchestra.run.smithi044.stderr: 85850K .......... .......... .......... .......... .......... 92% 62.7M 1s 2023-12-03T11:41:22.813 INFO:teuthology.orchestra.run.smithi044.stderr: 85900K .......... .......... .......... .......... .......... 92% 21.3M 1s 2023-12-03T11:41:22.815 INFO:teuthology.orchestra.run.smithi044.stderr: 85950K .......... .......... .......... .......... .......... 92% 24.5M 1s 2023-12-03T11:41:22.817 INFO:teuthology.orchestra.run.smithi044.stderr: 86000K .......... .......... .......... .......... .......... 92% 30.1M 1s 2023-12-03T11:41:22.819 INFO:teuthology.orchestra.run.smithi044.stderr: 86050K .......... .......... .......... .......... .......... 92% 23.8M 1s 2023-12-03T11:41:22.819 INFO:teuthology.orchestra.run.smithi044.stderr: 86100K .......... .......... .......... .......... .......... 92% 58.6M 1s 2023-12-03T11:41:22.821 INFO:teuthology.orchestra.run.smithi044.stderr: 86150K .......... .......... .......... .......... .......... 92% 27.5M 1s 2023-12-03T11:41:22.823 INFO:teuthology.orchestra.run.smithi044.stderr: 86200K .......... .......... .......... .......... .......... 92% 29.5M 1s 2023-12-03T11:41:22.825 INFO:teuthology.orchestra.run.smithi044.stderr: 86250K .......... .......... .......... .......... .......... 92% 25.5M 1s 2023-12-03T11:41:22.826 INFO:teuthology.orchestra.run.smithi044.stderr: 86300K .......... .......... .......... .......... .......... 92% 73.6M 1s 2023-12-03T11:41:22.827 INFO:teuthology.orchestra.run.smithi044.stderr: 86350K .......... .......... .......... .......... .......... 93% 39.8M 1s 2023-12-03T11:41:22.828 INFO:teuthology.orchestra.run.smithi044.stderr: 86400K .......... .......... .......... .......... .......... 93% 30.9M 1s 2023-12-03T11:41:22.831 INFO:teuthology.orchestra.run.smithi044.stderr: 86450K .......... .......... .......... .......... .......... 93% 23.8M 1s 2023-12-03T11:41:22.833 INFO:teuthology.orchestra.run.smithi044.stderr: 86500K .......... .......... .......... .......... .......... 93% 23.5M 1s 2023-12-03T11:41:22.833 INFO:teuthology.orchestra.run.smithi044.stderr: 86550K .......... .......... .......... .......... .......... 93% 79.7M 1s 2023-12-03T11:41:22.835 INFO:teuthology.orchestra.run.smithi044.stderr: 86600K .......... .......... .......... .......... .......... 93% 26.8M 1s 2023-12-03T11:41:22.836 INFO:teuthology.orchestra.run.smithi044.stderr: 86650K .......... .......... .......... .......... .......... 93% 31.4M 1s 2023-12-03T11:41:22.839 INFO:teuthology.orchestra.run.smithi044.stderr: 86700K .......... .......... .......... .......... .......... 93% 23.9M 1s 2023-12-03T11:41:22.840 INFO:teuthology.orchestra.run.smithi044.stderr: 86750K .......... .......... .......... .......... .......... 93% 25.3M 1s 2023-12-03T11:41:22.841 INFO:teuthology.orchestra.run.smithi044.stderr: 86800K .......... .......... .......... .......... .......... 93% 49.6M 0s 2023-12-03T11:41:22.843 INFO:teuthology.orchestra.run.smithi044.stderr: 86850K .......... .......... .......... .......... .......... 93% 22.1M 0s 2023-12-03T11:41:22.845 INFO:teuthology.orchestra.run.smithi044.stderr: 86900K .......... .......... .......... .......... .......... 93% 34.5M 0s 2023-12-03T11:41:22.848 INFO:teuthology.orchestra.run.smithi044.stderr: 86950K .......... .......... .......... .......... .......... 93% 20.7M 0s 2023-12-03T11:41:22.848 INFO:teuthology.orchestra.run.smithi044.stderr: 87000K .......... .......... .......... .......... .......... 93% 77.2M 0s 2023-12-03T11:41:22.849 INFO:teuthology.orchestra.run.smithi044.stderr: 87050K .......... .......... .......... .......... .......... 93% 27.9M 0s 2023-12-03T11:41:22.854 INFO:teuthology.orchestra.run.smithi044.stderr: 87100K .......... .......... .......... .......... .......... 93% 24.9M 0s 2023-12-03T11:41:22.854 INFO:teuthology.orchestra.run.smithi044.stderr: 87150K .......... .......... .......... .......... .......... 93% 17.3M 0s 2023-12-03T11:41:22.856 INFO:teuthology.orchestra.run.smithi044.stderr: 87200K .......... .......... .......... .......... .......... 93% 28.2M 0s 2023-12-03T11:41:22.857 INFO:teuthology.orchestra.run.smithi044.stderr: 87250K .......... .......... .......... .......... .......... 93% 40.8M 0s 2023-12-03T11:41:22.860 INFO:teuthology.orchestra.run.smithi044.stderr: 87300K .......... .......... .......... .......... .......... 94% 18.9M 0s 2023-12-03T11:41:22.862 INFO:teuthology.orchestra.run.smithi044.stderr: 87350K .......... .......... .......... .......... .......... 94% 27.5M 0s 2023-12-03T11:41:22.864 INFO:teuthology.orchestra.run.smithi044.stderr: 87400K .......... .......... .......... .......... .......... 94% 22.3M 0s 2023-12-03T11:41:22.864 INFO:teuthology.orchestra.run.smithi044.stderr: 87450K .......... .......... .......... .......... .......... 94% 52.5M 0s 2023-12-03T11:41:22.867 INFO:teuthology.orchestra.run.smithi044.stderr: 87500K .......... .......... .......... .......... .......... 94% 17.9M 0s 2023-12-03T11:41:22.869 INFO:teuthology.orchestra.run.smithi044.stderr: 87550K .......... .......... .......... .......... .......... 94% 28.3M 0s 2023-12-03T11:41:22.874 INFO:teuthology.orchestra.run.smithi044.stderr: 87600K .......... .......... .......... .......... .......... 94% 11.7M 0s 2023-12-03T11:41:22.875 INFO:teuthology.orchestra.run.smithi044.stderr: 87650K .......... .......... .......... .......... .......... 94% 36.0M 0s 2023-12-03T11:41:22.876 INFO:teuthology.orchestra.run.smithi044.stderr: 87700K .......... .......... .......... .......... .......... 94% 42.6M 0s 2023-12-03T11:41:22.878 INFO:teuthology.orchestra.run.smithi044.stderr: 87750K .......... .......... .......... .......... .......... 94% 25.8M 0s 2023-12-03T11:41:22.880 INFO:teuthology.orchestra.run.smithi044.stderr: 87800K .......... .......... .......... .......... .......... 94% 36.0M 0s 2023-12-03T11:41:22.880 INFO:teuthology.orchestra.run.smithi044.stderr: 87850K .......... .......... .......... .......... .......... 94% 43.8M 0s 2023-12-03T11:41:22.881 INFO:teuthology.orchestra.run.smithi044.stderr: 87900K .......... .......... .......... .......... .......... 94% 35.1M 0s 2023-12-03T11:41:22.883 INFO:teuthology.orchestra.run.smithi044.stderr: 87950K .......... .......... .......... .......... .......... 94% 44.6M 0s 2023-12-03T11:41:22.884 INFO:teuthology.orchestra.run.smithi044.stderr: 88000K .......... .......... .......... .......... .......... 94% 28.9M 0s 2023-12-03T11:41:22.885 INFO:teuthology.orchestra.run.smithi044.stderr: 88050K .......... .......... .......... .......... .......... 94% 57.8M 0s 2023-12-03T11:41:22.892 INFO:teuthology.orchestra.run.smithi044.stderr: 88100K .......... .......... .......... .......... .......... 94% 29.7M 0s 2023-12-03T11:41:22.892 INFO:teuthology.orchestra.run.smithi044.stderr: 88150K .......... .......... .......... .......... .......... 94% 50.1M 0s 2023-12-03T11:41:22.892 INFO:teuthology.orchestra.run.smithi044.stderr: 88200K .......... .......... .......... .......... .......... 94% 25.2M 0s 2023-12-03T11:41:22.892 INFO:teuthology.orchestra.run.smithi044.stderr: 88250K .......... .......... .......... .......... .......... 95% 34.2M 0s 2023-12-03T11:41:22.893 INFO:teuthology.orchestra.run.smithi044.stderr: 88300K .......... .......... .......... .......... .......... 95% 25.7M 0s 2023-12-03T11:41:22.895 INFO:teuthology.orchestra.run.smithi044.stderr: 88350K .......... .......... .......... .......... .......... 95% 24.6M 0s 2023-12-03T11:41:22.896 INFO:teuthology.orchestra.run.smithi044.stderr: 88400K .......... .......... .......... .......... .......... 95% 71.5M 0s 2023-12-03T11:41:22.897 INFO:teuthology.orchestra.run.smithi044.stderr: 88450K .......... .......... .......... .......... .......... 95% 28.4M 0s 2023-12-03T11:41:22.898 INFO:teuthology.orchestra.run.smithi044.stderr: 88500K .......... .......... .......... .......... .......... 95% 46.6M 0s 2023-12-03T11:41:22.901 INFO:teuthology.orchestra.run.smithi044.stderr: 88550K .......... .......... .......... .......... .......... 95% 24.8M 0s 2023-12-03T11:41:22.902 INFO:teuthology.orchestra.run.smithi044.stderr: 88600K .......... .......... .......... .......... .......... 95% 25.3M 0s 2023-12-03T11:41:22.903 INFO:teuthology.orchestra.run.smithi044.stderr: 88650K .......... .......... .......... .......... .......... 95% 75.7M 0s 2023-12-03T11:41:22.905 INFO:teuthology.orchestra.run.smithi044.stderr: 88700K .......... .......... .......... .......... .......... 95% 23.7M 0s 2023-12-03T11:41:22.907 INFO:teuthology.orchestra.run.smithi044.stderr: 88750K .......... .......... .......... .......... .......... 95% 36.5M 0s 2023-12-03T11:41:22.908 INFO:teuthology.orchestra.run.smithi044.stderr: 88800K .......... .......... .......... .......... .......... 95% 26.8M 0s 2023-12-03T11:41:22.911 INFO:teuthology.orchestra.run.smithi044.stderr: 88850K .......... .......... .......... .......... .......... 95% 28.6M 0s 2023-12-03T11:41:22.911 INFO:teuthology.orchestra.run.smithi044.stderr: 88900K .......... .......... .......... .......... .......... 95% 71.6M 0s 2023-12-03T11:41:22.912 INFO:teuthology.orchestra.run.smithi044.stderr: 88950K .......... .......... .......... .......... .......... 95% 46.9M 0s 2023-12-03T11:41:22.913 INFO:teuthology.orchestra.run.smithi044.stderr: 89000K .......... .......... .......... .......... .......... 95% 34.7M 0s 2023-12-03T11:41:22.915 INFO:teuthology.orchestra.run.smithi044.stderr: 89050K .......... .......... .......... .......... .......... 95% 32.0M 0s 2023-12-03T11:41:22.916 INFO:teuthology.orchestra.run.smithi044.stderr: 89100K .......... .......... .......... .......... .......... 95% 25.9M 0s 2023-12-03T11:41:22.917 INFO:teuthology.orchestra.run.smithi044.stderr: 89150K .......... .......... .......... .......... .......... 96% 78.3M 0s 2023-12-03T11:41:22.919 INFO:teuthology.orchestra.run.smithi044.stderr: 89200K .......... .......... .......... .......... .......... 96% 31.7M 0s 2023-12-03T11:41:22.921 INFO:teuthology.orchestra.run.smithi044.stderr: 89250K .......... .......... .......... .......... .......... 96% 24.9M 0s 2023-12-03T11:41:22.923 INFO:teuthology.orchestra.run.smithi044.stderr: 89300K .......... .......... .......... .......... .......... 96% 67.5M 0s 2023-12-03T11:41:22.923 INFO:teuthology.orchestra.run.smithi044.stderr: 89350K .......... .......... .......... .......... .......... 96% 26.7M 0s 2023-12-03T11:41:22.925 INFO:teuthology.orchestra.run.smithi044.stderr: 89400K .......... .......... .......... .......... .......... 96% 23.2M 0s 2023-12-03T11:41:22.926 INFO:teuthology.orchestra.run.smithi044.stderr: 89450K .......... .......... .......... .......... .......... 96% 38.7M 0s 2023-12-03T11:41:22.930 INFO:teuthology.orchestra.run.smithi044.stderr: 89500K .......... .......... .......... .......... .......... 96% 14.3M 0s 2023-12-03T11:41:22.932 INFO:teuthology.orchestra.run.smithi044.stderr: 89550K .......... .......... .......... .......... .......... 96% 26.8M 0s 2023-12-03T11:41:22.933 INFO:teuthology.orchestra.run.smithi044.stderr: 89600K .......... .......... .......... .......... .......... 96% 41.2M 0s 2023-12-03T11:41:22.935 INFO:teuthology.orchestra.run.smithi044.stderr: 89650K .......... .......... .......... .......... .......... 96% 27.0M 0s 2023-12-03T11:41:22.936 INFO:teuthology.orchestra.run.smithi044.stderr: 89700K .......... .......... .......... .......... .......... 96% 30.8M 0s 2023-12-03T11:41:22.939 INFO:teuthology.orchestra.run.smithi044.stderr: 89750K .......... .......... .......... .......... .......... 96% 24.1M 0s 2023-12-03T11:41:22.941 INFO:teuthology.orchestra.run.smithi044.stderr: 89800K .......... .......... .......... .......... .......... 96% 21.3M 0s 2023-12-03T11:41:22.941 INFO:teuthology.orchestra.run.smithi044.stderr: 89850K .......... .......... .......... .......... .......... 96% 62.8M 0s 2023-12-03T11:41:22.944 INFO:teuthology.orchestra.run.smithi044.stderr: 89900K .......... .......... .......... .......... .......... 96% 34.4M 0s 2023-12-03T11:41:22.945 INFO:teuthology.orchestra.run.smithi044.stderr: 89950K .......... .......... .......... .......... .......... 96% 25.4M 0s 2023-12-03T11:41:22.945 INFO:teuthology.orchestra.run.smithi044.stderr: 90000K .......... .......... .......... .......... .......... 96% 76.1M 0s 2023-12-03T11:41:22.947 INFO:teuthology.orchestra.run.smithi044.stderr: 90050K .......... .......... .......... .......... .......... 96% 31.4M 0s 2023-12-03T11:41:22.949 INFO:teuthology.orchestra.run.smithi044.stderr: 90100K .......... .......... .......... .......... .......... 97% 23.3M 0s 2023-12-03T11:41:22.950 INFO:teuthology.orchestra.run.smithi044.stderr: 90150K .......... .......... .......... .......... .......... 97% 33.4M 0s 2023-12-03T11:41:22.952 INFO:teuthology.orchestra.run.smithi044.stderr: 90200K .......... .......... .......... .......... .......... 97% 42.2M 0s 2023-12-03T11:41:22.954 INFO:teuthology.orchestra.run.smithi044.stderr: 90250K .......... .......... .......... .......... .......... 97% 27.3M 0s 2023-12-03T11:41:22.955 INFO:teuthology.orchestra.run.smithi044.stderr: 90300K .......... .......... .......... .......... .......... 97% 71.3M 0s 2023-12-03T11:41:22.956 INFO:teuthology.orchestra.run.smithi044.stderr: 90350K .......... .......... .......... .......... .......... 97% 29.8M 0s 2023-12-03T11:41:22.958 INFO:teuthology.orchestra.run.smithi044.stderr: 90400K .......... .......... .......... .......... .......... 97% 30.3M 0s 2023-12-03T11:41:22.960 INFO:teuthology.orchestra.run.smithi044.stderr: 90450K .......... .......... .......... .......... .......... 97% 28.4M 0s 2023-12-03T11:41:22.960 INFO:teuthology.orchestra.run.smithi044.stderr: 90500K .......... .......... .......... .......... .......... 97% 66.0M 0s 2023-12-03T11:41:22.962 INFO:teuthology.orchestra.run.smithi044.stderr: 90550K .......... .......... .......... .......... .......... 97% 27.6M 0s 2023-12-03T11:41:22.965 INFO:teuthology.orchestra.run.smithi044.stderr: 90600K .......... .......... .......... .......... .......... 97% 25.1M 0s 2023-12-03T11:41:22.965 INFO:teuthology.orchestra.run.smithi044.stderr: 90650K .......... .......... .......... .......... .......... 97% 35.7M 0s 2023-12-03T11:41:22.967 INFO:teuthology.orchestra.run.smithi044.stderr: 90700K .......... .......... .......... .......... .......... 97% 23.3M 0s 2023-12-03T11:41:22.968 INFO:teuthology.orchestra.run.smithi044.stderr: 90750K .......... .......... .......... .......... .......... 97% 42.1M 0s 2023-12-03T11:41:22.970 INFO:teuthology.orchestra.run.smithi044.stderr: 90800K .......... .......... .......... .......... .......... 97% 28.0M 0s 2023-12-03T11:41:22.972 INFO:teuthology.orchestra.run.smithi044.stderr: 90850K .......... .......... .......... .......... .......... 97% 25.6M 0s 2023-12-03T11:41:22.974 INFO:teuthology.orchestra.run.smithi044.stderr: 90900K .......... .......... .......... .......... .......... 97% 29.6M 0s 2023-12-03T11:41:22.974 INFO:teuthology.orchestra.run.smithi044.stderr: 90950K .......... .......... .......... .......... .......... 97% 74.4M 0s 2023-12-03T11:41:22.978 INFO:teuthology.orchestra.run.smithi044.stderr: 91000K .......... .......... .......... .......... .......... 98% 14.4M 0s 2023-12-03T11:41:22.979 INFO:teuthology.orchestra.run.smithi044.stderr: 91050K .......... .......... .......... .......... .......... 98% 27.8M 0s 2023-12-03T11:41:22.980 INFO:teuthology.orchestra.run.smithi044.stderr: 91100K .......... .......... .......... .......... .......... 98% 41.5M 0s 2023-12-03T11:41:22.983 INFO:teuthology.orchestra.run.smithi044.stderr: 91150K .......... .......... .......... .......... .......... 98% 18.8M 0s 2023-12-03T11:41:22.985 INFO:teuthology.orchestra.run.smithi044.stderr: 91200K .......... .......... .......... .......... .......... 98% 22.9M 0s 2023-12-03T11:41:22.986 INFO:teuthology.orchestra.run.smithi044.stderr: 91250K .......... .......... .......... .......... .......... 98% 62.3M 0s 2023-12-03T11:41:22.988 INFO:teuthology.orchestra.run.smithi044.stderr: 91300K .......... .......... .......... .......... .......... 98% 21.2M 0s 2023-12-03T11:41:22.991 INFO:teuthology.orchestra.run.smithi044.stderr: 91350K .......... .......... .......... .......... .......... 98% 21.2M 0s 2023-12-03T11:41:22.992 INFO:teuthology.orchestra.run.smithi044.stderr: 91400K .......... .......... .......... .......... .......... 98% 27.0M 0s 2023-12-03T11:41:22.993 INFO:teuthology.orchestra.run.smithi044.stderr: 91450K .......... .......... .......... .......... .......... 98% 64.6M 0s 2023-12-03T11:41:22.997 INFO:teuthology.orchestra.run.smithi044.stderr: 91500K .......... .......... .......... .......... .......... 98% 12.4M 0s 2023-12-03T11:41:22.998 INFO:teuthology.orchestra.run.smithi044.stderr: 91550K .......... .......... .......... .......... .......... 98% 41.1M 0s 2023-12-03T11:41:23.000 INFO:teuthology.orchestra.run.smithi044.stderr: 91600K .......... .......... .......... .......... .......... 98% 25.1M 0s 2023-12-03T11:41:23.002 INFO:teuthology.orchestra.run.smithi044.stderr: 91650K .......... .......... .......... .......... .......... 98% 29.5M 0s 2023-12-03T11:41:23.003 INFO:teuthology.orchestra.run.smithi044.stderr: 91700K .......... .......... .......... .......... .......... 98% 59.1M 0s 2023-12-03T11:41:23.004 INFO:teuthology.orchestra.run.smithi044.stderr: 91750K .......... .......... .......... .......... .......... 98% 28.8M 0s 2023-12-03T11:41:23.005 INFO:teuthology.orchestra.run.smithi044.stderr: 91800K .......... .......... .......... .......... .......... 98% 46.8M 0s 2023-12-03T11:41:23.007 INFO:teuthology.orchestra.run.smithi044.stderr: 91850K .......... .......... .......... .......... .......... 98% 33.2M 0s 2023-12-03T11:41:23.009 INFO:teuthology.orchestra.run.smithi044.stderr: 91900K .......... .......... .......... .......... .......... 98% 30.9M 0s 2023-12-03T11:41:23.009 INFO:teuthology.orchestra.run.smithi044.stderr: 91950K .......... .......... .......... .......... .......... 99% 45.7M 0s 2023-12-03T11:41:23.011 INFO:teuthology.orchestra.run.smithi044.stderr: 92000K .......... .......... .......... .......... .......... 99% 28.4M 0s 2023-12-03T11:41:23.012 INFO:teuthology.orchestra.run.smithi044.stderr: 92050K .......... .......... .......... .......... .......... 99% 38.3M 0s 2023-12-03T11:41:23.015 INFO:teuthology.orchestra.run.smithi044.stderr: 92100K .......... .......... .......... .......... .......... 99% 25.6M 0s 2023-12-03T11:41:23.015 INFO:teuthology.orchestra.run.smithi044.stderr: 92150K .......... .......... .......... .......... .......... 99% 77.4M 0s 2023-12-03T11:41:23.017 INFO:teuthology.orchestra.run.smithi044.stderr: 92200K .......... .......... .......... .......... .......... 99% 23.2M 0s 2023-12-03T11:41:23.019 INFO:teuthology.orchestra.run.smithi044.stderr: 92250K .......... .......... .......... .......... .......... 99% 31.6M 0s 2023-12-03T11:41:23.021 INFO:teuthology.orchestra.run.smithi044.stderr: 92300K .......... .......... .......... .......... .......... 99% 22.2M 0s 2023-12-03T11:41:23.022 INFO:teuthology.orchestra.run.smithi044.stderr: 92350K .......... .......... .......... .......... .......... 99% 41.8M 0s 2023-12-03T11:41:23.023 INFO:teuthology.orchestra.run.smithi044.stderr: 92400K .......... .......... .......... .......... .......... 99% 40.6M 0s 2023-12-03T11:41:23.025 INFO:teuthology.orchestra.run.smithi044.stderr: 92450K .......... .......... .......... .......... .......... 99% 28.5M 0s 2023-12-03T11:41:23.027 INFO:teuthology.orchestra.run.smithi044.stderr: 92500K .......... .......... .......... .......... .......... 99% 35.8M 0s 2023-12-03T11:41:23.028 INFO:teuthology.orchestra.run.smithi044.stderr: 92550K .......... .......... .......... .......... .......... 99% 26.6M 0s 2023-12-03T11:41:23.029 INFO:teuthology.orchestra.run.smithi044.stderr: 92600K .......... .......... .......... .......... .......... 99% 55.9M 0s 2023-12-03T11:41:23.031 INFO:teuthology.orchestra.run.smithi044.stderr: 92650K .......... .......... .......... .......... .......... 99% 25.2M 0s 2023-12-03T11:41:23.033 INFO:teuthology.orchestra.run.smithi044.stderr: 92700K .......... .......... .......... .......... .......... 99% 33.9M 0s 2023-12-03T11:41:23.034 INFO:teuthology.orchestra.run.smithi044.stderr: 92750K .......... .......... .......... .......... .......... 99% 29.3M 0s 2023-12-03T11:41:23.036 INFO:teuthology.orchestra.run.smithi044.stderr: 92800K .......... .......... .......... .......... .......... 99% 26.3M 0s 2023-12-03T11:41:23.038 INFO:teuthology.orchestra.run.smithi044.stderr: 92850K .......... .......... .......... .......... .......... 99% 40.9M 0s 2023-12-03T11:41:23.039 INFO:teuthology.orchestra.run.smithi044.stderr: 92900K 100% 134G=7.3s 2023-12-03T11:41:23.039 INFO:teuthology.orchestra.run.smithi044.stderr: 2023-12-03T11:41:23.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03 11:41:23 (12.4 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2023-12-03T11:41:23.039 INFO:teuthology.orchestra.run.smithi044.stderr: 2023-12-03T11:41:23.068 INFO:teuthology.orchestra.run.smithi044.stdout:Archive: gradle-6.0.1-bin.zip 2023-12-03T11:41:23.069 INFO:teuthology.orchestra.run.smithi044.stdout: creating: /opt/gradle/gradle-6.0.1/ 2023-12-03T11:41:23.069 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2023-12-03T11:41:23.069 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2023-12-03T11:41:23.069 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2023-12-03T11:41:23.069 INFO:teuthology.orchestra.run.smithi044.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2023-12-03T11:41:23.069 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2023-12-03T11:41:23.069 INFO:teuthology.orchestra.run.smithi044.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2023-12-03T11:41:23.069 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2023-12-03T11:41:23.069 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2023-12-03T11:41:23.069 INFO:teuthology.orchestra.run.smithi044.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2023-12-03T11:41:23.069 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2023-12-03T11:41:23.071 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2023-12-03T11:41:23.071 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2023-12-03T11:41:23.081 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2023-12-03T11:41:23.084 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2023-12-03T11:41:23.084 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2023-12-03T11:41:23.085 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2023-12-03T11:41:23.085 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2023-12-03T11:41:23.100 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2023-12-03T11:41:23.101 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2023-12-03T11:41:23.101 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2023-12-03T11:41:23.102 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2023-12-03T11:41:23.110 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2023-12-03T11:41:23.110 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2023-12-03T11:41:23.110 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2023-12-03T11:41:23.112 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2023-12-03T11:41:23.114 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2023-12-03T11:41:23.114 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2023-12-03T11:41:23.116 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2023-12-03T11:41:23.116 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2023-12-03T11:41:23.116 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2023-12-03T11:41:23.116 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2023-12-03T11:41:23.118 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2023-12-03T11:41:23.119 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2023-12-03T11:41:23.119 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2023-12-03T11:41:23.122 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2023-12-03T11:41:23.122 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2023-12-03T11:41:23.122 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2023-12-03T11:41:23.123 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2023-12-03T11:41:23.123 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2023-12-03T11:41:23.123 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2023-12-03T11:41:23.364 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2023-12-03T11:41:23.365 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2023-12-03T11:41:23.365 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2023-12-03T11:41:23.365 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2023-12-03T11:41:23.420 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2023-12-03T11:41:23.420 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2023-12-03T11:41:23.421 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2023-12-03T11:41:23.421 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2023-12-03T11:41:23.421 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2023-12-03T11:41:23.436 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2023-12-03T11:41:23.438 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2023-12-03T11:41:23.440 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2023-12-03T11:41:23.440 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2023-12-03T11:41:23.440 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2023-12-03T11:41:23.441 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2023-12-03T11:41:23.442 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2023-12-03T11:41:23.457 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2023-12-03T11:41:23.457 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2023-12-03T11:41:23.458 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2023-12-03T11:41:23.458 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2023-12-03T11:41:23.459 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2023-12-03T11:41:23.460 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2023-12-03T11:41:23.462 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2023-12-03T11:41:23.464 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2023-12-03T11:41:23.464 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2023-12-03T11:41:23.480 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2023-12-03T11:41:23.484 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2023-12-03T11:41:23.487 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2023-12-03T11:41:23.489 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2023-12-03T11:41:23.489 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2023-12-03T11:41:23.491 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2023-12-03T11:41:23.492 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2023-12-03T11:41:23.492 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2023-12-03T11:41:23.496 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2023-12-03T11:41:23.498 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2023-12-03T11:41:23.516 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2023-12-03T11:41:23.517 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2023-12-03T11:41:23.526 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2023-12-03T11:41:23.526 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2023-12-03T11:41:23.526 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2023-12-03T11:41:23.527 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2023-12-03T11:41:23.527 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2023-12-03T11:41:23.534 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2023-12-03T11:41:23.534 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2023-12-03T11:41:23.539 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2023-12-03T11:41:23.540 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2023-12-03T11:41:23.540 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2023-12-03T11:41:23.540 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2023-12-03T11:41:23.540 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2023-12-03T11:41:23.540 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2023-12-03T11:41:23.540 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2023-12-03T11:41:23.540 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2023-12-03T11:41:23.540 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2023-12-03T11:41:23.540 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2023-12-03T11:41:23.540 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2023-12-03T11:41:23.540 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2023-12-03T11:41:23.540 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2023-12-03T11:41:23.541 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2023-12-03T11:41:23.541 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2023-12-03T11:41:23.541 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2023-12-03T11:41:23.541 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2023-12-03T11:41:23.541 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2023-12-03T11:41:23.541 INFO:teuthology.orchestra.run.smithi044.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2023-12-03T11:41:23.541 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2023-12-03T11:41:23.541 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2023-12-03T11:41:23.542 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2023-12-03T11:41:23.542 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2023-12-03T11:41:23.542 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2023-12-03T11:41:23.543 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2023-12-03T11:41:23.545 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2023-12-03T11:41:23.547 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2023-12-03T11:41:23.547 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2023-12-03T11:41:23.549 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2023-12-03T11:41:23.549 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2023-12-03T11:41:23.552 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2023-12-03T11:41:23.552 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2023-12-03T11:41:23.552 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2023-12-03T11:41:23.554 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2023-12-03T11:41:23.555 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2023-12-03T11:41:23.555 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2023-12-03T11:41:23.556 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2023-12-03T11:41:23.558 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2023-12-03T11:41:23.559 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2023-12-03T11:41:23.561 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2023-12-03T11:41:23.561 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2023-12-03T11:41:23.562 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2023-12-03T11:41:23.562 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2023-12-03T11:41:23.562 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2023-12-03T11:41:23.563 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2023-12-03T11:41:23.563 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2023-12-03T11:41:23.566 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2023-12-03T11:41:23.566 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2023-12-03T11:41:23.567 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2023-12-03T11:41:23.570 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2023-12-03T11:41:23.572 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2023-12-03T11:41:23.573 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2023-12-03T11:41:23.574 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2023-12-03T11:41:23.576 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2023-12-03T11:41:23.576 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2023-12-03T11:41:23.582 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2023-12-03T11:41:23.583 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2023-12-03T11:41:23.597 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2023-12-03T11:41:23.598 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2023-12-03T11:41:23.599 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2023-12-03T11:41:23.599 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2023-12-03T11:41:23.599 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2023-12-03T11:41:23.599 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2023-12-03T11:41:23.599 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2023-12-03T11:41:23.600 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2023-12-03T11:41:23.600 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2023-12-03T11:41:23.600 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2023-12-03T11:41:23.619 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2023-12-03T11:41:23.620 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2023-12-03T11:41:23.620 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2023-12-03T11:41:23.620 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2023-12-03T11:41:23.622 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2023-12-03T11:41:23.624 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2023-12-03T11:41:23.630 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2023-12-03T11:41:23.632 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2023-12-03T11:41:23.636 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2023-12-03T11:41:23.636 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2023-12-03T11:41:23.637 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2023-12-03T11:41:23.637 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2023-12-03T11:41:23.639 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2023-12-03T11:41:23.639 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2023-12-03T11:41:23.641 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2023-12-03T11:41:23.649 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2023-12-03T11:41:23.650 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2023-12-03T11:41:23.652 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2023-12-03T11:41:23.652 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2023-12-03T11:41:23.653 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2023-12-03T11:41:23.654 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2023-12-03T11:41:23.654 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2023-12-03T11:41:23.656 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2023-12-03T11:41:23.660 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2023-12-03T11:41:23.662 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2023-12-03T11:41:23.663 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2023-12-03T11:41:23.665 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2023-12-03T11:41:23.667 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2023-12-03T11:41:23.668 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2023-12-03T11:41:23.677 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2023-12-03T11:41:23.678 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2023-12-03T11:41:23.684 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2023-12-03T11:41:23.690 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2023-12-03T11:41:23.692 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2023-12-03T11:41:23.693 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2023-12-03T11:41:23.702 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2023-12-03T11:41:23.704 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2023-12-03T11:41:23.711 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2023-12-03T11:41:23.711 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2023-12-03T11:41:23.720 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2023-12-03T11:41:23.722 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2023-12-03T11:41:23.723 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2023-12-03T11:41:23.727 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2023-12-03T11:41:23.733 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2023-12-03T11:41:23.763 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2023-12-03T11:41:23.765 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2023-12-03T11:41:23.766 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2023-12-03T11:41:23.767 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2023-12-03T11:41:23.768 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2023-12-03T11:41:23.768 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2023-12-03T11:41:23.768 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2023-12-03T11:41:23.769 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2023-12-03T11:41:23.771 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2023-12-03T11:41:23.772 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2023-12-03T11:41:23.773 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2023-12-03T11:41:23.773 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2023-12-03T11:41:23.774 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2023-12-03T11:41:23.775 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2023-12-03T11:41:23.775 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2023-12-03T11:41:23.777 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2023-12-03T11:41:23.777 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2023-12-03T11:41:23.777 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2023-12-03T11:41:23.777 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2023-12-03T11:41:23.777 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2023-12-03T11:41:23.777 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2023-12-03T11:41:23.777 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2023-12-03T11:41:23.778 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2023-12-03T11:41:23.780 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2023-12-03T11:41:23.780 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2023-12-03T11:41:23.784 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2023-12-03T11:41:23.785 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2023-12-03T11:41:23.786 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2023-12-03T11:41:23.786 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2023-12-03T11:41:23.786 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2023-12-03T11:41:23.836 INFO:teuthology.orchestra.run.smithi044.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2023-12-03T11:41:24.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:24.200 INFO:teuthology.orchestra.run.smithi044.stdout:Welcome to Gradle 6.0.1! 2023-12-03T11:41:24.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:24.200 INFO:teuthology.orchestra.run.smithi044.stdout:Here are the highlights of this release: 2023-12-03T11:41:24.200 INFO:teuthology.orchestra.run.smithi044.stdout: - Substantial improvements in dependency management, including 2023-12-03T11:41:24.200 INFO:teuthology.orchestra.run.smithi044.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2023-12-03T11:41:24.200 INFO:teuthology.orchestra.run.smithi044.stdout: - Advanced control of transitive versions 2023-12-03T11:41:24.200 INFO:teuthology.orchestra.run.smithi044.stdout: - Support for optional features and dependencies 2023-12-03T11:41:24.200 INFO:teuthology.orchestra.run.smithi044.stdout: - Rules to tweak published metadata 2023-12-03T11:41:24.200 INFO:teuthology.orchestra.run.smithi044.stdout: - Support for Java 13 2023-12-03T11:41:24.200 INFO:teuthology.orchestra.run.smithi044.stdout: - Faster incremental Java and Groovy compilation 2023-12-03T11:41:24.201 INFO:teuthology.orchestra.run.smithi044.stdout: - New Zinc compiler for Scala 2023-12-03T11:41:24.201 INFO:teuthology.orchestra.run.smithi044.stdout: - VS2019 support 2023-12-03T11:41:24.201 INFO:teuthology.orchestra.run.smithi044.stdout: - Support for Gradle Enterprise plugin 3.0 2023-12-03T11:41:24.201 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:24.201 INFO:teuthology.orchestra.run.smithi044.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2023-12-03T11:41:24.201 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:24.201 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:24.201 INFO:teuthology.orchestra.run.smithi044.stdout:------------------------------------------------------------ 2023-12-03T11:41:24.201 INFO:teuthology.orchestra.run.smithi044.stdout:Gradle 6.0.1 2023-12-03T11:41:24.201 INFO:teuthology.orchestra.run.smithi044.stdout:------------------------------------------------------------ 2023-12-03T11:41:24.201 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:24.201 INFO:teuthology.orchestra.run.smithi044.stdout:Build time: 2019-11-18 20:25:01 UTC 2023-12-03T11:41:24.201 INFO:teuthology.orchestra.run.smithi044.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2023-12-03T11:41:24.201 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:24.202 INFO:teuthology.orchestra.run.smithi044.stdout:Kotlin: 1.3.50 2023-12-03T11:41:24.202 INFO:teuthology.orchestra.run.smithi044.stdout:Groovy: 2.5.8 2023-12-03T11:41:24.202 INFO:teuthology.orchestra.run.smithi044.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2023-12-03T11:41:24.202 INFO:teuthology.orchestra.run.smithi044.stdout:JVM: 1.8.0_362 (Red Hat, Inc. 25.362-b08) 2023-12-03T11:41:24.202 INFO:teuthology.orchestra.run.smithi044.stdout:OS: Linux 5.14.0-388.el9.x86_64 amd64 2023-12-03T11:41:24.202 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:24.203 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2023-12-03T11:41:24.203 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-12-03T11:41:24.204 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi044.front.sepia.ceph.com 2023-12-03T11:41:24.204 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-12-03T11:41:24.204 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi091.front.sepia.ceph.com 2023-12-03T11:41:24.204 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2023-12-03T11:41:24.502 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2023-12-03T11:41:24.503 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2023-12-03T11:41:24.503 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'VDBOUHZXFZGGOHMSJIFU', 'access_secret': 'yNHTjn7rn479ri3Jsec0tX9QKFZ6sHWDcdEJcRsMl0r8vVwbD/H3lA==', 'region': 'mexico', 'endpoint': 'smithi044.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi044.front.sepia.ceph.com'} 2023-12-03T11:41:24.503 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2023-12-03T11:41:24.503 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'VDBOUHZXFZGGOHMSJIFU', '--secret', 'yNHTjn7rn479ri3Jsec0tX9QKFZ6sHWDcdEJcRsMl0r8vVwbD/H3lA==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2023-12-03T11:41:24.503 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key VDBOUHZXFZGGOHMSJIFU --secret yNHTjn7rn479ri3Jsec0tX9QKFZ6sHWDcdEJcRsMl0r8vVwbD/H3lA== --email tester.client.0_test@test.test --cluster ceph 2023-12-03T11:41:24.566 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:41:24.566 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:41:24.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.578+0000 7f4e51b22800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.579+0000 7f4e51b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:24.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.579+0000 7f4e51b22800 20 realm 2023-12-03T11:41:24.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.579+0000 7f4e51b22800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.580+0000 7f4e51b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:24.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.580+0000 7f4e51b22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:41:24.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.580+0000 7f4e51b22800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.580+0000 7f4e51b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:24.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.580+0000 7f4e51b22800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.581+0000 7f4e51b22800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:41:24.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.581+0000 7f4e51b22800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.582+0000 7f4e51b22800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:41:24.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.582+0000 7f4e51b22800 20 searching for the correct realm 2023-12-03T11:41:24.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.592+0000 7f4e4d795640 0 -- 172.21.15.44:0/1460406735 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x562eecf787c0 msgr2=0x562eecf7ac10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:41:24.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.594+0000 7f4e51b22800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:41:24.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.594+0000 7f4e51b22800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:41:24.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.594+0000 7f4e51b22800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:41:24.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.594+0000 7f4e51b22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:41:24.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.594+0000 7f4e51b22800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.594+0000 7f4e51b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:24.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.594+0000 7f4e51b22800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.594+0000 7f4e51b22800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:41:24.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.594+0000 7f4e51b22800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.594+0000 7f4e51b22800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:41:24.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.594+0000 7f4e51b22800 20 zone default found 2023-12-03T11:41:24.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.594+0000 7f4e51b22800 4 Realm: () 2023-12-03T11:41:24.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.594+0000 7f4e51b22800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:41:24.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.594+0000 7f4e51b22800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:41:24.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.594+0000 7f4e51b22800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:41:24.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.594+0000 7f4e51b22800 20 zonegroup default 2023-12-03T11:41:24.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.595+0000 7f4e51b22800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.595+0000 7f4e51b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:24.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.595+0000 7f4e51b22800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.595+0000 7f4e51b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:24.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.595+0000 7f4e51b22800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.595+0000 7f4e51b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:24.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.595+0000 7f4e51b22800 20 started sync module instance, tier type = 2023-12-03T11:41:24.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.595+0000 7f4e51b22800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:41:24.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.603+0000 7f4e4df96640 0 -- 172.21.15.44:0/1460406735 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x562eecf809d0 msgr2=0x562eecf82e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:41:24.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.605+0000 7f4e51b22800 20 add_watcher() i=0 2023-12-03T11:41:24.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.605+0000 7f4e51b22800 20 add_watcher() i=1 2023-12-03T11:41:24.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.605+0000 7f4e51b22800 20 add_watcher() i=2 2023-12-03T11:41:24.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.605+0000 7f4e51b22800 20 add_watcher() i=3 2023-12-03T11:41:24.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.605+0000 7f4e51b22800 20 add_watcher() i=4 2023-12-03T11:41:24.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.605+0000 7f4e51b22800 20 add_watcher() i=5 2023-12-03T11:41:24.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.605+0000 7f4e51b22800 20 add_watcher() i=6 2023-12-03T11:41:24.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.606+0000 7f4e51b22800 20 add_watcher() i=7 2023-12-03T11:41:24.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.606+0000 7f4e51b22800 2 all 8 watchers are set, enabling cache 2023-12-03T11:41:24.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.608+0000 7f4e12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:41:24.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.608+0000 7f4e51b22800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:41:24.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.608+0000 7f4e51b22800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:41:24.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.613+0000 7f4e51b22800 5 note: GC not initialized 2023-12-03T11:41:24.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.614+0000 7f4d81ffb640 20 reqs_thread_entry: start 2023-12-03T11:41:24.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.614+0000 7f4e51b22800 20 init_complete bucket index max shards: 1 2023-12-03T11:41:24.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.614+0000 7f4e51b22800 20 Filter name: none 2023-12-03T11:41:24.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.615+0000 7f4d737fe640 20 reqs_thread_entry: start 2023-12-03T11:41:24.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.615+0000 7f4e51b22800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2023-12-03T11:41:24.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.615+0000 7f4e51b22800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.615+0000 7f4e51b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:24.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.615+0000 7f4e51b22800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2023-12-03T11:41:24.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.615+0000 7f4e51b22800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2023-12-03T11:41:24.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.615+0000 7f4e51b22800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2023-12-03T11:41:24.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.615+0000 7f4e51b22800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.615+0000 7f4e51b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:24.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.615+0000 7f4e51b22800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2023-12-03T11:41:24.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.615+0000 7f4e51b22800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2023-12-03T11:41:24.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.615+0000 7f4e51b22800 10 cache get: name=default.rgw.meta+users.keys+VDBOUHZXFZGGOHMSJIFU : miss 2023-12-03T11:41:24.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.615+0000 7f4e51b22800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.616+0000 7f4e51b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:24.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.616+0000 7f4e51b22800 10 cache put: name=default.rgw.meta+users.keys+VDBOUHZXFZGGOHMSJIFU info.flags=0x0 2023-12-03T11:41:24.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.616+0000 7f4e51b22800 10 adding default.rgw.meta+users.keys+VDBOUHZXFZGGOHMSJIFU to cache LRU end 2023-12-03T11:41:24.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.616+0000 7f4e51b22800 10 cache get: name=default.rgw.meta+users.keys+VDBOUHZXFZGGOHMSJIFU : hit (negative entry) 2023-12-03T11:41:24.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.616+0000 7f4e51b22800 10 cache get: name=default.rgw.meta+users.keys+VDBOUHZXFZGGOHMSJIFU : hit (negative entry) 2023-12-03T11:41:24.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.617+0000 7f4e51b22800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2023-12-03T11:41:24.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.617+0000 7f4e51b22800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2023-12-03T11:41:24.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.617+0000 7f4e51b22800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2023-12-03T11:41:24.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.618+0000 7f4e2f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693297 cookie 94759544188096 notifier 7725 bl.length()=636 2023-12-03T11:41:24.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.618+0000 7f4e2f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2023-12-03T11:41:24.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.618+0000 7f4e2f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2023-12-03T11:41:24.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.619+0000 7f4e51b22800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2023-12-03T11:41:24.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.619+0000 7f4e51b22800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2023-12-03T11:41:24.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.619+0000 7f4e51b22800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2023-12-03T11:41:24.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.620+0000 7f4e2f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693221 cookie 94759544181040 notifier 7725 bl.length()=200 2023-12-03T11:41:24.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.620+0000 7f4e2f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2023-12-03T11:41:24.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.620+0000 7f4e2f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2023-12-03T11:41:24.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.621+0000 7f4e51b22800 10 cache put: name=default.rgw.meta+users.keys+VDBOUHZXFZGGOHMSJIFU info.flags=0x7 2023-12-03T11:41:24.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.621+0000 7f4e51b22800 10 moving default.rgw.meta+users.keys+VDBOUHZXFZGGOHMSJIFU to cache LRU end 2023-12-03T11:41:24.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.621+0000 7f4e51b22800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:VDBOUHZXFZGGOHMSJIFU, ofs0, ns] 2023-12-03T11:41:24.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.622+0000 7f4e2f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693237 cookie 94759544187056 notifier 7725 bl.length()=189 2023-12-03T11:41:24.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.622+0000 7f4e2f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+VDBOUHZXFZGGOHMSJIFU info.flags=0x7 2023-12-03T11:41:24.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.622+0000 7f4e2f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+VDBOUHZXFZGGOHMSJIFU to cache LRU end 2023-12-03T11:41:24.623 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-12-03T11:41:24.623 INFO:teuthology.orchestra.run.smithi044.stdout: "user_id": "tester.client.0", 2023-12-03T11:41:24.624 INFO:teuthology.orchestra.run.smithi044.stdout: "display_name": "Ms. tester.client.0", 2023-12-03T11:41:24.624 INFO:teuthology.orchestra.run.smithi044.stdout: "email": "tester.client.0_test@test.test", 2023-12-03T11:41:24.624 INFO:teuthology.orchestra.run.smithi044.stdout: "suspended": 0, 2023-12-03T11:41:24.624 INFO:teuthology.orchestra.run.smithi044.stdout: "max_buckets": 1000, 2023-12-03T11:41:24.624 INFO:teuthology.orchestra.run.smithi044.stdout: "subusers": [], 2023-12-03T11:41:24.624 INFO:teuthology.orchestra.run.smithi044.stdout: "keys": [ 2023-12-03T11:41:24.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-12-03T11:41:24.624 INFO:teuthology.orchestra.run.smithi044.stdout: "user": "tester.client.0", 2023-12-03T11:41:24.624 INFO:teuthology.orchestra.run.smithi044.stdout: "access_key": "VDBOUHZXFZGGOHMSJIFU", 2023-12-03T11:41:24.624 INFO:teuthology.orchestra.run.smithi044.stdout: "secret_key": "yNHTjn7rn479ri3Jsec0tX9QKFZ6sHWDcdEJcRsMl0r8vVwbD/H3lA==" 2023-12-03T11:41:24.624 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-12-03T11:41:24.624 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2023-12-03T11:41:24.624 INFO:teuthology.orchestra.run.smithi044.stdout: "swift_keys": [], 2023-12-03T11:41:24.624 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": [], 2023-12-03T11:41:24.624 INFO:teuthology.orchestra.run.smithi044.stdout: "op_mask": "read, write, delete", 2023-12-03T11:41:24.625 INFO:teuthology.orchestra.run.smithi044.stdout: "default_placement": "", 2023-12-03T11:41:24.625 INFO:teuthology.orchestra.run.smithi044.stdout: "default_storage_class": "", 2023-12-03T11:41:24.625 INFO:teuthology.orchestra.run.smithi044.stdout: "placement_tags": [], 2023-12-03T11:41:24.625 INFO:teuthology.orchestra.run.smithi044.stdout: "bucket_quota": { 2023-12-03T11:41:24.625 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2023-12-03T11:41:24.625 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2023-12-03T11:41:24.625 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2023-12-03T11:41:24.625 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2023-12-03T11:41:24.625 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2023-12-03T11:41:24.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-12-03T11:41:24.625 INFO:teuthology.orchestra.run.smithi044.stdout: "user_quota": { 2023-12-03T11:41:24.625 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2023-12-03T11:41:24.625 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2023-12-03T11:41:24.625 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2023-12-03T11:41:24.625 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2023-12-03T11:41:24.625 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2023-12-03T11:41:24.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-12-03T11:41:24.626 INFO:teuthology.orchestra.run.smithi044.stdout: "temp_url_keys": [], 2023-12-03T11:41:24.626 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "rgw", 2023-12-03T11:41:24.626 INFO:teuthology.orchestra.run.smithi044.stdout: "mfa_ids": [] 2023-12-03T11:41:24.626 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-12-03T11:41:24.626 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:24.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.623+0000 7f4e12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:41:24.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.625+0000 7f4e51b22800 20 remove_watcher() i=0 2023-12-03T11:41:24.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.625+0000 7f4e51b22800 2 removed watcher, disabling cache 2023-12-03T11:41:24.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.626+0000 7f4e51b22800 20 remove_watcher() i=1 2023-12-03T11:41:24.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.628+0000 7f4e51b22800 20 remove_watcher() i=2 2023-12-03T11:41:24.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.629+0000 7f4e51b22800 20 remove_watcher() i=3 2023-12-03T11:41:24.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.630+0000 7f4e51b22800 20 remove_watcher() i=4 2023-12-03T11:41:24.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.631+0000 7f4e51b22800 20 remove_watcher() i=5 2023-12-03T11:41:24.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.632+0000 7f4e51b22800 20 remove_watcher() i=6 2023-12-03T11:41:24.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.633+0000 7f4e51b22800 20 remove_watcher() i=7 2023-12-03T11:41:24.641 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:41:24.641 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2023-12-03T11:41:24.670 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2023-12-03T11:41:24.671 DEBUG:teuthology.orchestra.run.smithi044:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2023-12-03T11:41:24.736 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2023-12-03T11:41:24.827 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:41:24.827 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:41:24.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.840+0000 7f51c5f30800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.842+0000 7f51c5f30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:24.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.842+0000 7f51c5f30800 20 realm 2023-12-03T11:41:24.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.842+0000 7f51c5f30800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.842+0000 7f51c5f30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:24.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.842+0000 7f51c5f30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:41:24.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.842+0000 7f51c5f30800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.842+0000 7f51c5f30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:24.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.842+0000 7f51c5f30800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.843+0000 7f51c5f30800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:41:24.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.843+0000 7f51c5f30800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.844+0000 7f51c5f30800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:41:24.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.844+0000 7f51c5f30800 20 searching for the correct realm 2023-12-03T11:41:24.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.855+0000 7f51c1cc6640 0 -- 172.21.15.44:0/642079735 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55b4d9b42670 msgr2=0x55b4d9b44a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:41:24.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.856+0000 7f51c5f30800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:41:24.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.856+0000 7f51c5f30800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:41:24.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.856+0000 7f51c5f30800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:41:24.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.856+0000 7f51c5f30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:41:24.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.856+0000 7f51c5f30800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.857+0000 7f51c5f30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:24.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.857+0000 7f51c5f30800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.857+0000 7f51c5f30800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:41:24.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.857+0000 7f51c5f30800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.857+0000 7f51c5f30800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:41:24.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.857+0000 7f51c5f30800 20 zone default found 2023-12-03T11:41:24.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.857+0000 7f51c5f30800 4 Realm: () 2023-12-03T11:41:24.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.857+0000 7f51c5f30800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:41:24.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.857+0000 7f51c5f30800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:41:24.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.857+0000 7f51c5f30800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:41:24.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.857+0000 7f51c5f30800 20 zonegroup default 2023-12-03T11:41:24.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.857+0000 7f51c5f30800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.858+0000 7f51c5f30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:24.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.858+0000 7f51c5f30800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.858+0000 7f51c5f30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:24.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.858+0000 7f51c5f30800 20 rados->read ofs=0 len=0 2023-12-03T11:41:24.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.858+0000 7f51c5f30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:24.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.858+0000 7f51c5f30800 20 started sync module instance, tier type = 2023-12-03T11:41:24.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.858+0000 7f51c5f30800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:41:24.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.866+0000 7f51c24c7640 0 -- 172.21.15.44:0/642079735 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f51b806b070 msgr2=0x7f51b80ce040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:41:24.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.868+0000 7f51c5f30800 20 add_watcher() i=0 2023-12-03T11:41:24.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.868+0000 7f51c5f30800 20 add_watcher() i=1 2023-12-03T11:41:24.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.868+0000 7f51c5f30800 20 add_watcher() i=2 2023-12-03T11:41:24.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.868+0000 7f51c5f30800 20 add_watcher() i=3 2023-12-03T11:41:24.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.868+0000 7f51c5f30800 20 add_watcher() i=4 2023-12-03T11:41:24.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.868+0000 7f51c5f30800 20 add_watcher() i=5 2023-12-03T11:41:24.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.868+0000 7f51c5f30800 20 add_watcher() i=6 2023-12-03T11:41:24.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.869+0000 7f51c5f30800 20 add_watcher() i=7 2023-12-03T11:41:24.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.869+0000 7f51c5f30800 2 all 8 watchers are set, enabling cache 2023-12-03T11:41:24.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.870+0000 7f51877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:41:24.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.871+0000 7f51c5f30800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:41:24.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.871+0000 7f51c5f30800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:41:24.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.918+0000 7f50f67fc640 20 reqs_thread_entry: start 2023-12-03T11:41:24.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.918+0000 7f51c5f30800 20 init_complete bucket index max shards: 1 2023-12-03T11:41:24.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.918+0000 7f51c5f30800 20 Filter name: none 2023-12-03T11:41:24.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.918+0000 7f50e7fff640 20 reqs_thread_entry: start 2023-12-03T11:41:24.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.918+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:41:24.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.920+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:24.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.920+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:24.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.920+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:41:24.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.920+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='_UMIXUt7fiOyWkbL5BW2WAWCqNNA8FJm', time=2023-12-03T13:36:28.751653+0000, chain.objs.size()=2 2023-12-03T11:41:24.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.921+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.9nsQAu1Hq-sZ28fa4p5r0fEb7rpP7FC_0 2023-12-03T11:41:24.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.921+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.9nsQAu1Hq-sZ28fa4p5r0fEb7rpP7FC_1 2023-12-03T11:41:24.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.921+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='_ZEeYsa3VP2RPdRmSJ9T6ENDqad0L-GC', time=2023-12-03T13:36:28.806590+0000, chain.objs.size()=2 2023-12-03T11:41:24.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.921+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.-hu2PS74923_mtosF0XkjUS-pA6EAC7_1 2023-12-03T11:41:24.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.921+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.-hu2PS74923_mtosF0XkjUS-pA6EAC7_2 2023-12-03T11:41:24.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.926+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:41:24.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.929+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:41:24.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.931+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:24.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.931+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:24.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.931+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:24.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.932+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:41:24.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.934+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:24.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.934+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:24.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.934+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2023-12-03T11:41:24.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.934+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.11555830209973298190', time=2023-12-03T13:36:28.699198+0000, chain.objs.size()=4 2023-12-03T11:41:24.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.934+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.8__multipart_foo.2~kZLV1mMAsIx-ZJx2IFGENleK5tXGjEc.1 2023-12-03T11:41:24.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.934+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.8__multipart_foo.2~kZLV1mMAsIx-ZJx2IFGENleK5tXGjEc.2 2023-12-03T11:41:24.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.934+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.8__multipart_foo.2~kZLV1mMAsIx-ZJx2IFGENleK5tXGjEc.3 2023-12-03T11:41:24.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.934+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.8__multipart_foo.2~kZLV1mMAsIx-ZJx2IFGENleK5tXGjEc.4 2023-12-03T11:41:24.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.934+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.1_1_f2da08f3fe9c9c50c2c0d5487b397353', time=2023-12-03T13:36:28.781967+0000, chain.objs.size()=5 2023-12-03T11:41:24.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.934+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.1 2023-12-03T11:41:24.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.934+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.1_1 2023-12-03T11:41:24.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.935+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.2 2023-12-03T11:41:24.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.935+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.2_1 2023-12-03T11:41:24.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.935+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.3 2023-12-03T11:41:24.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.935+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.631626898493404941', time=2023-12-03T13:36:28.794395+0000, chain.objs.size()=5 2023-12-03T11:41:24.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.935+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.1 2023-12-03T11:41:24.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.935+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.1_1 2023-12-03T11:41:24.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.935+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.2 2023-12-03T11:41:24.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.937+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.2_1 2023-12-03T11:41:24.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.937+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.3 2023-12-03T11:41:24.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.937+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.1_1_0f9ee03b3f24bf3d677231b0d4755470', time=2023-12-03T13:36:28.802379+0000, chain.objs.size()=5 2023-12-03T11:41:24.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.937+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.1 2023-12-03T11:41:24.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.938+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.1_1 2023-12-03T11:41:24.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.938+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.2 2023-12-03T11:41:24.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.938+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.2_1 2023-12-03T11:41:24.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.938+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-LUKEWARM.2~hMARzs__onzZKwyraRz0HHTHXGddpPE.3 2023-12-03T11:41:24.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.938+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.14005413547435585571', time=2023-12-03T13:36:28.841692+0000, chain.objs.size()=5 2023-12-03T11:41:24.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.938+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__multipart_foo-FROZEN.2~ObSIJA9XRIM-juNj5LpIJ0SJU8eyq1-.1 2023-12-03T11:41:24.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.938+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__shadow_foo-FROZEN.2~ObSIJA9XRIM-juNj5LpIJ0SJU8eyq1-.1_1 2023-12-03T11:41:24.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.938+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__multipart_foo-FROZEN.2~ObSIJA9XRIM-juNj5LpIJ0SJU8eyq1-.2 2023-12-03T11:41:24.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.938+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__shadow_foo-FROZEN.2~ObSIJA9XRIM-juNj5LpIJ0SJU8eyq1-.2_1 2023-12-03T11:41:24.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.939+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__multipart_foo-FROZEN.2~ObSIJA9XRIM-juNj5LpIJ0SJU8eyq1-.3 2023-12-03T11:41:24.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.942+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:41:24.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.944+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:41:24.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.945+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:24.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.945+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:24.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.946+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:41:24.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.946+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.hE0IhaDifyj-uLSifn0qsr9WZTIxJRX_1_6a9dfe91a6fc057b73d0ea5d3b77be5c', time=2023-12-03T13:36:28.718631+0000, chain.objs.size()=2 2023-12-03T11:41:24.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.946+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.hE0IhaDifyj-uLSifn0qsr9WZTIxJRX_0 2023-12-03T11:41:24.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.946+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.hE0IhaDifyj-uLSifn0qsr9WZTIxJRX_1 2023-12-03T11:41:24.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.946+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.11144776869064333912', time=2023-12-03T13:36:28.872217+0000, chain.objs.size()=3 2023-12-03T11:41:24.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.946+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12__shadow_.0cJqm4SmH6fyd-sd4TZ-G_huWc9OQmH_0 2023-12-03T11:41:24.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.946+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12__shadow_.0cJqm4SmH6fyd-sd4TZ-G_huWc9OQmH_1 2023-12-03T11:41:24.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.946+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12__shadow_.0cJqm4SmH6fyd-sd4TZ-G_huWc9OQmH_2 2023-12-03T11:41:24.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.949+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:41:24.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.951+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:41:24.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.952+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:24.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.952+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:24.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.953+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:24.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.954+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:41:24.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.955+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:24.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.956+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:24.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.956+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:24.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.957+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:41:24.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.959+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:24.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.959+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:24.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.959+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:24.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.960+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:41:24.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.962+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:24.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.962+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:24.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.963+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:41:24.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.963+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.2147914547053907546', time=2023-12-03T13:36:28.660779+0000, chain.objs.size()=4 2023-12-03T11:41:24.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.963+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.11__multipart_foo.2~oKO_SIqogcy04MN8y0DHre0qGSmfLST.1 2023-12-03T11:41:24.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.963+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.11__multipart_foo.2~oKO_SIqogcy04MN8y0DHre0qGSmfLST.2 2023-12-03T11:41:24.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.963+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.11__multipart_foo.2~oKO_SIqogcy04MN8y0DHre0qGSmfLST.3 2023-12-03T11:41:24.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.963+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.11__multipart_foo.2~oKO_SIqogcy04MN8y0DHre0qGSmfLST.4 2023-12-03T11:41:24.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.963+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='_nI3qJ0fL-r_TjDRtPbtpriSjDJfvT1R', time=2023-12-03T13:36:28.821205+0000, chain.objs.size()=3 2023-12-03T11:41:24.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.963+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.bIZndDBQPRKgNz3MoLkR4cxyN1B0JJo_0 2023-12-03T11:41:24.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.963+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.bIZndDBQPRKgNz3MoLkR4cxyN1B0JJo_1 2023-12-03T11:41:24.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.963+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.bIZndDBQPRKgNz3MoLkR4cxyN1B0JJo_2 2023-12-03T11:41:24.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.966+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:41:24.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.968+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:41:24.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.970+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:24.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.970+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:24.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.971+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:41:24.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.971+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.9707469193298936919', time=2023-12-03T13:36:28.645959+0000, chain.objs.size()=4 2023-12-03T11:41:24.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.971+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.10__multipart_foo.2~NRwZnHg8Vzye7TVXkipMVT-TPXYJSxj.1 2023-12-03T11:41:24.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.971+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.10__multipart_foo.2~NRwZnHg8Vzye7TVXkipMVT-TPXYJSxj.2 2023-12-03T11:41:24.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.971+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.10__multipart_foo.2~NRwZnHg8Vzye7TVXkipMVT-TPXYJSxj.3 2023-12-03T11:41:24.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.971+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.10__multipart_foo.2~NRwZnHg8Vzye7TVXkipMVT-TPXYJSxj.4 2023-12-03T11:41:24.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.971+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.15165498622313365685', time=2023-12-03T13:36:28.846195+0000, chain.objs.size()=5 2023-12-03T11:41:24.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.971+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__multipart_foo-LUKEWARM.2~Dz3nutPJQF3BSu1zhU5a4RqfoECZEQi.1 2023-12-03T11:41:24.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.971+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__shadow_foo-LUKEWARM.2~Dz3nutPJQF3BSu1zhU5a4RqfoECZEQi.1_1 2023-12-03T11:41:24.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.971+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__multipart_foo-LUKEWARM.2~Dz3nutPJQF3BSu1zhU5a4RqfoECZEQi.2 2023-12-03T11:41:24.976 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.971+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__shadow_foo-LUKEWARM.2~Dz3nutPJQF3BSu1zhU5a4RqfoECZEQi.2_1 2023-12-03T11:41:24.976 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.971+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__multipart_foo-LUKEWARM.2~Dz3nutPJQF3BSu1zhU5a4RqfoECZEQi.3 2023-12-03T11:41:24.976 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.975+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:41:24.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.978+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:41:24.980 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.979+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:24.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.980+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:24.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.980+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:24.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.981+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:41:24.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.982+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:24.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.983+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:24.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.983+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:41:24.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.983+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.17545548839326365404', time=2023-12-03T13:36:28.680451+0000, chain.objs.size()=4 2023-12-03T11:41:24.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.983+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9__multipart_foo.2~d_6Jp2MPaiBCGNRMBj2_k73oLR8_31x.1 2023-12-03T11:41:24.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.983+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9__multipart_foo.2~d_6Jp2MPaiBCGNRMBj2_k73oLR8_31x.2 2023-12-03T11:41:24.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.983+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9__multipart_foo.2~d_6Jp2MPaiBCGNRMBj2_k73oLR8_31x.3 2023-12-03T11:41:24.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.983+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.9__multipart_foo.2~d_6Jp2MPaiBCGNRMBj2_k73oLR8_31x.4 2023-12-03T11:41:24.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.983+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.D9h1gFNBW9ggLc4wJgTSkVywSNQ5PDD_1_1185a456eb67558dde9f6d5c640d5ec3', time=2023-12-03T13:36:28.739619+0000, chain.objs.size()=2 2023-12-03T11:41:24.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.983+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.D9h1gFNBW9ggLc4wJgTSkVywSNQ5PDD_0 2023-12-03T11:41:24.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.983+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.D9h1gFNBW9ggLc4wJgTSkVywSNQ5PDD_1 2023-12-03T11:41:24.989 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.988+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:41:24.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.990+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:41:24.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.992+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:24.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.992+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:24.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.992+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:41:24.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.992+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.14694426577960200789', time=2023-12-03T13:36:28.811970+0000, chain.objs.size()=5 2023-12-03T11:41:24.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.992+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.1 2023-12-03T11:41:24.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.992+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.1_1 2023-12-03T11:41:24.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.992+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.2 2023-12-03T11:41:24.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.992+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.2_1 2023-12-03T11:41:24.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.992+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.3 2023-12-03T11:41:24.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.995+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:41:24.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.997+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:41:24.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.999+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.999+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:24.999+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.000+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:41:25.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.002+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.002+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.002+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.003+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:41:25.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.005+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.005+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.005+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2023-12-03T11:41:25.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.005+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='_YXX_WEE5aPjjvsy7J6HF3MEpoX1_kB8', time=2023-12-03T13:36:28.726736+0000, chain.objs.size()=1 2023-12-03T11:41:25.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.005+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.0tp963Q3nbsr3qmaVlMUAxrYhoq3aoV_1 2023-12-03T11:41:25.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.005+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='_PIc52q_4vk5oppIDy-ywaKx6Axeu5ti', time=2023-12-03T13:36:28.743505+0000, chain.objs.size()=1 2023-12-03T11:41:25.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.005+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.2qw5DdKKvt3I1EIcC5sJDvP96DvJSqj_1 2023-12-03T11:41:25.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.005+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='_5QxsiQY1m02WFCxmDlMLvbgWChfHCHP', time=2023-12-03T13:36:28.798255+0000, chain.objs.size()=3 2023-12-03T11:41:25.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.005+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.aQ2SLiEhhLd4qw6j3lM77wgW0KDTdbl_0 2023-12-03T11:41:25.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.005+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.aQ2SLiEhhLd4qw6j3lM77wgW0KDTdbl_1 2023-12-03T11:41:25.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.005+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.aQ2SLiEhhLd4qw6j3lM77wgW0KDTdbl_2 2023-12-03T11:41:25.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.008+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:41:25.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.010+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:41:25.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.012+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.012+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.012+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.013+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:41:25.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.015+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.015+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.015+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.016+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:41:25.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.018+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.018+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.019+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.020+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:41:25.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.021+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.021+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.022+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:41:25.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.022+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.6841886426244023594', time=2023-12-03T13:36:28.747583+0000, chain.objs.size()=1 2023-12-03T11:41:25.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.022+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.-wC8iZz0wOpq6d2qiYcX1FmUwyogqiX_1 2023-12-03T11:41:25.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.023+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:41:25.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.025+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:41:25.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.026+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.027+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.027+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:41:25.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.027+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='_YXJjSvwaiyk53eDbxerAB6p_XNItzu7', time=2023-12-03T13:36:28.786270+0000, chain.objs.size()=3 2023-12-03T11:41:25.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.027+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.SHL6isXdOybGySHPd0pcFNWemDAQKqE_0 2023-12-03T11:41:25.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.027+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.SHL6isXdOybGySHPd0pcFNWemDAQKqE_1 2023-12-03T11:41:25.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.027+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.SHL6isXdOybGySHPd0pcFNWemDAQKqE_2 2023-12-03T11:41:25.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.030+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:41:25.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.032+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:41:25.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.033+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.034+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.034+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2023-12-03T11:41:25.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.034+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.5310989475983401622', time=2023-12-03T13:36:28.730904+0000, chain.objs.size()=2 2023-12-03T11:41:25.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.034+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.D9h1gFNBW9ggLc4wJgTSkVywSNQ5PDD_0 2023-12-03T11:41:25.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.034+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.D9h1gFNBW9ggLc4wJgTSkVywSNQ5PDD_1 2023-12-03T11:41:25.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.034+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.-wC8iZz0wOpq6d2qiYcX1FmUwyogqiX_1_83e2abb05daa084ced31185e291951f2', time=2023-12-03T13:36:28.760312+0000, chain.objs.size()=1 2023-12-03T11:41:25.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.034+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.-wC8iZz0wOpq6d2qiYcX1FmUwyogqiX_1 2023-12-03T11:41:25.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.034+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.16687783434326797147', time=2023-12-03T13:36:28.777191+0000, chain.objs.size()=5 2023-12-03T11:41:25.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.034+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.1 2023-12-03T11:41:25.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.034+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.1_1 2023-12-03T11:41:25.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.034+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.2 2023-12-03T11:41:25.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.034+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.2_1 2023-12-03T11:41:25.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.034+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-FROZEN.2~VpwPBErUWRWl6D7qQwO12WR90zolOqh.3 2023-12-03T11:41:25.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.034+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='_JV--RqO2Rs6kgfJf3nWdAvkAM7nxQl3', time=2023-12-03T13:36:28.790487+0000, chain.objs.size()=2 2023-12-03T11:41:25.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.034+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.1_btFogcO5neU067WRPa-8fIWOLbOsQ_1 2023-12-03T11:41:25.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.034+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.1_btFogcO5neU067WRPa-8fIWOLbOsQ_2 2023-12-03T11:41:25.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.037+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:41:25.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.039+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:41:25.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.040+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.041+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.041+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.042+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:41:25.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.044+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.044+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.045+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:41:25.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.045+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.17939752204479921556', time=2023-12-03T13:36:28.851456+0000, chain.objs.size()=3 2023-12-03T11:41:25.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.045+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__multipart_foo-STANDARD.2~jrO2GEYLA0xH9IyTGBsOE-pJKpdd7r7.1 2023-12-03T11:41:25.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.045+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__multipart_foo-STANDARD.2~jrO2GEYLA0xH9IyTGBsOE-pJKpdd7r7.2 2023-12-03T11:41:25.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.045+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.13__multipart_foo-STANDARD.2~jrO2GEYLA0xH9IyTGBsOE-pJKpdd7r7.3 2023-12-03T11:41:25.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.047+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:41:25.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.049+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:41:25.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.050+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.051+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.051+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.052+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:41:25.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.053+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.054+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.054+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:41:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.054+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.1_1_1a4ee8236fadd2d2055d61a226b899ea', time=2023-12-03T13:36:28.826303+0000, chain.objs.size()=5 2023-12-03T11:41:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.054+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.1 2023-12-03T11:41:25.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.054+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.1_1 2023-12-03T11:41:25.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.054+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.2 2023-12-03T11:41:25.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.054+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.2_1 2023-12-03T11:41:25.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.054+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__multipart_foo-STANDARD.2~Nbyt5gRDyHKJagAgfg7DyyxeB_Z8UpC.3 2023-12-03T11:41:25.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.056+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:41:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.058+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:41:25.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.060+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.060+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.061+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:41:25.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.061+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='_Pn7dPxXxIE_FKEnIADqmBTpwX81VwgS', time=2023-12-03T13:36:28.755888+0000, chain.objs.size()=2 2023-12-03T11:41:25.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.061+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.mcURseV0ZRIt1lYpZytbNuuRtLsmCtL_0 2023-12-03T11:41:25.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.061+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.mcURseV0ZRIt1lYpZytbNuuRtLsmCtL_1 2023-12-03T11:41:25.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.063+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:41:25.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.065+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:41:25.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.067+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.067+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.068+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.069+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:41:25.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.070+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.070+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.071+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:41:25.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.071+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.7925414971850557585', time=2023-12-03T13:36:28.714830+0000, chain.objs.size()=2 2023-12-03T11:41:25.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.071+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.hE0IhaDifyj-uLSifn0qsr9WZTIxJRX_0 2023-12-03T11:41:25.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.071+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.hE0IhaDifyj-uLSifn0qsr9WZTIxJRX_1 2023-12-03T11:41:25.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.072+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:41:25.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.074+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:41:25.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.075+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.076+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.076+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:41:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.076+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='_HjPamC5MASxj3wahiikfnIh_sCXZ8hx', time=2023-12-03T13:36:28.735366+0000, chain.objs.size()=2 2023-12-03T11:41:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.076+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_._RaQBdhrhgcD7irJwM-MKGlCPdnDInv_0 2023-12-03T11:41:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.076+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_._RaQBdhrhgcD7irJwM-MKGlCPdnDInv_1 2023-12-03T11:41:25.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.078+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:41:25.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.080+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:41:25.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.081+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.082+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.082+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.083+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:41:25.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.084+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.085+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.085+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:41:25.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.085+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='_KFCdW6YJ6GiwbOqLOv--ZcxEoLX3h3D', time=2023-12-03T13:36:28.722640+0000, chain.objs.size()=2 2023-12-03T11:41:25.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.085+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.YcRVrY5kxZIYT3o38Zpl9Bc6WEDGH7X_0 2023-12-03T11:41:25.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.085+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.14__shadow_.YcRVrY5kxZIYT3o38Zpl9Bc6WEDGH7X_1 2023-12-03T11:41:25.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.085+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='_wBZXE3JQs4n2RL_tom_m4D8KCSVrBw0', time=2023-12-03T13:36:28.816937+0000, chain.objs.size()=3 2023-12-03T11:41:25.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.085+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.ELCejSM4f68kSELjiJnOXJuFI-P6m3r_0 2023-12-03T11:41:25.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.085+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.ELCejSM4f68kSELjiJnOXJuFI-P6m3r_1 2023-12-03T11:41:25.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.085+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.15__shadow_.ELCejSM4f68kSELjiJnOXJuFI-P6m3r_2 2023-12-03T11:41:25.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.089+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:41:25.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.091+0000 7f51c5f30800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:41:25.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.092+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.093+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.093+0000 7f51c5f30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:41:25.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.093+0000 7f51c5f30800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.7272626509401976650', time=2023-12-03T13:36:28.868223+0000, chain.objs.size()=3 2023-12-03T11:41:25.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.093+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12__shadow_.7CVv4E6Qj0yRiYuN5fxdgxO1BQbfwjE_0 2023-12-03T11:41:25.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.093+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12__shadow_.7CVv4E6Qj0yRiYuN5fxdgxO1BQbfwjE_1 2023-12-03T11:41:25.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.093+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.12__shadow_.7CVv4E6Qj0yRiYuN5fxdgxO1BQbfwjE_2 2023-12-03T11:41:25.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.095+0000 7f51c5f30800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:41:25.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.098+0000 7f51877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:41:25.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.100+0000 7f51c5f30800 20 remove_watcher() i=0 2023-12-03T11:41:25.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.100+0000 7f51c5f30800 2 removed watcher, disabling cache 2023-12-03T11:41:25.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.101+0000 7f51c5f30800 20 remove_watcher() i=1 2023-12-03T11:41:25.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.103+0000 7f51c5f30800 20 remove_watcher() i=2 2023-12-03T11:41:25.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.104+0000 7f51c5f30800 20 remove_watcher() i=3 2023-12-03T11:41:25.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.105+0000 7f51c5f30800 20 remove_watcher() i=4 2023-12-03T11:41:25.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.106+0000 7f51c5f30800 20 remove_watcher() i=5 2023-12-03T11:41:25.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.107+0000 7f51c5f30800 20 remove_watcher() i=6 2023-12-03T11:41:25.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.108+0000 7f51c5f30800 20 remove_watcher() i=7 2023-12-03T11:41:25.114 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2023-12-03T11:41:25.164 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:41:25.165 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:41:25.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.178+0000 7fb4c5740800 20 rados->read ofs=0 len=0 2023-12-03T11:41:25.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.180+0000 7fb4c5740800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:25.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.180+0000 7fb4c5740800 20 realm 2023-12-03T11:41:25.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.180+0000 7fb4c5740800 20 rados->read ofs=0 len=0 2023-12-03T11:41:25.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.180+0000 7fb4c5740800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:25.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.180+0000 7fb4c5740800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:41:25.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.180+0000 7fb4c5740800 20 rados->read ofs=0 len=0 2023-12-03T11:41:25.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.180+0000 7fb4c5740800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:25.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.180+0000 7fb4c5740800 20 rados->read ofs=0 len=0 2023-12-03T11:41:25.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.181+0000 7fb4c5740800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:41:25.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.181+0000 7fb4c5740800 20 rados->read ofs=0 len=0 2023-12-03T11:41:25.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.182+0000 7fb4c5740800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:41:25.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.182+0000 7fb4c5740800 20 searching for the correct realm 2023-12-03T11:41:25.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.189+0000 7fb4c0d02640 0 -- 172.21.15.44:0/525373908 >> [v2:172.21.15.44:6808/1530174506,v1:172.21.15.44:6809/1530174506] conn(0x5622c9b66e30 msgr2=0x5622c9b69220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:41:25.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.192+0000 7fb4c5740800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:41:25.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.192+0000 7fb4c5740800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:41:25.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.192+0000 7fb4c5740800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:41:25.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.192+0000 7fb4c5740800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:41:25.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.192+0000 7fb4c5740800 20 rados->read ofs=0 len=0 2023-12-03T11:41:25.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.192+0000 7fb4c5740800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:25.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.192+0000 7fb4c5740800 20 rados->read ofs=0 len=0 2023-12-03T11:41:25.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.193+0000 7fb4c5740800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:41:25.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.193+0000 7fb4c5740800 20 rados->read ofs=0 len=0 2023-12-03T11:41:25.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.193+0000 7fb4c5740800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:41:25.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.193+0000 7fb4c5740800 20 zone default found 2023-12-03T11:41:25.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.193+0000 7fb4c5740800 4 Realm: () 2023-12-03T11:41:25.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.193+0000 7fb4c5740800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:41:25.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.193+0000 7fb4c5740800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:41:25.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.193+0000 7fb4c5740800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:41:25.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.193+0000 7fb4c5740800 20 zonegroup default 2023-12-03T11:41:25.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.193+0000 7fb4c5740800 20 rados->read ofs=0 len=0 2023-12-03T11:41:25.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.193+0000 7fb4c5740800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:25.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.193+0000 7fb4c5740800 20 rados->read ofs=0 len=0 2023-12-03T11:41:25.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.193+0000 7fb4c5740800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:25.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.194+0000 7fb4c5740800 20 rados->read ofs=0 len=0 2023-12-03T11:41:25.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.194+0000 7fb4c5740800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:41:25.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.194+0000 7fb4c5740800 20 started sync module instance, tier type = 2023-12-03T11:41:25.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.194+0000 7fb4c5740800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:41:25.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.194+0000 7fb4c1d04640 0 -- 172.21.15.44:0/525373908 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7fb4b8031450 msgr2=0x7fb4b80318d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:41:25.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.204+0000 7fb4c5740800 20 add_watcher() i=0 2023-12-03T11:41:25.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.204+0000 7fb4c5740800 20 add_watcher() i=1 2023-12-03T11:41:25.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.204+0000 7fb4c5740800 20 add_watcher() i=2 2023-12-03T11:41:25.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.204+0000 7fb4c5740800 20 add_watcher() i=3 2023-12-03T11:41:25.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.204+0000 7fb4c5740800 20 add_watcher() i=4 2023-12-03T11:41:25.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.204+0000 7fb4c5740800 20 add_watcher() i=5 2023-12-03T11:41:25.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.204+0000 7fb4c5740800 20 add_watcher() i=6 2023-12-03T11:41:25.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.204+0000 7fb4c5740800 20 add_watcher() i=7 2023-12-03T11:41:25.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.204+0000 7fb4c5740800 2 all 8 watchers are set, enabling cache 2023-12-03T11:41:25.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.206+0000 7fb486fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:41:25.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.206+0000 7fb4c5740800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:41:25.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.206+0000 7fb4c5740800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:41:25.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.249+0000 7fb3f5ffb640 20 reqs_thread_entry: start 2023-12-03T11:41:25.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.249+0000 7fb4c5740800 20 init_complete bucket index max shards: 1 2023-12-03T11:41:25.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.249+0000 7fb4c5740800 20 Filter name: none 2023-12-03T11:41:25.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.249+0000 7fb3e77fe640 20 reqs_thread_entry: start 2023-12-03T11:41:25.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.249+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:41:25.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.251+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.251+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.252+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.253+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:41:25.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.254+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.255+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.255+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.256+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:41:25.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.257+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.258+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.258+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.259+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:41:25.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.260+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.260+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.261+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.261+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:41:25.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.263+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.263+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.263+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.264+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:41:25.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.266+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.266+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.266+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.267+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:41:25.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.269+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.270+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.270+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.271+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:41:25.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.273+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.273+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.273+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.275+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:41:25.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.276+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.276+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.277+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.278+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:41:25.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.279+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.279+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.279+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.280+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:41:25.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.282+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.282+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.282+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.283+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:41:25.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.285+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.285+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.286+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.287+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:41:25.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.288+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.288+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.289+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.290+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:41:25.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.291+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.291+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.291+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.292+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:41:25.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.294+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.294+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.294+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.295+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:41:25.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.297+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.297+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.297+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.298+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:41:25.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.299+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.300+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.300+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.301+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:41:25.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.302+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.303+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.303+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.304+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:41:25.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.305+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.305+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.306+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.307+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:41:25.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.308+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.309+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.309+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.310+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:41:25.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.311+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.311+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.312+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.313+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:41:25.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.314+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.314+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.314+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.315+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:41:25.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.317+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.317+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.317+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.318+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:41:25.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.319+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.320+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.320+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.321+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:41:25.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.322+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.323+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.323+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.324+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:41:25.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.326+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.326+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.327+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.328+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:41:25.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.329+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.329+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.330+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.331+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:41:25.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.332+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.332+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.333+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.334+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:41:25.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.335+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.335+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.336+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.336+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:41:25.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.338+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.338+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.339+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.340+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:41:25.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.341+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.342+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.342+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.343+0000 7fb4c5740800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:41:25.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.344+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.345+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:41:25.346 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.345+0000 7fb4c5740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:41:25.347 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.347+0000 7fb486fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:41:25.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.349+0000 7fb4c5740800 20 remove_watcher() i=0 2023-12-03T11:41:25.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.349+0000 7fb4c5740800 2 removed watcher, disabling cache 2023-12-03T11:41:25.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.350+0000 7fb4c5740800 20 remove_watcher() i=1 2023-12-03T11:41:25.352 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.351+0000 7fb4c5740800 20 remove_watcher() i=2 2023-12-03T11:41:25.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.353+0000 7fb4c5740800 20 remove_watcher() i=3 2023-12-03T11:41:25.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.354+0000 7fb4c5740800 20 remove_watcher() i=4 2023-12-03T11:41:25.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.355+0000 7fb4c5740800 20 remove_watcher() i=5 2023-12-03T11:41:25.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.356+0000 7fb4c5740800 20 remove_watcher() i=6 2023-12-03T11:41:25.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:41:25.357+0000 7fb4c5740800 20 remove_watcher() i=7 2023-12-03T11:41:25.364 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2023-12-03T11:41:25.844 INFO:teuthology.orchestra.run.smithi044.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2023-12-03T11:41:29.744 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :clean UP-TO-DATE 2023-12-03T11:41:48.444 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :compileJava 2023-12-03T11:41:48.445 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :processResources 2023-12-03T11:41:48.445 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :classes 2023-12-03T11:41:49.043 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:49.044 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :compileTestJava 2023-12-03T11:41:49.044 INFO:teuthology.orchestra.run.smithi044.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2023-12-03T11:41:49.045 INFO:teuthology.orchestra.run.smithi044.stderr:Note: Recompile with -Xlint:deprecation for details. 2023-12-03T11:41:49.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:49.045 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :processTestResources NO-SOURCE 2023-12-03T11:41:49.045 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :testClasses 2023-12-03T11:41:55.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:55.144 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :test 2023-12-03T11:41:55.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:55.144 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2023-12-03T11:41:55.743 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:55.744 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2023-12-03T11:41:55.843 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:55.844 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2023-12-03T11:41:55.943 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:55.943 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2023-12-03T11:41:56.143 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:56.143 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2023-12-03T11:41:56.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:56.543 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2023-12-03T11:41:56.744 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:56.744 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2023-12-03T11:41:56.744 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:56.744 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2023-12-03T11:41:56.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:56.844 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2023-12-03T11:41:56.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:56.844 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2023-12-03T11:41:57.043 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:57.043 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2023-12-03T11:41:57.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:57.444 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2023-12-03T11:41:57.743 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:41:57.743 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2023-12-03T11:42:01.843 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:01.843 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2023-12-03T11:42:02.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:02.144 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2023-12-03T11:42:02.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:02.144 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2023-12-03T11:42:02.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:02.344 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2023-12-03T11:42:02.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:02.344 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2023-12-03T11:42:02.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:02.643 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2023-12-03T11:42:03.043 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:03.043 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2023-12-03T11:42:03.244 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:03.244 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2023-12-03T11:42:03.244 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:03.245 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2023-12-03T11:42:03.343 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:03.343 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2023-12-03T11:42:05.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:05.644 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2023-12-03T11:42:05.843 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:05.843 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2023-12-03T11:42:06.243 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:06.244 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2023-12-03T11:42:06.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:06.443 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2023-12-03T11:42:06.743 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:06.744 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2023-12-03T11:42:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:06.943 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2023-12-03T11:42:17.243 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:17.244 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2023-12-03T11:42:17.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:17.443 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2023-12-03T11:42:18.544 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:18.544 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2023-12-03T11:42:18.743 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:18.743 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2023-12-03T11:42:19.743 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:19.744 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2023-12-03T11:42:19.943 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:19.943 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2023-12-03T11:42:20.343 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:20.344 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2023-12-03T11:42:20.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:20.543 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2023-12-03T11:42:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:20.643 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2023-12-03T11:42:20.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:20.844 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2023-12-03T11:42:20.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:20.844 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2023-12-03T11:42:21.044 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:21.044 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2023-12-03T11:42:21.044 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:21.044 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2023-12-03T11:42:21.243 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:21.244 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2023-12-03T11:42:21.244 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:21.244 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2023-12-03T11:42:21.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:21.444 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2023-12-03T11:42:21.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:21.444 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2023-12-03T11:42:21.644 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:21.644 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2023-12-03T11:42:21.644 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:21.644 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2023-12-03T11:42:21.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:21.844 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2023-12-03T11:42:21.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:21.844 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2023-12-03T11:42:22.044 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:22.044 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2023-12-03T11:42:22.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:22.643 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2023-12-03T11:42:22.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:22.844 INFO:teuthology.orchestra.run.smithi044.stdout:---------------------------------------------------------------------- 2023-12-03T11:42:22.844 INFO:teuthology.orchestra.run.smithi044.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2023-12-03T11:42:22.844 INFO:teuthology.orchestra.run.smithi044.stdout:---------------------------------------------------------------------- 2023-12-03T11:42:22.891 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:22.892 INFO:teuthology.orchestra.run.smithi044.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2023-12-03T11:42:22.892 INFO:teuthology.orchestra.run.smithi044.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2023-12-03T11:42:22.892 INFO:teuthology.orchestra.run.smithi044.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2023-12-03T11:42:22.892 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:22.892 INFO:teuthology.orchestra.run.smithi044.stdout:BUILD SUCCESSFUL in 57s 2023-12-03T11:42:22.892 INFO:teuthology.orchestra.run.smithi044.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2023-12-03T11:42:23.209 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2023-12-03T11:42:23.260 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:42:23.260 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:42:23.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.273+0000 7f5b5e71e800 20 rados->read ofs=0 len=0 2023-12-03T11:42:23.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.275+0000 7f5b5e71e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:23.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.275+0000 7f5b5e71e800 20 realm 2023-12-03T11:42:23.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.275+0000 7f5b5e71e800 20 rados->read ofs=0 len=0 2023-12-03T11:42:23.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.275+0000 7f5b5e71e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:23.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.275+0000 7f5b5e71e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:42:23.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.275+0000 7f5b5e71e800 20 rados->read ofs=0 len=0 2023-12-03T11:42:23.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.275+0000 7f5b5e71e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:23.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.275+0000 7f5b5e71e800 20 rados->read ofs=0 len=0 2023-12-03T11:42:23.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.276+0000 7f5b5e71e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:42:23.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.276+0000 7f5b5e71e800 20 rados->read ofs=0 len=0 2023-12-03T11:42:23.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.277+0000 7f5b5e71e800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:42:23.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.277+0000 7f5b5e71e800 20 searching for the correct realm 2023-12-03T11:42:23.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.288+0000 7f5b5c225640 0 -- 172.21.15.44:0/2452337873 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55f893a40c80 msgr2=0x55f893a430d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:42:23.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.289+0000 7f5b5e71e800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:42:23.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.289+0000 7f5b5e71e800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:42:23.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.289+0000 7f5b5e71e800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:42:23.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.289+0000 7f5b5e71e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:42:23.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.289+0000 7f5b5e71e800 20 rados->read ofs=0 len=0 2023-12-03T11:42:23.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.289+0000 7f5b5e71e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:23.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.289+0000 7f5b5e71e800 20 rados->read ofs=0 len=0 2023-12-03T11:42:23.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.290+0000 7f5b5e71e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:42:23.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.290+0000 7f5b5e71e800 20 rados->read ofs=0 len=0 2023-12-03T11:42:23.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.290+0000 7f5b5e71e800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:42:23.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.290+0000 7f5b5e71e800 20 zone default found 2023-12-03T11:42:23.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.290+0000 7f5b5e71e800 4 Realm: () 2023-12-03T11:42:23.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.290+0000 7f5b5e71e800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:42:23.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.290+0000 7f5b5e71e800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:42:23.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.290+0000 7f5b5e71e800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:42:23.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.290+0000 7f5b5e71e800 20 zonegroup default 2023-12-03T11:42:23.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.290+0000 7f5b5e71e800 20 rados->read ofs=0 len=0 2023-12-03T11:42:23.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.290+0000 7f5b5e71e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:23.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.290+0000 7f5b5e71e800 20 rados->read ofs=0 len=0 2023-12-03T11:42:23.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.291+0000 7f5b5e71e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:23.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.291+0000 7f5b5e71e800 20 rados->read ofs=0 len=0 2023-12-03T11:42:23.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.291+0000 7f5b5e71e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:23.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.291+0000 7f5b5e71e800 20 started sync module instance, tier type = 2023-12-03T11:42:23.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.291+0000 7f5b5e71e800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:42:23.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.298+0000 7f5b5ca26640 0 -- 172.21.15.44:0/2452337873 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f5b50017070 msgr2=0x7f5b500868b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:42:23.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.301+0000 7f5b5e71e800 20 add_watcher() i=0 2023-12-03T11:42:23.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.301+0000 7f5b5e71e800 20 add_watcher() i=1 2023-12-03T11:42:23.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.301+0000 7f5b5e71e800 20 add_watcher() i=2 2023-12-03T11:42:23.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.301+0000 7f5b5e71e800 20 add_watcher() i=3 2023-12-03T11:42:23.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.301+0000 7f5b5e71e800 20 add_watcher() i=4 2023-12-03T11:42:23.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.301+0000 7f5b5e71e800 20 add_watcher() i=5 2023-12-03T11:42:23.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.301+0000 7f5b5e71e800 20 add_watcher() i=6 2023-12-03T11:42:23.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.301+0000 7f5b5e71e800 20 add_watcher() i=7 2023-12-03T11:42:23.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.302+0000 7f5b5e71e800 2 all 8 watchers are set, enabling cache 2023-12-03T11:42:23.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.303+0000 7f5b227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:42:23.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.303+0000 7f5b5e71e800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:42:23.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.303+0000 7f5b5e71e800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:42:23.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.348+0000 7f5a917fa640 20 reqs_thread_entry: start 2023-12-03T11:42:23.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.348+0000 7f5b5e71e800 20 init_complete bucket index max shards: 1 2023-12-03T11:42:23.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.348+0000 7f5b5e71e800 20 Filter name: none 2023-12-03T11:42:23.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.348+0000 7f5a8affd640 20 reqs_thread_entry: start 2023-12-03T11:42:23.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.348+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:42:23.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.350+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.352 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.350+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.352 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.351+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.352+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:42:23.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.353+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.354+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.354+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.355+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:42:23.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.357+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.357+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.357+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.358+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:42:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.360+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.360+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.360+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.361+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:42:23.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.363+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.363+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.364+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.364+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:42:23.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.366+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.366+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.367+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:42:23.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.367+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.17201051371483474687', time=2023-12-03T13:42:00.727460+0000, chain.objs.size()=7 2023-12-03T11:42:23.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.367+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~Klv551XpezGV73dFhJ-xBaGdYw4Zw9C.1 2023-12-03T11:42:23.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.367+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~Klv551XpezGV73dFhJ-xBaGdYw4Zw9C.1_1 2023-12-03T11:42:23.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.367+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~Klv551XpezGV73dFhJ-xBaGdYw4Zw9C.1_2 2023-12-03T11:42:23.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.367+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~Klv551XpezGV73dFhJ-xBaGdYw4Zw9C.2 2023-12-03T11:42:23.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.367+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~Klv551XpezGV73dFhJ-xBaGdYw4Zw9C.2_1 2023-12-03T11:42:23.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.367+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~Klv551XpezGV73dFhJ-xBaGdYw4Zw9C.2_2 2023-12-03T11:42:23.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.367+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~Klv551XpezGV73dFhJ-xBaGdYw4Zw9C.3 2023-12-03T11:42:23.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.372+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:42:23.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.378+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:42:23.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.379+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.380+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.380+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:42:23.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.380+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.14319913068931307071', time=2023-12-03T13:42:01.868692+0000, chain.objs.size()=5 2023-12-03T11:42:23.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.380+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.34__shadow_.aXrYzcyll1UogmdRanaPTIvIMsVQ3yF_1 2023-12-03T11:42:23.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.380+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.34__shadow_.aXrYzcyll1UogmdRanaPTIvIMsVQ3yF_2 2023-12-03T11:42:23.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.380+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.34__shadow_.aXrYzcyll1UogmdRanaPTIvIMsVQ3yF_3 2023-12-03T11:42:23.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.380+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.34__shadow_.aXrYzcyll1UogmdRanaPTIvIMsVQ3yF_4 2023-12-03T11:42:23.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.380+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.34__shadow_.aXrYzcyll1UogmdRanaPTIvIMsVQ3yF_5 2023-12-03T11:42:23.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.380+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.473555985112285848', time=2023-12-03T13:42:13.154843+0000, chain.objs.size()=19 2023-12-03T11:42:23.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.380+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~eW_9ElLH0MKO6b5Ibg64H9l1vG7VTNf.1 2023-12-03T11:42:23.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.380+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~eW_9ElLH0MKO6b5Ibg64H9l1vG7VTNf.1_1 2023-12-03T11:42:23.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.380+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~eW_9ElLH0MKO6b5Ibg64H9l1vG7VTNf.2 2023-12-03T11:42:23.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.381+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~eW_9ElLH0MKO6b5Ibg64H9l1vG7VTNf.2_1 2023-12-03T11:42:23.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.381+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~eW_9ElLH0MKO6b5Ibg64H9l1vG7VTNf.3 2023-12-03T11:42:23.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.381+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~eW_9ElLH0MKO6b5Ibg64H9l1vG7VTNf.3_1 2023-12-03T11:42:23.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.381+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~eW_9ElLH0MKO6b5Ibg64H9l1vG7VTNf.4 2023-12-03T11:42:23.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.383+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~eW_9ElLH0MKO6b5Ibg64H9l1vG7VTNf.4_1 2023-12-03T11:42:23.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.385+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~eW_9ElLH0MKO6b5Ibg64H9l1vG7VTNf.5 2023-12-03T11:42:23.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.385+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~eW_9ElLH0MKO6b5Ibg64H9l1vG7VTNf.5_1 2023-12-03T11:42:23.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.385+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~eW_9ElLH0MKO6b5Ibg64H9l1vG7VTNf.6 2023-12-03T11:42:23.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.385+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~eW_9ElLH0MKO6b5Ibg64H9l1vG7VTNf.6_1 2023-12-03T11:42:23.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.385+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~eW_9ElLH0MKO6b5Ibg64H9l1vG7VTNf.7 2023-12-03T11:42:23.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.388+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~eW_9ElLH0MKO6b5Ibg64H9l1vG7VTNf.7_1 2023-12-03T11:42:23.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.388+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~eW_9ElLH0MKO6b5Ibg64H9l1vG7VTNf.8 2023-12-03T11:42:23.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.388+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~eW_9ElLH0MKO6b5Ibg64H9l1vG7VTNf.8_1 2023-12-03T11:42:23.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.388+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~eW_9ElLH0MKO6b5Ibg64H9l1vG7VTNf.9 2023-12-03T11:42:23.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.388+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~eW_9ElLH0MKO6b5Ibg64H9l1vG7VTNf.9_1 2023-12-03T11:42:23.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.388+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~eW_9ElLH0MKO6b5Ibg64H9l1vG7VTNf.10 2023-12-03T11:42:23.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.394+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:42:23.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.400+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:42:23.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.401+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.402+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.402+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.404+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:42:23.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.405+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.405+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.406+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.407+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:42:23.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.409+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.409+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.409+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:42:23.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.409+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.16313598645339744592', time=2023-12-03T13:42:19.825858+0000, chain.objs.size()=9 2023-12-03T11:42:23.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.409+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.45__multipart_key1.2~Kbwz1mFZ650cAoJ93-kproYTk2MLKIk.1 2023-12-03T11:42:23.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.409+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.45__shadow_key1.2~Kbwz1mFZ650cAoJ93-kproYTk2MLKIk.1_1 2023-12-03T11:42:23.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.409+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.45__multipart_key1.2~Kbwz1mFZ650cAoJ93-kproYTk2MLKIk.2 2023-12-03T11:42:23.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.410+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.45__shadow_key1.2~Kbwz1mFZ650cAoJ93-kproYTk2MLKIk.2_1 2023-12-03T11:42:23.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.410+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.45__multipart_key1.2~Kbwz1mFZ650cAoJ93-kproYTk2MLKIk.3 2023-12-03T11:42:23.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.410+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.45__shadow_key1.2~Kbwz1mFZ650cAoJ93-kproYTk2MLKIk.3_1 2023-12-03T11:42:23.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.410+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.45__multipart_key1.2~Kbwz1mFZ650cAoJ93-kproYTk2MLKIk.4 2023-12-03T11:42:23.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.410+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.45__shadow_key1.2~Kbwz1mFZ650cAoJ93-kproYTk2MLKIk.4_1 2023-12-03T11:42:23.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.410+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.45__multipart_key1.2~Kbwz1mFZ650cAoJ93-kproYTk2MLKIk.5 2023-12-03T11:42:23.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.414+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:42:23.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.418+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:42:23.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.419+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.420+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.420+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:42:23.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.420+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.1323086095244172841', time=2023-12-03T13:42:22.660275+0000, chain.objs.size()=21 2023-12-03T11:42:23.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.420+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.54__multipart_key1.2~JNVN_i70OgxnbG44ntJmBbK2i5IkoDU.1 2023-12-03T11:42:23.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.420+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.54__shadow_key1.2~JNVN_i70OgxnbG44ntJmBbK2i5IkoDU.1_1 2023-12-03T11:42:23.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.420+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.54__multipart_key1.2~JNVN_i70OgxnbG44ntJmBbK2i5IkoDU.2 2023-12-03T11:42:23.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.420+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.54__shadow_key1.2~JNVN_i70OgxnbG44ntJmBbK2i5IkoDU.2_1 2023-12-03T11:42:23.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.420+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.54__multipart_key1.2~JNVN_i70OgxnbG44ntJmBbK2i5IkoDU.3 2023-12-03T11:42:23.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.420+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.54__shadow_key1.2~JNVN_i70OgxnbG44ntJmBbK2i5IkoDU.3_1 2023-12-03T11:42:23.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.420+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.54__multipart_key1.2~JNVN_i70OgxnbG44ntJmBbK2i5IkoDU.4 2023-12-03T11:42:23.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.420+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.54__shadow_key1.2~JNVN_i70OgxnbG44ntJmBbK2i5IkoDU.4_1 2023-12-03T11:42:23.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.420+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.54__multipart_key1.2~JNVN_i70OgxnbG44ntJmBbK2i5IkoDU.5 2023-12-03T11:42:23.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.420+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.54__shadow_key1.2~JNVN_i70OgxnbG44ntJmBbK2i5IkoDU.5_1 2023-12-03T11:42:23.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.420+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.54__multipart_key1.2~JNVN_i70OgxnbG44ntJmBbK2i5IkoDU.6 2023-12-03T11:42:23.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.420+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.54__shadow_key1.2~JNVN_i70OgxnbG44ntJmBbK2i5IkoDU.6_1 2023-12-03T11:42:23.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.423+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.54__multipart_key1.2~JNVN_i70OgxnbG44ntJmBbK2i5IkoDU.7 2023-12-03T11:42:23.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.428+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.54__shadow_key1.2~JNVN_i70OgxnbG44ntJmBbK2i5IkoDU.7_1 2023-12-03T11:42:23.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.428+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.54__multipart_key1.2~JNVN_i70OgxnbG44ntJmBbK2i5IkoDU.8 2023-12-03T11:42:23.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.428+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.54__shadow_key1.2~JNVN_i70OgxnbG44ntJmBbK2i5IkoDU.8_1 2023-12-03T11:42:23.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.428+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.54__multipart_key1.2~JNVN_i70OgxnbG44ntJmBbK2i5IkoDU.9 2023-12-03T11:42:23.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.428+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.54__shadow_key1.2~JNVN_i70OgxnbG44ntJmBbK2i5IkoDU.9_1 2023-12-03T11:42:23.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.428+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.54__multipart_key1.2~JNVN_i70OgxnbG44ntJmBbK2i5IkoDU.10 2023-12-03T11:42:23.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.428+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.54__shadow_key1.2~JNVN_i70OgxnbG44ntJmBbK2i5IkoDU.10_1 2023-12-03T11:42:23.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.428+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.54__multipart_key1.2~JNVN_i70OgxnbG44ntJmBbK2i5IkoDU.11 2023-12-03T11:42:23.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.433+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:42:23.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.436+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:42:23.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.437+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.437+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.438+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.439+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:42:23.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.440+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.440+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.441+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.442+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:42:23.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.443+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.444+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.444+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:42:23.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.444+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.5776916220920882760', time=2023-12-03T13:42:03.034688+0000, chain.objs.size()=9 2023-12-03T11:42:23.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.444+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.39__multipart_key1.2~08_o0sAXDlQe7q6PSZgxeNGndGjLCQe.1 2023-12-03T11:42:23.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.444+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.39__shadow_key1.2~08_o0sAXDlQe7q6PSZgxeNGndGjLCQe.1_1 2023-12-03T11:42:23.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.444+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.39__multipart_key1.2~08_o0sAXDlQe7q6PSZgxeNGndGjLCQe.2 2023-12-03T11:42:23.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.444+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.39__shadow_key1.2~08_o0sAXDlQe7q6PSZgxeNGndGjLCQe.2_1 2023-12-03T11:42:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.444+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.39__multipart_key1.2~08_o0sAXDlQe7q6PSZgxeNGndGjLCQe.3 2023-12-03T11:42:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.444+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.39__shadow_key1.2~08_o0sAXDlQe7q6PSZgxeNGndGjLCQe.3_1 2023-12-03T11:42:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.444+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.39__multipart_key1.2~08_o0sAXDlQe7q6PSZgxeNGndGjLCQe.4 2023-12-03T11:42:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.444+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.39__shadow_key1.2~08_o0sAXDlQe7q6PSZgxeNGndGjLCQe.4_1 2023-12-03T11:42:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.444+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.39__multipart_key1.2~08_o0sAXDlQe7q6PSZgxeNGndGjLCQe.5 2023-12-03T11:42:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.444+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.17658871426765402919', time=2023-12-03T13:42:17.298994+0000, chain.objs.size()=16 2023-12-03T11:42:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.444+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~ixkIDRrHCj0E1Au5eSi4tkiKhhFc7Va.1 2023-12-03T11:42:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.445+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~ixkIDRrHCj0E1Au5eSi4tkiKhhFc7Va.1_1 2023-12-03T11:42:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.445+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~ixkIDRrHCj0E1Au5eSi4tkiKhhFc7Va.1_2 2023-12-03T11:42:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.449+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~ixkIDRrHCj0E1Au5eSi4tkiKhhFc7Va.2 2023-12-03T11:42:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.449+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~ixkIDRrHCj0E1Au5eSi4tkiKhhFc7Va.2_1 2023-12-03T11:42:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.449+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~ixkIDRrHCj0E1Au5eSi4tkiKhhFc7Va.2_2 2023-12-03T11:42:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.449+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~ixkIDRrHCj0E1Au5eSi4tkiKhhFc7Va.3 2023-12-03T11:42:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.449+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~ixkIDRrHCj0E1Au5eSi4tkiKhhFc7Va.3_1 2023-12-03T11:42:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.449+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~ixkIDRrHCj0E1Au5eSi4tkiKhhFc7Va.3_2 2023-12-03T11:42:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.449+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~ixkIDRrHCj0E1Au5eSi4tkiKhhFc7Va.4 2023-12-03T11:42:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.449+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~ixkIDRrHCj0E1Au5eSi4tkiKhhFc7Va.4_1 2023-12-03T11:42:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.449+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~ixkIDRrHCj0E1Au5eSi4tkiKhhFc7Va.4_2 2023-12-03T11:42:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.449+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~ixkIDRrHCj0E1Au5eSi4tkiKhhFc7Va.5 2023-12-03T11:42:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.449+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~ixkIDRrHCj0E1Au5eSi4tkiKhhFc7Va.5_1 2023-12-03T11:42:23.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.457+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~ixkIDRrHCj0E1Au5eSi4tkiKhhFc7Va.5_2 2023-12-03T11:42:23.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.457+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~ixkIDRrHCj0E1Au5eSi4tkiKhhFc7Va.6 2023-12-03T11:42:23.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.461+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:42:23.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.464+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:42:23.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.465+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.466+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.466+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:42:23.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.466+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.5058012277619159492', time=2023-12-03T13:42:01.729474+0000, chain.objs.size()=7 2023-12-03T11:42:23.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.466+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~ugmiD2h5i8v2oMyXaqVn8Rw6XXijM3i.1 2023-12-03T11:42:23.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.466+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~ugmiD2h5i8v2oMyXaqVn8Rw6XXijM3i.1_1 2023-12-03T11:42:23.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.466+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~ugmiD2h5i8v2oMyXaqVn8Rw6XXijM3i.1_2 2023-12-03T11:42:23.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.466+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~ugmiD2h5i8v2oMyXaqVn8Rw6XXijM3i.2 2023-12-03T11:42:23.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.466+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~ugmiD2h5i8v2oMyXaqVn8Rw6XXijM3i.2_1 2023-12-03T11:42:23.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.466+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~ugmiD2h5i8v2oMyXaqVn8Rw6XXijM3i.2_2 2023-12-03T11:42:23.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.466+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~ugmiD2h5i8v2oMyXaqVn8Rw6XXijM3i.3 2023-12-03T11:42:23.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.466+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.10953647902795319338', time=2023-12-03T13:42:15.150464+0000, chain.objs.size()=16 2023-12-03T11:42:23.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.466+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~NEtYoz7ZAxqWY4A0j0k6uK1OLj7AsWB.1 2023-12-03T11:42:23.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.466+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~NEtYoz7ZAxqWY4A0j0k6uK1OLj7AsWB.1_1 2023-12-03T11:42:23.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.466+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~NEtYoz7ZAxqWY4A0j0k6uK1OLj7AsWB.1_2 2023-12-03T11:42:23.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.466+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~NEtYoz7ZAxqWY4A0j0k6uK1OLj7AsWB.2 2023-12-03T11:42:23.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.466+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~NEtYoz7ZAxqWY4A0j0k6uK1OLj7AsWB.2_1 2023-12-03T11:42:23.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.470+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~NEtYoz7ZAxqWY4A0j0k6uK1OLj7AsWB.2_2 2023-12-03T11:42:23.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.471+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~NEtYoz7ZAxqWY4A0j0k6uK1OLj7AsWB.3 2023-12-03T11:42:23.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.471+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~NEtYoz7ZAxqWY4A0j0k6uK1OLj7AsWB.3_1 2023-12-03T11:42:23.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.471+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~NEtYoz7ZAxqWY4A0j0k6uK1OLj7AsWB.3_2 2023-12-03T11:42:23.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.471+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~NEtYoz7ZAxqWY4A0j0k6uK1OLj7AsWB.4 2023-12-03T11:42:23.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.473+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~NEtYoz7ZAxqWY4A0j0k6uK1OLj7AsWB.4_1 2023-12-03T11:42:23.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.473+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~NEtYoz7ZAxqWY4A0j0k6uK1OLj7AsWB.4_2 2023-12-03T11:42:23.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.473+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~NEtYoz7ZAxqWY4A0j0k6uK1OLj7AsWB.5 2023-12-03T11:42:23.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.473+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~NEtYoz7ZAxqWY4A0j0k6uK1OLj7AsWB.5_1 2023-12-03T11:42:23.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.473+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~NEtYoz7ZAxqWY4A0j0k6uK1OLj7AsWB.5_2 2023-12-03T11:42:23.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.473+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~NEtYoz7ZAxqWY4A0j0k6uK1OLj7AsWB.6 2023-12-03T11:42:23.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.480+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:42:23.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.485+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:42:23.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.486+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.487+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.487+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2023-12-03T11:42:23.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.487+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.13942878561875441821', time=2023-12-03T13:41:56.593029+0000, chain.objs.size()=9 2023-12-03T11:42:23.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.487+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.30__multipart_key1.2~FC72Zg-J46-43udAiofwTzJwcpaPNjO.1 2023-12-03T11:42:23.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.487+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.30__shadow_key1.2~FC72Zg-J46-43udAiofwTzJwcpaPNjO.1_1 2023-12-03T11:42:23.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.487+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.30__multipart_key1.2~FC72Zg-J46-43udAiofwTzJwcpaPNjO.2 2023-12-03T11:42:23.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.487+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.30__shadow_key1.2~FC72Zg-J46-43udAiofwTzJwcpaPNjO.2_1 2023-12-03T11:42:23.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.487+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.30__multipart_key1.2~FC72Zg-J46-43udAiofwTzJwcpaPNjO.3 2023-12-03T11:42:23.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.487+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.30__shadow_key1.2~FC72Zg-J46-43udAiofwTzJwcpaPNjO.3_1 2023-12-03T11:42:23.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.487+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.30__multipart_key1.2~FC72Zg-J46-43udAiofwTzJwcpaPNjO.4 2023-12-03T11:42:23.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.487+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.30__shadow_key1.2~FC72Zg-J46-43udAiofwTzJwcpaPNjO.4_1 2023-12-03T11:42:23.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.487+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.30__multipart_key1.2~FC72Zg-J46-43udAiofwTzJwcpaPNjO.5 2023-12-03T11:42:23.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.487+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4647.32__shadow_key1.2~fDEsMqTVXEU-67ikp7ugCRloNmgTAML.1_1_466541f299397b466f4735231d048a9d', time=2023-12-03T13:41:57.475269+0000, chain.objs.size()=9 2023-12-03T11:42:23.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.487+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.32__multipart_key1.2~fDEsMqTVXEU-67ikp7ugCRloNmgTAML.1 2023-12-03T11:42:23.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.487+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.32__shadow_key1.2~fDEsMqTVXEU-67ikp7ugCRloNmgTAML.1_1 2023-12-03T11:42:23.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.487+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.32__multipart_key1.2~fDEsMqTVXEU-67ikp7ugCRloNmgTAML.2 2023-12-03T11:42:23.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.490+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.32__shadow_key1.2~fDEsMqTVXEU-67ikp7ugCRloNmgTAML.2_1 2023-12-03T11:42:23.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.490+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.32__multipart_key1.2~fDEsMqTVXEU-67ikp7ugCRloNmgTAML.3 2023-12-03T11:42:23.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.491+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.32__shadow_key1.2~fDEsMqTVXEU-67ikp7ugCRloNmgTAML.3_1 2023-12-03T11:42:23.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.491+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.32__multipart_key1.2~fDEsMqTVXEU-67ikp7ugCRloNmgTAML.4 2023-12-03T11:42:23.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.491+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.32__shadow_key1.2~fDEsMqTVXEU-67ikp7ugCRloNmgTAML.4_1 2023-12-03T11:42:23.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.491+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.32__multipart_key1.2~fDEsMqTVXEU-67ikp7ugCRloNmgTAML.5 2023-12-03T11:42:23.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.491+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.5648722480608973423', time=2023-12-03T13:42:18.544752+0000, chain.objs.size()=9 2023-12-03T11:42:23.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.491+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.44__multipart_key1.2~vk57uYEgsbup4aHlhnDaDW_eVJ-KrbM.1 2023-12-03T11:42:23.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.492+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.44__shadow_key1.2~vk57uYEgsbup4aHlhnDaDW_eVJ-KrbM.1_1 2023-12-03T11:42:23.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.492+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.44__multipart_key1.2~vk57uYEgsbup4aHlhnDaDW_eVJ-KrbM.2 2023-12-03T11:42:23.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.492+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.44__shadow_key1.2~vk57uYEgsbup4aHlhnDaDW_eVJ-KrbM.2_1 2023-12-03T11:42:23.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.492+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.44__multipart_key1.2~vk57uYEgsbup4aHlhnDaDW_eVJ-KrbM.3 2023-12-03T11:42:23.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.495+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.44__shadow_key1.2~vk57uYEgsbup4aHlhnDaDW_eVJ-KrbM.3_1 2023-12-03T11:42:23.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.496+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.44__multipart_key1.2~vk57uYEgsbup4aHlhnDaDW_eVJ-KrbM.4 2023-12-03T11:42:23.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.496+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.44__shadow_key1.2~vk57uYEgsbup4aHlhnDaDW_eVJ-KrbM.4_1 2023-12-03T11:42:23.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.497+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.44__multipart_key1.2~vk57uYEgsbup4aHlhnDaDW_eVJ-KrbM.5 2023-12-03T11:42:23.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.501+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:42:23.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.508+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:42:23.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.509+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.509+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.509+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.510+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:42:23.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.512+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.512+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.512+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:42:23.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.512+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.14568836602490205251', time=2023-12-03T13:42:06.290126+0000, chain.objs.size()=9 2023-12-03T11:42:23.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.512+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.41__multipart_file2.mpg.2~5HnmNLcEt5kDkGeeSIAOLXy0AwAWtwC.1 2023-12-03T11:42:23.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.513+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.41__shadow_file2.mpg.2~5HnmNLcEt5kDkGeeSIAOLXy0AwAWtwC.1_1 2023-12-03T11:42:23.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.513+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.41__multipart_file2.mpg.2~5HnmNLcEt5kDkGeeSIAOLXy0AwAWtwC.2 2023-12-03T11:42:23.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.513+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.41__shadow_file2.mpg.2~5HnmNLcEt5kDkGeeSIAOLXy0AwAWtwC.2_1 2023-12-03T11:42:23.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.513+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.41__multipart_file2.mpg.2~5HnmNLcEt5kDkGeeSIAOLXy0AwAWtwC.3 2023-12-03T11:42:23.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.513+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.41__shadow_file2.mpg.2~5HnmNLcEt5kDkGeeSIAOLXy0AwAWtwC.3_1 2023-12-03T11:42:23.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.513+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.41__multipart_file2.mpg.2~5HnmNLcEt5kDkGeeSIAOLXy0AwAWtwC.4 2023-12-03T11:42:23.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.513+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.41__shadow_file2.mpg.2~5HnmNLcEt5kDkGeeSIAOLXy0AwAWtwC.4_1 2023-12-03T11:42:23.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.513+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.41__multipart_file2.mpg.2~5HnmNLcEt5kDkGeeSIAOLXy0AwAWtwC.5 2023-12-03T11:42:23.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.513+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j', time=2023-12-03T13:42:20.450994+0000, chain.objs.size()=76 2023-12-03T11:42:23.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.513+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.1 2023-12-03T11:42:23.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.513+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.2 2023-12-03T11:42:23.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.513+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.3 2023-12-03T11:42:23.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.516+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.4 2023-12-03T11:42:23.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.516+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.5 2023-12-03T11:42:23.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.516+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.6 2023-12-03T11:42:23.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.517+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.7 2023-12-03T11:42:23.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.517+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.8 2023-12-03T11:42:23.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.517+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.9 2023-12-03T11:42:23.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.518+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.10 2023-12-03T11:42:23.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.518+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.11 2023-12-03T11:42:23.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.518+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.12 2023-12-03T11:42:23.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.518+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.13 2023-12-03T11:42:23.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.518+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.14 2023-12-03T11:42:23.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.521+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.15 2023-12-03T11:42:23.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.521+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.16 2023-12-03T11:42:23.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.524+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.17 2023-12-03T11:42:23.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.524+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.18 2023-12-03T11:42:23.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.524+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.19 2023-12-03T11:42:23.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.524+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.20 2023-12-03T11:42:23.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.524+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.21 2023-12-03T11:42:23.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.524+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.22 2023-12-03T11:42:23.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.524+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.23 2023-12-03T11:42:23.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.524+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.24 2023-12-03T11:42:23.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.524+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.25 2023-12-03T11:42:23.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.524+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.26 2023-12-03T11:42:23.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.524+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.27 2023-12-03T11:42:23.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.528+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.28 2023-12-03T11:42:23.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.528+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.29 2023-12-03T11:42:23.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.528+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.30 2023-12-03T11:42:23.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.528+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.31 2023-12-03T11:42:23.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.528+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.32 2023-12-03T11:42:23.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.528+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.33 2023-12-03T11:42:23.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.528+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.34 2023-12-03T11:42:23.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.528+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.35 2023-12-03T11:42:23.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.529+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.36 2023-12-03T11:42:23.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.529+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.37 2023-12-03T11:42:23.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.529+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.38 2023-12-03T11:42:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.532+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.39 2023-12-03T11:42:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.532+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.40 2023-12-03T11:42:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.533+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.41 2023-12-03T11:42:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.533+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.42 2023-12-03T11:42:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.533+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.43 2023-12-03T11:42:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.533+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.44 2023-12-03T11:42:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.533+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.45 2023-12-03T11:42:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.533+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.46 2023-12-03T11:42:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.533+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.47 2023-12-03T11:42:23.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.535+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.48 2023-12-03T11:42:23.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.535+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.49 2023-12-03T11:42:23.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.535+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.50 2023-12-03T11:42:23.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.535+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.51 2023-12-03T11:42:23.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.536+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.52 2023-12-03T11:42:23.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.536+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.53 2023-12-03T11:42:23.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.537+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.54 2023-12-03T11:42:23.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.538+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.55 2023-12-03T11:42:23.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.538+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.56 2023-12-03T11:42:23.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.538+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.57 2023-12-03T11:42:23.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.538+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.58 2023-12-03T11:42:23.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.539+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.59 2023-12-03T11:42:23.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.539+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.60 2023-12-03T11:42:23.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.539+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.61 2023-12-03T11:42:23.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.539+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.62 2023-12-03T11:42:23.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.539+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.63 2023-12-03T11:42:23.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.540+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.64 2023-12-03T11:42:23.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.540+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.65 2023-12-03T11:42:23.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.541+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.66 2023-12-03T11:42:23.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.541+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.67 2023-12-03T11:42:23.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.542+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.68 2023-12-03T11:42:23.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.543+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.69 2023-12-03T11:42:23.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.543+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.70 2023-12-03T11:42:23.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.543+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.71 2023-12-03T11:42:23.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.543+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.72 2023-12-03T11:42:23.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.543+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.73 2023-12-03T11:42:23.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.543+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.74 2023-12-03T11:42:23.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.545+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.75 2023-12-03T11:42:23.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.545+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.46__multipart_key1.2~OKHOWFjU6PQMkwxsvSNhDDjEdwcOk1j.77 2023-12-03T11:42:23.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.550+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:42:23.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.552+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:42:23.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.554+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.554+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.554+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.555+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:42:23.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.556+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.557+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.557+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:42:23.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.557+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.7352619889808420639', time=2023-12-03T13:42:00.294904+0000, chain.objs.size()=9 2023-12-03T11:42:23.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.557+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~PZLjjDF4RrnFcCcZe5PBNL-hRX3yQMh.1 2023-12-03T11:42:23.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.557+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~PZLjjDF4RrnFcCcZe5PBNL-hRX3yQMh.1_1 2023-12-03T11:42:23.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.557+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~PZLjjDF4RrnFcCcZe5PBNL-hRX3yQMh.2 2023-12-03T11:42:23.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.557+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~PZLjjDF4RrnFcCcZe5PBNL-hRX3yQMh.2_1 2023-12-03T11:42:23.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.557+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~PZLjjDF4RrnFcCcZe5PBNL-hRX3yQMh.3 2023-12-03T11:42:23.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.557+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~PZLjjDF4RrnFcCcZe5PBNL-hRX3yQMh.3_1 2023-12-03T11:42:23.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.557+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~PZLjjDF4RrnFcCcZe5PBNL-hRX3yQMh.4 2023-12-03T11:42:23.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.557+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~PZLjjDF4RrnFcCcZe5PBNL-hRX3yQMh.4_1 2023-12-03T11:42:23.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.557+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~PZLjjDF4RrnFcCcZe5PBNL-hRX3yQMh.5 2023-12-03T11:42:23.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.562+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:42:23.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.569+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:42:23.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.570+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.571+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.571+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:42:23.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.571+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.6482413711886286433', time=2023-12-03T13:42:01.976608+0000, chain.objs.size()=7 2023-12-03T11:42:23.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.571+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~fHor8JIsgs2Y8yqixcaZu9_-NmmqxAs.1 2023-12-03T11:42:23.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.571+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~fHor8JIsgs2Y8yqixcaZu9_-NmmqxAs.1_1 2023-12-03T11:42:23.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.571+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~fHor8JIsgs2Y8yqixcaZu9_-NmmqxAs.1_2 2023-12-03T11:42:23.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.571+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~fHor8JIsgs2Y8yqixcaZu9_-NmmqxAs.2 2023-12-03T11:42:23.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.571+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~fHor8JIsgs2Y8yqixcaZu9_-NmmqxAs.2_1 2023-12-03T11:42:23.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.571+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~fHor8JIsgs2Y8yqixcaZu9_-NmmqxAs.2_2 2023-12-03T11:42:23.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.571+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~fHor8JIsgs2Y8yqixcaZu9_-NmmqxAs.3 2023-12-03T11:42:23.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.574+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:42:23.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.577+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:42:23.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.578+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.579+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.579+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:42:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.579+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.18338830743557146796', time=2023-12-03T13:42:06.279539+0000, chain.objs.size()=9 2023-12-03T11:42:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.579+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.41__multipart_file.mpg.2~FQQuNorQKzAXElfOjLckj1CQ-KKuf5X.1 2023-12-03T11:42:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.579+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.41__shadow_file.mpg.2~FQQuNorQKzAXElfOjLckj1CQ-KKuf5X.1_1 2023-12-03T11:42:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.579+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.41__multipart_file.mpg.2~FQQuNorQKzAXElfOjLckj1CQ-KKuf5X.2 2023-12-03T11:42:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.579+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.41__shadow_file.mpg.2~FQQuNorQKzAXElfOjLckj1CQ-KKuf5X.2_1 2023-12-03T11:42:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.579+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.41__multipart_file.mpg.2~FQQuNorQKzAXElfOjLckj1CQ-KKuf5X.3 2023-12-03T11:42:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.579+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.41__shadow_file.mpg.2~FQQuNorQKzAXElfOjLckj1CQ-KKuf5X.3_1 2023-12-03T11:42:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.579+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.41__multipart_file.mpg.2~FQQuNorQKzAXElfOjLckj1CQ-KKuf5X.4 2023-12-03T11:42:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.579+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.41__shadow_file.mpg.2~FQQuNorQKzAXElfOjLckj1CQ-KKuf5X.4_1 2023-12-03T11:42:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.579+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.41__multipart_file.mpg.2~FQQuNorQKzAXElfOjLckj1CQ-KKuf5X.5 2023-12-03T11:42:23.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.582+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:42:23.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.585+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:42:23.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.587+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.587+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.588+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:42:23.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.588+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='2~e3k3BMcKAO2jyCHZTgFaKatDXOVOMOJ', time=2023-12-03T13:41:55.635466+0000, chain.objs.size()=9 2023-12-03T11:42:23.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.588+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.28__multipart_key1.2~e3k3BMcKAO2jyCHZTgFaKatDXOVOMOJ.1 2023-12-03T11:42:23.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.588+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.28__shadow_key1.2~e3k3BMcKAO2jyCHZTgFaKatDXOVOMOJ.1_1 2023-12-03T11:42:23.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.588+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.28__multipart_key1.2~e3k3BMcKAO2jyCHZTgFaKatDXOVOMOJ.2 2023-12-03T11:42:23.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.588+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.28__shadow_key1.2~e3k3BMcKAO2jyCHZTgFaKatDXOVOMOJ.2_1 2023-12-03T11:42:23.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.588+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.28__multipart_key1.2~e3k3BMcKAO2jyCHZTgFaKatDXOVOMOJ.3 2023-12-03T11:42:23.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.588+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.28__shadow_key1.2~e3k3BMcKAO2jyCHZTgFaKatDXOVOMOJ.3_1 2023-12-03T11:42:23.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.588+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.28__multipart_key1.2~e3k3BMcKAO2jyCHZTgFaKatDXOVOMOJ.4 2023-12-03T11:42:23.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.588+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.28__shadow_key1.2~e3k3BMcKAO2jyCHZTgFaKatDXOVOMOJ.4_1 2023-12-03T11:42:23.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.588+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.28__multipart_key1.2~e3k3BMcKAO2jyCHZTgFaKatDXOVOMOJ.5 2023-12-03T11:42:23.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.588+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.6105251505863500797', time=2023-12-03T13:41:57.583465+0000, chain.objs.size()=9 2023-12-03T11:42:23.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.588+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.32__multipart_key1.2~fDEsMqTVXEU-67ikp7ugCRloNmgTAML.1 2023-12-03T11:42:23.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.588+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.32__shadow_key1.2~fDEsMqTVXEU-67ikp7ugCRloNmgTAML.1_1 2023-12-03T11:42:23.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.588+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.32__multipart_key1.2~fDEsMqTVXEU-67ikp7ugCRloNmgTAML.2 2023-12-03T11:42:23.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.591+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.32__shadow_key1.2~fDEsMqTVXEU-67ikp7ugCRloNmgTAML.2_1 2023-12-03T11:42:23.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.591+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.32__multipart_key1.2~fDEsMqTVXEU-67ikp7ugCRloNmgTAML.3 2023-12-03T11:42:23.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.591+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.32__shadow_key1.2~fDEsMqTVXEU-67ikp7ugCRloNmgTAML.3_1 2023-12-03T11:42:23.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.591+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.32__multipart_key1.2~fDEsMqTVXEU-67ikp7ugCRloNmgTAML.4 2023-12-03T11:42:23.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.591+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.32__shadow_key1.2~fDEsMqTVXEU-67ikp7ugCRloNmgTAML.4_1 2023-12-03T11:42:23.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.592+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.32__multipart_key1.2~fDEsMqTVXEU-67ikp7ugCRloNmgTAML.5 2023-12-03T11:42:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.599+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:42:23.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.601+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:42:23.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.602+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.603+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.603+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:42:23.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.603+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.2941012756243439771', time=2023-12-03T13:42:17.161657+0000, chain.objs.size()=16 2023-12-03T11:42:23.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.603+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~O6i1wI_k2zBdb0ZuwzXN8wh88TfeOS7.1 2023-12-03T11:42:23.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.603+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~O6i1wI_k2zBdb0ZuwzXN8wh88TfeOS7.1_1 2023-12-03T11:42:23.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.603+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~O6i1wI_k2zBdb0ZuwzXN8wh88TfeOS7.1_2 2023-12-03T11:42:23.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.603+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~O6i1wI_k2zBdb0ZuwzXN8wh88TfeOS7.2 2023-12-03T11:42:23.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.603+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~O6i1wI_k2zBdb0ZuwzXN8wh88TfeOS7.2_1 2023-12-03T11:42:23.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.603+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~O6i1wI_k2zBdb0ZuwzXN8wh88TfeOS7.2_2 2023-12-03T11:42:23.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.603+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~O6i1wI_k2zBdb0ZuwzXN8wh88TfeOS7.3 2023-12-03T11:42:23.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.603+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~O6i1wI_k2zBdb0ZuwzXN8wh88TfeOS7.3_1 2023-12-03T11:42:23.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.603+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~O6i1wI_k2zBdb0ZuwzXN8wh88TfeOS7.3_2 2023-12-03T11:42:23.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.603+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~O6i1wI_k2zBdb0ZuwzXN8wh88TfeOS7.4 2023-12-03T11:42:23.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.603+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~O6i1wI_k2zBdb0ZuwzXN8wh88TfeOS7.4_1 2023-12-03T11:42:23.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.603+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~O6i1wI_k2zBdb0ZuwzXN8wh88TfeOS7.4_2 2023-12-03T11:42:23.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.606+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~O6i1wI_k2zBdb0ZuwzXN8wh88TfeOS7.5 2023-12-03T11:42:23.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.606+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~O6i1wI_k2zBdb0ZuwzXN8wh88TfeOS7.5_1 2023-12-03T11:42:23.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.606+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~O6i1wI_k2zBdb0ZuwzXN8wh88TfeOS7.5_2 2023-12-03T11:42:23.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.609+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~O6i1wI_k2zBdb0ZuwzXN8wh88TfeOS7.6 2023-12-03T11:42:23.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.614+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:42:23.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.616+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:42:23.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.620+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.620+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.620+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:42:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.620+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.17722720250955275646', time=2023-12-03T13:42:05.655663+0000, chain.objs.size()=9 2023-12-03T11:42:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.620+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.40__multipart_key1.2~A6Qm9dAIhK5J_H5IzIB8Pj1dS3THRn9.1 2023-12-03T11:42:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.620+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.40__shadow_key1.2~A6Qm9dAIhK5J_H5IzIB8Pj1dS3THRn9.1_1 2023-12-03T11:42:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.620+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.40__multipart_key1.2~A6Qm9dAIhK5J_H5IzIB8Pj1dS3THRn9.2 2023-12-03T11:42:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.620+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.40__shadow_key1.2~A6Qm9dAIhK5J_H5IzIB8Pj1dS3THRn9.2_1 2023-12-03T11:42:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.620+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.40__multipart_key1.2~A6Qm9dAIhK5J_H5IzIB8Pj1dS3THRn9.3 2023-12-03T11:42:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.620+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.40__shadow_key1.2~A6Qm9dAIhK5J_H5IzIB8Pj1dS3THRn9.3_1 2023-12-03T11:42:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.620+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.40__multipart_key1.2~A6Qm9dAIhK5J_H5IzIB8Pj1dS3THRn9.4 2023-12-03T11:42:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.620+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.40__shadow_key1.2~A6Qm9dAIhK5J_H5IzIB8Pj1dS3THRn9.4_1 2023-12-03T11:42:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.620+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.40__multipart_key1.2~A6Qm9dAIhK5J_H5IzIB8Pj1dS3THRn9.5 2023-12-03T11:42:23.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.625+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:42:23.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.628+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:42:23.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.629+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.629+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.630+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:42:23.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.630+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.7810059974950180057', time=2023-12-03T13:41:59.259058+0000, chain.objs.size()=9 2023-12-03T11:42:23.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.630+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~e1NJ8PzY_V4_trlYQYFzwD0gdadQqou.1 2023-12-03T11:42:23.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.630+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~e1NJ8PzY_V4_trlYQYFzwD0gdadQqou.1_1 2023-12-03T11:42:23.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.630+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~e1NJ8PzY_V4_trlYQYFzwD0gdadQqou.2 2023-12-03T11:42:23.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.630+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~e1NJ8PzY_V4_trlYQYFzwD0gdadQqou.2_1 2023-12-03T11:42:23.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.630+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~e1NJ8PzY_V4_trlYQYFzwD0gdadQqou.3 2023-12-03T11:42:23.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.630+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~e1NJ8PzY_V4_trlYQYFzwD0gdadQqou.3_1 2023-12-03T11:42:23.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.630+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~e1NJ8PzY_V4_trlYQYFzwD0gdadQqou.4 2023-12-03T11:42:23.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.630+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~e1NJ8PzY_V4_trlYQYFzwD0gdadQqou.4_1 2023-12-03T11:42:23.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.630+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~e1NJ8PzY_V4_trlYQYFzwD0gdadQqou.5 2023-12-03T11:42:23.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.634+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:42:23.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.639+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:42:23.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.640+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.641+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.641+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.642+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:42:23.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.643+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.644+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.644+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:42:23.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.644+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.3384081096185207488', time=2023-12-03T13:42:10.201500+0000, chain.objs.size()=21 2023-12-03T11:42:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.644+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~MTVSnSAWCHhKSL0V_JfNnH57zUBtR_x.1 2023-12-03T11:42:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.644+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~MTVSnSAWCHhKSL0V_JfNnH57zUBtR_x.1_1 2023-12-03T11:42:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.644+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~MTVSnSAWCHhKSL0V_JfNnH57zUBtR_x.2 2023-12-03T11:42:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.644+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~MTVSnSAWCHhKSL0V_JfNnH57zUBtR_x.2_1 2023-12-03T11:42:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.644+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~MTVSnSAWCHhKSL0V_JfNnH57zUBtR_x.3 2023-12-03T11:42:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.644+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~MTVSnSAWCHhKSL0V_JfNnH57zUBtR_x.3_1 2023-12-03T11:42:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.644+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~MTVSnSAWCHhKSL0V_JfNnH57zUBtR_x.4 2023-12-03T11:42:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.644+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~MTVSnSAWCHhKSL0V_JfNnH57zUBtR_x.4_1 2023-12-03T11:42:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.644+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~MTVSnSAWCHhKSL0V_JfNnH57zUBtR_x.5 2023-12-03T11:42:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.644+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~MTVSnSAWCHhKSL0V_JfNnH57zUBtR_x.5_1 2023-12-03T11:42:23.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.644+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~MTVSnSAWCHhKSL0V_JfNnH57zUBtR_x.6 2023-12-03T11:42:23.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.644+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~MTVSnSAWCHhKSL0V_JfNnH57zUBtR_x.6_1 2023-12-03T11:42:23.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.647+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~MTVSnSAWCHhKSL0V_JfNnH57zUBtR_x.7 2023-12-03T11:42:23.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.647+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~MTVSnSAWCHhKSL0V_JfNnH57zUBtR_x.7_1 2023-12-03T11:42:23.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.649+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~MTVSnSAWCHhKSL0V_JfNnH57zUBtR_x.8 2023-12-03T11:42:23.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.649+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~MTVSnSAWCHhKSL0V_JfNnH57zUBtR_x.8_1 2023-12-03T11:42:23.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.649+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~MTVSnSAWCHhKSL0V_JfNnH57zUBtR_x.9 2023-12-03T11:42:23.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.649+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~MTVSnSAWCHhKSL0V_JfNnH57zUBtR_x.9_1 2023-12-03T11:42:23.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.650+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~MTVSnSAWCHhKSL0V_JfNnH57zUBtR_x.10 2023-12-03T11:42:23.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.650+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~MTVSnSAWCHhKSL0V_JfNnH57zUBtR_x.10_1 2023-12-03T11:42:23.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.650+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~MTVSnSAWCHhKSL0V_JfNnH57zUBtR_x.11 2023-12-03T11:42:23.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.655+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:42:23.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.657+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:42:23.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.659+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.659+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.659+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.660+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:42:23.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.662+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.662+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.662+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:42:23.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.662+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.10367528959136784724', time=2023-12-03T13:41:59.845776+0000, chain.objs.size()=9 2023-12-03T11:42:23.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.662+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~ZnBLSry9Ox31Z18VtnzdgPrAOboYpxu.1 2023-12-03T11:42:23.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.662+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~ZnBLSry9Ox31Z18VtnzdgPrAOboYpxu.1_1 2023-12-03T11:42:23.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.662+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~ZnBLSry9Ox31Z18VtnzdgPrAOboYpxu.2 2023-12-03T11:42:23.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.662+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~ZnBLSry9Ox31Z18VtnzdgPrAOboYpxu.2_1 2023-12-03T11:42:23.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.662+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~ZnBLSry9Ox31Z18VtnzdgPrAOboYpxu.3 2023-12-03T11:42:23.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.662+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~ZnBLSry9Ox31Z18VtnzdgPrAOboYpxu.3_1 2023-12-03T11:42:23.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.662+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~ZnBLSry9Ox31Z18VtnzdgPrAOboYpxu.4 2023-12-03T11:42:23.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.662+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__shadow_key1.2~ZnBLSry9Ox31Z18VtnzdgPrAOboYpxu.4_1 2023-12-03T11:42:23.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.662+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.35__multipart_key1.2~ZnBLSry9Ox31Z18VtnzdgPrAOboYpxu.5 2023-12-03T11:42:23.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.666+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:42:23.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.669+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:42:23.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.670+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.671+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.671+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.672+0000 7f5b5e71e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:42:23.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.673+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.674+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.674+0000 7f5b5e71e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:42:23.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.674+0000 7f5b5e71e800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.13406914366744754624', time=2023-12-03T13:42:12.410396+0000, chain.objs.size()=21 2023-12-03T11:42:23.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.674+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~HMDHAsh8VutNJjg4Ih_FOAcqpKqyA9r.1 2023-12-03T11:42:23.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.674+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~HMDHAsh8VutNJjg4Ih_FOAcqpKqyA9r.1_1 2023-12-03T11:42:23.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.674+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~HMDHAsh8VutNJjg4Ih_FOAcqpKqyA9r.2 2023-12-03T11:42:23.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.674+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~HMDHAsh8VutNJjg4Ih_FOAcqpKqyA9r.2_1 2023-12-03T11:42:23.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.674+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~HMDHAsh8VutNJjg4Ih_FOAcqpKqyA9r.3 2023-12-03T11:42:23.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.674+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~HMDHAsh8VutNJjg4Ih_FOAcqpKqyA9r.3_1 2023-12-03T11:42:23.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.674+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~HMDHAsh8VutNJjg4Ih_FOAcqpKqyA9r.4 2023-12-03T11:42:23.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.674+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~HMDHAsh8VutNJjg4Ih_FOAcqpKqyA9r.4_1 2023-12-03T11:42:23.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.674+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~HMDHAsh8VutNJjg4Ih_FOAcqpKqyA9r.5 2023-12-03T11:42:23.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.674+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~HMDHAsh8VutNJjg4Ih_FOAcqpKqyA9r.5_1 2023-12-03T11:42:23.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.674+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~HMDHAsh8VutNJjg4Ih_FOAcqpKqyA9r.6 2023-12-03T11:42:23.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.674+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~HMDHAsh8VutNJjg4Ih_FOAcqpKqyA9r.6_1 2023-12-03T11:42:23.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.679+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~HMDHAsh8VutNJjg4Ih_FOAcqpKqyA9r.7 2023-12-03T11:42:23.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.679+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~HMDHAsh8VutNJjg4Ih_FOAcqpKqyA9r.7_1 2023-12-03T11:42:23.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.679+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~HMDHAsh8VutNJjg4Ih_FOAcqpKqyA9r.8 2023-12-03T11:42:23.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.679+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~HMDHAsh8VutNJjg4Ih_FOAcqpKqyA9r.8_1 2023-12-03T11:42:23.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.679+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~HMDHAsh8VutNJjg4Ih_FOAcqpKqyA9r.9 2023-12-03T11:42:23.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.679+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~HMDHAsh8VutNJjg4Ih_FOAcqpKqyA9r.9_1 2023-12-03T11:42:23.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.679+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~HMDHAsh8VutNJjg4Ih_FOAcqpKqyA9r.10 2023-12-03T11:42:23.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.679+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__shadow_key1.2~HMDHAsh8VutNJjg4Ih_FOAcqpKqyA9r.10_1 2023-12-03T11:42:23.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.679+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.43__multipart_key1.2~HMDHAsh8VutNJjg4Ih_FOAcqpKqyA9r.11 2023-12-03T11:42:23.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.684+0000 7f5b5e71e800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:42:23.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.687+0000 7f5b227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:42:23.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.689+0000 7f5b5e71e800 20 remove_watcher() i=0 2023-12-03T11:42:23.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.689+0000 7f5b5e71e800 2 removed watcher, disabling cache 2023-12-03T11:42:23.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.690+0000 7f5b5e71e800 20 remove_watcher() i=1 2023-12-03T11:42:23.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.691+0000 7f5b5e71e800 20 remove_watcher() i=2 2023-12-03T11:42:23.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.692+0000 7f5b5e71e800 20 remove_watcher() i=3 2023-12-03T11:42:23.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.693+0000 7f5b5e71e800 20 remove_watcher() i=4 2023-12-03T11:42:23.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.694+0000 7f5b5e71e800 20 remove_watcher() i=5 2023-12-03T11:42:23.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.695+0000 7f5b5e71e800 20 remove_watcher() i=6 2023-12-03T11:42:23.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.696+0000 7f5b5e71e800 20 remove_watcher() i=7 2023-12-03T11:42:23.703 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2023-12-03T11:42:23.753 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:42:23.753 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:42:23.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.766+0000 7f700cb26800 20 rados->read ofs=0 len=0 2023-12-03T11:42:23.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.768+0000 7f700cb26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:23.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.768+0000 7f700cb26800 20 realm 2023-12-03T11:42:23.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.768+0000 7f700cb26800 20 rados->read ofs=0 len=0 2023-12-03T11:42:23.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.768+0000 7f700cb26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:23.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.768+0000 7f700cb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:42:23.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.768+0000 7f700cb26800 20 rados->read ofs=0 len=0 2023-12-03T11:42:23.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.768+0000 7f700cb26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:23.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.768+0000 7f700cb26800 20 rados->read ofs=0 len=0 2023-12-03T11:42:23.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.769+0000 7f700cb26800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:42:23.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.769+0000 7f700cb26800 20 rados->read ofs=0 len=0 2023-12-03T11:42:23.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.770+0000 7f700cb26800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:42:23.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.770+0000 7f700cb26800 20 searching for the correct realm 2023-12-03T11:42:23.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.779+0000 7f7008f24640 0 -- 172.21.15.44:0/3669828709 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x5621dacf29b0 msgr2=0x5621dacf4e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:42:23.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.781+0000 7f700cb26800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:42:23.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.781+0000 7f700cb26800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:42:23.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.781+0000 7f700cb26800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:42:23.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.781+0000 7f700cb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:42:23.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.781+0000 7f700cb26800 20 rados->read ofs=0 len=0 2023-12-03T11:42:23.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.781+0000 7f700cb26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:23.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.781+0000 7f700cb26800 20 rados->read ofs=0 len=0 2023-12-03T11:42:23.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.781+0000 7f700cb26800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:42:23.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.781+0000 7f700cb26800 20 rados->read ofs=0 len=0 2023-12-03T11:42:23.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.782+0000 7f700cb26800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:42:23.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.782+0000 7f700cb26800 20 zone default found 2023-12-03T11:42:23.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.782+0000 7f700cb26800 4 Realm: () 2023-12-03T11:42:23.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.782+0000 7f700cb26800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:42:23.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.782+0000 7f700cb26800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:42:23.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.782+0000 7f700cb26800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:42:23.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.782+0000 7f700cb26800 20 zonegroup default 2023-12-03T11:42:23.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.782+0000 7f700cb26800 20 rados->read ofs=0 len=0 2023-12-03T11:42:23.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.782+0000 7f700cb26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:23.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.782+0000 7f700cb26800 20 rados->read ofs=0 len=0 2023-12-03T11:42:23.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.782+0000 7f700cb26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:23.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.782+0000 7f700cb26800 20 rados->read ofs=0 len=0 2023-12-03T11:42:23.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.782+0000 7f700cb26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:23.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.782+0000 7f700cb26800 20 started sync module instance, tier type = 2023-12-03T11:42:23.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.782+0000 7f700cb26800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:42:23.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.789+0000 7f7008f24640 0 -- 172.21.15.44:0/3669828709 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x7f6fe0079e10 msgr2=0x7f6fe007c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:42:23.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.792+0000 7f700cb26800 20 add_watcher() i=0 2023-12-03T11:42:23.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.792+0000 7f700cb26800 20 add_watcher() i=1 2023-12-03T11:42:23.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.792+0000 7f700cb26800 20 add_watcher() i=2 2023-12-03T11:42:23.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.792+0000 7f700cb26800 20 add_watcher() i=3 2023-12-03T11:42:23.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.792+0000 7f700cb26800 20 add_watcher() i=4 2023-12-03T11:42:23.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.792+0000 7f700cb26800 20 add_watcher() i=5 2023-12-03T11:42:23.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.792+0000 7f700cb26800 20 add_watcher() i=6 2023-12-03T11:42:23.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.793+0000 7f700cb26800 20 add_watcher() i=7 2023-12-03T11:42:23.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.793+0000 7f700cb26800 2 all 8 watchers are set, enabling cache 2023-12-03T11:42:23.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.794+0000 7f6fce7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:42:23.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.795+0000 7f700cb26800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:42:23.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.795+0000 7f700cb26800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:42:23.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.838+0000 7f6f3d7fa640 20 reqs_thread_entry: start 2023-12-03T11:42:23.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.838+0000 7f700cb26800 20 init_complete bucket index max shards: 1 2023-12-03T11:42:23.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.838+0000 7f700cb26800 20 Filter name: none 2023-12-03T11:42:23.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.838+0000 7f6f36ffd640 20 reqs_thread_entry: start 2023-12-03T11:42:23.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.838+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:42:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.840+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.841+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.841+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.842+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:42:23.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.843+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.844+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.844+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.845+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:42:23.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.846+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.847+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.847+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.848+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:42:23.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.849+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.850+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.850+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.851+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:42:23.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.853+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.853+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.853+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.855+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:42:23.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.856+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.856+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.856+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.857+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:42:23.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.859+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.859+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.859+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.860+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:42:23.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.862+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.863+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.863+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.864+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:42:23.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.865+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.865+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.866+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.867+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:42:23.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.868+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.869+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.869+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.870+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:42:23.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.871+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.872+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.872+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.873+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:42:23.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.875+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.875+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.875+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.876+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:42:23.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.878+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.878+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.880 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.879+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.880+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:42:23.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.881+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.881+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.882+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.883+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:42:23.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.884+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.884+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.885+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.886+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:42:23.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.887+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.888+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.888+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.889+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:42:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.890+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.891+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.891+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.892+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:42:23.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.893+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.894+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.894+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.895+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:42:23.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.896+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.896+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.897+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.898+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:42:23.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.899+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.899+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.900+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.901+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:42:23.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.902+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.902+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.903+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.904+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:42:23.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.905+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.905+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.905+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.906+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:42:23.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.907+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.908+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.908+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.909+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:42:23.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.910+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.911+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.911+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.912+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:42:23.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.913+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.914+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.914+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.915+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:42:23.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.916+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.917+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.917+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.918+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:42:23.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.919+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.920+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.920+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.921+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:42:23.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.922+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.922+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.923+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.924+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:42:23.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.925+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.925+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.926+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.926+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:42:23.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.928+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.928+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.928+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.929+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:42:23.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.931+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.931+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.931+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.933+0000 7f700cb26800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:42:23.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.934+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.934+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:23.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.935+0000 7f700cb26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:23.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.936+0000 7f6fce7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:42:23.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.938+0000 7f700cb26800 20 remove_watcher() i=0 2023-12-03T11:42:23.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.938+0000 7f700cb26800 2 removed watcher, disabling cache 2023-12-03T11:42:23.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.939+0000 7f700cb26800 20 remove_watcher() i=1 2023-12-03T11:42:23.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.940+0000 7f700cb26800 20 remove_watcher() i=2 2023-12-03T11:42:23.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.941+0000 7f700cb26800 20 remove_watcher() i=3 2023-12-03T11:42:23.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.942+0000 7f700cb26800 20 remove_watcher() i=4 2023-12-03T11:42:23.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.943+0000 7f700cb26800 20 remove_watcher() i=5 2023-12-03T11:42:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.944+0000 7f700cb26800 20 remove_watcher() i=6 2023-12-03T11:42:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:23.945+0000 7f700cb26800 20 remove_watcher() i=7 2023-12-03T11:42:23.952 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2023-12-03T11:42:24.002 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:42:24.002 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:42:24.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.015+0000 7f7fcec44800 20 rados->read ofs=0 len=0 2023-12-03T11:42:24.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.017+0000 7f7fcec44800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:24.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.017+0000 7f7fcec44800 20 realm 2023-12-03T11:42:24.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.017+0000 7f7fcec44800 20 rados->read ofs=0 len=0 2023-12-03T11:42:24.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.017+0000 7f7fcec44800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:24.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.017+0000 7f7fcec44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:42:24.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.017+0000 7f7fcec44800 20 rados->read ofs=0 len=0 2023-12-03T11:42:24.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.017+0000 7f7fcec44800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:24.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.017+0000 7f7fcec44800 20 rados->read ofs=0 len=0 2023-12-03T11:42:24.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.019+0000 7f7fcec44800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:42:24.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.019+0000 7f7fcec44800 20 rados->read ofs=0 len=0 2023-12-03T11:42:24.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.019+0000 7f7fcec44800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:42:24.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.019+0000 7f7fcec44800 20 searching for the correct realm 2023-12-03T11:42:24.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.028+0000 7f7fcc744640 0 -- 172.21.15.44:0/3148518150 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55bd04224520 msgr2=0x55bd04226910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:42:24.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.030+0000 7f7fcec44800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:42:24.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.030+0000 7f7fcec44800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:42:24.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.030+0000 7f7fcec44800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:42:24.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.030+0000 7f7fcec44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:42:24.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.030+0000 7f7fcec44800 20 rados->read ofs=0 len=0 2023-12-03T11:42:24.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.030+0000 7f7fcec44800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:24.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.030+0000 7f7fcec44800 20 rados->read ofs=0 len=0 2023-12-03T11:42:24.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.030+0000 7f7fcec44800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:42:24.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.030+0000 7f7fcec44800 20 rados->read ofs=0 len=0 2023-12-03T11:42:24.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.031+0000 7f7fcec44800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:42:24.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.031+0000 7f7fcec44800 20 zone default found 2023-12-03T11:42:24.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.031+0000 7f7fcec44800 4 Realm: () 2023-12-03T11:42:24.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.031+0000 7f7fcec44800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:42:24.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.031+0000 7f7fcec44800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:42:24.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.031+0000 7f7fcec44800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:42:24.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.031+0000 7f7fcec44800 20 zonegroup default 2023-12-03T11:42:24.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.031+0000 7f7fcec44800 20 rados->read ofs=0 len=0 2023-12-03T11:42:24.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.031+0000 7f7fcec44800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:24.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.031+0000 7f7fcec44800 20 rados->read ofs=0 len=0 2023-12-03T11:42:24.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.032+0000 7f7fcec44800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:24.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.032+0000 7f7fcec44800 20 rados->read ofs=0 len=0 2023-12-03T11:42:24.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.032+0000 7f7fcec44800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:24.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.032+0000 7f7fcec44800 20 started sync module instance, tier type = 2023-12-03T11:42:24.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.032+0000 7f7fcec44800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:42:24.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.037+0000 7f7fccf45640 0 -- 172.21.15.44:0/3148518150 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f7fc0058220 msgr2=0x7f7fc0008830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:42:24.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.041+0000 7f7fcec44800 20 add_watcher() i=0 2023-12-03T11:42:24.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.041+0000 7f7fcec44800 20 add_watcher() i=1 2023-12-03T11:42:24.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.041+0000 7f7fcec44800 20 add_watcher() i=2 2023-12-03T11:42:24.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.041+0000 7f7fcec44800 20 add_watcher() i=3 2023-12-03T11:42:24.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.041+0000 7f7fcec44800 20 add_watcher() i=4 2023-12-03T11:42:24.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.041+0000 7f7fcec44800 20 add_watcher() i=5 2023-12-03T11:42:24.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.041+0000 7f7fcec44800 20 add_watcher() i=6 2023-12-03T11:42:24.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.042+0000 7f7fcec44800 20 add_watcher() i=7 2023-12-03T11:42:24.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.042+0000 7f7fcec44800 2 all 8 watchers are set, enabling cache 2023-12-03T11:42:24.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.043+0000 7f7f927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:42:24.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.044+0000 7f7fcec44800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:42:24.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.044+0000 7f7fcec44800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:42:24.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.087+0000 7f7f017fa640 20 reqs_thread_entry: start 2023-12-03T11:42:24.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.087+0000 7f7fcec44800 20 init_complete bucket index max shards: 1 2023-12-03T11:42:24.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.088+0000 7f7fcec44800 20 Filter name: none 2023-12-03T11:42:24.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.088+0000 7f7efaffd640 20 reqs_thread_entry: start 2023-12-03T11:42:24.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.088+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:42:24.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.089+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.089+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.090+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.091+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:42:24.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.092+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.092+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.093+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.093+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:42:24.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.095+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.095+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.095+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.096+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:42:24.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.098+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.099+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.099+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.100+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:42:24.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.101+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.101+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.102+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.103+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:42:24.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.104+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.104+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.105+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.106+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:42:24.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.107+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.107+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.107+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.108+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:42:24.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.109+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.110+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.110+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.111+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:42:24.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.112+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.113+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.113+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.114+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:42:24.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.116+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.116+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.116+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.117+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:42:24.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.119+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.119+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.120+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.120+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:42:24.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.122+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.123+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.123+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.124+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:42:24.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.125+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.126+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.126+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.127+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:42:24.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.128+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.128+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.129+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.130+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:42:24.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.131+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.131+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.132+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.133+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:42:24.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.134+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.134+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.135+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.136+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:42:24.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.137+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.137+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.138+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.139+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:42:24.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.140+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.140+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.141+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.141+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:42:24.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.143+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.143+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.144+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.145+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:42:24.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.146+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.146+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.146+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.147+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:42:24.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.149+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.149+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.149+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.150+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:42:24.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.151+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.152+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.152+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.153+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:42:24.156 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.154+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.156 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.154+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.156 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.155+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.156+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:42:24.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.157+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.157+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.158+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.159+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:42:24.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.160+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.160+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.161+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.162+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:42:24.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.163+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.164+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.164+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.165+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:42:24.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.166+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.167+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.167+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.168+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:42:24.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.169+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.169+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.169+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.170+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:42:24.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.172+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.172+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.173+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.173+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:42:24.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.175+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.176+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.176+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.177+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:42:24.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.178+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.179+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.179+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.180+0000 7f7fcec44800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:42:24.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.181+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.182+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.182+0000 7f7fcec44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.184+0000 7f7f927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:42:24.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.186+0000 7f7fcec44800 20 remove_watcher() i=0 2023-12-03T11:42:24.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.186+0000 7f7fcec44800 2 removed watcher, disabling cache 2023-12-03T11:42:24.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.187+0000 7f7fcec44800 20 remove_watcher() i=1 2023-12-03T11:42:24.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.189+0000 7f7fcec44800 20 remove_watcher() i=2 2023-12-03T11:42:24.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.190+0000 7f7fcec44800 20 remove_watcher() i=3 2023-12-03T11:42:24.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.191+0000 7f7fcec44800 20 remove_watcher() i=4 2023-12-03T11:42:24.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.192+0000 7f7fcec44800 20 remove_watcher() i=5 2023-12-03T11:42:24.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.192+0000 7f7fcec44800 20 remove_watcher() i=6 2023-12-03T11:42:24.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.193+0000 7f7fcec44800 20 remove_watcher() i=7 2023-12-03T11:42:24.200 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2023-12-03T11:42:24.250 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:42:24.250 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:42:24.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.264+0000 7fec6bb2a800 20 rados->read ofs=0 len=0 2023-12-03T11:42:24.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.266+0000 7fec6bb2a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:24.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.266+0000 7fec6bb2a800 20 realm 2023-12-03T11:42:24.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.266+0000 7fec6bb2a800 20 rados->read ofs=0 len=0 2023-12-03T11:42:24.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.266+0000 7fec6bb2a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:24.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.266+0000 7fec6bb2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:42:24.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.266+0000 7fec6bb2a800 20 rados->read ofs=0 len=0 2023-12-03T11:42:24.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.266+0000 7fec6bb2a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:24.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.266+0000 7fec6bb2a800 20 rados->read ofs=0 len=0 2023-12-03T11:42:24.268 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.267+0000 7fec6bb2a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:42:24.268 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.267+0000 7fec6bb2a800 20 rados->read ofs=0 len=0 2023-12-03T11:42:24.268 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.267+0000 7fec6bb2a800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:42:24.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.267+0000 7fec6bb2a800 20 searching for the correct realm 2023-12-03T11:42:24.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.277+0000 7fec670ef640 0 -- 172.21.15.44:0/3541952064 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x55bf55c5eef0 msgr2=0x55bf55c612e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:42:24.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.278+0000 7fec6bb2a800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:42:24.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.278+0000 7fec6bb2a800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:42:24.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.278+0000 7fec6bb2a800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:42:24.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.278+0000 7fec6bb2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:42:24.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.278+0000 7fec6bb2a800 20 rados->read ofs=0 len=0 2023-12-03T11:42:24.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.278+0000 7fec6bb2a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:24.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.278+0000 7fec6bb2a800 20 rados->read ofs=0 len=0 2023-12-03T11:42:24.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.279+0000 7fec6bb2a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:42:24.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.279+0000 7fec6bb2a800 20 rados->read ofs=0 len=0 2023-12-03T11:42:24.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.279+0000 7fec6bb2a800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:42:24.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.279+0000 7fec6bb2a800 20 zone default found 2023-12-03T11:42:24.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.279+0000 7fec6bb2a800 4 Realm: () 2023-12-03T11:42:24.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.279+0000 7fec6bb2a800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:42:24.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.279+0000 7fec6bb2a800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:42:24.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.279+0000 7fec6bb2a800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:42:24.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.279+0000 7fec6bb2a800 20 zonegroup default 2023-12-03T11:42:24.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.279+0000 7fec6bb2a800 20 rados->read ofs=0 len=0 2023-12-03T11:42:24.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.279+0000 7fec6bb2a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:24.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.279+0000 7fec6bb2a800 20 rados->read ofs=0 len=0 2023-12-03T11:42:24.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.280+0000 7fec6bb2a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:24.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.280+0000 7fec6bb2a800 20 rados->read ofs=0 len=0 2023-12-03T11:42:24.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.280+0000 7fec6bb2a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:24.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.280+0000 7fec6bb2a800 20 started sync module instance, tier type = 2023-12-03T11:42:24.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.280+0000 7fec6bb2a800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:42:24.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.285+0000 7fec670ef640 0 -- 172.21.15.44:0/3541952064 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x7fec40079e10 msgr2=0x7fec4007c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:42:24.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.289+0000 7fec6bb2a800 20 add_watcher() i=0 2023-12-03T11:42:24.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.289+0000 7fec6bb2a800 20 add_watcher() i=1 2023-12-03T11:42:24.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.289+0000 7fec6bb2a800 20 add_watcher() i=2 2023-12-03T11:42:24.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.289+0000 7fec6bb2a800 20 add_watcher() i=3 2023-12-03T11:42:24.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.289+0000 7fec6bb2a800 20 add_watcher() i=4 2023-12-03T11:42:24.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.289+0000 7fec6bb2a800 20 add_watcher() i=5 2023-12-03T11:42:24.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.289+0000 7fec6bb2a800 20 add_watcher() i=6 2023-12-03T11:42:24.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.289+0000 7fec6bb2a800 20 add_watcher() i=7 2023-12-03T11:42:24.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.289+0000 7fec6bb2a800 2 all 8 watchers are set, enabling cache 2023-12-03T11:42:24.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.292+0000 7fec2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:42:24.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.293+0000 7fec6bb2a800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:42:24.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.293+0000 7fec6bb2a800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:42:24.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.334+0000 7feba4ff9640 20 reqs_thread_entry: start 2023-12-03T11:42:24.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.334+0000 7fec6bb2a800 20 init_complete bucket index max shards: 1 2023-12-03T11:42:24.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.334+0000 7fec6bb2a800 20 Filter name: none 2023-12-03T11:42:24.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.334+0000 7feb9a7fc640 20 reqs_thread_entry: start 2023-12-03T11:42:24.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.334+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:42:24.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.335+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.336+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.336+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.338+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:42:24.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.339+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.340+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.340+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.341+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:42:24.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.342+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.343+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.343+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.344+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:42:24.346 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.345+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.347 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.346+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.347+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.347+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:42:24.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.349+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.349+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.349+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.350+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:42:24.352 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.352+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.352+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.352+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.353+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:42:24.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.354+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.355+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.355+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.356+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:42:24.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.357+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.358+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.358+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.359+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:42:24.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.360+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.360+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.360+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.361+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:42:24.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.363+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.363+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.363+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.365+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:42:24.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.366+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.366+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.366+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.367+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:42:24.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.369+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.369+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.369+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.370+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:42:24.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.372+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.372+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.373+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.374+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:42:24.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.375+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.375+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.375+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.376+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:42:24.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.378+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.378+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.379+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.379+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:42:24.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.381+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.381+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.382+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.383+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:42:24.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.384+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.384+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.384+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.385+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:42:24.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.387+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.387+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.387+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.388+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:42:24.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.390+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.390+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.390+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.391+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:42:24.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.392+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.393+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.393+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.394+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:42:24.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.396+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.396+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.397+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.398+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:42:24.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.399+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.400+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.400+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.401+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:42:24.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.402+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.403+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.403+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.404+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:42:24.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.405+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.405+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.406+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.407+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:42:24.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.408+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.408+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.409+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.409+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:42:24.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.411+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.412+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.412+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.413+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:42:24.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.414+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.415+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.415+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.416+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:42:24.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.417+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.418+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.418+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.420+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:42:24.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.421+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.421+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.422+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.423+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:42:24.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.424+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.424+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.425+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.425+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:42:24.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.427+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.427+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.428+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.429+0000 7fec6bb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:42:24.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.430+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.431+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:24.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.431+0000 7fec6bb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:24.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.433+0000 7fec2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:42:24.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.435+0000 7fec6bb2a800 20 remove_watcher() i=0 2023-12-03T11:42:24.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.435+0000 7fec6bb2a800 2 removed watcher, disabling cache 2023-12-03T11:42:24.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.436+0000 7fec6bb2a800 20 remove_watcher() i=1 2023-12-03T11:42:24.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.437+0000 7fec6bb2a800 20 remove_watcher() i=2 2023-12-03T11:42:24.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.438+0000 7fec6bb2a800 20 remove_watcher() i=3 2023-12-03T11:42:24.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.440+0000 7fec6bb2a800 20 remove_watcher() i=4 2023-12-03T11:42:24.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.442+0000 7fec6bb2a800 20 remove_watcher() i=5 2023-12-03T11:42:24.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.443+0000 7fec6bb2a800 20 remove_watcher() i=6 2023-12-03T11:42:24.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:24.444+0000 7fec6bb2a800 20 remove_watcher() i=7 2023-12-03T11:42:24.451 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2023-12-03T11:42:24.925 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :clean 2023-12-03T11:42:25.622 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :compileJava 2023-12-03T11:42:25.622 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :processResources 2023-12-03T11:42:25.622 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :classes 2023-12-03T11:42:26.022 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:26.022 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :compileTestJava 2023-12-03T11:42:26.023 INFO:teuthology.orchestra.run.smithi044.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2023-12-03T11:42:26.023 INFO:teuthology.orchestra.run.smithi044.stderr:Note: Recompile with -Xlint:deprecation for details. 2023-12-03T11:42:26.024 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:26.024 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :processTestResources NO-SOURCE 2023-12-03T11:42:26.024 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :testClasses 2023-12-03T11:42:28.024 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:28.024 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :test 2023-12-03T11:42:28.024 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:28.024 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2023-12-03T11:42:28.024 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:28.024 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2023-12-03T11:42:28.024 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:28.024 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2023-12-03T11:42:28.024 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:28.024 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2023-12-03T11:42:28.024 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:28.025 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2023-12-03T11:42:28.025 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:28.025 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2023-12-03T11:42:28.122 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:28.122 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2023-12-03T11:42:28.122 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:28.122 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2023-12-03T11:42:28.222 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:28.222 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2023-12-03T11:42:28.321 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:28.322 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2023-12-03T11:42:28.522 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:28.522 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2023-12-03T11:42:28.522 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:28.522 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2023-12-03T11:42:28.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:28.622 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2023-12-03T11:42:28.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:28.722 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2023-12-03T11:42:29.022 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:29.022 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2023-12-03T11:42:29.022 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:29.022 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2023-12-03T11:42:29.222 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:29.222 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2023-12-03T11:42:29.222 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:29.222 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2023-12-03T11:42:29.347 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:29.347 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------- 2023-12-03T11:42:29.348 INFO:teuthology.orchestra.run.smithi044.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2023-12-03T11:42:29.348 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------- 2023-12-03T11:42:29.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:29.348 INFO:teuthology.orchestra.run.smithi044.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2023-12-03T11:42:29.348 INFO:teuthology.orchestra.run.smithi044.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2023-12-03T11:42:29.348 INFO:teuthology.orchestra.run.smithi044.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2023-12-03T11:42:29.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:29.348 INFO:teuthology.orchestra.run.smithi044.stdout:BUILD SUCCESSFUL in 4s 2023-12-03T11:42:29.348 INFO:teuthology.orchestra.run.smithi044.stdout:5 actionable tasks: 5 executed 2023-12-03T11:42:29.360 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2023-12-03T11:42:29.412 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:42:29.412 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:42:29.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.426+0000 7f4665920800 20 rados->read ofs=0 len=0 2023-12-03T11:42:29.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.427+0000 7f4665920800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:29.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.427+0000 7f4665920800 20 realm 2023-12-03T11:42:29.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.427+0000 7f4665920800 20 rados->read ofs=0 len=0 2023-12-03T11:42:29.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.428+0000 7f4665920800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:29.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.428+0000 7f4665920800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:42:29.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.428+0000 7f4665920800 20 rados->read ofs=0 len=0 2023-12-03T11:42:29.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.428+0000 7f4665920800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:29.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.428+0000 7f4665920800 20 rados->read ofs=0 len=0 2023-12-03T11:42:29.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.429+0000 7f4665920800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:42:29.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.429+0000 7f4665920800 20 rados->read ofs=0 len=0 2023-12-03T11:42:29.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.430+0000 7f4665920800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:42:29.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.430+0000 7f4665920800 20 searching for the correct realm 2023-12-03T11:42:29.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.441+0000 7f4661da7640 0 -- 172.21.15.44:0/1216260116 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x557607d30c10 msgr2=0x557607d330d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:42:29.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.441+0000 7f4665920800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:42:29.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.441+0000 7f4665920800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:42:29.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.441+0000 7f4665920800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:42:29.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.441+0000 7f4665920800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:42:29.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.441+0000 7f4665920800 20 rados->read ofs=0 len=0 2023-12-03T11:42:29.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.442+0000 7f4665920800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:29.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.442+0000 7f4665920800 20 rados->read ofs=0 len=0 2023-12-03T11:42:29.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.442+0000 7f4665920800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:42:29.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.442+0000 7f4665920800 20 rados->read ofs=0 len=0 2023-12-03T11:42:29.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.442+0000 7f4665920800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:42:29.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.442+0000 7f4665920800 20 zone default found 2023-12-03T11:42:29.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.442+0000 7f4665920800 4 Realm: () 2023-12-03T11:42:29.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.442+0000 7f4665920800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:42:29.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.442+0000 7f4665920800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:42:29.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.442+0000 7f4665920800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:42:29.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.442+0000 7f4665920800 20 zonegroup default 2023-12-03T11:42:29.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.442+0000 7f4665920800 20 rados->read ofs=0 len=0 2023-12-03T11:42:29.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.443+0000 7f4665920800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:29.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.443+0000 7f4665920800 20 rados->read ofs=0 len=0 2023-12-03T11:42:29.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.443+0000 7f4665920800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:29.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.443+0000 7f4665920800 20 rados->read ofs=0 len=0 2023-12-03T11:42:29.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.443+0000 7f4665920800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:29.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.443+0000 7f4665920800 20 started sync module instance, tier type = 2023-12-03T11:42:29.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.443+0000 7f4665920800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:42:29.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.451+0000 7f4661da7640 0 -- 172.21.15.44:0/1216260116 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x7f463c079d90 msgr2=0x7f463c07c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:42:29.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.454+0000 7f4665920800 20 add_watcher() i=0 2023-12-03T11:42:29.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.454+0000 7f4665920800 20 add_watcher() i=1 2023-12-03T11:42:29.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.454+0000 7f4665920800 20 add_watcher() i=2 2023-12-03T11:42:29.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.454+0000 7f4665920800 20 add_watcher() i=3 2023-12-03T11:42:29.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.454+0000 7f4665920800 20 add_watcher() i=4 2023-12-03T11:42:29.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.454+0000 7f4665920800 20 add_watcher() i=5 2023-12-03T11:42:29.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.454+0000 7f4665920800 20 add_watcher() i=6 2023-12-03T11:42:29.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.455+0000 7f4665920800 20 add_watcher() i=7 2023-12-03T11:42:29.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.455+0000 7f4665920800 2 all 8 watchers are set, enabling cache 2023-12-03T11:42:29.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.457+0000 7f4626fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:42:29.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.457+0000 7f4665920800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:42:29.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.457+0000 7f4665920800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:42:29.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.502+0000 7f4595ffb640 20 reqs_thread_entry: start 2023-12-03T11:42:29.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.503+0000 7f4665920800 20 init_complete bucket index max shards: 1 2023-12-03T11:42:29.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.503+0000 7f4665920800 20 Filter name: none 2023-12-03T11:42:29.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.503+0000 7f45877fe640 20 reqs_thread_entry: start 2023-12-03T11:42:29.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.503+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:42:29.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.504+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.505+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.505+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.506+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:42:29.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.507+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.508+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.508+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.509+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:42:29.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.510+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.511+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.511+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.512+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:42:29.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.513+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.514+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.514+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.515+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:42:29.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.516+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.517+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.517+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.518+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:42:29.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.519+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.520+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.520+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.521+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:42:29.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.523+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.523+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.523+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.524+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:42:29.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.526+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.526+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.526+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.528+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:42:29.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.529+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.529+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.530+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.531+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:42:29.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.532+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.533+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.533+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.534+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:42:29.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.536+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.536+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.537+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.538+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:42:29.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.539+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.540+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.540+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.541+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:42:29.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.542+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.543+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.543+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.544+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:42:29.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.546+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.546+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.547+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.548+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:42:29.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.549+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.549+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.550+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.550+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:42:29.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.552+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.553+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.553+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.554+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:42:29.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.555+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.556+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.556+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.557+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:42:29.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.559+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.559+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.559+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.560+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:42:29.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.562+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.562+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.562+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.563+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:42:29.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.565+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.565+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.566+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.567+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:42:29.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.568+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.568+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.569+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.570+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:42:29.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.571+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.572+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.573+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.574+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:42:29.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.575+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.575+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.577 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.576+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.577+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:42:29.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.578+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.578+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.578+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.579+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:42:29.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.581+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.582+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.582+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.583+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:42:29.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.584+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.585+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.585+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.586+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:42:29.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.588+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.588+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.589+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.590+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:42:29.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.591+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.592+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.592+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.593+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:42:29.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.595+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.595+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.595+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.596+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:42:29.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.598+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.598+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.598+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.599+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:42:29.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.601+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.601+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.601+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.602+0000 7f4665920800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:42:29.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.604+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.604+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.605+0000 7f4665920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.607+0000 7f4626fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:42:29.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.609+0000 7f4665920800 20 remove_watcher() i=0 2023-12-03T11:42:29.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.609+0000 7f4665920800 2 removed watcher, disabling cache 2023-12-03T11:42:29.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.610+0000 7f4665920800 20 remove_watcher() i=1 2023-12-03T11:42:29.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.611+0000 7f4665920800 20 remove_watcher() i=2 2023-12-03T11:42:29.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.612+0000 7f4665920800 20 remove_watcher() i=3 2023-12-03T11:42:29.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.613+0000 7f4665920800 20 remove_watcher() i=4 2023-12-03T11:42:29.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.614+0000 7f4665920800 20 remove_watcher() i=5 2023-12-03T11:42:29.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.615+0000 7f4665920800 20 remove_watcher() i=6 2023-12-03T11:42:29.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.616+0000 7f4665920800 20 remove_watcher() i=7 2023-12-03T11:42:29.623 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2023-12-03T11:42:29.673 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:42:29.673 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:42:29.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.686+0000 7fcac5b32800 20 rados->read ofs=0 len=0 2023-12-03T11:42:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.687+0000 7fcac5b32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.687+0000 7fcac5b32800 20 realm 2023-12-03T11:42:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.687+0000 7fcac5b32800 20 rados->read ofs=0 len=0 2023-12-03T11:42:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.688+0000 7fcac5b32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.688+0000 7fcac5b32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:42:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.688+0000 7fcac5b32800 20 rados->read ofs=0 len=0 2023-12-03T11:42:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.688+0000 7fcac5b32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.688+0000 7fcac5b32800 20 rados->read ofs=0 len=0 2023-12-03T11:42:29.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.688+0000 7fcac5b32800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:42:29.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.688+0000 7fcac5b32800 20 rados->read ofs=0 len=0 2023-12-03T11:42:29.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.689+0000 7fcac5b32800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:42:29.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.689+0000 7fcac5b32800 20 searching for the correct realm 2023-12-03T11:42:29.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.699+0000 7fcac175b640 0 -- 172.21.15.44:0/1109940669 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x5579c13c13b0 msgr2=0x5579c13c37a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:42:29.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.699+0000 7fcac5b32800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:42:29.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.699+0000 7fcac5b32800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:42:29.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.699+0000 7fcac5b32800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:42:29.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.699+0000 7fcac5b32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:42:29.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.699+0000 7fcac5b32800 20 rados->read ofs=0 len=0 2023-12-03T11:42:29.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.700+0000 7fcac5b32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:29.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.700+0000 7fcac5b32800 20 rados->read ofs=0 len=0 2023-12-03T11:42:29.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.700+0000 7fcac5b32800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:42:29.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.700+0000 7fcac5b32800 20 rados->read ofs=0 len=0 2023-12-03T11:42:29.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.700+0000 7fcac5b32800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:42:29.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.700+0000 7fcac5b32800 20 zone default found 2023-12-03T11:42:29.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.700+0000 7fcac5b32800 4 Realm: () 2023-12-03T11:42:29.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.700+0000 7fcac5b32800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:42:29.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.700+0000 7fcac5b32800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:42:29.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.700+0000 7fcac5b32800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.700+0000 7fcac5b32800 20 zonegroup default 2023-12-03T11:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.700+0000 7fcac5b32800 20 rados->read ofs=0 len=0 2023-12-03T11:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.700+0000 7fcac5b32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.700+0000 7fcac5b32800 20 rados->read ofs=0 len=0 2023-12-03T11:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.701+0000 7fcac5b32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.701+0000 7fcac5b32800 20 rados->read ofs=0 len=0 2023-12-03T11:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.701+0000 7fcac5b32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.701+0000 7fcac5b32800 20 started sync module instance, tier type = 2023-12-03T11:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.701+0000 7fcac5b32800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:42:29.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.709+0000 7fcac1f5c640 0 -- 172.21.15.44:0/1109940669 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x5579c13c9280 msgr2=0x5579c13cb740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.710+0000 7fcac5b32800 20 add_watcher() i=0 2023-12-03T11:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.710+0000 7fcac5b32800 20 add_watcher() i=1 2023-12-03T11:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.710+0000 7fcac5b32800 20 add_watcher() i=2 2023-12-03T11:42:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.710+0000 7fcac5b32800 20 add_watcher() i=3 2023-12-03T11:42:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.710+0000 7fcac5b32800 20 add_watcher() i=4 2023-12-03T11:42:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.710+0000 7fcac5b32800 20 add_watcher() i=5 2023-12-03T11:42:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.711+0000 7fcac5b32800 20 add_watcher() i=6 2023-12-03T11:42:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.711+0000 7fcac5b32800 20 add_watcher() i=7 2023-12-03T11:42:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.711+0000 7fcac5b32800 2 all 8 watchers are set, enabling cache 2023-12-03T11:42:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.713+0000 7fca86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:42:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.713+0000 7fcac5b32800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:42:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.713+0000 7fcac5b32800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:42:29.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.756+0000 7fc9f5ffb640 20 reqs_thread_entry: start 2023-12-03T11:42:29.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.756+0000 7fcac5b32800 20 init_complete bucket index max shards: 1 2023-12-03T11:42:29.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.756+0000 7fcac5b32800 20 Filter name: none 2023-12-03T11:42:29.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.757+0000 7fc9e77fe640 20 reqs_thread_entry: start 2023-12-03T11:42:29.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.757+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:42:29.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.758+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.758+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.759+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.760+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:42:29.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.761+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.761+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.762+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.763+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:42:29.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.764+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.765+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.765+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.766+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:42:29.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.767+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.768+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.768+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.769+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:42:29.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.770+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.771+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.771+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.772+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:42:29.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.773+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.774+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.774+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.775+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:42:29.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.776+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.777+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.777+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.778+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:42:29.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.779+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.780+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.780+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.782+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:42:29.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.783+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.783+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.783+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.784+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:42:29.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.786+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.786+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.786+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.787+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:42:29.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.789+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.790+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.790+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.791+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:42:29.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.792+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.793+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.793+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.794+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:42:29.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.796+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.796+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.796+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.797+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:42:29.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.799+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.799+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.799+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.800+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:42:29.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.802+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.802+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.802+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.803+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:42:29.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.805+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.805+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.806+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.806+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:42:29.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.808+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.808+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.808+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.809+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:42:29.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.811+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.811+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.811+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.812+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:42:29.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.814+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.814+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.814+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.815+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:42:29.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.817+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.817+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.817+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.818+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:42:29.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.819+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.820+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.820+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.821+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:42:29.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.822+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.823+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.823+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.824+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:42:29.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.825+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.826+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.826+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.827+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:42:29.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.828+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.829+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.829+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.830+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:42:29.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.831+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.832+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.832+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.833+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:42:29.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.834+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.835+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.835+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.836+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:42:29.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.837+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.838+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.838+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.839+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:42:29.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.840+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.840+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.841+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.842+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:42:29.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.843+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.843+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.843+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.844+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:42:29.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.846+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.846+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.847+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.847+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:42:29.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.849+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.850+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.850+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.851+0000 7fcac5b32800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:42:29.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.852+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.853+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:29.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.853+0000 7fcac5b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:29.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.855+0000 7fca86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:42:29.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.857+0000 7fcac5b32800 20 remove_watcher() i=0 2023-12-03T11:42:29.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.857+0000 7fcac5b32800 2 removed watcher, disabling cache 2023-12-03T11:42:29.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.858+0000 7fcac5b32800 20 remove_watcher() i=1 2023-12-03T11:42:29.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.859+0000 7fcac5b32800 20 remove_watcher() i=2 2023-12-03T11:42:29.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.860+0000 7fcac5b32800 20 remove_watcher() i=3 2023-12-03T11:42:29.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.861+0000 7fcac5b32800 20 remove_watcher() i=4 2023-12-03T11:42:29.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.862+0000 7fcac5b32800 20 remove_watcher() i=5 2023-12-03T11:42:29.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.863+0000 7fcac5b32800 20 remove_watcher() i=6 2023-12-03T11:42:29.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:29.864+0000 7fcac5b32800 20 remove_watcher() i=7 2023-12-03T11:42:29.871 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2023-12-03T11:42:29.920 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:42:29.921 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:42:30.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.137+0000 7ff4dd2c0800 20 rados->read ofs=0 len=0 2023-12-03T11:42:30.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.139+0000 7ff4dd2c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:30.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.139+0000 7ff4dd2c0800 20 realm 2023-12-03T11:42:30.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.139+0000 7ff4dd2c0800 20 rados->read ofs=0 len=0 2023-12-03T11:42:30.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.139+0000 7ff4dd2c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:30.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.139+0000 7ff4dd2c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:42:30.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.139+0000 7ff4dd2c0800 20 rados->read ofs=0 len=0 2023-12-03T11:42:30.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.139+0000 7ff4dd2c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:30.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.139+0000 7ff4dd2c0800 20 rados->read ofs=0 len=0 2023-12-03T11:42:30.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.140+0000 7ff4dd2c0800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:42:30.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.140+0000 7ff4dd2c0800 20 rados->read ofs=0 len=0 2023-12-03T11:42:30.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.342+0000 7ff4dd2c0800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:42:30.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.342+0000 7ff4dd2c0800 20 searching for the correct realm 2023-12-03T11:42:30.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.348+0000 7ff4dadc7640 0 -- 172.21.15.44:0/1150861822 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55fda7a8ac70 msgr2=0x55fda7a8d060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:42:30.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.353+0000 7ff4dadc7640 0 -- 172.21.15.44:0/1150861822 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x7ff4b4079d90 msgr2=0x7ff4b407c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:42:30.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.354+0000 7ff4dd2c0800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:42:30.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.354+0000 7ff4dd2c0800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:42:30.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.354+0000 7ff4dd2c0800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:42:30.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.354+0000 7ff4dd2c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:42:30.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.354+0000 7ff4dd2c0800 20 rados->read ofs=0 len=0 2023-12-03T11:42:30.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.355+0000 7ff4dd2c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:30.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.355+0000 7ff4dd2c0800 20 rados->read ofs=0 len=0 2023-12-03T11:42:30.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.355+0000 7ff4dd2c0800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:42:30.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.355+0000 7ff4dd2c0800 20 rados->read ofs=0 len=0 2023-12-03T11:42:30.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.355+0000 7ff4dd2c0800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:42:30.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.355+0000 7ff4dd2c0800 20 zone default found 2023-12-03T11:42:30.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.355+0000 7ff4dd2c0800 4 Realm: () 2023-12-03T11:42:30.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.355+0000 7ff4dd2c0800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:42:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.355+0000 7ff4dd2c0800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:42:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.355+0000 7ff4dd2c0800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:42:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.355+0000 7ff4dd2c0800 20 zonegroup default 2023-12-03T11:42:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.355+0000 7ff4dd2c0800 20 rados->read ofs=0 len=0 2023-12-03T11:42:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.356+0000 7ff4dd2c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.356+0000 7ff4dd2c0800 20 rados->read ofs=0 len=0 2023-12-03T11:42:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.356+0000 7ff4dd2c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.356+0000 7ff4dd2c0800 20 rados->read ofs=0 len=0 2023-12-03T11:42:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.356+0000 7ff4dd2c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.356+0000 7ff4dd2c0800 20 started sync module instance, tier type = 2023-12-03T11:42:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.356+0000 7ff4dd2c0800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:42:30.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.365+0000 7ff4dd2c0800 20 add_watcher() i=0 2023-12-03T11:42:30.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.365+0000 7ff4dd2c0800 20 add_watcher() i=1 2023-12-03T11:42:30.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.365+0000 7ff4dd2c0800 20 add_watcher() i=2 2023-12-03T11:42:30.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.365+0000 7ff4dd2c0800 20 add_watcher() i=3 2023-12-03T11:42:30.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.365+0000 7ff4dd2c0800 20 add_watcher() i=4 2023-12-03T11:42:30.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.365+0000 7ff4dd2c0800 20 add_watcher() i=5 2023-12-03T11:42:30.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.365+0000 7ff4dd2c0800 20 add_watcher() i=6 2023-12-03T11:42:30.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.366+0000 7ff4dd2c0800 20 add_watcher() i=7 2023-12-03T11:42:30.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.366+0000 7ff4dd2c0800 2 all 8 watchers are set, enabling cache 2023-12-03T11:42:30.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.368+0000 7ff41bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:42:30.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.369+0000 7ff4dd2c0800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:42:30.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.369+0000 7ff4dd2c0800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:42:30.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.413+0000 7ff412ffd640 20 reqs_thread_entry: start 2023-12-03T11:42:30.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.413+0000 7ff4dd2c0800 20 init_complete bucket index max shards: 1 2023-12-03T11:42:30.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.413+0000 7ff4dd2c0800 20 Filter name: none 2023-12-03T11:42:30.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.413+0000 7ff410ff9640 20 reqs_thread_entry: start 2023-12-03T11:42:30.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.413+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:42:30.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.415+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.415+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.416+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.417+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:42:30.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.419+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.419+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.420+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.421+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:42:30.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.422+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.422+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.423+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.424+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:42:30.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.425+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.425+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.425+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.426+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:42:30.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.428+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.428+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.429+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.430+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:42:30.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.431+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.431+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.431+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.432+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:42:30.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.434+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.434+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.434+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.435+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:42:30.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.436+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.437+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.437+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.438+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:42:30.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.439+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.440+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.440+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.441+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:42:30.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.442+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.443+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.443+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.444+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:42:30.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.445+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.446+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.446+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.447+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:42:30.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.448+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.449+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.449+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.450+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:42:30.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.451+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.452+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.452+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.454+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:42:30.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.455+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.455+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.456+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.457+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:42:30.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.458+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.458+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.459+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.460+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:42:30.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.461+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.462+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.462+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.463+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:42:30.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.464+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.465+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.465+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.466+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:42:30.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.468+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.468+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.469+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.470+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:42:30.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.471+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.472+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.472+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.473+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:42:30.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.475+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.475+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.476+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.476+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:42:30.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.478+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.478+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.479+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.480+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:42:30.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.481+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.481+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.482+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.482+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:42:30.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.484+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.484+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.484+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.485+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:42:30.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.486+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.487+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.487+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.488+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:42:30.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.489+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.490+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.490+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.491+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:42:30.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.493+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.493+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.494+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.495+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:42:30.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.496+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.497+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.497+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.499+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:42:30.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.500+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.500+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.500+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.501+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:42:30.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.503+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.503+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.503+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.504+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:42:30.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.506+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.506+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.506+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.508+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:42:30.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.510+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.510+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.510+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.511+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:42:30.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.512+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.513+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.513+0000 7ff4dd2c0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.515+0000 7ff41bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:42:30.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.517+0000 7ff4dd2c0800 20 remove_watcher() i=0 2023-12-03T11:42:30.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.517+0000 7ff4dd2c0800 2 removed watcher, disabling cache 2023-12-03T11:42:30.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.518+0000 7ff4dd2c0800 20 remove_watcher() i=1 2023-12-03T11:42:30.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.519+0000 7ff4dd2c0800 20 remove_watcher() i=2 2023-12-03T11:42:30.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.520+0000 7ff4dd2c0800 20 remove_watcher() i=3 2023-12-03T11:42:30.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.521+0000 7ff4dd2c0800 20 remove_watcher() i=4 2023-12-03T11:42:30.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.522+0000 7ff4dd2c0800 20 remove_watcher() i=5 2023-12-03T11:42:30.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.522+0000 7ff4dd2c0800 20 remove_watcher() i=6 2023-12-03T11:42:30.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.523+0000 7ff4dd2c0800 20 remove_watcher() i=7 2023-12-03T11:42:30.530 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2023-12-03T11:42:30.584 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:42:30.584 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:42:30.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.597+0000 7f03bcb33800 20 rados->read ofs=0 len=0 2023-12-03T11:42:30.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.599+0000 7f03bcb33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:30.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.599+0000 7f03bcb33800 20 realm 2023-12-03T11:42:30.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.599+0000 7f03bcb33800 20 rados->read ofs=0 len=0 2023-12-03T11:42:30.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.599+0000 7f03bcb33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:30.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.599+0000 7f03bcb33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:42:30.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.599+0000 7f03bcb33800 20 rados->read ofs=0 len=0 2023-12-03T11:42:30.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.599+0000 7f03bcb33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:30.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.599+0000 7f03bcb33800 20 rados->read ofs=0 len=0 2023-12-03T11:42:30.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.600+0000 7f03bcb33800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:42:30.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.600+0000 7f03bcb33800 20 rados->read ofs=0 len=0 2023-12-03T11:42:30.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.601+0000 7f03bcb33800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:42:30.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.601+0000 7f03bcb33800 20 searching for the correct realm 2023-12-03T11:42:30.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.610+0000 7f03b7ffa640 0 -- 172.21.15.44:0/2783974296 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x561e181410a0 msgr2=0x561e18143490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:42:30.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.611+0000 7f03bcb33800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:42:30.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.611+0000 7f03bcb33800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:42:30.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.611+0000 7f03bcb33800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:42:30.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.611+0000 7f03bcb33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:42:30.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.611+0000 7f03bcb33800 20 rados->read ofs=0 len=0 2023-12-03T11:42:30.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.612+0000 7f03bcb33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:30.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.612+0000 7f03bcb33800 20 rados->read ofs=0 len=0 2023-12-03T11:42:30.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.612+0000 7f03bcb33800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:42:30.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.612+0000 7f03bcb33800 20 rados->read ofs=0 len=0 2023-12-03T11:42:30.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.612+0000 7f03bcb33800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:42:30.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.612+0000 7f03bcb33800 20 zone default found 2023-12-03T11:42:30.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.612+0000 7f03bcb33800 4 Realm: () 2023-12-03T11:42:30.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.612+0000 7f03bcb33800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:42:30.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.612+0000 7f03bcb33800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:42:30.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.612+0000 7f03bcb33800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:42:30.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.612+0000 7f03bcb33800 20 zonegroup default 2023-12-03T11:42:30.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.612+0000 7f03bcb33800 20 rados->read ofs=0 len=0 2023-12-03T11:42:30.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.612+0000 7f03bcb33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:30.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.613+0000 7f03bcb33800 20 rados->read ofs=0 len=0 2023-12-03T11:42:30.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.613+0000 7f03bcb33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:30.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.613+0000 7f03bcb33800 20 rados->read ofs=0 len=0 2023-12-03T11:42:30.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.613+0000 7f03bcb33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:42:30.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.613+0000 7f03bcb33800 20 started sync module instance, tier type = 2023-12-03T11:42:30.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.613+0000 7f03bcb33800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:42:30.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.619+0000 7f03b7ffa640 0 -- 172.21.15.44:0/2783974296 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x7f0390079d90 msgr2=0x7f039007c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:42:30.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.622+0000 7f03bcb33800 20 add_watcher() i=0 2023-12-03T11:42:30.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.622+0000 7f03bcb33800 20 add_watcher() i=1 2023-12-03T11:42:30.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.622+0000 7f03bcb33800 20 add_watcher() i=2 2023-12-03T11:42:30.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.622+0000 7f03bcb33800 20 add_watcher() i=3 2023-12-03T11:42:30.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.622+0000 7f03bcb33800 20 add_watcher() i=4 2023-12-03T11:42:30.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.622+0000 7f03bcb33800 20 add_watcher() i=5 2023-12-03T11:42:30.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.622+0000 7f03bcb33800 20 add_watcher() i=6 2023-12-03T11:42:30.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.623+0000 7f03bcb33800 20 add_watcher() i=7 2023-12-03T11:42:30.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.623+0000 7f03bcb33800 2 all 8 watchers are set, enabling cache 2023-12-03T11:42:30.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.625+0000 7f037e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:42:30.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.625+0000 7f03bcb33800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:42:30.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.625+0000 7f03bcb33800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:42:30.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.667+0000 7f02ed7fa640 20 reqs_thread_entry: start 2023-12-03T11:42:30.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.667+0000 7f03bcb33800 20 init_complete bucket index max shards: 1 2023-12-03T11:42:30.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.667+0000 7f03bcb33800 20 Filter name: none 2023-12-03T11:42:30.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.667+0000 7f02e6ffd640 20 reqs_thread_entry: start 2023-12-03T11:42:30.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.667+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:42:30.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.669+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.669+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.669+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.670+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:42:30.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.672+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.672+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.673+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.674+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:42:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.675+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.675+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.676+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.676+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:42:30.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.677+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.678+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.678+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.679+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:42:30.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.680+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.681+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.681+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.682+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:42:30.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.683+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.684+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.684+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.685+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:42:30.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.687+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.687+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.688+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.689+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:42:30.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.690+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.691+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.691+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.692+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:42:30.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.693+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.693+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.694+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.694+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:42:30.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.696+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.696+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.696+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.697+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:42:30.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.699+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.699+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.699+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.701+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:42:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.702+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.702+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.702+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.703+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:42:30.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.705+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.705+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.705+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.706+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:42:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.707+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.708+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.708+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.709+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:42:30.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.710+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.711+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.711+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.712+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:42:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.713+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.714+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.714+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.715+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:42:30.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.717+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.717+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.717+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.718+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:42:30.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.720+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.720+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.720+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.722+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:42:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.723+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.723+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.724+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.725+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:42:30.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.726+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.726+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.727+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.728+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:42:30.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.729+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.729+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.729+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.730+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:42:30.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.731+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.732+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.732+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.740+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:42:30.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.741+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.742+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.742+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.743+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:42:30.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.744+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.745+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.745+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.746+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:42:30.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.748+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.748+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.748+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.749+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:42:30.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.751+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.751+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.751+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.752+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:42:30.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.754+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.754+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.755+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.756+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:42:30.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.757+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.758+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.758+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.759+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:42:30.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.761+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.761+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.761+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.763+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:42:30.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.764+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.764+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.765+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.766+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:42:30.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.767+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.767+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.767+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.768+0000 7f03bcb33800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:42:30.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.769+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.770+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:42:30.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.770+0000 7f03bcb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:42:30.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.772+0000 7f037e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:42:30.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.774+0000 7f03bcb33800 20 remove_watcher() i=0 2023-12-03T11:42:30.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.774+0000 7f03bcb33800 2 removed watcher, disabling cache 2023-12-03T11:42:30.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.775+0000 7f03bcb33800 20 remove_watcher() i=1 2023-12-03T11:42:30.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.776+0000 7f03bcb33800 20 remove_watcher() i=2 2023-12-03T11:42:30.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.777+0000 7f03bcb33800 20 remove_watcher() i=3 2023-12-03T11:42:30.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.778+0000 7f03bcb33800 20 remove_watcher() i=4 2023-12-03T11:42:30.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.779+0000 7f03bcb33800 20 remove_watcher() i=5 2023-12-03T11:42:30.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.781+0000 7f03bcb33800 20 remove_watcher() i=6 2023-12-03T11:42:30.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:42:30.783+0000 7f03bcb33800 20 remove_watcher() i=7 2023-12-03T11:42:30.789 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2023-12-03T11:42:31.371 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :clean 2023-12-03T11:42:31.969 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :compileJava 2023-12-03T11:42:31.969 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :processResources 2023-12-03T11:42:31.969 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :classes 2023-12-03T11:42:32.570 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:32.570 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :compileTestJava 2023-12-03T11:42:32.570 INFO:teuthology.orchestra.run.smithi044.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2023-12-03T11:42:32.570 INFO:teuthology.orchestra.run.smithi044.stderr:Note: Recompile with -Xlint:deprecation for details. 2023-12-03T11:42:32.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:32.571 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :processTestResources NO-SOURCE 2023-12-03T11:42:32.572 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :testClasses 2023-12-03T11:42:34.570 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:34.571 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :test 2023-12-03T11:42:34.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:34.571 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2023-12-03T11:42:34.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:34.571 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2023-12-03T11:42:34.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:34.571 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2023-12-03T11:42:34.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:34.571 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2023-12-03T11:42:34.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:34.670 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2023-12-03T11:42:34.670 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:34.670 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2023-12-03T11:42:34.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:34.869 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2023-12-03T11:42:35.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:35.270 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2023-12-03T11:42:35.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:35.469 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2023-12-03T11:42:35.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:35.569 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2023-12-03T11:42:35.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:35.669 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2023-12-03T11:42:35.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:35.769 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2023-12-03T11:42:35.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:35.969 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2023-12-03T11:42:35.970 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:35.970 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2023-12-03T11:42:36.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:36.069 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2023-12-03T11:42:36.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:36.070 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2023-12-03T11:42:36.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:36.269 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2023-12-03T11:42:36.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:36.469 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2023-12-03T11:42:36.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:36.669 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2023-12-03T11:42:36.670 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:36.670 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2023-12-03T11:42:36.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:36.869 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2023-12-03T11:42:36.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:36.969 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2023-12-03T11:42:37.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:37.170 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2023-12-03T11:42:37.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:37.170 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2023-12-03T11:42:37.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:37.369 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2023-12-03T11:42:37.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:37.369 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2023-12-03T11:42:37.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:37.569 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2023-12-03T11:42:37.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:37.669 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2023-12-03T11:42:37.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:37.869 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2023-12-03T11:42:37.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:37.869 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2023-12-03T11:42:38.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:38.069 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2023-12-03T11:42:38.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:38.170 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2023-12-03T11:42:38.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:38.369 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2023-12-03T11:42:38.870 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:38.870 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2023-12-03T11:42:39.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:39.169 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2023-12-03T11:42:42.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:42.570 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2023-12-03T11:42:42.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:42.870 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2023-12-03T11:42:42.870 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:42.870 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2023-12-03T11:42:43.070 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:43.070 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2023-12-03T11:42:43.070 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:43.070 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2023-12-03T11:42:43.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:43.369 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2023-12-03T11:42:43.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:43.669 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2023-12-03T11:42:43.870 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:43.870 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2023-12-03T11:42:43.870 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:43.870 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2023-12-03T11:42:43.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:43.969 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2023-12-03T11:42:44.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:44.669 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2023-12-03T11:42:44.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:44.869 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2023-12-03T11:42:45.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:45.169 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2023-12-03T11:42:45.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:45.369 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2023-12-03T11:42:45.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:45.769 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2023-12-03T11:42:45.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:45.969 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2023-12-03T11:42:48.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:48.369 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2023-12-03T11:42:48.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:48.569 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2023-12-03T11:42:49.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:49.469 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2023-12-03T11:42:49.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:49.669 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2023-12-03T11:42:50.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:50.069 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2023-12-03T11:42:50.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:50.269 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2023-12-03T11:42:50.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:50.669 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2023-12-03T11:42:50.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:50.969 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2023-12-03T11:42:51.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:51.069 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2023-12-03T11:42:51.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:51.169 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2023-12-03T11:42:51.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:51.169 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2023-12-03T11:42:51.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:51.369 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2023-12-03T11:42:51.370 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:51.370 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2023-12-03T11:42:51.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:51.569 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2023-12-03T11:42:51.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:51.569 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2023-12-03T11:42:51.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:51.769 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2023-12-03T11:42:51.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:51.869 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2023-12-03T11:42:52.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:52.069 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2023-12-03T11:42:52.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:52.069 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2023-12-03T11:42:52.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:52.269 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2023-12-03T11:42:52.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:52.269 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2023-12-03T11:42:52.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:52.469 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2023-12-03T11:42:52.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:52.569 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2023-12-03T11:42:52.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:52.769 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2023-12-03T11:42:52.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:52.869 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2023-12-03T11:42:53.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:53.069 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2023-12-03T11:42:53.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:53.070 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2023-12-03T11:42:53.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:53.269 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2023-12-03T11:42:53.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:53.369 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2023-12-03T11:42:53.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:53.569 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2023-12-03T11:42:53.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:53.669 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2023-12-03T11:42:53.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:53.869 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2023-12-03T11:42:53.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:53.869 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2023-12-03T11:42:54.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:54.069 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2023-12-03T11:42:54.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:54.169 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2023-12-03T11:42:54.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:54.369 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2023-12-03T11:42:54.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:54.469 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2023-12-03T11:42:54.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:54.669 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2023-12-03T11:42:54.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:54.669 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2023-12-03T11:42:54.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:54.869 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2023-12-03T11:42:54.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:54.969 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2023-12-03T11:42:55.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:55.169 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2023-12-03T11:42:55.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:55.269 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2023-12-03T11:42:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:55.469 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2023-12-03T11:42:55.570 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:55.571 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2023-12-03T11:42:55.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:55.769 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2023-12-03T11:42:55.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:55.769 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2023-12-03T11:42:55.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:55.969 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2023-12-03T11:42:56.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:56.069 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2023-12-03T11:42:56.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:56.269 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2023-12-03T11:42:56.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:56.269 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2023-12-03T11:42:56.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:56.569 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2023-12-03T11:42:56.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:56.569 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2023-12-03T11:42:56.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:56.769 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2023-12-03T11:42:56.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:56.869 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2023-12-03T11:42:57.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:57.069 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2023-12-03T11:42:57.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:57.069 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2023-12-03T11:42:57.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:57.369 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2023-12-03T11:42:57.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:57.369 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2023-12-03T11:42:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:57.569 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2023-12-03T11:42:57.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:57.869 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2023-12-03T11:42:58.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:58.069 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2023-12-03T11:42:58.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:58.169 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2023-12-03T11:42:58.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:58.369 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2023-12-03T11:42:58.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:58.369 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2023-12-03T11:42:58.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:58.569 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2023-12-03T11:42:58.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:58.669 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2023-12-03T11:42:58.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:58.869 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2023-12-03T11:42:58.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:58.869 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2023-12-03T11:42:59.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:59.069 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2023-12-03T11:42:59.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:59.069 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2023-12-03T11:42:59.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:59.270 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2023-12-03T11:42:59.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:59.270 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2023-12-03T11:42:59.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:59.369 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2023-12-03T11:42:59.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:59.569 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2023-12-03T11:42:59.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:59.769 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2023-12-03T11:42:59.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:59.769 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2023-12-03T11:42:59.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:59.869 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2023-12-03T11:42:59.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:42:59.969 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2023-12-03T11:43:00.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:43:00.169 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2023-12-03T11:43:00.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:43:00.170 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2023-12-03T11:43:00.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:43:00.369 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2023-12-03T11:43:00.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:43:00.469 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2023-12-03T11:43:00.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:43:00.669 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2023-12-03T11:43:00.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:43:00.669 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2023-12-03T11:43:00.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:43:00.869 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2023-12-03T11:43:01.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:43:01.169 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2023-12-03T11:43:01.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:43:01.369 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2023-12-03T11:43:01.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:43:01.669 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2023-12-03T11:43:01.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:43:01.827 INFO:teuthology.orchestra.run.smithi044.stdout:---------------------------------------------------------------------- 2023-12-03T11:43:01.827 INFO:teuthology.orchestra.run.smithi044.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2023-12-03T11:43:01.827 INFO:teuthology.orchestra.run.smithi044.stdout:---------------------------------------------------------------------- 2023-12-03T11:43:01.827 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:43:01.827 INFO:teuthology.orchestra.run.smithi044.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2023-12-03T11:43:01.827 INFO:teuthology.orchestra.run.smithi044.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2023-12-03T11:43:01.827 INFO:teuthology.orchestra.run.smithi044.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2023-12-03T11:43:01.827 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:43:01.827 INFO:teuthology.orchestra.run.smithi044.stdout:BUILD SUCCESSFUL in 30s 2023-12-03T11:43:01.827 INFO:teuthology.orchestra.run.smithi044.stdout:5 actionable tasks: 5 executed 2023-12-03T11:43:01.829 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2023-12-03T11:43:01.878 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:43:01.879 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:43:01.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.892+0000 7f0d33d31800 20 rados->read ofs=0 len=0 2023-12-03T11:43:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.894+0000 7f0d33d31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.894+0000 7f0d33d31800 20 realm 2023-12-03T11:43:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.894+0000 7f0d33d31800 20 rados->read ofs=0 len=0 2023-12-03T11:43:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.894+0000 7f0d33d31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.894+0000 7f0d33d31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:43:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.894+0000 7f0d33d31800 20 rados->read ofs=0 len=0 2023-12-03T11:43:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.894+0000 7f0d33d31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.894+0000 7f0d33d31800 20 rados->read ofs=0 len=0 2023-12-03T11:43:01.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.895+0000 7f0d33d31800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:01.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.895+0000 7f0d33d31800 20 rados->read ofs=0 len=0 2023-12-03T11:43:01.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.896+0000 7f0d33d31800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:43:01.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.896+0000 7f0d33d31800 20 searching for the correct realm 2023-12-03T11:43:01.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.906+0000 7f0d3017f640 0 -- 172.21.15.44:0/917003973 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55ad5c1c0d80 msgr2=0x55ad5c1c3240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:43:01.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.907+0000 7f0d33d31800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:43:01.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.907+0000 7f0d33d31800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:43:01.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.907+0000 7f0d33d31800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:43:01.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.907+0000 7f0d33d31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:43:01.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.907+0000 7f0d33d31800 20 rados->read ofs=0 len=0 2023-12-03T11:43:01.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.907+0000 7f0d33d31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:01.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.907+0000 7f0d33d31800 20 rados->read ofs=0 len=0 2023-12-03T11:43:01.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.907+0000 7f0d33d31800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:01.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.907+0000 7f0d33d31800 20 rados->read ofs=0 len=0 2023-12-03T11:43:01.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.907+0000 7f0d33d31800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:43:01.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.907+0000 7f0d33d31800 20 zone default found 2023-12-03T11:43:01.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.907+0000 7f0d33d31800 4 Realm: () 2023-12-03T11:43:01.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.907+0000 7f0d33d31800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:43:01.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.907+0000 7f0d33d31800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:43:01.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.907+0000 7f0d33d31800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:43:01.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.907+0000 7f0d33d31800 20 zonegroup default 2023-12-03T11:43:01.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.907+0000 7f0d33d31800 20 rados->read ofs=0 len=0 2023-12-03T11:43:01.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.908+0000 7f0d33d31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:01.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.908+0000 7f0d33d31800 20 rados->read ofs=0 len=0 2023-12-03T11:43:01.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.908+0000 7f0d33d31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:01.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:01.908+0000 7f0d33d31800 20 rados->read ofs=0 len=0 2023-12-03T11:43:02.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.107+0000 7f0d33d31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:02.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.107+0000 7f0d33d31800 20 started sync module instance, tier type = 2023-12-03T11:43:02.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.107+0000 7f0d33d31800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:43:02.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.113+0000 7f0d3017f640 0 -- 172.21.15.44:0/917003973 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f0d1805ede0 msgr2=0x7f0d18002430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:43:02.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.117+0000 7f0d33d31800 20 add_watcher() i=0 2023-12-03T11:43:02.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.117+0000 7f0d33d31800 20 add_watcher() i=1 2023-12-03T11:43:02.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.117+0000 7f0d33d31800 20 add_watcher() i=2 2023-12-03T11:43:02.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.117+0000 7f0d33d31800 20 add_watcher() i=3 2023-12-03T11:43:02.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.117+0000 7f0d33d31800 20 add_watcher() i=4 2023-12-03T11:43:02.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.117+0000 7f0d33d31800 20 add_watcher() i=5 2023-12-03T11:43:02.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.117+0000 7f0d33d31800 20 add_watcher() i=6 2023-12-03T11:43:02.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.118+0000 7f0d33d31800 20 add_watcher() i=7 2023-12-03T11:43:02.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.118+0000 7f0d33d31800 2 all 8 watchers are set, enabling cache 2023-12-03T11:43:02.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.119+0000 7f0cf5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:02.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.120+0000 7f0d33d31800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:43:02.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.120+0000 7f0d33d31800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:43:02.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.163+0000 7f0c6cff9640 20 reqs_thread_entry: start 2023-12-03T11:43:02.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.163+0000 7f0d33d31800 20 init_complete bucket index max shards: 1 2023-12-03T11:43:02.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.163+0000 7f0d33d31800 20 Filter name: none 2023-12-03T11:43:02.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.163+0000 7f0c627fc640 20 reqs_thread_entry: start 2023-12-03T11:43:02.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.164+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:43:02.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.165+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.165+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.166+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.167+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:43:02.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.168+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.169+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.169+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:43:02.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.169+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4647.79__shadow_key1.2~B4zt0u6QLs8xl-7QTNQSw3btzCR3icT.1_1_659550813bba206968fc290859be5497', time=2023-12-03T13:42:39.029158+0000, chain.objs.size()=9 2023-12-03T11:43:02.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.169+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.79__multipart_key1.2~B4zt0u6QLs8xl-7QTNQSw3btzCR3icT.1 2023-12-03T11:43:02.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.169+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.79__shadow_key1.2~B4zt0u6QLs8xl-7QTNQSw3btzCR3icT.1_1 2023-12-03T11:43:02.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.169+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.79__multipart_key1.2~B4zt0u6QLs8xl-7QTNQSw3btzCR3icT.2 2023-12-03T11:43:02.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.169+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.79__shadow_key1.2~B4zt0u6QLs8xl-7QTNQSw3btzCR3icT.2_1 2023-12-03T11:43:02.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.169+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.79__multipart_key1.2~B4zt0u6QLs8xl-7QTNQSw3btzCR3icT.3 2023-12-03T11:43:02.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.169+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.79__shadow_key1.2~B4zt0u6QLs8xl-7QTNQSw3btzCR3icT.3_1 2023-12-03T11:43:02.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.169+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.79__multipart_key1.2~B4zt0u6QLs8xl-7QTNQSw3btzCR3icT.4 2023-12-03T11:43:02.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.169+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.79__shadow_key1.2~B4zt0u6QLs8xl-7QTNQSw3btzCR3icT.4_1 2023-12-03T11:43:02.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.169+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.79__multipart_key1.2~B4zt0u6QLs8xl-7QTNQSw3btzCR3icT.5 2023-12-03T11:43:02.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.173+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:43:02.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.176+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:43:02.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.177+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.178+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.178+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.179+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:43:02.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.180+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.181+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.181+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:43:02.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.181+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.13501407187023143406', time=2023-12-03T13:42:44.676589+0000, chain.objs.size()=9 2023-12-03T11:43:02.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.181+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.87__multipart_key1.2~eDv5gweRhZ97ac18uKrVYtoOFkSfDQr.1 2023-12-03T11:43:02.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.181+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.87__shadow_key1.2~eDv5gweRhZ97ac18uKrVYtoOFkSfDQr.1_1 2023-12-03T11:43:02.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.181+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.87__multipart_key1.2~eDv5gweRhZ97ac18uKrVYtoOFkSfDQr.2 2023-12-03T11:43:02.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.181+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.87__shadow_key1.2~eDv5gweRhZ97ac18uKrVYtoOFkSfDQr.2_1 2023-12-03T11:43:02.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.181+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.87__multipart_key1.2~eDv5gweRhZ97ac18uKrVYtoOFkSfDQr.3 2023-12-03T11:43:02.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.181+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.87__shadow_key1.2~eDv5gweRhZ97ac18uKrVYtoOFkSfDQr.3_1 2023-12-03T11:43:02.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.181+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.87__multipart_key1.2~eDv5gweRhZ97ac18uKrVYtoOFkSfDQr.4 2023-12-03T11:43:02.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.181+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.87__shadow_key1.2~eDv5gweRhZ97ac18uKrVYtoOFkSfDQr.4_1 2023-12-03T11:43:02.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.181+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.87__multipart_key1.2~eDv5gweRhZ97ac18uKrVYtoOFkSfDQr.5 2023-12-03T11:43:02.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.186+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:43:02.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.188+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:43:02.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.190+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.190+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.190+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.191+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:43:02.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.193+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.193+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.194+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:43:02.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.194+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.13930713830808638557', time=2023-12-03T13:42:41.566714+0000, chain.objs.size()=9 2023-12-03T11:43:02.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.194+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~KmjvddjsRJcZ5mpBlRxNbet38b9OQDV.1 2023-12-03T11:43:02.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.194+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~KmjvddjsRJcZ5mpBlRxNbet38b9OQDV.1_1 2023-12-03T11:43:02.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.194+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~KmjvddjsRJcZ5mpBlRxNbet38b9OQDV.2 2023-12-03T11:43:02.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.194+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~KmjvddjsRJcZ5mpBlRxNbet38b9OQDV.2_1 2023-12-03T11:43:02.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.194+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~KmjvddjsRJcZ5mpBlRxNbet38b9OQDV.3 2023-12-03T11:43:02.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.194+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~KmjvddjsRJcZ5mpBlRxNbet38b9OQDV.3_1 2023-12-03T11:43:02.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.194+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~KmjvddjsRJcZ5mpBlRxNbet38b9OQDV.4 2023-12-03T11:43:02.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.194+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~KmjvddjsRJcZ5mpBlRxNbet38b9OQDV.4_1 2023-12-03T11:43:02.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.194+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~KmjvddjsRJcZ5mpBlRxNbet38b9OQDV.5 2023-12-03T11:43:02.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.194+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.4292736717077815209', time=2023-12-03T13:42:47.728825+0000, chain.objs.size()=9 2023-12-03T11:43:02.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.194+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~N4q4mcCR3OVcObrJswUTZ2uabT6rEWi.1 2023-12-03T11:43:02.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.194+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~N4q4mcCR3OVcObrJswUTZ2uabT6rEWi.1_1 2023-12-03T11:43:02.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.194+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~N4q4mcCR3OVcObrJswUTZ2uabT6rEWi.2 2023-12-03T11:43:02.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.196+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~N4q4mcCR3OVcObrJswUTZ2uabT6rEWi.2_1 2023-12-03T11:43:02.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.198+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~N4q4mcCR3OVcObrJswUTZ2uabT6rEWi.3 2023-12-03T11:43:02.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.198+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~N4q4mcCR3OVcObrJswUTZ2uabT6rEWi.3_1 2023-12-03T11:43:02.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.198+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~N4q4mcCR3OVcObrJswUTZ2uabT6rEWi.4 2023-12-03T11:43:02.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.198+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~N4q4mcCR3OVcObrJswUTZ2uabT6rEWi.4_1 2023-12-03T11:43:02.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.199+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~N4q4mcCR3OVcObrJswUTZ2uabT6rEWi.5 2023-12-03T11:43:02.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.202+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:43:02.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.205+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:43:02.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.206+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.206+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.207+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.208+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:43:02.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.210+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.210+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.210+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.211+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:43:02.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.212+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.213+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.213+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.214+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:43:02.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.215+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.216+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.216+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.217+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:43:02.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.219+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.219+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.220+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.221+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:43:02.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.222+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.222+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.223+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:43:02.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.223+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.3442888884253890060', time=2023-12-03T13:42:42.002345+0000, chain.objs.size()=7 2023-12-03T11:43:02.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.223+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~WLK44AORjYBp2t1kJp1KrEe6yahkjMB.1 2023-12-03T11:43:02.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.223+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~WLK44AORjYBp2t1kJp1KrEe6yahkjMB.1_1 2023-12-03T11:43:02.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.223+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~WLK44AORjYBp2t1kJp1KrEe6yahkjMB.1_2 2023-12-03T11:43:02.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.223+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~WLK44AORjYBp2t1kJp1KrEe6yahkjMB.2 2023-12-03T11:43:02.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.223+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~WLK44AORjYBp2t1kJp1KrEe6yahkjMB.2_1 2023-12-03T11:43:02.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.223+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~WLK44AORjYBp2t1kJp1KrEe6yahkjMB.2_2 2023-12-03T11:43:02.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.223+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~WLK44AORjYBp2t1kJp1KrEe6yahkjMB.3 2023-12-03T11:43:02.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.226+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:43:02.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.229+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:43:02.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.230+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.230+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.230+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:43:02.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.230+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.2128641187904652615', time=2023-12-03T13:42:48.410147+0000, chain.objs.size()=7 2023-12-03T11:43:02.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.230+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~jNDDrhmtFIZZRrOUswETxYT9dC1J8Br.1 2023-12-03T11:43:02.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.230+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~jNDDrhmtFIZZRrOUswETxYT9dC1J8Br.1_1 2023-12-03T11:43:02.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.230+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~jNDDrhmtFIZZRrOUswETxYT9dC1J8Br.1_2 2023-12-03T11:43:02.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.230+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~jNDDrhmtFIZZRrOUswETxYT9dC1J8Br.2 2023-12-03T11:43:02.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.230+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~jNDDrhmtFIZZRrOUswETxYT9dC1J8Br.2_1 2023-12-03T11:43:02.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.230+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~jNDDrhmtFIZZRrOUswETxYT9dC1J8Br.2_2 2023-12-03T11:43:02.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.230+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~jNDDrhmtFIZZRrOUswETxYT9dC1J8Br.3 2023-12-03T11:43:02.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.234+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:43:02.237 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.237+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:43:02.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.238+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.238+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.239+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:43:02.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.239+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M', time=2023-12-03T13:42:50.854831+0000, chain.objs.size()=113 2023-12-03T11:43:02.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.239+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.1 2023-12-03T11:43:02.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.239+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.2 2023-12-03T11:43:02.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.239+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.3 2023-12-03T11:43:02.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.239+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.4 2023-12-03T11:43:02.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.239+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.5 2023-12-03T11:43:02.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.239+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.6 2023-12-03T11:43:02.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.239+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.7 2023-12-03T11:43:02.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.239+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.8 2023-12-03T11:43:02.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.239+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.9 2023-12-03T11:43:02.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.239+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.10 2023-12-03T11:43:02.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.239+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.11 2023-12-03T11:43:02.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.239+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.12 2023-12-03T11:43:02.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.241+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.13 2023-12-03T11:43:02.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.242+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.14 2023-12-03T11:43:02.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.243+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.15 2023-12-03T11:43:02.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.243+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.16 2023-12-03T11:43:02.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.243+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.17 2023-12-03T11:43:02.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.243+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.18 2023-12-03T11:43:02.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.243+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.19 2023-12-03T11:43:02.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.243+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.20 2023-12-03T11:43:02.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.243+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.21 2023-12-03T11:43:02.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.243+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.22 2023-12-03T11:43:02.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.243+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.23 2023-12-03T11:43:02.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.246+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.24 2023-12-03T11:43:02.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.246+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.25 2023-12-03T11:43:02.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.246+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.26 2023-12-03T11:43:02.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.247+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.27 2023-12-03T11:43:02.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.248+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.28 2023-12-03T11:43:02.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.248+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.29 2023-12-03T11:43:02.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.248+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.30 2023-12-03T11:43:02.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.248+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.31 2023-12-03T11:43:02.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.248+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.32 2023-12-03T11:43:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.248+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.33 2023-12-03T11:43:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.248+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.34 2023-12-03T11:43:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.249+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.35 2023-12-03T11:43:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.249+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.36 2023-12-03T11:43:02.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.250+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.37 2023-12-03T11:43:02.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.250+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.38 2023-12-03T11:43:02.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.252+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.39 2023-12-03T11:43:02.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.252+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.40 2023-12-03T11:43:02.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.252+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.41 2023-12-03T11:43:02.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.252+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.42 2023-12-03T11:43:02.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.252+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.43 2023-12-03T11:43:02.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.252+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.44 2023-12-03T11:43:02.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.252+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.45 2023-12-03T11:43:02.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.253+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.46 2023-12-03T11:43:02.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.253+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.47 2023-12-03T11:43:02.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.253+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.48 2023-12-03T11:43:02.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.256+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.49 2023-12-03T11:43:02.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.256+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.50 2023-12-03T11:43:02.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.257+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.51 2023-12-03T11:43:02.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.257+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.52 2023-12-03T11:43:02.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.257+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.53 2023-12-03T11:43:02.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.258+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.54 2023-12-03T11:43:02.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.258+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.55 2023-12-03T11:43:02.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.258+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.56 2023-12-03T11:43:02.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.258+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.57 2023-12-03T11:43:02.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.258+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.58 2023-12-03T11:43:02.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.258+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.59 2023-12-03T11:43:02.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.258+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.60 2023-12-03T11:43:02.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.260+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.61 2023-12-03T11:43:02.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.260+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.62 2023-12-03T11:43:02.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.260+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.63 2023-12-03T11:43:02.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.260+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.64 2023-12-03T11:43:02.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.261+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.65 2023-12-03T11:43:02.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.262+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.66 2023-12-03T11:43:02.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.262+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.67 2023-12-03T11:43:02.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.262+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.68 2023-12-03T11:43:02.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.262+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.69 2023-12-03T11:43:02.268 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.263+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.70 2023-12-03T11:43:02.268 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.263+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.71 2023-12-03T11:43:02.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.265+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.72 2023-12-03T11:43:02.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.265+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.73 2023-12-03T11:43:02.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.265+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.74 2023-12-03T11:43:02.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.265+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.75 2023-12-03T11:43:02.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.266+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.76 2023-12-03T11:43:02.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.266+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.77 2023-12-03T11:43:02.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.266+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.78 2023-12-03T11:43:02.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.266+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.79 2023-12-03T11:43:02.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.266+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.80 2023-12-03T11:43:02.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.266+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.81 2023-12-03T11:43:02.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.266+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.82 2023-12-03T11:43:02.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.268+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.83 2023-12-03T11:43:02.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.269+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.84 2023-12-03T11:43:02.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.269+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.85 2023-12-03T11:43:02.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.269+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.86 2023-12-03T11:43:02.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.269+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.87 2023-12-03T11:43:02.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.272+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.88 2023-12-03T11:43:02.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.272+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.89 2023-12-03T11:43:02.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.272+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.90 2023-12-03T11:43:02.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.272+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.91 2023-12-03T11:43:02.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.273+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.92 2023-12-03T11:43:02.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.273+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.93 2023-12-03T11:43:02.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.273+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.94 2023-12-03T11:43:02.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.273+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.95 2023-12-03T11:43:02.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.273+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.96 2023-12-03T11:43:02.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.273+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.97 2023-12-03T11:43:02.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.273+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.98 2023-12-03T11:43:02.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.275+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.99 2023-12-03T11:43:02.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.275+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.100 2023-12-03T11:43:02.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.275+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.101 2023-12-03T11:43:02.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.275+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.102 2023-12-03T11:43:02.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.278+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.103 2023-12-03T11:43:02.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.278+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.104 2023-12-03T11:43:02.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.279+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.105 2023-12-03T11:43:02.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.279+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.106 2023-12-03T11:43:02.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.279+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.107 2023-12-03T11:43:02.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.279+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.108 2023-12-03T11:43:02.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.279+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.109 2023-12-03T11:43:02.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.279+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.110 2023-12-03T11:43:02.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.279+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.111 2023-12-03T11:43:02.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.279+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.112 2023-12-03T11:43:02.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.279+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.93__multipart_key1.2~zLtj__Vopvxx7xMRoV-9v8HJnIpVA4M.113 2023-12-03T11:43:02.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.285+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:43:02.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.287+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:43:02.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.288+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.289+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.289+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:43:02.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.289+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.1535463287849144224', time=2023-12-03T13:42:48.273074+0000, chain.objs.size()=7 2023-12-03T11:43:02.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.289+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~Q1sSuhytFyMjdSZcS6eVjmvmsRm5ZJK.1 2023-12-03T11:43:02.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.289+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~Q1sSuhytFyMjdSZcS6eVjmvmsRm5ZJK.1_1 2023-12-03T11:43:02.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.289+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~Q1sSuhytFyMjdSZcS6eVjmvmsRm5ZJK.1_2 2023-12-03T11:43:02.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.289+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~Q1sSuhytFyMjdSZcS6eVjmvmsRm5ZJK.2 2023-12-03T11:43:02.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.289+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~Q1sSuhytFyMjdSZcS6eVjmvmsRm5ZJK.2_1 2023-12-03T11:43:02.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.289+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~Q1sSuhytFyMjdSZcS6eVjmvmsRm5ZJK.2_2 2023-12-03T11:43:02.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.289+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~Q1sSuhytFyMjdSZcS6eVjmvmsRm5ZJK.3 2023-12-03T11:43:02.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.292+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:43:02.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.295+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:43:02.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.296+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.297+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.297+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:43:02.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.297+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.8369051652082246270', time=2023-12-03T13:42:49.540395+0000, chain.objs.size()=9 2023-12-03T11:43:02.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.297+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.91__multipart_key1.2~c33oR4NRHh8ROxcebG3ZIorqmr1zvYi.1 2023-12-03T11:43:02.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.297+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.91__shadow_key1.2~c33oR4NRHh8ROxcebG3ZIorqmr1zvYi.1_1 2023-12-03T11:43:02.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.297+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.91__multipart_key1.2~c33oR4NRHh8ROxcebG3ZIorqmr1zvYi.2 2023-12-03T11:43:02.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.297+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.91__shadow_key1.2~c33oR4NRHh8ROxcebG3ZIorqmr1zvYi.2_1 2023-12-03T11:43:02.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.297+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.91__multipart_key1.2~c33oR4NRHh8ROxcebG3ZIorqmr1zvYi.3 2023-12-03T11:43:02.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.297+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.91__shadow_key1.2~c33oR4NRHh8ROxcebG3ZIorqmr1zvYi.3_1 2023-12-03T11:43:02.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.297+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.91__multipart_key1.2~c33oR4NRHh8ROxcebG3ZIorqmr1zvYi.4 2023-12-03T11:43:02.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.297+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.91__shadow_key1.2~c33oR4NRHh8ROxcebG3ZIorqmr1zvYi.4_1 2023-12-03T11:43:02.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.297+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.91__multipart_key1.2~c33oR4NRHh8ROxcebG3ZIorqmr1zvYi.5 2023-12-03T11:43:02.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.301+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:43:02.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.303+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:43:02.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.305+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.305+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.305+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:43:02.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.305+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.11674739378106121427', time=2023-12-03T13:43:01.682696+0000, chain.objs.size()=9 2023-12-03T11:43:02.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.305+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.132__multipart_key1/data/file.mpg.2~WPjmzcxnUs4YrFjYs3vUlBs1cAhi4oi.1 2023-12-03T11:43:02.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.305+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.132__shadow_key1/data/file.mpg.2~WPjmzcxnUs4YrFjYs3vUlBs1cAhi4oi.1_1 2023-12-03T11:43:02.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.305+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.132__multipart_key1/data/file.mpg.2~WPjmzcxnUs4YrFjYs3vUlBs1cAhi4oi.2 2023-12-03T11:43:02.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.305+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.132__shadow_key1/data/file.mpg.2~WPjmzcxnUs4YrFjYs3vUlBs1cAhi4oi.2_1 2023-12-03T11:43:02.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.305+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.132__multipart_key1/data/file.mpg.2~WPjmzcxnUs4YrFjYs3vUlBs1cAhi4oi.3 2023-12-03T11:43:02.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.305+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.132__shadow_key1/data/file.mpg.2~WPjmzcxnUs4YrFjYs3vUlBs1cAhi4oi.3_1 2023-12-03T11:43:02.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.305+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.132__multipart_key1/data/file.mpg.2~WPjmzcxnUs4YrFjYs3vUlBs1cAhi4oi.4 2023-12-03T11:43:02.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.305+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.132__shadow_key1/data/file.mpg.2~WPjmzcxnUs4YrFjYs3vUlBs1cAhi4oi.4_1 2023-12-03T11:43:02.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.305+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.132__multipart_key1/data/file.mpg.2~WPjmzcxnUs4YrFjYs3vUlBs1cAhi4oi.5 2023-12-03T11:43:02.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.309+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:43:02.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.312+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:43:02.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.313+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.313+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.314+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:43:02.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.314+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.11026368650509699244', time=2023-12-03T13:42:42.436953+0000, chain.objs.size()=7 2023-12-03T11:43:02.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.314+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~306H7RadVmT2va57JpPYJowDR8gvhZi.1 2023-12-03T11:43:02.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.314+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~306H7RadVmT2va57JpPYJowDR8gvhZi.1_1 2023-12-03T11:43:02.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.314+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~306H7RadVmT2va57JpPYJowDR8gvhZi.1_2 2023-12-03T11:43:02.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.314+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~306H7RadVmT2va57JpPYJowDR8gvhZi.2 2023-12-03T11:43:02.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.314+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~306H7RadVmT2va57JpPYJowDR8gvhZi.2_1 2023-12-03T11:43:02.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.314+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~306H7RadVmT2va57JpPYJowDR8gvhZi.2_2 2023-12-03T11:43:02.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.314+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~306H7RadVmT2va57JpPYJowDR8gvhZi.3 2023-12-03T11:43:02.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.317+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:43:02.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.319+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:43:02.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.321+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.321+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.321+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:43:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.321+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.9489693186702287869', time=2023-12-03T13:42:41.131459+0000, chain.objs.size()=9 2023-12-03T11:43:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.321+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~2T56RHTt_oF0cIu5qkZhFuHlKvVUHxa.1 2023-12-03T11:43:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.321+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~2T56RHTt_oF0cIu5qkZhFuHlKvVUHxa.1_1 2023-12-03T11:43:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.321+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~2T56RHTt_oF0cIu5qkZhFuHlKvVUHxa.2 2023-12-03T11:43:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.321+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~2T56RHTt_oF0cIu5qkZhFuHlKvVUHxa.2_1 2023-12-03T11:43:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.321+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~2T56RHTt_oF0cIu5qkZhFuHlKvVUHxa.3 2023-12-03T11:43:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.321+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~2T56RHTt_oF0cIu5qkZhFuHlKvVUHxa.3_1 2023-12-03T11:43:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.321+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~2T56RHTt_oF0cIu5qkZhFuHlKvVUHxa.4 2023-12-03T11:43:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.321+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~2T56RHTt_oF0cIu5qkZhFuHlKvVUHxa.4_1 2023-12-03T11:43:02.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.321+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~2T56RHTt_oF0cIu5qkZhFuHlKvVUHxa.5 2023-12-03T11:43:02.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.326+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:43:02.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.328+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:43:02.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.329+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.330+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.330+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:43:02.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.330+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.3437873362585598804', time=2023-12-03T13:42:36.546148+0000, chain.objs.size()=2 2023-12-03T11:43:02.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.330+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.71__shadow_.UHwLMdy0MbizcF-Tg7pJVPVILcs4Fpq_1 2023-12-03T11:43:02.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.330+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.71__shadow_.UHwLMdy0MbizcF-Tg7pJVPVILcs4Fpq_2 2023-12-03T11:43:02.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.332+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:43:02.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.334+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:43:02.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.335+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.336+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.336+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.337+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:43:02.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.338+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.338+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.339+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:43:02.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.339+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='2~VqwM-VDPqJLQP3M7fUvehMQFG44PYds', time=2023-12-03T13:42:35.228576+0000, chain.objs.size()=9 2023-12-03T11:43:02.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.339+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.67__multipart_key1.2~VqwM-VDPqJLQP3M7fUvehMQFG44PYds.1 2023-12-03T11:43:02.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.339+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.67__shadow_key1.2~VqwM-VDPqJLQP3M7fUvehMQFG44PYds.1_1 2023-12-03T11:43:02.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.339+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.67__multipart_key1.2~VqwM-VDPqJLQP3M7fUvehMQFG44PYds.2 2023-12-03T11:43:02.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.339+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.67__shadow_key1.2~VqwM-VDPqJLQP3M7fUvehMQFG44PYds.2_1 2023-12-03T11:43:02.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.339+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.67__multipart_key1.2~VqwM-VDPqJLQP3M7fUvehMQFG44PYds.3 2023-12-03T11:43:02.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.339+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.67__shadow_key1.2~VqwM-VDPqJLQP3M7fUvehMQFG44PYds.3_1 2023-12-03T11:43:02.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.339+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.67__multipart_key1.2~VqwM-VDPqJLQP3M7fUvehMQFG44PYds.4 2023-12-03T11:43:02.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.339+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.67__shadow_key1.2~VqwM-VDPqJLQP3M7fUvehMQFG44PYds.4_1 2023-12-03T11:43:02.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.339+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.67__multipart_key1.2~VqwM-VDPqJLQP3M7fUvehMQFG44PYds.5 2023-12-03T11:43:02.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.339+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.12640292344894316648', time=2023-12-03T13:42:50.117452+0000, chain.objs.size()=9 2023-12-03T11:43:02.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.339+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.92__multipart_key1.2~ApVljD1MODqkzm9ZBurY9NCvkiIvEtu.1 2023-12-03T11:43:02.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.339+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.92__shadow_key1.2~ApVljD1MODqkzm9ZBurY9NCvkiIvEtu.1_1 2023-12-03T11:43:02.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.339+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.92__multipart_key1.2~ApVljD1MODqkzm9ZBurY9NCvkiIvEtu.2 2023-12-03T11:43:02.346 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.343+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.92__shadow_key1.2~ApVljD1MODqkzm9ZBurY9NCvkiIvEtu.2_1 2023-12-03T11:43:02.346 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.343+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.92__multipart_key1.2~ApVljD1MODqkzm9ZBurY9NCvkiIvEtu.3 2023-12-03T11:43:02.346 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.343+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.92__shadow_key1.2~ApVljD1MODqkzm9ZBurY9NCvkiIvEtu.3_1 2023-12-03T11:43:02.346 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.343+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.92__multipart_key1.2~ApVljD1MODqkzm9ZBurY9NCvkiIvEtu.4 2023-12-03T11:43:02.347 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.343+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.92__shadow_key1.2~ApVljD1MODqkzm9ZBurY9NCvkiIvEtu.4_1 2023-12-03T11:43:02.347 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.343+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.92__multipart_key1.2~ApVljD1MODqkzm9ZBurY9NCvkiIvEtu.5 2023-12-03T11:43:02.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.348+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:43:02.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.350+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:43:02.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.352+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.352+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.352+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.353+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:43:02.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.355+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.355+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.355+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.356+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:43:02.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.358+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.358+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.359+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:43:02.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.359+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.578196606179403105', time=2023-12-03T13:42:42.676489+0000, chain.objs.size()=7 2023-12-03T11:43:02.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.359+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~TLu38aOhSFQ5fzhE0n7UfTZQ7Q8d6I-.1 2023-12-03T11:43:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.359+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~TLu38aOhSFQ5fzhE0n7UfTZQ7Q8d6I-.1_1 2023-12-03T11:43:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.359+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~TLu38aOhSFQ5fzhE0n7UfTZQ7Q8d6I-.1_2 2023-12-03T11:43:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.359+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~TLu38aOhSFQ5fzhE0n7UfTZQ7Q8d6I-.2 2023-12-03T11:43:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.359+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~TLu38aOhSFQ5fzhE0n7UfTZQ7Q8d6I-.2_1 2023-12-03T11:43:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.359+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~TLu38aOhSFQ5fzhE0n7UfTZQ7Q8d6I-.2_2 2023-12-03T11:43:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.359+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~TLu38aOhSFQ5fzhE0n7UfTZQ7Q8d6I-.3 2023-12-03T11:43:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.359+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.9879140407439766558', time=2023-12-03T13:42:46.575045+0000, chain.objs.size()=9 2023-12-03T11:43:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.359+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~OGj3pT3CM_HLc2hj2qBAmy9x2urZsPr.1 2023-12-03T11:43:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.359+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~OGj3pT3CM_HLc2hj2qBAmy9x2urZsPr.1_1 2023-12-03T11:43:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.359+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~OGj3pT3CM_HLc2hj2qBAmy9x2urZsPr.2 2023-12-03T11:43:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.359+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~OGj3pT3CM_HLc2hj2qBAmy9x2urZsPr.2_1 2023-12-03T11:43:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.359+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~OGj3pT3CM_HLc2hj2qBAmy9x2urZsPr.3 2023-12-03T11:43:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.363+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~OGj3pT3CM_HLc2hj2qBAmy9x2urZsPr.3_1 2023-12-03T11:43:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.363+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~OGj3pT3CM_HLc2hj2qBAmy9x2urZsPr.4 2023-12-03T11:43:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.363+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~OGj3pT3CM_HLc2hj2qBAmy9x2urZsPr.4_1 2023-12-03T11:43:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.363+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~OGj3pT3CM_HLc2hj2qBAmy9x2urZsPr.5 2023-12-03T11:43:02.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.367+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:43:02.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.369+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:43:02.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.370+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.371+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.371+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:43:02.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.371+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.5222904640289635115', time=2023-12-03T13:42:40.546610+0000, chain.objs.size()=9 2023-12-03T11:43:02.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.371+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~puAmahsKI4zHpttXHZaldbVdsyR5ru8.1 2023-12-03T11:43:02.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.371+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~puAmahsKI4zHpttXHZaldbVdsyR5ru8.1_1 2023-12-03T11:43:02.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.371+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~puAmahsKI4zHpttXHZaldbVdsyR5ru8.2 2023-12-03T11:43:02.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.371+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~puAmahsKI4zHpttXHZaldbVdsyR5ru8.2_1 2023-12-03T11:43:02.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.371+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~puAmahsKI4zHpttXHZaldbVdsyR5ru8.3 2023-12-03T11:43:02.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.371+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~puAmahsKI4zHpttXHZaldbVdsyR5ru8.3_1 2023-12-03T11:43:02.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.371+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~puAmahsKI4zHpttXHZaldbVdsyR5ru8.4 2023-12-03T11:43:02.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.371+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__shadow_key1.2~puAmahsKI4zHpttXHZaldbVdsyR5ru8.4_1 2023-12-03T11:43:02.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.371+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.82__multipart_key1.2~puAmahsKI4zHpttXHZaldbVdsyR5ru8.5 2023-12-03T11:43:02.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.375+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:43:02.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.378+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:43:02.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.379+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.380+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.380+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2023-12-03T11:43:02.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.380+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.1828428555276039780', time=2023-12-03T13:42:38.923036+0000, chain.objs.size()=9 2023-12-03T11:43:02.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.380+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.79__multipart_key1.2~B4zt0u6QLs8xl-7QTNQSw3btzCR3icT.1 2023-12-03T11:43:02.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.380+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.79__shadow_key1.2~B4zt0u6QLs8xl-7QTNQSw3btzCR3icT.1_1 2023-12-03T11:43:02.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.380+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.79__multipart_key1.2~B4zt0u6QLs8xl-7QTNQSw3btzCR3icT.2 2023-12-03T11:43:02.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.380+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.79__shadow_key1.2~B4zt0u6QLs8xl-7QTNQSw3btzCR3icT.2_1 2023-12-03T11:43:02.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.380+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.79__multipart_key1.2~B4zt0u6QLs8xl-7QTNQSw3btzCR3icT.3 2023-12-03T11:43:02.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.380+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.79__shadow_key1.2~B4zt0u6QLs8xl-7QTNQSw3btzCR3icT.3_1 2023-12-03T11:43:02.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.380+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.79__multipart_key1.2~B4zt0u6QLs8xl-7QTNQSw3btzCR3icT.4 2023-12-03T11:43:02.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.380+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.79__shadow_key1.2~B4zt0u6QLs8xl-7QTNQSw3btzCR3icT.4_1 2023-12-03T11:43:02.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.380+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.79__multipart_key1.2~B4zt0u6QLs8xl-7QTNQSw3btzCR3icT.5 2023-12-03T11:43:02.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.380+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.9144266574870816782', time=2023-12-03T13:42:43.683927+0000, chain.objs.size()=9 2023-12-03T11:43:02.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.380+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.86__multipart_key1.2~l_SgF45lNX3xoj07EFtpFBdPJL7us0g.1 2023-12-03T11:43:02.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.380+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.86__shadow_key1.2~l_SgF45lNX3xoj07EFtpFBdPJL7us0g.1_1 2023-12-03T11:43:02.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.380+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.86__multipart_key1.2~l_SgF45lNX3xoj07EFtpFBdPJL7us0g.2 2023-12-03T11:43:02.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.382+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.86__shadow_key1.2~l_SgF45lNX3xoj07EFtpFBdPJL7us0g.2_1 2023-12-03T11:43:02.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.382+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.86__multipart_key1.2~l_SgF45lNX3xoj07EFtpFBdPJL7us0g.3 2023-12-03T11:43:02.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.382+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.86__shadow_key1.2~l_SgF45lNX3xoj07EFtpFBdPJL7us0g.3_1 2023-12-03T11:43:02.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.382+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.86__multipart_key1.2~l_SgF45lNX3xoj07EFtpFBdPJL7us0g.4 2023-12-03T11:43:02.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.383+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.86__shadow_key1.2~l_SgF45lNX3xoj07EFtpFBdPJL7us0g.4_1 2023-12-03T11:43:02.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.383+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.86__multipart_key1.2~l_SgF45lNX3xoj07EFtpFBdPJL7us0g.5 2023-12-03T11:43:02.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.383+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.5169797243996262712', time=2023-12-03T13:42:46.895219+0000, chain.objs.size()=9 2023-12-03T11:43:02.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.383+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~8X5zVXgAbwnbTpE7GhzsQZJsklT82M4.1 2023-12-03T11:43:02.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.383+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~8X5zVXgAbwnbTpE7GhzsQZJsklT82M4.1_1 2023-12-03T11:43:02.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.383+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~8X5zVXgAbwnbTpE7GhzsQZJsklT82M4.2 2023-12-03T11:43:02.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.384+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~8X5zVXgAbwnbTpE7GhzsQZJsklT82M4.2_1 2023-12-03T11:43:02.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.384+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~8X5zVXgAbwnbTpE7GhzsQZJsklT82M4.3 2023-12-03T11:43:02.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.386+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~8X5zVXgAbwnbTpE7GhzsQZJsklT82M4.3_1 2023-12-03T11:43:02.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.386+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~8X5zVXgAbwnbTpE7GhzsQZJsklT82M4.4 2023-12-03T11:43:02.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.386+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~8X5zVXgAbwnbTpE7GhzsQZJsklT82M4.4_1 2023-12-03T11:43:02.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.388+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~8X5zVXgAbwnbTpE7GhzsQZJsklT82M4.5 2023-12-03T11:43:02.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.390+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:43:02.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.393+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:43:02.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.394+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.394+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.395+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:43:02.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.395+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.1185804330584654582', time=2023-12-03T13:42:42.572960+0000, chain.objs.size()=5 2023-12-03T11:43:02.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.395+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.81__shadow_.QypeekSvple6BtxXKsszhvLawXSCh6U_1 2023-12-03T11:43:02.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.395+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.81__shadow_.QypeekSvple6BtxXKsszhvLawXSCh6U_2 2023-12-03T11:43:02.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.395+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.81__shadow_.QypeekSvple6BtxXKsszhvLawXSCh6U_3 2023-12-03T11:43:02.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.395+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.81__shadow_.QypeekSvple6BtxXKsszhvLawXSCh6U_4 2023-12-03T11:43:02.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.395+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.81__shadow_.QypeekSvple6BtxXKsszhvLawXSCh6U_5 2023-12-03T11:43:02.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.395+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.8610847434067158818', time=2023-12-03T13:42:45.235889+0000, chain.objs.size()=9 2023-12-03T11:43:02.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.395+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.88__multipart_file2.mpg.2~_HQiMHEnLmUc6LKQB8E3hHZZiWLxWcD.1 2023-12-03T11:43:02.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.395+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.88__shadow_file2.mpg.2~_HQiMHEnLmUc6LKQB8E3hHZZiWLxWcD.1_1 2023-12-03T11:43:02.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.395+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.88__multipart_file2.mpg.2~_HQiMHEnLmUc6LKQB8E3hHZZiWLxWcD.2 2023-12-03T11:43:02.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.395+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.88__shadow_file2.mpg.2~_HQiMHEnLmUc6LKQB8E3hHZZiWLxWcD.2_1 2023-12-03T11:43:02.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.395+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.88__multipart_file2.mpg.2~_HQiMHEnLmUc6LKQB8E3hHZZiWLxWcD.3 2023-12-03T11:43:02.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.395+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.88__shadow_file2.mpg.2~_HQiMHEnLmUc6LKQB8E3hHZZiWLxWcD.3_1 2023-12-03T11:43:02.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.395+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.88__multipart_file2.mpg.2~_HQiMHEnLmUc6LKQB8E3hHZZiWLxWcD.4 2023-12-03T11:43:02.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.398+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.88__shadow_file2.mpg.2~_HQiMHEnLmUc6LKQB8E3hHZZiWLxWcD.4_1 2023-12-03T11:43:02.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.398+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.88__multipart_file2.mpg.2~_HQiMHEnLmUc6LKQB8E3hHZZiWLxWcD.5 2023-12-03T11:43:02.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.401+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:43:02.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.404+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:43:02.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.405+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.405+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.406+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:43:02.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.406+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.15447287322416954533', time=2023-12-03T13:42:45.225774+0000, chain.objs.size()=9 2023-12-03T11:43:02.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.406+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.88__multipart_file.mpg.2~EdB-5MB8t8gGCpI3c7D_V1Zo0KOt5SL.1 2023-12-03T11:43:02.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.406+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.88__shadow_file.mpg.2~EdB-5MB8t8gGCpI3c7D_V1Zo0KOt5SL.1_1 2023-12-03T11:43:02.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.406+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.88__multipart_file.mpg.2~EdB-5MB8t8gGCpI3c7D_V1Zo0KOt5SL.2 2023-12-03T11:43:02.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.406+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.88__shadow_file.mpg.2~EdB-5MB8t8gGCpI3c7D_V1Zo0KOt5SL.2_1 2023-12-03T11:43:02.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.406+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.88__multipart_file.mpg.2~EdB-5MB8t8gGCpI3c7D_V1Zo0KOt5SL.3 2023-12-03T11:43:02.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.406+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.88__shadow_file.mpg.2~EdB-5MB8t8gGCpI3c7D_V1Zo0KOt5SL.3_1 2023-12-03T11:43:02.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.406+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.88__multipart_file.mpg.2~EdB-5MB8t8gGCpI3c7D_V1Zo0KOt5SL.4 2023-12-03T11:43:02.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.406+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.88__shadow_file.mpg.2~EdB-5MB8t8gGCpI3c7D_V1Zo0KOt5SL.4_1 2023-12-03T11:43:02.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.406+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.88__multipart_file.mpg.2~EdB-5MB8t8gGCpI3c7D_V1Zo0KOt5SL.5 2023-12-03T11:43:02.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.406+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.9509290612259935924', time=2023-12-03T13:42:48.003029+0000, chain.objs.size()=7 2023-12-03T11:43:02.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.406+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~KugXMTfVmmNk0zhn6G0nRqyo7KPGAB_.1 2023-12-03T11:43:02.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.406+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~KugXMTfVmmNk0zhn6G0nRqyo7KPGAB_.1_1 2023-12-03T11:43:02.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.406+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~KugXMTfVmmNk0zhn6G0nRqyo7KPGAB_.1_2 2023-12-03T11:43:02.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.408+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~KugXMTfVmmNk0zhn6G0nRqyo7KPGAB_.2 2023-12-03T11:43:02.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.408+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~KugXMTfVmmNk0zhn6G0nRqyo7KPGAB_.2_1 2023-12-03T11:43:02.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.411+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__shadow_key1.2~KugXMTfVmmNk0zhn6G0nRqyo7KPGAB_.2_2 2023-12-03T11:43:02.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.411+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.90__multipart_key1.2~KugXMTfVmmNk0zhn6G0nRqyo7KPGAB_.3 2023-12-03T11:43:02.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.414+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:43:02.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.416+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:43:02.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.418+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.418+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.418+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.419+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:43:02.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.420+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.421+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.421+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:43:02.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.421+0000 7f0d33d31800 20 garbage collection: RGWGC::process iterating over entry tag='ff414afd-0753-48a7-8bb4-762be6d38c82.4641.5071035328109586379', time=2023-12-03T13:43:01.185329+0000, chain.objs.size()=9 2023-12-03T11:43:02.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.421+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.131__multipart_key1.2~vqLZtXyavuFk536IYhV8jgqjjF6go7R.1 2023-12-03T11:43:02.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.421+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.131__shadow_key1.2~vqLZtXyavuFk536IYhV8jgqjjF6go7R.1_1 2023-12-03T11:43:02.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.421+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.131__multipart_key1.2~vqLZtXyavuFk536IYhV8jgqjjF6go7R.2 2023-12-03T11:43:02.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.421+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.131__shadow_key1.2~vqLZtXyavuFk536IYhV8jgqjjF6go7R.2_1 2023-12-03T11:43:02.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.421+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.131__multipart_key1.2~vqLZtXyavuFk536IYhV8jgqjjF6go7R.3 2023-12-03T11:43:02.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.421+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.131__shadow_key1.2~vqLZtXyavuFk536IYhV8jgqjjF6go7R.3_1 2023-12-03T11:43:02.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.421+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.131__multipart_key1.2~vqLZtXyavuFk536IYhV8jgqjjF6go7R.4 2023-12-03T11:43:02.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.421+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.131__shadow_key1.2~vqLZtXyavuFk536IYhV8jgqjjF6go7R.4_1 2023-12-03T11:43:02.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.421+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ff414afd-0753-48a7-8bb4-762be6d38c82.4647.131__multipart_key1.2~vqLZtXyavuFk536IYhV8jgqjjF6go7R.5 2023-12-03T11:43:02.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.424+0000 7f0d33d31800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:43:02.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.427+0000 7f0d33d31800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:43:02.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.429+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.429+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.429+0000 7f0d33d31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.431+0000 7f0cf5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:02.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.433+0000 7f0d33d31800 20 remove_watcher() i=0 2023-12-03T11:43:02.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.433+0000 7f0d33d31800 2 removed watcher, disabling cache 2023-12-03T11:43:02.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.435+0000 7f0d33d31800 20 remove_watcher() i=1 2023-12-03T11:43:02.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.436+0000 7f0d33d31800 20 remove_watcher() i=2 2023-12-03T11:43:02.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.437+0000 7f0d33d31800 20 remove_watcher() i=3 2023-12-03T11:43:02.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.438+0000 7f0d33d31800 20 remove_watcher() i=4 2023-12-03T11:43:02.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.439+0000 7f0d33d31800 20 remove_watcher() i=5 2023-12-03T11:43:02.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.440+0000 7f0d33d31800 20 remove_watcher() i=6 2023-12-03T11:43:02.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.441+0000 7f0d33d31800 20 remove_watcher() i=7 2023-12-03T11:43:02.447 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2023-12-03T11:43:02.497 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:43:02.497 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:43:02.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.511+0000 7fd1afe9d800 20 rados->read ofs=0 len=0 2023-12-03T11:43:02.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.513+0000 7fd1afe9d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:02.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.513+0000 7fd1afe9d800 20 realm 2023-12-03T11:43:02.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.513+0000 7fd1afe9d800 20 rados->read ofs=0 len=0 2023-12-03T11:43:02.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.513+0000 7fd1afe9d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:02.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.513+0000 7fd1afe9d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:43:02.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.513+0000 7fd1afe9d800 20 rados->read ofs=0 len=0 2023-12-03T11:43:02.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.513+0000 7fd1afe9d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:02.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.513+0000 7fd1afe9d800 20 rados->read ofs=0 len=0 2023-12-03T11:43:02.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.514+0000 7fd1afe9d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:02.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.514+0000 7fd1afe9d800 20 rados->read ofs=0 len=0 2023-12-03T11:43:02.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.515+0000 7fd1afe9d800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:43:02.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.515+0000 7fd1afe9d800 20 searching for the correct realm 2023-12-03T11:43:02.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.724+0000 7fd1ae19e640 0 -- 172.21.15.44:0/2279041526 >> [v2:172.21.15.44:6808/1530174506,v1:172.21.15.44:6809/1530174506] conn(0x55b73b420960 msgr2=0x55b73b422d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:43:02.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.726+0000 7fd1afe9d800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:43:02.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.726+0000 7fd1afe9d800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:43:02.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.726+0000 7fd1afe9d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:43:02.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.726+0000 7fd1afe9d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:43:02.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.726+0000 7fd1afe9d800 20 rados->read ofs=0 len=0 2023-12-03T11:43:02.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.726+0000 7fd1afe9d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:02.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.726+0000 7fd1afe9d800 20 rados->read ofs=0 len=0 2023-12-03T11:43:02.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.727+0000 7fd1afe9d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:02.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.727+0000 7fd1afe9d800 20 rados->read ofs=0 len=0 2023-12-03T11:43:02.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.727+0000 7fd1afe9d800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:43:02.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.727+0000 7fd1afe9d800 20 zone default found 2023-12-03T11:43:02.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.727+0000 7fd1afe9d800 4 Realm: () 2023-12-03T11:43:02.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.727+0000 7fd1afe9d800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:43:02.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.727+0000 7fd1afe9d800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:43:02.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.727+0000 7fd1afe9d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:43:02.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.727+0000 7fd1afe9d800 20 zonegroup default 2023-12-03T11:43:02.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.727+0000 7fd1afe9d800 20 rados->read ofs=0 len=0 2023-12-03T11:43:02.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.728+0000 7fd1afe9d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:02.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.728+0000 7fd1afe9d800 20 rados->read ofs=0 len=0 2023-12-03T11:43:02.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.728+0000 7fd1afe9d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:02.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.728+0000 7fd1afe9d800 20 rados->read ofs=0 len=0 2023-12-03T11:43:02.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.728+0000 7fd1afe9d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:02.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.728+0000 7fd1afe9d800 20 started sync module instance, tier type = 2023-12-03T11:43:02.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.728+0000 7fd1afe9d800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:43:02.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.731+0000 7fd1ad99d640 0 -- 172.21.15.44:0/2279041526 >> [v2:172.21.15.91:6808/776869758,v1:172.21.15.91:6809/776869758] conn(0x7fd1a8057120 msgr2=0x7fd1a8056b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:43:02.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.737+0000 7fd1afe9d800 20 add_watcher() i=0 2023-12-03T11:43:02.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.737+0000 7fd1afe9d800 20 add_watcher() i=1 2023-12-03T11:43:02.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.737+0000 7fd1afe9d800 20 add_watcher() i=2 2023-12-03T11:43:02.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.737+0000 7fd1afe9d800 20 add_watcher() i=3 2023-12-03T11:43:02.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.737+0000 7fd1afe9d800 20 add_watcher() i=4 2023-12-03T11:43:02.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.737+0000 7fd1afe9d800 20 add_watcher() i=5 2023-12-03T11:43:02.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.737+0000 7fd1afe9d800 20 add_watcher() i=6 2023-12-03T11:43:02.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.738+0000 7fd1afe9d800 20 add_watcher() i=7 2023-12-03T11:43:02.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.738+0000 7fd1afe9d800 2 all 8 watchers are set, enabling cache 2023-12-03T11:43:02.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.740+0000 7fd1737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:02.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.740+0000 7fd1afe9d800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:43:02.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.740+0000 7fd1afe9d800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:43:02.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.781+0000 7fd0e27fc640 20 reqs_thread_entry: start 2023-12-03T11:43:02.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.781+0000 7fd1afe9d800 20 init_complete bucket index max shards: 1 2023-12-03T11:43:02.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.781+0000 7fd1afe9d800 20 Filter name: none 2023-12-03T11:43:02.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.781+0000 7fd0d3fff640 20 reqs_thread_entry: start 2023-12-03T11:43:02.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.782+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:43:02.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.783+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.783+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.784+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.785+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:43:02.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.786+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.786+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.787+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.788+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:43:02.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.789+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.789+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.789+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.790+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:43:02.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.792+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.792+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.793+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.794+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:43:02.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.795+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.796+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.796+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.797+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:43:02.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.798+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.799+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.799+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.800+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:43:02.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.802+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.802+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.802+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.803+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:43:02.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.805+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.805+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.806+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.807+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:43:02.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.808+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.808+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.809+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.810+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:43:02.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.811+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.811+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.812+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.813+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:43:02.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.814+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.814+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.814+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.815+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:43:02.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.817+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.817+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.818+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.819+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:43:02.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.820+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.821+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.821+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.822+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:43:02.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.823+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.823+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.824+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.825+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:43:02.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.826+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.827+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.827+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.828+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:43:02.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.829+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.829+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.830+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.831+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:43:02.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.832+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.832+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.833+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.833+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:43:02.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.835+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.835+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.835+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.836+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:43:02.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.838+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.838+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.838+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.839+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:43:02.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.841+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.841+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.841+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.842+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:43:02.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.843+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.844+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.844+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.846+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:43:02.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.847+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.847+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.848+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.848+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:43:02.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.850+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.850+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.850+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.851+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:43:02.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.852+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.853+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.853+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.854+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:43:02.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.855+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.856+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.856+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.857+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:43:02.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.858+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.859+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.859+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.860+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:43:02.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.861+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.862+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.862+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.863+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:43:02.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.864+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.864+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.865+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.866+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:43:02.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.867+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.868+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.868+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.869+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:43:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.870+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.870+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.871+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.871+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:43:02.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.873+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.873+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.873+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.875+0000 7fd1afe9d800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:43:02.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.876+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.876+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:43:02.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.877+0000 7fd1afe9d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:43:02.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.878+0000 7fd1737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:02.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.880+0000 7fd1afe9d800 20 remove_watcher() i=0 2023-12-03T11:43:02.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.880+0000 7fd1afe9d800 2 removed watcher, disabling cache 2023-12-03T11:43:02.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.881+0000 7fd1afe9d800 20 remove_watcher() i=1 2023-12-03T11:43:02.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.882+0000 7fd1afe9d800 20 remove_watcher() i=2 2023-12-03T11:43:02.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.884+0000 7fd1afe9d800 20 remove_watcher() i=3 2023-12-03T11:43:02.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.885+0000 7fd1afe9d800 20 remove_watcher() i=4 2023-12-03T11:43:02.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.886+0000 7fd1afe9d800 20 remove_watcher() i=5 2023-12-03T11:43:02.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.886+0000 7fd1afe9d800 20 remove_watcher() i=6 2023-12-03T11:43:02.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:02.887+0000 7fd1afe9d800 20 remove_watcher() i=7 2023-12-03T11:43:02.894 INFO:teuthology.run_tasks:Running task s3tests... 2023-12-03T11:43:02.914 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2023-12-03T11:43:02.914 INFO:tasks.s3tests:Downloading s3-tests... 2023-12-03T11:43:02.914 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2023-12-03T11:43:02.915 DEBUG:teuthology.orchestra.run.smithi044:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2023-12-03T11:43:02.942 INFO:teuthology.orchestra.run.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2023-12-03T11:43:03.651 INFO:tasks.s3tests:Creating rgw users... 2023-12-03T11:43:03.652 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2023-12-03T11:43:03.652 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --email foo.client.0+test@test.test --caps 'user-policy=*' --access-key UIRPNPIRQZADNCCLGDPH --secret 9YjHgoC9QV97ox6riV0tSRHZFsOq1ay2RpEc4qC/zYzobjqUzbvgvw== --cluster ceph 2023-12-03T11:43:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:43:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:43:03.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.769+0000 7f6f388ba800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.771+0000 7f6f388ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:03.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.771+0000 7f6f388ba800 20 realm 2023-12-03T11:43:03.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.771+0000 7f6f388ba800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.771+0000 7f6f388ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:03.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.771+0000 7f6f388ba800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:43:03.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.771+0000 7f6f388ba800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.771+0000 7f6f388ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:03.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.771+0000 7f6f388ba800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.772+0000 7f6f388ba800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:03.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.772+0000 7f6f388ba800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.773+0000 7f6f388ba800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:43:03.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.773+0000 7f6f388ba800 20 searching for the correct realm 2023-12-03T11:43:03.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.784+0000 7f6f363ba640 0 -- 172.21.15.44:0/637771102 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x5597e1fbd540 msgr2=0x5597e1fbf930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:43:03.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.785+0000 7f6f388ba800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:43:03.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.785+0000 7f6f388ba800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:43:03.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.785+0000 7f6f388ba800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:43:03.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.785+0000 7f6f388ba800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:43:03.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.785+0000 7f6f388ba800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.785+0000 7f6f388ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:03.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.785+0000 7f6f388ba800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.785+0000 7f6f388ba800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:03.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.785+0000 7f6f388ba800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.786+0000 7f6f388ba800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:43:03.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.786+0000 7f6f388ba800 20 zone default found 2023-12-03T11:43:03.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.786+0000 7f6f388ba800 4 Realm: () 2023-12-03T11:43:03.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.786+0000 7f6f388ba800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:43:03.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.786+0000 7f6f388ba800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:43:03.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.786+0000 7f6f388ba800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:43:03.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.786+0000 7f6f388ba800 20 zonegroup default 2023-12-03T11:43:03.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.786+0000 7f6f388ba800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.786+0000 7f6f388ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:03.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.786+0000 7f6f388ba800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.786+0000 7f6f388ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:03.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.786+0000 7f6f388ba800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.787+0000 7f6f388ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:03.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.787+0000 7f6f388ba800 20 started sync module instance, tier type = 2023-12-03T11:43:03.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.787+0000 7f6f388ba800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:43:03.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.795+0000 7f6f36bbb640 0 -- 172.21.15.44:0/637771102 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x5597e1fc5500 msgr2=0x5597e1fc79c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:43:03.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.797+0000 7f6f388ba800 20 add_watcher() i=0 2023-12-03T11:43:03.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.797+0000 7f6f388ba800 20 add_watcher() i=1 2023-12-03T11:43:03.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.797+0000 7f6f388ba800 20 add_watcher() i=2 2023-12-03T11:43:03.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.797+0000 7f6f388ba800 20 add_watcher() i=3 2023-12-03T11:43:03.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.797+0000 7f6f388ba800 20 add_watcher() i=4 2023-12-03T11:43:03.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.797+0000 7f6f388ba800 20 add_watcher() i=5 2023-12-03T11:43:03.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.797+0000 7f6f388ba800 20 add_watcher() i=6 2023-12-03T11:43:03.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.797+0000 7f6f388ba800 20 add_watcher() i=7 2023-12-03T11:43:03.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.797+0000 7f6f388ba800 2 all 8 watchers are set, enabling cache 2023-12-03T11:43:03.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.799+0000 7f6efbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:03.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.799+0000 7f6f388ba800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:43:03.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.799+0000 7f6f388ba800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:43:03.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.804+0000 7f6f388ba800 5 note: GC not initialized 2023-12-03T11:43:03.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.804+0000 7f6e6affd640 20 reqs_thread_entry: start 2023-12-03T11:43:03.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.805+0000 7f6f388ba800 20 init_complete bucket index max shards: 1 2023-12-03T11:43:03.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.805+0000 7f6f388ba800 20 Filter name: none 2023-12-03T11:43:03.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.805+0000 7f6e68ff9640 20 reqs_thread_entry: start 2023-12-03T11:43:03.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.805+0000 7f6f388ba800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2023-12-03T11:43:03.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.805+0000 7f6f388ba800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.805+0000 7f6f388ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:03.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.805+0000 7f6f388ba800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2023-12-03T11:43:03.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.805+0000 7f6f388ba800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-12-03T11:43:03.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.805+0000 7f6f388ba800 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2023-12-03T11:43:03.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.805+0000 7f6f388ba800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.805+0000 7f6f388ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:03.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.805+0000 7f6f388ba800 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2023-12-03T11:43:03.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.805+0000 7f6f388ba800 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2023-12-03T11:43:03.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.805+0000 7f6f388ba800 10 cache get: name=default.rgw.meta+users.keys+UIRPNPIRQZADNCCLGDPH : miss 2023-12-03T11:43:03.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.805+0000 7f6f388ba800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.806+0000 7f6f388ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:03.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.806+0000 7f6f388ba800 10 cache put: name=default.rgw.meta+users.keys+UIRPNPIRQZADNCCLGDPH info.flags=0x0 2023-12-03T11:43:03.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.806+0000 7f6f388ba800 10 adding default.rgw.meta+users.keys+UIRPNPIRQZADNCCLGDPH to cache LRU end 2023-12-03T11:43:03.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.806+0000 7f6f388ba800 10 cache get: name=default.rgw.meta+users.keys+UIRPNPIRQZADNCCLGDPH : hit (negative entry) 2023-12-03T11:43:03.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.806+0000 7f6f388ba800 10 cache get: name=default.rgw.meta+users.keys+UIRPNPIRQZADNCCLGDPH : hit (negative entry) 2023-12-03T11:43:03.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.807+0000 7f6f388ba800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2023-12-03T11:43:03.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.807+0000 7f6f388ba800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-12-03T11:43:03.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.807+0000 7f6f388ba800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2023-12-03T11:43:03.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.807+0000 7f6f24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693374 cookie 140115456872448 notifier 7553 bl.length()=640 2023-12-03T11:43:03.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.807+0000 7f6f24ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2023-12-03T11:43:03.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.807+0000 7f6f24ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-12-03T11:43:03.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.809+0000 7f6f388ba800 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2023-12-03T11:43:03.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.809+0000 7f6f388ba800 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2023-12-03T11:43:03.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.809+0000 7f6f388ba800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.email:foo.client.0+test@test.test, ofs0, ns] 2023-12-03T11:43:03.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.809+0000 7f6f24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693427 cookie 94110819859472 notifier 7553 bl.length()=194 2023-12-03T11:43:03.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.809+0000 7f6f24ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2023-12-03T11:43:03.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.809+0000 7f6f24ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2023-12-03T11:43:03.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.811+0000 7f6f388ba800 10 cache put: name=default.rgw.meta+users.keys+UIRPNPIRQZADNCCLGDPH info.flags=0x7 2023-12-03T11:43:03.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.811+0000 7f6f388ba800 10 moving default.rgw.meta+users.keys+UIRPNPIRQZADNCCLGDPH to cache LRU end 2023-12-03T11:43:03.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.811+0000 7f6f388ba800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:UIRPNPIRQZADNCCLGDPH, ofs0, ns] 2023-12-03T11:43:03.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.811+0000 7f6f17fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693428 cookie 94110819848784 notifier 7553 bl.length()=186 2023-12-03T11:43:03.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.811+0000 7f6f17fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+UIRPNPIRQZADNCCLGDPH info.flags=0x7 2023-12-03T11:43:03.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.811+0000 7f6f17fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+UIRPNPIRQZADNCCLGDPH to cache LRU end 2023-12-03T11:43:03.813 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-12-03T11:43:03.813 INFO:teuthology.orchestra.run.smithi044.stdout: "user_id": "foo.client.0", 2023-12-03T11:43:03.813 INFO:teuthology.orchestra.run.smithi044.stdout: "display_name": "Mr. foo.client.0", 2023-12-03T11:43:03.813 INFO:teuthology.orchestra.run.smithi044.stdout: "email": "foo.client.0+test@test.test", 2023-12-03T11:43:03.813 INFO:teuthology.orchestra.run.smithi044.stdout: "suspended": 0, 2023-12-03T11:43:03.813 INFO:teuthology.orchestra.run.smithi044.stdout: "max_buckets": 1000, 2023-12-03T11:43:03.813 INFO:teuthology.orchestra.run.smithi044.stdout: "subusers": [], 2023-12-03T11:43:03.813 INFO:teuthology.orchestra.run.smithi044.stdout: "keys": [ 2023-12-03T11:43:03.813 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-12-03T11:43:03.813 INFO:teuthology.orchestra.run.smithi044.stdout: "user": "foo.client.0", 2023-12-03T11:43:03.813 INFO:teuthology.orchestra.run.smithi044.stdout: "access_key": "UIRPNPIRQZADNCCLGDPH", 2023-12-03T11:43:03.813 INFO:teuthology.orchestra.run.smithi044.stdout: "secret_key": "9YjHgoC9QV97ox6riV0tSRHZFsOq1ay2RpEc4qC/zYzobjqUzbvgvw==" 2023-12-03T11:43:03.813 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-12-03T11:43:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2023-12-03T11:43:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "swift_keys": [], 2023-12-03T11:43:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": [ 2023-12-03T11:43:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-12-03T11:43:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "user-policy", 2023-12-03T11:43:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "perm": "*" 2023-12-03T11:43:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-12-03T11:43:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2023-12-03T11:43:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "op_mask": "read, write, delete", 2023-12-03T11:43:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "default_placement": "", 2023-12-03T11:43:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "default_storage_class": "", 2023-12-03T11:43:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "placement_tags": [], 2023-12-03T11:43:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "bucket_quota": { 2023-12-03T11:43:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2023-12-03T11:43:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2023-12-03T11:43:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2023-12-03T11:43:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2023-12-03T11:43:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2023-12-03T11:43:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-12-03T11:43:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "user_quota": { 2023-12-03T11:43:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2023-12-03T11:43:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2023-12-03T11:43:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2023-12-03T11:43:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2023-12-03T11:43:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2023-12-03T11:43:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-12-03T11:43:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "temp_url_keys": [], 2023-12-03T11:43:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "rgw", 2023-12-03T11:43:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "mfa_ids": [] 2023-12-03T11:43:03.815 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-12-03T11:43:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:43:03.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.812+0000 7f6efbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:03.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.814+0000 7f6f388ba800 20 remove_watcher() i=0 2023-12-03T11:43:03.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.814+0000 7f6f388ba800 2 removed watcher, disabling cache 2023-12-03T11:43:03.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.815+0000 7f6f388ba800 20 remove_watcher() i=1 2023-12-03T11:43:03.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.816+0000 7f6f388ba800 20 remove_watcher() i=2 2023-12-03T11:43:03.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.817+0000 7f6f388ba800 20 remove_watcher() i=3 2023-12-03T11:43:03.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.818+0000 7f6f388ba800 20 remove_watcher() i=4 2023-12-03T11:43:03.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.819+0000 7f6f388ba800 20 remove_watcher() i=5 2023-12-03T11:43:03.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.820+0000 7f6f388ba800 20 remove_watcher() i=6 2023-12-03T11:43:03.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.821+0000 7f6f388ba800 20 remove_watcher() i=7 2023-12-03T11:43:03.827 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 3413913170 --totp-seed ZJGPPEHPGCVP2QHMUX6HDPEXIY4FZ6JNQIC2EYQAKEKSE4CTJNISWTY4JTZHGOFQ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2023-12-03T11:43:03.892 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:43:03.892 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:43:03.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.902+0000 7f3d0ed32800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.904+0000 7f3d0ed32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:03.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.904+0000 7f3d0ed32800 20 realm 2023-12-03T11:43:03.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.904+0000 7f3d0ed32800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.904+0000 7f3d0ed32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:03.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.904+0000 7f3d0ed32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:43:03.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.904+0000 7f3d0ed32800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.904+0000 7f3d0ed32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:03.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.904+0000 7f3d0ed32800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.905+0000 7f3d0ed32800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:03.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.905+0000 7f3d0ed32800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.906+0000 7f3d0ed32800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:43:03.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.906+0000 7f3d0ed32800 20 searching for the correct realm 2023-12-03T11:43:03.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.916+0000 7f3d0b163640 0 -- 172.21.15.44:0/847127585 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x562599319b10 msgr2=0x56259931bfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:43:03.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.916+0000 7f3d0ed32800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:43:03.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.916+0000 7f3d0ed32800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:43:03.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.916+0000 7f3d0ed32800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:43:03.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.916+0000 7f3d0ed32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:43:03.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.916+0000 7f3d0ed32800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.916+0000 7f3d0ed32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:03.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.916+0000 7f3d0ed32800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.917+0000 7f3d0ed32800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:03.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.917+0000 7f3d0ed32800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.917+0000 7f3d0ed32800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:43:03.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.917+0000 7f3d0ed32800 20 zone default found 2023-12-03T11:43:03.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.917+0000 7f3d0ed32800 4 Realm: () 2023-12-03T11:43:03.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.917+0000 7f3d0ed32800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:43:03.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.917+0000 7f3d0ed32800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:43:03.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.917+0000 7f3d0ed32800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:43:03.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.917+0000 7f3d0ed32800 20 zonegroup default 2023-12-03T11:43:03.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.917+0000 7f3d0ed32800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.918+0000 7f3d0ed32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:03.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.918+0000 7f3d0ed32800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.918+0000 7f3d0ed32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:03.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.918+0000 7f3d0ed32800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.918+0000 7f3d0ed32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:03.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.918+0000 7f3d0ed32800 20 started sync module instance, tier type = 2023-12-03T11:43:03.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.918+0000 7f3d0ed32800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:43:03.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.925+0000 7f3d0b163640 0 -- 172.21.15.44:0/847127585 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x7f3ce4079e10 msgr2=0x7f3ce407c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:43:03.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.927+0000 7f3d0ed32800 20 add_watcher() i=0 2023-12-03T11:43:03.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.927+0000 7f3d0ed32800 20 add_watcher() i=1 2023-12-03T11:43:03.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.927+0000 7f3d0ed32800 20 add_watcher() i=2 2023-12-03T11:43:03.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.927+0000 7f3d0ed32800 20 add_watcher() i=3 2023-12-03T11:43:03.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.927+0000 7f3d0ed32800 20 add_watcher() i=4 2023-12-03T11:43:03.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.927+0000 7f3d0ed32800 20 add_watcher() i=5 2023-12-03T11:43:03.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.927+0000 7f3d0ed32800 20 add_watcher() i=6 2023-12-03T11:43:03.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.928+0000 7f3d0ed32800 20 add_watcher() i=7 2023-12-03T11:43:03.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.928+0000 7f3d0ed32800 2 all 8 watchers are set, enabling cache 2023-12-03T11:43:03.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.930+0000 7f3c4bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:03.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.930+0000 7f3d0ed32800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:43:03.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.930+0000 7f3d0ed32800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:43:03.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.935+0000 7f3d0ed32800 5 note: GC not initialized 2023-12-03T11:43:03.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.935+0000 7f3c3affd640 20 reqs_thread_entry: start 2023-12-03T11:43:03.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.935+0000 7f3d0ed32800 20 init_complete bucket index max shards: 1 2023-12-03T11:43:03.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.935+0000 7f3d0ed32800 20 Filter name: none 2023-12-03T11:43:03.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.935+0000 7f3c38ff9640 20 reqs_thread_entry: start 2023-12-03T11:43:03.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.935+0000 7f3d0ed32800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2023-12-03T11:43:03.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.935+0000 7f3d0ed32800 20 rados->read ofs=0 len=0 2023-12-03T11:43:03.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.936+0000 7f3d0ed32800 20 rados_obj.operate() r=0 bl.length=455 2023-12-03T11:43:03.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.936+0000 7f3d0ed32800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2023-12-03T11:43:03.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.936+0000 7f3d0ed32800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-12-03T11:43:03.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:03.936+0000 7f3d0ed32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:43:05.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.153+0000 7f3d0ed32800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2023-12-03T11:43:05.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.153+0000 7f3d0ed32800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-12-03T11:43:05.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.153+0000 7f3d0ed32800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2023-12-03T11:43:05.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.154+0000 7f3d00ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627967 cookie 139899768520704 notifier 8022 bl.length()=654 2023-12-03T11:43:05.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.154+0000 7f3d00ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2023-12-03T11:43:05.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.154+0000 7f3d00ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-12-03T11:43:05.156 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.155+0000 7f3c4bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:05.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.158+0000 7f3d0ed32800 20 remove_watcher() i=0 2023-12-03T11:43:05.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.158+0000 7f3d0ed32800 2 removed watcher, disabling cache 2023-12-03T11:43:05.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.159+0000 7f3d0ed32800 20 remove_watcher() i=1 2023-12-03T11:43:05.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.160+0000 7f3d0ed32800 20 remove_watcher() i=2 2023-12-03T11:43:05.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.161+0000 7f3d0ed32800 20 remove_watcher() i=3 2023-12-03T11:43:05.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.163+0000 7f3d0ed32800 20 remove_watcher() i=4 2023-12-03T11:43:05.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.164+0000 7f3d0ed32800 20 remove_watcher() i=5 2023-12-03T11:43:05.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.165+0000 7f3d0ed32800 20 remove_watcher() i=6 2023-12-03T11:43:05.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.166+0000 7f3d0ed32800 20 remove_watcher() i=7 2023-12-03T11:43:05.173 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2023-12-03T11:43:05.174 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name 'Mr. bar.client.0' --email bar.client.0+test@test.test --caps 'user-policy=*' --access-key DXUCHBBRNOLDQEOPLFXC --secret HT14yUyOoVcLhVyTSO0+Bma0K9p7mz9MN4DFLEWSdS6ILr0QPxRrew== --cluster ceph 2023-12-03T11:43:05.243 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:43:05.243 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:43:05.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.255+0000 7f69a0d40800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.257+0000 7f69a0d40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.257+0000 7f69a0d40800 20 realm 2023-12-03T11:43:05.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.257+0000 7f69a0d40800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.257+0000 7f69a0d40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.257+0000 7f69a0d40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:43:05.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.257+0000 7f69a0d40800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.257+0000 7f69a0d40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.257+0000 7f69a0d40800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.258+0000 7f69a0d40800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:05.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.258+0000 7f69a0d40800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.259+0000 7f69a0d40800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:43:05.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.259+0000 7f69a0d40800 20 searching for the correct realm 2023-12-03T11:43:05.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.267+0000 7f699ca4c640 0 -- 172.21.15.44:0/2791289379 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x556ef5d5fb80 msgr2=0x556ef5d61fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:43:05.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.270+0000 7f69a0d40800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:43:05.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.270+0000 7f69a0d40800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:43:05.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.270+0000 7f69a0d40800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:43:05.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.270+0000 7f69a0d40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:43:05.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.270+0000 7f69a0d40800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.271+0000 7f69a0d40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.271+0000 7f69a0d40800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.271+0000 7f69a0d40800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:05.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.271+0000 7f69a0d40800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.271+0000 7f69a0d40800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:43:05.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.271+0000 7f69a0d40800 20 zone default found 2023-12-03T11:43:05.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.271+0000 7f69a0d40800 4 Realm: () 2023-12-03T11:43:05.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.271+0000 7f69a0d40800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:43:05.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.271+0000 7f69a0d40800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:43:05.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.271+0000 7f69a0d40800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:43:05.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.271+0000 7f69a0d40800 20 zonegroup default 2023-12-03T11:43:05.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.271+0000 7f69a0d40800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.271+0000 7f69a0d40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.271+0000 7f69a0d40800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.272+0000 7f69a0d40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.272+0000 7f69a0d40800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.272+0000 7f69a0d40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.272+0000 7f69a0d40800 20 started sync module instance, tier type = 2023-12-03T11:43:05.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.272+0000 7f69a0d40800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:43:05.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.275+0000 7f699ca4c640 0 -- 172.21.15.44:0/2791289379 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x7f697807ab70 msgr2=0x7f697807cfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:43:05.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.281+0000 7f69a0d40800 20 add_watcher() i=0 2023-12-03T11:43:05.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.281+0000 7f69a0d40800 20 add_watcher() i=1 2023-12-03T11:43:05.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.281+0000 7f69a0d40800 20 add_watcher() i=2 2023-12-03T11:43:05.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.281+0000 7f69a0d40800 20 add_watcher() i=3 2023-12-03T11:43:05.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.281+0000 7f69a0d40800 20 add_watcher() i=4 2023-12-03T11:43:05.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.281+0000 7f69a0d40800 20 add_watcher() i=5 2023-12-03T11:43:05.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.281+0000 7f69a0d40800 20 add_watcher() i=6 2023-12-03T11:43:05.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.282+0000 7f69a0d40800 20 add_watcher() i=7 2023-12-03T11:43:05.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.282+0000 7f69a0d40800 2 all 8 watchers are set, enabling cache 2023-12-03T11:43:05.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.284+0000 7f6962fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:05.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.284+0000 7f69a0d40800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:43:05.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.284+0000 7f69a0d40800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:43:05.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.289+0000 7f69a0d40800 5 note: GC not initialized 2023-12-03T11:43:05.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.289+0000 7f68d1ffb640 20 reqs_thread_entry: start 2023-12-03T11:43:05.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.289+0000 7f69a0d40800 20 init_complete bucket index max shards: 1 2023-12-03T11:43:05.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.290+0000 7f69a0d40800 20 Filter name: none 2023-12-03T11:43:05.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.290+0000 7f68c37fe640 20 reqs_thread_entry: start 2023-12-03T11:43:05.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.290+0000 7f69a0d40800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2023-12-03T11:43:05.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.290+0000 7f69a0d40800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.290+0000 7f69a0d40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.290+0000 7f69a0d40800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2023-12-03T11:43:05.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.290+0000 7f69a0d40800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-12-03T11:43:05.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.290+0000 7f69a0d40800 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2023-12-03T11:43:05.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.290+0000 7f69a0d40800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.291+0000 7f69a0d40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.291+0000 7f69a0d40800 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2023-12-03T11:43:05.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.291+0000 7f69a0d40800 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2023-12-03T11:43:05.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.291+0000 7f69a0d40800 10 cache get: name=default.rgw.meta+users.keys+DXUCHBBRNOLDQEOPLFXC : miss 2023-12-03T11:43:05.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.291+0000 7f69a0d40800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.291+0000 7f69a0d40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.291+0000 7f69a0d40800 10 cache put: name=default.rgw.meta+users.keys+DXUCHBBRNOLDQEOPLFXC info.flags=0x0 2023-12-03T11:43:05.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.291+0000 7f69a0d40800 10 adding default.rgw.meta+users.keys+DXUCHBBRNOLDQEOPLFXC to cache LRU end 2023-12-03T11:43:05.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.291+0000 7f69a0d40800 10 cache get: name=default.rgw.meta+users.keys+DXUCHBBRNOLDQEOPLFXC : hit (negative entry) 2023-12-03T11:43:05.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.291+0000 7f69a0d40800 10 cache get: name=default.rgw.meta+users.keys+DXUCHBBRNOLDQEOPLFXC : hit (negative entry) 2023-12-03T11:43:05.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.292+0000 7f69a0d40800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2023-12-03T11:43:05.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.292+0000 7f69a0d40800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-12-03T11:43:05.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.292+0000 7f69a0d40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2023-12-03T11:43:05.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.292+0000 7f69837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627913 cookie 93935056760656 notifier 8043 bl.length()=640 2023-12-03T11:43:05.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.292+0000 7f69837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2023-12-03T11:43:05.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.292+0000 7f69837fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-12-03T11:43:05.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.294+0000 7f69a0d40800 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2023-12-03T11:43:05.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.294+0000 7f69a0d40800 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2023-12-03T11:43:05.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.294+0000 7f69a0d40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:bar.client.0+test@test.test, ofs0, ns] 2023-12-03T11:43:05.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.294+0000 7f69837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627914 cookie 93935056760656 notifier 8043 bl.length()=194 2023-12-03T11:43:05.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.294+0000 7f69837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2023-12-03T11:43:05.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.294+0000 7f69837fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2023-12-03T11:43:05.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.296+0000 7f69a0d40800 10 cache put: name=default.rgw.meta+users.keys+DXUCHBBRNOLDQEOPLFXC info.flags=0x7 2023-12-03T11:43:05.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.296+0000 7f69a0d40800 10 moving default.rgw.meta+users.keys+DXUCHBBRNOLDQEOPLFXC to cache LRU end 2023-12-03T11:43:05.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.296+0000 7f69a0d40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:DXUCHBBRNOLDQEOPLFXC, ofs0, ns] 2023-12-03T11:43:05.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.297+0000 7f69837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627915 cookie 93935056760656 notifier 8043 bl.length()=186 2023-12-03T11:43:05.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.297+0000 7f69837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+DXUCHBBRNOLDQEOPLFXC info.flags=0x7 2023-12-03T11:43:05.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.297+0000 7f69837fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+DXUCHBBRNOLDQEOPLFXC to cache LRU end 2023-12-03T11:43:05.298 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-12-03T11:43:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: "user_id": "bar.client.0", 2023-12-03T11:43:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: "display_name": "Mr. bar.client.0", 2023-12-03T11:43:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: "email": "bar.client.0+test@test.test", 2023-12-03T11:43:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: "suspended": 0, 2023-12-03T11:43:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: "max_buckets": 1000, 2023-12-03T11:43:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: "subusers": [], 2023-12-03T11:43:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: "keys": [ 2023-12-03T11:43:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-12-03T11:43:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: "user": "bar.client.0", 2023-12-03T11:43:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: "access_key": "DXUCHBBRNOLDQEOPLFXC", 2023-12-03T11:43:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: "secret_key": "HT14yUyOoVcLhVyTSO0+Bma0K9p7mz9MN4DFLEWSdS6ILr0QPxRrew==" 2023-12-03T11:43:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-12-03T11:43:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2023-12-03T11:43:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: "swift_keys": [], 2023-12-03T11:43:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": [ 2023-12-03T11:43:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-12-03T11:43:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "user-policy", 2023-12-03T11:43:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: "perm": "*" 2023-12-03T11:43:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-12-03T11:43:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2023-12-03T11:43:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: "op_mask": "read, write, delete", 2023-12-03T11:43:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: "default_placement": "", 2023-12-03T11:43:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: "default_storage_class": "", 2023-12-03T11:43:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: "placement_tags": [], 2023-12-03T11:43:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: "bucket_quota": { 2023-12-03T11:43:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2023-12-03T11:43:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2023-12-03T11:43:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2023-12-03T11:43:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2023-12-03T11:43:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2023-12-03T11:43:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-12-03T11:43:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: "user_quota": { 2023-12-03T11:43:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2023-12-03T11:43:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2023-12-03T11:43:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2023-12-03T11:43:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2023-12-03T11:43:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2023-12-03T11:43:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-12-03T11:43:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: "temp_url_keys": [], 2023-12-03T11:43:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "rgw", 2023-12-03T11:43:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: "mfa_ids": [] 2023-12-03T11:43:05.301 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-12-03T11:43:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:43:05.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.298+0000 7f6962fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:05.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.300+0000 7f69a0d40800 20 remove_watcher() i=0 2023-12-03T11:43:05.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.300+0000 7f69a0d40800 2 removed watcher, disabling cache 2023-12-03T11:43:05.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.302+0000 7f69a0d40800 20 remove_watcher() i=1 2023-12-03T11:43:05.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.303+0000 7f69a0d40800 20 remove_watcher() i=2 2023-12-03T11:43:05.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.304+0000 7f69a0d40800 20 remove_watcher() i=3 2023-12-03T11:43:05.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.305+0000 7f69a0d40800 20 remove_watcher() i=4 2023-12-03T11:43:05.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.306+0000 7f69a0d40800 20 remove_watcher() i=5 2023-12-03T11:43:05.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.307+0000 7f69a0d40800 20 remove_watcher() i=6 2023-12-03T11:43:05.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.308+0000 7f69a0d40800 20 remove_watcher() i=7 2023-12-03T11:43:05.315 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 7515201561 --totp-seed FXYUGBXPSFOPZZ7BWD46NFTTDOS5XY55X6XO2B5YALQSXZ66XD24IGBBN7SBQWMI --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2023-12-03T11:43:05.380 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:43:05.380 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:43:05.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.390+0000 7fcaca52c800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.392+0000 7fcaca52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.392+0000 7fcaca52c800 20 realm 2023-12-03T11:43:05.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.392+0000 7fcaca52c800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.392+0000 7fcaca52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.392+0000 7fcaca52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:43:05.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.392+0000 7fcaca52c800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.392+0000 7fcaca52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.392+0000 7fcaca52c800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.393+0000 7fcaca52c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:05.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.393+0000 7fcaca52c800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.394+0000 7fcaca52c800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:43:05.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.394+0000 7fcaca52c800 20 searching for the correct realm 2023-12-03T11:43:05.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.404+0000 7fcac62f0640 0 -- 172.21.15.44:0/3151118940 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55756b2c4690 msgr2=0x55756b2c6a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:43:05.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.404+0000 7fcaca52c800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:43:05.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.404+0000 7fcaca52c800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:43:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.404+0000 7fcaca52c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:43:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.404+0000 7fcaca52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:43:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.404+0000 7fcaca52c800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.405+0000 7fcaca52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.405+0000 7fcaca52c800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.405+0000 7fcaca52c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.405+0000 7fcaca52c800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.405+0000 7fcaca52c800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:43:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.405+0000 7fcaca52c800 20 zone default found 2023-12-03T11:43:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.405+0000 7fcaca52c800 4 Realm: () 2023-12-03T11:43:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.405+0000 7fcaca52c800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:43:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.405+0000 7fcaca52c800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:43:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.405+0000 7fcaca52c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:43:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.405+0000 7fcaca52c800 20 zonegroup default 2023-12-03T11:43:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.405+0000 7fcaca52c800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.405+0000 7fcaca52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.405+0000 7fcaca52c800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.406+0000 7fcaca52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.406+0000 7fcaca52c800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.406+0000 7fcaca52c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.406+0000 7fcaca52c800 20 started sync module instance, tier type = 2023-12-03T11:43:05.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.406+0000 7fcaca52c800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:43:05.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.414+0000 7fcac6af1640 0 -- 172.21.15.44:0/3151118940 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x55756b2cc660 msgr2=0x55756b2ceb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:43:05.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.415+0000 7fcaca52c800 20 add_watcher() i=0 2023-12-03T11:43:05.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.415+0000 7fcaca52c800 20 add_watcher() i=1 2023-12-03T11:43:05.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.415+0000 7fcaca52c800 20 add_watcher() i=2 2023-12-03T11:43:05.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.415+0000 7fcaca52c800 20 add_watcher() i=3 2023-12-03T11:43:05.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.415+0000 7fcaca52c800 20 add_watcher() i=4 2023-12-03T11:43:05.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.415+0000 7fcaca52c800 20 add_watcher() i=5 2023-12-03T11:43:05.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.416+0000 7fcaca52c800 20 add_watcher() i=6 2023-12-03T11:43:05.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.416+0000 7fcaca52c800 20 add_watcher() i=7 2023-12-03T11:43:05.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.416+0000 7fcaca52c800 2 all 8 watchers are set, enabling cache 2023-12-03T11:43:05.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.418+0000 7fca8bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:05.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.418+0000 7fcaca52c800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:43:05.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.418+0000 7fcaca52c800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:43:05.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.423+0000 7fcaca52c800 5 note: GC not initialized 2023-12-03T11:43:05.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.423+0000 7fc9faffd640 20 reqs_thread_entry: start 2023-12-03T11:43:05.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.423+0000 7fcaca52c800 20 init_complete bucket index max shards: 1 2023-12-03T11:43:05.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.423+0000 7fcaca52c800 20 Filter name: none 2023-12-03T11:43:05.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.424+0000 7fc9f8ff9640 20 reqs_thread_entry: start 2023-12-03T11:43:05.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.424+0000 7fcaca52c800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2023-12-03T11:43:05.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.424+0000 7fcaca52c800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.425+0000 7fcaca52c800 20 rados_obj.operate() r=0 bl.length=455 2023-12-03T11:43:05.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.425+0000 7fcaca52c800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2023-12-03T11:43:05.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.425+0000 7fcaca52c800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-12-03T11:43:05.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.425+0000 7fcaca52c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:43:05.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.427+0000 7fcaca52c800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2023-12-03T11:43:05.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.427+0000 7fcaca52c800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-12-03T11:43:05.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.427+0000 7fcaca52c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2023-12-03T11:43:05.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.428+0000 7fcab4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627916 cookie 93962795155280 notifier 7607 bl.length()=654 2023-12-03T11:43:05.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.428+0000 7fcab4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2023-12-03T11:43:05.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.428+0000 7fcab4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-12-03T11:43:05.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.429+0000 7fca8bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:05.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.431+0000 7fcaca52c800 20 remove_watcher() i=0 2023-12-03T11:43:05.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.431+0000 7fcaca52c800 2 removed watcher, disabling cache 2023-12-03T11:43:05.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.432+0000 7fcaca52c800 20 remove_watcher() i=1 2023-12-03T11:43:05.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.433+0000 7fcaca52c800 20 remove_watcher() i=2 2023-12-03T11:43:05.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.434+0000 7fcaca52c800 20 remove_watcher() i=3 2023-12-03T11:43:05.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.435+0000 7fcaca52c800 20 remove_watcher() i=4 2023-12-03T11:43:05.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.437+0000 7fcaca52c800 20 remove_watcher() i=5 2023-12-03T11:43:05.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.438+0000 7fcaca52c800 20 remove_watcher() i=6 2023-12-03T11:43:05.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.439+0000 7fcaca52c800 20 remove_watcher() i=7 2023-12-03T11:43:05.445 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2023-12-03T11:43:05.446 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr. testx$tenanteduser.client.0' --email 'testx$tenanteduser.client.0+test@test.test' --caps 'user-policy=*' --access-key BHIVORVVLSBCEHDVLEKB --secret LAVEv6ygplsllwEgB8L+mhwOANl47rgLEKAzEgtLFkxKCkC2Q9UCTg== --cluster ceph 2023-12-03T11:43:05.512 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:43:05.512 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:43:05.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.522+0000 7faf6ab37800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.524+0000 7faf6ab37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.524+0000 7faf6ab37800 20 realm 2023-12-03T11:43:05.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.524+0000 7faf6ab37800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.524+0000 7faf6ab37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.524+0000 7faf6ab37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:43:05.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.524+0000 7faf6ab37800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.524+0000 7faf6ab37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.524+0000 7faf6ab37800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.525+0000 7faf6ab37800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:05.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.525+0000 7faf6ab37800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.526+0000 7faf6ab37800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:43:05.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.526+0000 7faf6ab37800 20 searching for the correct realm 2023-12-03T11:43:05.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.536+0000 7faf668cd640 0 -- 172.21.15.44:0/1951574619 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x562c3853d1d0 msgr2=0x562c3853f620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:43:05.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.537+0000 7faf6ab37800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:43:05.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.537+0000 7faf6ab37800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:43:05.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.537+0000 7faf6ab37800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:43:05.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.537+0000 7faf6ab37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:43:05.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.537+0000 7faf6ab37800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.537+0000 7faf6ab37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.537+0000 7faf6ab37800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.538+0000 7faf6ab37800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:05.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.538+0000 7faf6ab37800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.538+0000 7faf6ab37800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:43:05.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.538+0000 7faf6ab37800 20 zone default found 2023-12-03T11:43:05.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.538+0000 7faf6ab37800 4 Realm: () 2023-12-03T11:43:05.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.538+0000 7faf6ab37800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:43:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.538+0000 7faf6ab37800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:43:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.538+0000 7faf6ab37800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:43:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.538+0000 7faf6ab37800 20 zonegroup default 2023-12-03T11:43:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.538+0000 7faf6ab37800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.538+0000 7faf6ab37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.538+0000 7faf6ab37800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.539+0000 7faf6ab37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.539+0000 7faf6ab37800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.539+0000 7faf6ab37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.539+0000 7faf6ab37800 20 started sync module instance, tier type = 2023-12-03T11:43:05.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.539+0000 7faf6ab37800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:43:05.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.547+0000 7faf670ce640 0 -- 172.21.15.44:0/1951574619 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x562c38545460 msgr2=0x562c38547920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:43:05.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.548+0000 7faf6ab37800 20 add_watcher() i=0 2023-12-03T11:43:05.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.548+0000 7faf6ab37800 20 add_watcher() i=1 2023-12-03T11:43:05.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.548+0000 7faf6ab37800 20 add_watcher() i=2 2023-12-03T11:43:05.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.548+0000 7faf6ab37800 20 add_watcher() i=3 2023-12-03T11:43:05.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.548+0000 7faf6ab37800 20 add_watcher() i=4 2023-12-03T11:43:05.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.548+0000 7faf6ab37800 20 add_watcher() i=5 2023-12-03T11:43:05.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.548+0000 7faf6ab37800 20 add_watcher() i=6 2023-12-03T11:43:05.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.549+0000 7faf6ab37800 20 add_watcher() i=7 2023-12-03T11:43:05.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.549+0000 7faf6ab37800 2 all 8 watchers are set, enabling cache 2023-12-03T11:43:05.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.551+0000 7faea7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:05.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.551+0000 7faf6ab37800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:43:05.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.551+0000 7faf6ab37800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:43:05.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.556+0000 7faf6ab37800 5 note: GC not initialized 2023-12-03T11:43:05.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.556+0000 7fae96ffd640 20 reqs_thread_entry: start 2023-12-03T11:43:05.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.556+0000 7faf6ab37800 20 init_complete bucket index max shards: 1 2023-12-03T11:43:05.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.557+0000 7faf6ab37800 20 Filter name: none 2023-12-03T11:43:05.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.557+0000 7fae94ff9640 20 reqs_thread_entry: start 2023-12-03T11:43:05.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.557+0000 7faf6ab37800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2023-12-03T11:43:05.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.557+0000 7faf6ab37800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.557+0000 7faf6ab37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.557+0000 7faf6ab37800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2023-12-03T11:43:05.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.557+0000 7faf6ab37800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-12-03T11:43:05.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.557+0000 7faf6ab37800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test : miss 2023-12-03T11:43:05.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.557+0000 7faf6ab37800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.557+0000 7faf6ab37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.557+0000 7faf6ab37800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x0 2023-12-03T11:43:05.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.557+0000 7faf6ab37800 10 adding default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2023-12-03T11:43:05.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.557+0000 7faf6ab37800 10 cache get: name=default.rgw.meta+users.keys+BHIVORVVLSBCEHDVLEKB : miss 2023-12-03T11:43:05.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.557+0000 7faf6ab37800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.558+0000 7faf6ab37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.558+0000 7faf6ab37800 10 cache put: name=default.rgw.meta+users.keys+BHIVORVVLSBCEHDVLEKB info.flags=0x0 2023-12-03T11:43:05.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.558+0000 7faf6ab37800 10 adding default.rgw.meta+users.keys+BHIVORVVLSBCEHDVLEKB to cache LRU end 2023-12-03T11:43:05.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.558+0000 7faf6ab37800 10 cache get: name=default.rgw.meta+users.keys+BHIVORVVLSBCEHDVLEKB : hit (negative entry) 2023-12-03T11:43:05.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.558+0000 7faf6ab37800 10 cache get: name=default.rgw.meta+users.keys+BHIVORVVLSBCEHDVLEKB : hit (negative entry) 2023-12-03T11:43:05.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.559+0000 7faf6ab37800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2023-12-03T11:43:05.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.559+0000 7faf6ab37800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-12-03T11:43:05.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.559+0000 7faf6ab37800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2023-12-03T11:43:05.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.559+0000 7faf4d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511628021 cookie 94747923623968 notifier 7625 bl.length()=714 2023-12-03T11:43:05.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.559+0000 7faf4d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2023-12-03T11:43:05.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.560+0000 7faf4d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-12-03T11:43:05.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.561+0000 7faf6ab37800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2023-12-03T11:43:05.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.561+0000 7faf6ab37800 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2023-12-03T11:43:05.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.561+0000 7faf6ab37800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser.client.0+test@test.test, ofs0, ns] 2023-12-03T11:43:05.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.561+0000 7faf4d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627879 cookie 94747923629760 notifier 7625 bl.length()=224 2023-12-03T11:43:05.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.561+0000 7faf4d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2023-12-03T11:43:05.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.561+0000 7faf4d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2023-12-03T11:43:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.563+0000 7faf6ab37800 10 cache put: name=default.rgw.meta+users.keys+BHIVORVVLSBCEHDVLEKB info.flags=0x7 2023-12-03T11:43:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.563+0000 7faf6ab37800 10 moving default.rgw.meta+users.keys+BHIVORVVLSBCEHDVLEKB to cache LRU end 2023-12-03T11:43:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.563+0000 7faf6ab37800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:BHIVORVVLSBCEHDVLEKB, ofs0, ns] 2023-12-03T11:43:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.563+0000 7faf4d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511628022 cookie 94747923623968 notifier 7625 bl.length()=201 2023-12-03T11:43:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.563+0000 7faf4d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BHIVORVVLSBCEHDVLEKB info.flags=0x7 2023-12-03T11:43:05.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.563+0000 7faf4d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BHIVORVVLSBCEHDVLEKB to cache LRU end 2023-12-03T11:43:05.565 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-12-03T11:43:05.565 INFO:teuthology.orchestra.run.smithi044.stdout: "user_id": "testx$tenanteduser.client.0", 2023-12-03T11:43:05.565 INFO:teuthology.orchestra.run.smithi044.stdout: "display_name": "Mr. testx$tenanteduser.client.0", 2023-12-03T11:43:05.565 INFO:teuthology.orchestra.run.smithi044.stdout: "email": "testx$tenanteduser.client.0+test@test.test", 2023-12-03T11:43:05.565 INFO:teuthology.orchestra.run.smithi044.stdout: "suspended": 0, 2023-12-03T11:43:05.565 INFO:teuthology.orchestra.run.smithi044.stdout: "max_buckets": 1000, 2023-12-03T11:43:05.565 INFO:teuthology.orchestra.run.smithi044.stdout: "subusers": [], 2023-12-03T11:43:05.565 INFO:teuthology.orchestra.run.smithi044.stdout: "keys": [ 2023-12-03T11:43:05.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-12-03T11:43:05.566 INFO:teuthology.orchestra.run.smithi044.stdout: "user": "testx$tenanteduser.client.0", 2023-12-03T11:43:05.566 INFO:teuthology.orchestra.run.smithi044.stdout: "access_key": "BHIVORVVLSBCEHDVLEKB", 2023-12-03T11:43:05.566 INFO:teuthology.orchestra.run.smithi044.stdout: "secret_key": "LAVEv6ygplsllwEgB8L+mhwOANl47rgLEKAzEgtLFkxKCkC2Q9UCTg==" 2023-12-03T11:43:05.566 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-12-03T11:43:05.566 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2023-12-03T11:43:05.566 INFO:teuthology.orchestra.run.smithi044.stdout: "swift_keys": [], 2023-12-03T11:43:05.566 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": [ 2023-12-03T11:43:05.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-12-03T11:43:05.566 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "user-policy", 2023-12-03T11:43:05.566 INFO:teuthology.orchestra.run.smithi044.stdout: "perm": "*" 2023-12-03T11:43:05.566 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-12-03T11:43:05.566 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2023-12-03T11:43:05.566 INFO:teuthology.orchestra.run.smithi044.stdout: "op_mask": "read, write, delete", 2023-12-03T11:43:05.566 INFO:teuthology.orchestra.run.smithi044.stdout: "default_placement": "", 2023-12-03T11:43:05.566 INFO:teuthology.orchestra.run.smithi044.stdout: "default_storage_class": "", 2023-12-03T11:43:05.567 INFO:teuthology.orchestra.run.smithi044.stdout: "placement_tags": [], 2023-12-03T11:43:05.567 INFO:teuthology.orchestra.run.smithi044.stdout: "bucket_quota": { 2023-12-03T11:43:05.567 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2023-12-03T11:43:05.567 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2023-12-03T11:43:05.567 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2023-12-03T11:43:05.567 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2023-12-03T11:43:05.567 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2023-12-03T11:43:05.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-12-03T11:43:05.567 INFO:teuthology.orchestra.run.smithi044.stdout: "user_quota": { 2023-12-03T11:43:05.567 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2023-12-03T11:43:05.568 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2023-12-03T11:43:05.568 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2023-12-03T11:43:05.568 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2023-12-03T11:43:05.568 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2023-12-03T11:43:05.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-12-03T11:43:05.568 INFO:teuthology.orchestra.run.smithi044.stdout: "temp_url_keys": [], 2023-12-03T11:43:05.568 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "rgw", 2023-12-03T11:43:05.569 INFO:teuthology.orchestra.run.smithi044.stdout: "mfa_ids": [] 2023-12-03T11:43:05.569 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-12-03T11:43:05.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:43:05.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.564+0000 7faea7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:05.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.566+0000 7faf6ab37800 20 remove_watcher() i=0 2023-12-03T11:43:05.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.566+0000 7faf6ab37800 2 removed watcher, disabling cache 2023-12-03T11:43:05.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.567+0000 7faf6ab37800 20 remove_watcher() i=1 2023-12-03T11:43:05.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.568+0000 7faf6ab37800 20 remove_watcher() i=2 2023-12-03T11:43:05.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.569+0000 7faf6ab37800 20 remove_watcher() i=3 2023-12-03T11:43:05.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.570+0000 7faf6ab37800 20 remove_watcher() i=4 2023-12-03T11:43:05.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.571+0000 7faf6ab37800 20 remove_watcher() i=5 2023-12-03T11:43:05.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.572+0000 7faf6ab37800 20 remove_watcher() i=6 2023-12-03T11:43:05.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.573+0000 7faf6ab37800 20 remove_watcher() i=7 2023-12-03T11:43:05.580 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 3173459669 --totp-seed 4PYVOYOECQH5GPQJGQILC365VO3ADV7HBQ2UZF2T7NPSIGHDLNLH7SQLGOPJFVQZ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2023-12-03T11:43:05.644 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:43:05.644 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:43:05.655 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.654+0000 7f4b8e135800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.656+0000 7f4b8e135800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.656+0000 7f4b8e135800 20 realm 2023-12-03T11:43:05.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.656+0000 7f4b8e135800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.657+0000 7f4b8e135800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.657+0000 7f4b8e135800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:43:05.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.657+0000 7f4b8e135800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.657+0000 7f4b8e135800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.657+0000 7f4b8e135800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.658+0000 7f4b8e135800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:05.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.658+0000 7f4b8e135800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.658+0000 7f4b8e135800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:43:05.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.658+0000 7f4b8e135800 20 searching for the correct realm 2023-12-03T11:43:05.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.668+0000 7f4b89dde640 0 -- 172.21.15.44:0/3164524278 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x5601bc4d2630 msgr2=0x5601bc4d4a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:43:05.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.669+0000 7f4b8e135800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:43:05.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.669+0000 7f4b8e135800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:43:05.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.669+0000 7f4b8e135800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:43:05.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.669+0000 7f4b8e135800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:43:05.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.669+0000 7f4b8e135800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.670+0000 7f4b8e135800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.670+0000 7f4b8e135800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.670+0000 7f4b8e135800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:05.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.670+0000 7f4b8e135800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.670+0000 7f4b8e135800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:43:05.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.670+0000 7f4b8e135800 20 zone default found 2023-12-03T11:43:05.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.670+0000 7f4b8e135800 4 Realm: () 2023-12-03T11:43:05.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.670+0000 7f4b8e135800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:43:05.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.670+0000 7f4b8e135800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:43:05.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.670+0000 7f4b8e135800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:43:05.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.670+0000 7f4b8e135800 20 zonegroup default 2023-12-03T11:43:05.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.670+0000 7f4b8e135800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.670+0000 7f4b8e135800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.670+0000 7f4b8e135800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.671+0000 7f4b8e135800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.671+0000 7f4b8e135800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.671+0000 7f4b8e135800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.671+0000 7f4b8e135800 20 started sync module instance, tier type = 2023-12-03T11:43:05.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.671+0000 7f4b8e135800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:43:05.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.677+0000 7f4b8a5df640 0 -- 172.21.15.44:0/3164524278 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x5601bc4da5a0 msgr2=0x5601bc4dca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:43:05.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.680+0000 7f4b8e135800 20 add_watcher() i=0 2023-12-03T11:43:05.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.680+0000 7f4b8e135800 20 add_watcher() i=1 2023-12-03T11:43:05.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.680+0000 7f4b8e135800 20 add_watcher() i=2 2023-12-03T11:43:05.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.680+0000 7f4b8e135800 20 add_watcher() i=3 2023-12-03T11:43:05.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.680+0000 7f4b8e135800 20 add_watcher() i=4 2023-12-03T11:43:05.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.680+0000 7f4b8e135800 20 add_watcher() i=5 2023-12-03T11:43:05.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.680+0000 7f4b8e135800 20 add_watcher() i=6 2023-12-03T11:43:05.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.681+0000 7f4b8e135800 20 add_watcher() i=7 2023-12-03T11:43:05.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.681+0000 7f4b8e135800 2 all 8 watchers are set, enabling cache 2023-12-03T11:43:05.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.682+0000 7f4b4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:05.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.682+0000 7f4b8e135800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:43:05.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.682+0000 7f4b8e135800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:43:05.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.687+0000 7f4b8e135800 5 note: GC not initialized 2023-12-03T11:43:05.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.688+0000 7f4abe7fc640 20 reqs_thread_entry: start 2023-12-03T11:43:05.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.688+0000 7f4b8e135800 20 init_complete bucket index max shards: 1 2023-12-03T11:43:05.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.688+0000 7f4b8e135800 20 Filter name: none 2023-12-03T11:43:05.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.688+0000 7f4aaffff640 20 reqs_thread_entry: start 2023-12-03T11:43:05.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.688+0000 7f4b8e135800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2023-12-03T11:43:05.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.688+0000 7f4b8e135800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.689+0000 7f4b8e135800 20 rados_obj.operate() r=0 bl.length=514 2023-12-03T11:43:05.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.689+0000 7f4b8e135800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2023-12-03T11:43:05.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.689+0000 7f4b8e135800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-12-03T11:43:05.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.689+0000 7f4b8e135800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:43:05.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.691+0000 7f4b8e135800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2023-12-03T11:43:05.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.691+0000 7f4b8e135800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-12-03T11:43:05.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.691+0000 7f4b8e135800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2023-12-03T11:43:05.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.691+0000 7f4b6bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511628023 cookie 94565454188400 notifier 8106 bl.length()=728 2023-12-03T11:43:05.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.691+0000 7f4b6bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2023-12-03T11:43:05.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.691+0000 7f4b6bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-12-03T11:43:05.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.692+0000 7f4b4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:05.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.695+0000 7f4b8e135800 20 remove_watcher() i=0 2023-12-03T11:43:05.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.695+0000 7f4b8e135800 2 removed watcher, disabling cache 2023-12-03T11:43:05.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.696+0000 7f4b8e135800 20 remove_watcher() i=1 2023-12-03T11:43:05.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.697+0000 7f4b8e135800 20 remove_watcher() i=2 2023-12-03T11:43:05.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.698+0000 7f4b8e135800 20 remove_watcher() i=3 2023-12-03T11:43:05.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.699+0000 7f4b8e135800 20 remove_watcher() i=4 2023-12-03T11:43:05.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.700+0000 7f4b8e135800 20 remove_watcher() i=5 2023-12-03T11:43:05.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.701+0000 7f4b8e135800 20 remove_watcher() i=6 2023-12-03T11:43:05.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.702+0000 7f4b8e135800 20 remove_watcher() i=7 2023-12-03T11:43:05.708 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2023-12-03T11:43:05.708 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name 'Mr. foobar.client.0' --email foobar.client.0+test@test.test --caps 'user-policy=*' --access-key OJEMYLSYREDBZPLMRHKJ --secret xGeBR92CW4mHOa21nYvuXSdpVgDsZ9rFSF/EO9u0hx/6CZrIO1/quQ== --cluster ceph 2023-12-03T11:43:05.773 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:43:05.774 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:43:05.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.784+0000 7f1309c11800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.786+0000 7f1309c11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.786+0000 7f1309c11800 20 realm 2023-12-03T11:43:05.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.786+0000 7f1309c11800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.786+0000 7f1309c11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.786+0000 7f1309c11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:43:05.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.786+0000 7f1309c11800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.786+0000 7f1309c11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.786+0000 7f1309c11800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.787+0000 7f1309c11800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:05.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.787+0000 7f1309c11800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.787+0000 7f1309c11800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:43:05.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.787+0000 7f1309c11800 20 searching for the correct realm 2023-12-03T11:43:05.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.797+0000 7f13049b0640 0 -- 172.21.15.44:0/1799142771 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x561fcca3ee50 msgr2=0x561fcca41240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:43:05.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.798+0000 7f1309c11800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:43:05.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.798+0000 7f1309c11800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:43:05.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.798+0000 7f1309c11800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:43:05.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.798+0000 7f1309c11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:43:05.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.798+0000 7f1309c11800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.798+0000 7f1309c11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.798+0000 7f1309c11800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.799+0000 7f1309c11800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:05.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.799+0000 7f1309c11800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.799+0000 7f1309c11800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:43:05.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.799+0000 7f1309c11800 20 zone default found 2023-12-03T11:43:05.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.799+0000 7f1309c11800 4 Realm: () 2023-12-03T11:43:05.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.799+0000 7f1309c11800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:43:05.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.799+0000 7f1309c11800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:43:05.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.799+0000 7f1309c11800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:43:05.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.799+0000 7f1309c11800 20 zonegroup default 2023-12-03T11:43:05.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.799+0000 7f1309c11800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.799+0000 7f1309c11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.799+0000 7f1309c11800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.799+0000 7f1309c11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.799+0000 7f1309c11800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.800+0000 7f1309c11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.800+0000 7f1309c11800 20 started sync module instance, tier type = 2023-12-03T11:43:05.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.800+0000 7f1309c11800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:43:05.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.805+0000 7f13059b2640 0 -- 172.21.15.44:0/1799142771 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f12fc01a420 msgr2=0x7f12fc01a8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:43:05.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.808+0000 7f1309c11800 20 add_watcher() i=0 2023-12-03T11:43:05.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.808+0000 7f1309c11800 20 add_watcher() i=1 2023-12-03T11:43:05.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.808+0000 7f1309c11800 20 add_watcher() i=2 2023-12-03T11:43:05.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.808+0000 7f1309c11800 20 add_watcher() i=3 2023-12-03T11:43:05.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.808+0000 7f1309c11800 20 add_watcher() i=4 2023-12-03T11:43:05.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.808+0000 7f1309c11800 20 add_watcher() i=5 2023-12-03T11:43:05.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.808+0000 7f1309c11800 20 add_watcher() i=6 2023-12-03T11:43:05.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.809+0000 7f1309c11800 20 add_watcher() i=7 2023-12-03T11:43:05.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.809+0000 7f1309c11800 2 all 8 watchers are set, enabling cache 2023-12-03T11:43:05.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.811+0000 7f12cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:05.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.811+0000 7f1309c11800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:43:05.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.811+0000 7f1309c11800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:43:05.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.817+0000 7f1309c11800 5 note: GC not initialized 2023-12-03T11:43:05.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.817+0000 7f1239ffb640 20 reqs_thread_entry: start 2023-12-03T11:43:05.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.817+0000 7f1309c11800 20 init_complete bucket index max shards: 1 2023-12-03T11:43:05.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.817+0000 7f1309c11800 20 Filter name: none 2023-12-03T11:43:05.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.817+0000 7f122b7fe640 20 reqs_thread_entry: start 2023-12-03T11:43:05.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.817+0000 7f1309c11800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2023-12-03T11:43:05.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.817+0000 7f1309c11800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.817+0000 7f1309c11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.817+0000 7f1309c11800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2023-12-03T11:43:05.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.817+0000 7f1309c11800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:43:05.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.817+0000 7f1309c11800 10 cache get: name=default.rgw.meta+users.email+foobar.client.0+test@test.test : miss 2023-12-03T11:43:05.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.817+0000 7f1309c11800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.818+0000 7f1309c11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.818+0000 7f1309c11800 10 cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x0 2023-12-03T11:43:05.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.818+0000 7f1309c11800 10 adding default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2023-12-03T11:43:05.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.818+0000 7f1309c11800 10 cache get: name=default.rgw.meta+users.keys+OJEMYLSYREDBZPLMRHKJ : miss 2023-12-03T11:43:05.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.818+0000 7f1309c11800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.818+0000 7f1309c11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.818+0000 7f1309c11800 10 cache put: name=default.rgw.meta+users.keys+OJEMYLSYREDBZPLMRHKJ info.flags=0x0 2023-12-03T11:43:05.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.818+0000 7f1309c11800 10 adding default.rgw.meta+users.keys+OJEMYLSYREDBZPLMRHKJ to cache LRU end 2023-12-03T11:43:05.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.818+0000 7f1309c11800 10 cache get: name=default.rgw.meta+users.keys+OJEMYLSYREDBZPLMRHKJ : hit (negative entry) 2023-12-03T11:43:05.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.818+0000 7f1309c11800 10 cache get: name=default.rgw.meta+users.keys+OJEMYLSYREDBZPLMRHKJ : hit (negative entry) 2023-12-03T11:43:05.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.820+0000 7f1309c11800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:43:05.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.820+0000 7f1309c11800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:43:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.820+0000 7f1309c11800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2023-12-03T11:43:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.820+0000 7f12e77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627880 cookie 94694577322224 notifier 8127 bl.length()=655 2023-12-03T11:43:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.820+0000 7f12e77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:43:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.820+0000 7f12e77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:43:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.822+0000 7f1309c11800 10 cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x7 2023-12-03T11:43:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.822+0000 7f1309c11800 10 moving default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2023-12-03T11:43:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.822+0000 7f1309c11800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:foobar.client.0+test@test.test, ofs0, ns] 2023-12-03T11:43:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.822+0000 7f12e77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511628024 cookie 94694577315984 notifier 8127 bl.length()=200 2023-12-03T11:43:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.822+0000 7f12e77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x7 2023-12-03T11:43:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.822+0000 7f12e77fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2023-12-03T11:43:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.824+0000 7f1309c11800 10 cache put: name=default.rgw.meta+users.keys+OJEMYLSYREDBZPLMRHKJ info.flags=0x7 2023-12-03T11:43:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.824+0000 7f1309c11800 10 moving default.rgw.meta+users.keys+OJEMYLSYREDBZPLMRHKJ to cache LRU end 2023-12-03T11:43:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.824+0000 7f1309c11800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJEMYLSYREDBZPLMRHKJ, ofs0, ns] 2023-12-03T11:43:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.824+0000 7f12e77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627968 cookie 139719514152960 notifier 8127 bl.length()=189 2023-12-03T11:43:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.824+0000 7f12e77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJEMYLSYREDBZPLMRHKJ info.flags=0x7 2023-12-03T11:43:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.824+0000 7f12e77fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJEMYLSYREDBZPLMRHKJ to cache LRU end 2023-12-03T11:43:05.826 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-12-03T11:43:05.826 INFO:teuthology.orchestra.run.smithi044.stdout: "user_id": "foobar.client.0", 2023-12-03T11:43:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: "display_name": "Mr. foobar.client.0", 2023-12-03T11:43:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: "email": "foobar.client.0+test@test.test", 2023-12-03T11:43:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: "suspended": 0, 2023-12-03T11:43:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: "max_buckets": 1000, 2023-12-03T11:43:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: "subusers": [], 2023-12-03T11:43:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: "keys": [ 2023-12-03T11:43:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-12-03T11:43:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: "user": "foobar.client.0", 2023-12-03T11:43:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: "access_key": "OJEMYLSYREDBZPLMRHKJ", 2023-12-03T11:43:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: "secret_key": "xGeBR92CW4mHOa21nYvuXSdpVgDsZ9rFSF/EO9u0hx/6CZrIO1/quQ==" 2023-12-03T11:43:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-12-03T11:43:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2023-12-03T11:43:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: "swift_keys": [], 2023-12-03T11:43:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": [ 2023-12-03T11:43:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-12-03T11:43:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "user-policy", 2023-12-03T11:43:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: "perm": "*" 2023-12-03T11:43:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-12-03T11:43:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2023-12-03T11:43:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: "op_mask": "read, write, delete", 2023-12-03T11:43:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: "default_placement": "", 2023-12-03T11:43:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: "default_storage_class": "", 2023-12-03T11:43:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: "placement_tags": [], 2023-12-03T11:43:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: "bucket_quota": { 2023-12-03T11:43:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2023-12-03T11:43:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2023-12-03T11:43:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2023-12-03T11:43:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2023-12-03T11:43:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2023-12-03T11:43:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-12-03T11:43:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: "user_quota": { 2023-12-03T11:43:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2023-12-03T11:43:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2023-12-03T11:43:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2023-12-03T11:43:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2023-12-03T11:43:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2023-12-03T11:43:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-12-03T11:43:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: "temp_url_keys": [], 2023-12-03T11:43:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "rgw", 2023-12-03T11:43:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: "mfa_ids": [] 2023-12-03T11:43:05.829 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-12-03T11:43:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:43:05.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.825+0000 7f12cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:05.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.827+0000 7f1309c11800 20 remove_watcher() i=0 2023-12-03T11:43:05.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.827+0000 7f1309c11800 2 removed watcher, disabling cache 2023-12-03T11:43:05.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.828+0000 7f1309c11800 20 remove_watcher() i=1 2023-12-03T11:43:05.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.829+0000 7f1309c11800 20 remove_watcher() i=2 2023-12-03T11:43:05.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.831+0000 7f1309c11800 20 remove_watcher() i=3 2023-12-03T11:43:05.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.832+0000 7f1309c11800 20 remove_watcher() i=4 2023-12-03T11:43:05.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.833+0000 7f1309c11800 20 remove_watcher() i=5 2023-12-03T11:43:05.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.834+0000 7f1309c11800 20 remove_watcher() i=6 2023-12-03T11:43:05.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.835+0000 7f1309c11800 20 remove_watcher() i=7 2023-12-03T11:43:05.841 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 1707868811 --totp-seed 6JGEI445SZMPRH6QB23SZ7XJDV5VJBYHD5DCC52BZOHDDHTJHCTREPEWHDVF4OTP --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2023-12-03T11:43:05.904 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:43:05.905 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:43:05.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.915+0000 7fab0aa33800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.916+0000 7fab0aa33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.916+0000 7fab0aa33800 20 realm 2023-12-03T11:43:05.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.916+0000 7fab0aa33800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.917+0000 7fab0aa33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.917+0000 7fab0aa33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:43:05.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.917+0000 7fab0aa33800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.917+0000 7fab0aa33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.917+0000 7fab0aa33800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.918+0000 7fab0aa33800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:05.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.918+0000 7fab0aa33800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.918+0000 7fab0aa33800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:43:05.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.918+0000 7fab0aa33800 20 searching for the correct realm 2023-12-03T11:43:05.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.928+0000 7fab08d34640 0 -- 172.21.15.44:0/860592832 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x5569f1f06490 msgr2=0x5569f1f08950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:43:05.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.929+0000 7fab0aa33800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:43:05.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.929+0000 7fab0aa33800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:43:05.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.929+0000 7fab0aa33800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:43:05.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.929+0000 7fab0aa33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:43:05.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.929+0000 7fab0aa33800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.929+0000 7fab0aa33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.929+0000 7fab0aa33800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.929+0000 7fab0aa33800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:05.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.929+0000 7fab0aa33800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.929+0000 7fab0aa33800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:43:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.929+0000 7fab0aa33800 20 zone default found 2023-12-03T11:43:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.929+0000 7fab0aa33800 4 Realm: () 2023-12-03T11:43:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.929+0000 7fab0aa33800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:43:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.929+0000 7fab0aa33800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:43:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.929+0000 7fab0aa33800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:43:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.929+0000 7fab0aa33800 20 zonegroup default 2023-12-03T11:43:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.929+0000 7fab0aa33800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.930+0000 7fab0aa33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.930+0000 7fab0aa33800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.930+0000 7fab0aa33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.930+0000 7fab0aa33800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.930+0000 7fab0aa33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.930+0000 7fab0aa33800 20 started sync module instance, tier type = 2023-12-03T11:43:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.930+0000 7fab0aa33800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:43:05.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.937+0000 7fab08d34640 0 -- 172.21.15.44:0/860592832 >> [v2:172.21.15.44:6824/1867144922,v1:172.21.15.44:6825/1867144922] conn(0x7faae407ab70 msgr2=0x7faae407cfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:43:05.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.939+0000 7fab0aa33800 20 add_watcher() i=0 2023-12-03T11:43:05.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.939+0000 7fab0aa33800 20 add_watcher() i=1 2023-12-03T11:43:05.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.939+0000 7fab0aa33800 20 add_watcher() i=2 2023-12-03T11:43:05.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.939+0000 7fab0aa33800 20 add_watcher() i=3 2023-12-03T11:43:05.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.939+0000 7fab0aa33800 20 add_watcher() i=4 2023-12-03T11:43:05.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.939+0000 7fab0aa33800 20 add_watcher() i=5 2023-12-03T11:43:05.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.939+0000 7fab0aa33800 20 add_watcher() i=6 2023-12-03T11:43:05.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.940+0000 7fab0aa33800 20 add_watcher() i=7 2023-12-03T11:43:05.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.940+0000 7fab0aa33800 2 all 8 watchers are set, enabling cache 2023-12-03T11:43:05.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.942+0000 7faace7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:05.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.942+0000 7fab0aa33800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:43:05.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.942+0000 7fab0aa33800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:43:05.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.947+0000 7fab0aa33800 5 note: GC not initialized 2023-12-03T11:43:05.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.947+0000 7faa3d7fa640 20 reqs_thread_entry: start 2023-12-03T11:43:05.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.947+0000 7fab0aa33800 20 init_complete bucket index max shards: 1 2023-12-03T11:43:05.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.947+0000 7fab0aa33800 20 Filter name: none 2023-12-03T11:43:05.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.947+0000 7faa36ffd640 20 reqs_thread_entry: start 2023-12-03T11:43:05.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.947+0000 7fab0aa33800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2023-12-03T11:43:05.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.947+0000 7fab0aa33800 20 rados->read ofs=0 len=0 2023-12-03T11:43:05.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.948+0000 7fab0aa33800 20 rados_obj.operate() r=0 bl.length=467 2023-12-03T11:43:05.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.948+0000 7fab0aa33800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2023-12-03T11:43:05.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.948+0000 7fab0aa33800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:43:05.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.948+0000 7fab0aa33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:43:05.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.950+0000 7fab0aa33800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:43:05.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.950+0000 7fab0aa33800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:43:05.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.950+0000 7fab0aa33800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2023-12-03T11:43:05.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.951+0000 7faaeeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627881 cookie 93913519026192 notifier 7685 bl.length()=669 2023-12-03T11:43:05.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.951+0000 7faaeeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:43:05.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.951+0000 7faaeeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:43:05.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.952+0000 7faace7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:05.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.954+0000 7fab0aa33800 20 remove_watcher() i=0 2023-12-03T11:43:05.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.954+0000 7fab0aa33800 2 removed watcher, disabling cache 2023-12-03T11:43:05.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.955+0000 7fab0aa33800 20 remove_watcher() i=1 2023-12-03T11:43:05.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.956+0000 7fab0aa33800 20 remove_watcher() i=2 2023-12-03T11:43:05.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.957+0000 7fab0aa33800 20 remove_watcher() i=3 2023-12-03T11:43:05.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.960+0000 7fab0aa33800 20 remove_watcher() i=4 2023-12-03T11:43:05.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.961+0000 7fab0aa33800 20 remove_watcher() i=5 2023-12-03T11:43:05.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.963+0000 7fab0aa33800 20 remove_watcher() i=6 2023-12-03T11:43:05.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:05.964+0000 7fab0aa33800 20 remove_watcher() i=7 2023-12-03T11:43:05.970 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'roles=*' --cluster ceph 2023-12-03T11:43:06.025 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:43:06.026 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:43:06.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.036+0000 7f1025544800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.037+0000 7f1025544800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:06.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.037+0000 7f1025544800 20 realm 2023-12-03T11:43:06.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.037+0000 7f1025544800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.038+0000 7f1025544800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:06.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.038+0000 7f1025544800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:43:06.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.038+0000 7f1025544800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.038+0000 7f1025544800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:06.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.038+0000 7f1025544800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.039+0000 7f1025544800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:06.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.039+0000 7f1025544800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.040+0000 7f1025544800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:43:06.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.040+0000 7f1025544800 20 searching for the correct realm 2023-12-03T11:43:06.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.049+0000 7f102130a640 0 -- 172.21.15.44:0/3378172513 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x56120f526040 msgr2=0x56120f528490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:43:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.050+0000 7f1025544800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:43:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.050+0000 7f1025544800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:43:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.050+0000 7f1025544800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:43:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.050+0000 7f1025544800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:43:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.050+0000 7f1025544800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.051+0000 7f1025544800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.051+0000 7f1025544800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.051+0000 7f1025544800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.051+0000 7f1025544800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.051+0000 7f1025544800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:43:06.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.051+0000 7f1025544800 20 zone default found 2023-12-03T11:43:06.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.051+0000 7f1025544800 4 Realm: () 2023-12-03T11:43:06.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.051+0000 7f1025544800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:43:06.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.051+0000 7f1025544800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:43:06.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.051+0000 7f1025544800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:43:06.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.051+0000 7f1025544800 20 zonegroup default 2023-12-03T11:43:06.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.051+0000 7f1025544800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.051+0000 7f1025544800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:06.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.051+0000 7f1025544800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.052+0000 7f1025544800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:06.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.052+0000 7f1025544800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.052+0000 7f1025544800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:06.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.052+0000 7f1025544800 20 started sync module instance, tier type = 2023-12-03T11:43:06.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.052+0000 7f1025544800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:43:06.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.059+0000 7f1021b0b640 0 -- 172.21.15.44:0/3378172513 >> [v2:172.21.15.91:6816/2819228480,v1:172.21.15.91:6817/2819228480] conn(0x7f101806d910 msgr2=0x7f101807d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:43:06.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.061+0000 7f1025544800 20 add_watcher() i=0 2023-12-03T11:43:06.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.061+0000 7f1025544800 20 add_watcher() i=1 2023-12-03T11:43:06.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.061+0000 7f1025544800 20 add_watcher() i=2 2023-12-03T11:43:06.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.061+0000 7f1025544800 20 add_watcher() i=3 2023-12-03T11:43:06.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.061+0000 7f1025544800 20 add_watcher() i=4 2023-12-03T11:43:06.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.061+0000 7f1025544800 20 add_watcher() i=5 2023-12-03T11:43:06.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.061+0000 7f1025544800 20 add_watcher() i=6 2023-12-03T11:43:06.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.062+0000 7f1025544800 20 add_watcher() i=7 2023-12-03T11:43:06.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.062+0000 7f1025544800 2 all 8 watchers are set, enabling cache 2023-12-03T11:43:06.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.064+0000 7f0fe6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:06.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.064+0000 7f1025544800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:43:06.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.064+0000 7f1025544800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:43:06.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.069+0000 7f1025544800 5 note: GC not initialized 2023-12-03T11:43:06.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.069+0000 7f0f55ffb640 20 reqs_thread_entry: start 2023-12-03T11:43:06.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.069+0000 7f1025544800 20 init_complete bucket index max shards: 1 2023-12-03T11:43:06.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.069+0000 7f1025544800 20 Filter name: none 2023-12-03T11:43:06.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.069+0000 7f0f477fe640 20 reqs_thread_entry: start 2023-12-03T11:43:06.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.069+0000 7f1025544800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2023-12-03T11:43:06.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.069+0000 7f1025544800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.070+0000 7f1025544800 20 rados_obj.operate() r=0 bl.length=481 2023-12-03T11:43:06.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.070+0000 7f1025544800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2023-12-03T11:43:06.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.070+0000 7f1025544800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:43:06.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.070+0000 7f1025544800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:43:06.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.071+0000 7f1025544800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:43:06.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.071+0000 7f1025544800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:43:06.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.071+0000 7f1025544800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2023-12-03T11:43:06.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.071+0000 7f10037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627882 cookie 94635566520000 notifier 7703 bl.length()=682 2023-12-03T11:43:06.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.071+0000 7f10037fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:43:06.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.071+0000 7f10037fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:43:06.073 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-12-03T11:43:06.073 INFO:teuthology.orchestra.run.smithi044.stdout: "user_id": "foobar.client.0", 2023-12-03T11:43:06.073 INFO:teuthology.orchestra.run.smithi044.stdout: "display_name": "Mr. foobar.client.0", 2023-12-03T11:43:06.073 INFO:teuthology.orchestra.run.smithi044.stdout: "email": "foobar.client.0+test@test.test", 2023-12-03T11:43:06.073 INFO:teuthology.orchestra.run.smithi044.stdout: "suspended": 0, 2023-12-03T11:43:06.073 INFO:teuthology.orchestra.run.smithi044.stdout: "max_buckets": 1000, 2023-12-03T11:43:06.073 INFO:teuthology.orchestra.run.smithi044.stdout: "subusers": [], 2023-12-03T11:43:06.073 INFO:teuthology.orchestra.run.smithi044.stdout: "keys": [ 2023-12-03T11:43:06.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-12-03T11:43:06.074 INFO:teuthology.orchestra.run.smithi044.stdout: "user": "foobar.client.0", 2023-12-03T11:43:06.074 INFO:teuthology.orchestra.run.smithi044.stdout: "access_key": "OJEMYLSYREDBZPLMRHKJ", 2023-12-03T11:43:06.074 INFO:teuthology.orchestra.run.smithi044.stdout: "secret_key": "xGeBR92CW4mHOa21nYvuXSdpVgDsZ9rFSF/EO9u0hx/6CZrIO1/quQ==" 2023-12-03T11:43:06.074 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-12-03T11:43:06.074 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2023-12-03T11:43:06.074 INFO:teuthology.orchestra.run.smithi044.stdout: "swift_keys": [], 2023-12-03T11:43:06.074 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": [ 2023-12-03T11:43:06.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-12-03T11:43:06.074 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "roles", 2023-12-03T11:43:06.074 INFO:teuthology.orchestra.run.smithi044.stdout: "perm": "*" 2023-12-03T11:43:06.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-12-03T11:43:06.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-12-03T11:43:06.074 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "user-policy", 2023-12-03T11:43:06.074 INFO:teuthology.orchestra.run.smithi044.stdout: "perm": "*" 2023-12-03T11:43:06.075 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-12-03T11:43:06.075 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2023-12-03T11:43:06.075 INFO:teuthology.orchestra.run.smithi044.stdout: "op_mask": "read, write, delete", 2023-12-03T11:43:06.075 INFO:teuthology.orchestra.run.smithi044.stdout: "default_placement": "", 2023-12-03T11:43:06.075 INFO:teuthology.orchestra.run.smithi044.stdout: "default_storage_class": "", 2023-12-03T11:43:06.075 INFO:teuthology.orchestra.run.smithi044.stdout: "placement_tags": [], 2023-12-03T11:43:06.075 INFO:teuthology.orchestra.run.smithi044.stdout: "bucket_quota": { 2023-12-03T11:43:06.075 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2023-12-03T11:43:06.075 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2023-12-03T11:43:06.075 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2023-12-03T11:43:06.075 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2023-12-03T11:43:06.075 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2023-12-03T11:43:06.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-12-03T11:43:06.075 INFO:teuthology.orchestra.run.smithi044.stdout: "user_quota": { 2023-12-03T11:43:06.075 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2023-12-03T11:43:06.076 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2023-12-03T11:43:06.076 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2023-12-03T11:43:06.076 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2023-12-03T11:43:06.076 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2023-12-03T11:43:06.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-12-03T11:43:06.076 INFO:teuthology.orchestra.run.smithi044.stdout: "temp_url_keys": [], 2023-12-03T11:43:06.076 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "rgw", 2023-12-03T11:43:06.076 INFO:teuthology.orchestra.run.smithi044.stdout: "mfa_ids": [ 2023-12-03T11:43:06.076 INFO:teuthology.orchestra.run.smithi044.stdout: "1707868811" 2023-12-03T11:43:06.076 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2023-12-03T11:43:06.076 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-12-03T11:43:06.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:43:06.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.073+0000 7f0fe6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:06.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.075+0000 7f1025544800 20 remove_watcher() i=0 2023-12-03T11:43:06.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.075+0000 7f1025544800 2 removed watcher, disabling cache 2023-12-03T11:43:06.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.076+0000 7f1025544800 20 remove_watcher() i=1 2023-12-03T11:43:06.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.077+0000 7f1025544800 20 remove_watcher() i=2 2023-12-03T11:43:06.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.078+0000 7f1025544800 20 remove_watcher() i=3 2023-12-03T11:43:06.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.079+0000 7f1025544800 20 remove_watcher() i=4 2023-12-03T11:43:06.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.080+0000 7f1025544800 20 remove_watcher() i=5 2023-12-03T11:43:06.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.081+0000 7f1025544800 20 remove_watcher() i=6 2023-12-03T11:43:06.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.083+0000 7f1025544800 20 remove_watcher() i=7 2023-12-03T11:43:06.089 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*' --cluster ceph 2023-12-03T11:43:06.146 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:43:06.147 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:43:06.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.156+0000 7f183b335800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.161+0000 7f183b335800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:06.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.161+0000 7f183b335800 20 realm 2023-12-03T11:43:06.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.161+0000 7f183b335800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.161+0000 7f183b335800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:06.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.161+0000 7f183b335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:43:06.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.161+0000 7f183b335800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.161+0000 7f183b335800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:06.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.161+0000 7f183b335800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.165+0000 7f183b335800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:06.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.165+0000 7f183b335800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.168+0000 7f183b335800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:43:06.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.168+0000 7f183b335800 20 searching for the correct realm 2023-12-03T11:43:06.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.184+0000 7f18370cd640 0 -- 172.21.15.44:0/2038196105 >> [v2:172.21.15.91:6824/4235471279,v1:172.21.15.91:6825/4235471279] conn(0x55adb0a1e2f0 msgr2=0x55adb0a20740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:43:06.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.185+0000 7f183b335800 20 RGWRados::pool_iterate: got zone_info.ff414afd-0753-48a7-8bb4-762be6d38c82 2023-12-03T11:43:06.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.185+0000 7f183b335800 20 RGWRados::pool_iterate: got zonegroup_info.c74a4759-485c-490e-ba16-c77421736c36 2023-12-03T11:43:06.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.185+0000 7f183b335800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:43:06.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.185+0000 7f183b335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:43:06.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.185+0000 7f183b335800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.185+0000 7f183b335800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:06.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.185+0000 7f183b335800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.186+0000 7f183b335800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:43:06.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.186+0000 7f183b335800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.186+0000 7f183b335800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:43:06.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.186+0000 7f183b335800 20 zone default found 2023-12-03T11:43:06.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.186+0000 7f183b335800 4 Realm: () 2023-12-03T11:43:06.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.186+0000 7f183b335800 4 ZoneGroup: default (c74a4759-485c-490e-ba16-c77421736c36) 2023-12-03T11:43:06.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.186+0000 7f183b335800 4 Zone: default (ff414afd-0753-48a7-8bb4-762be6d38c82) 2023-12-03T11:43:06.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.186+0000 7f183b335800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:43:06.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.186+0000 7f183b335800 20 zonegroup default 2023-12-03T11:43:06.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.186+0000 7f183b335800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.186+0000 7f183b335800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:06.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.186+0000 7f183b335800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.187+0000 7f183b335800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:06.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.187+0000 7f183b335800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.187+0000 7f183b335800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:43:06.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.187+0000 7f183b335800 20 started sync module instance, tier type = 2023-12-03T11:43:06.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.187+0000 7f183b335800 20 started zone id=ff414afd-0753-48a7-8bb4-762be6d38c82 (name=default) with tier type = 2023-12-03T11:43:06.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.191+0000 7f18368cc640 0 -- 172.21.15.44:0/2038196105 >> [v2:172.21.15.44:6816/1914741384,v1:172.21.15.44:6817/1914741384] conn(0x55adb0a21bc0 msgr2=0x55adb0a23fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:43:06.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.196+0000 7f183b335800 20 add_watcher() i=0 2023-12-03T11:43:06.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.196+0000 7f183b335800 20 add_watcher() i=1 2023-12-03T11:43:06.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.196+0000 7f183b335800 20 add_watcher() i=2 2023-12-03T11:43:06.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.196+0000 7f183b335800 20 add_watcher() i=3 2023-12-03T11:43:06.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.196+0000 7f183b335800 20 add_watcher() i=4 2023-12-03T11:43:06.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.196+0000 7f183b335800 20 add_watcher() i=5 2023-12-03T11:43:06.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.196+0000 7f183b335800 20 add_watcher() i=6 2023-12-03T11:43:06.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.197+0000 7f183b335800 20 add_watcher() i=7 2023-12-03T11:43:06.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.197+0000 7f183b335800 2 all 8 watchers are set, enabling cache 2023-12-03T11:43:06.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.198+0000 7f17fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:06.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.199+0000 7f183b335800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:43:06.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.199+0000 7f183b335800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:43:06.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.204+0000 7f183b335800 5 note: GC not initialized 2023-12-03T11:43:06.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.204+0000 7f176bfff640 20 reqs_thread_entry: start 2023-12-03T11:43:06.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.204+0000 7f183b335800 20 init_complete bucket index max shards: 1 2023-12-03T11:43:06.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.204+0000 7f183b335800 20 Filter name: none 2023-12-03T11:43:06.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.204+0000 7f1769ffb640 20 reqs_thread_entry: start 2023-12-03T11:43:06.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.204+0000 7f183b335800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2023-12-03T11:43:06.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.204+0000 7f183b335800 20 rados->read ofs=0 len=0 2023-12-03T11:43:06.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.205+0000 7f183b335800 20 rados_obj.operate() r=0 bl.length=494 2023-12-03T11:43:06.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.205+0000 7f183b335800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2023-12-03T11:43:06.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.205+0000 7f183b335800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:43:06.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.205+0000 7f183b335800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:43:06.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.206+0000 7f183b335800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:43:06.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.206+0000 7f183b335800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:43:06.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.206+0000 7f183b335800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2023-12-03T11:43:06.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.206+0000 7f182dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595179 cookie 94204481124560 notifier 7721 bl.length()=703 2023-12-03T11:43:06.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.206+0000 7f182dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:43:06.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.206+0000 7f182dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:43:06.208 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-12-03T11:43:06.208 INFO:teuthology.orchestra.run.smithi044.stdout: "user_id": "foobar.client.0", 2023-12-03T11:43:06.208 INFO:teuthology.orchestra.run.smithi044.stdout: "display_name": "Mr. foobar.client.0", 2023-12-03T11:43:06.208 INFO:teuthology.orchestra.run.smithi044.stdout: "email": "foobar.client.0+test@test.test", 2023-12-03T11:43:06.208 INFO:teuthology.orchestra.run.smithi044.stdout: "suspended": 0, 2023-12-03T11:43:06.208 INFO:teuthology.orchestra.run.smithi044.stdout: "max_buckets": 1000, 2023-12-03T11:43:06.209 INFO:teuthology.orchestra.run.smithi044.stdout: "subusers": [], 2023-12-03T11:43:06.209 INFO:teuthology.orchestra.run.smithi044.stdout: "keys": [ 2023-12-03T11:43:06.209 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-12-03T11:43:06.209 INFO:teuthology.orchestra.run.smithi044.stdout: "user": "foobar.client.0", 2023-12-03T11:43:06.209 INFO:teuthology.orchestra.run.smithi044.stdout: "access_key": "OJEMYLSYREDBZPLMRHKJ", 2023-12-03T11:43:06.209 INFO:teuthology.orchestra.run.smithi044.stdout: "secret_key": "xGeBR92CW4mHOa21nYvuXSdpVgDsZ9rFSF/EO9u0hx/6CZrIO1/quQ==" 2023-12-03T11:43:06.209 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-12-03T11:43:06.209 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2023-12-03T11:43:06.209 INFO:teuthology.orchestra.run.smithi044.stdout: "swift_keys": [], 2023-12-03T11:43:06.209 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": [ 2023-12-03T11:43:06.209 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-12-03T11:43:06.210 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "oidc-provider", 2023-12-03T11:43:06.210 INFO:teuthology.orchestra.run.smithi044.stdout: "perm": "*" 2023-12-03T11:43:06.210 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-12-03T11:43:06.210 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-12-03T11:43:06.210 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "roles", 2023-12-03T11:43:06.210 INFO:teuthology.orchestra.run.smithi044.stdout: "perm": "*" 2023-12-03T11:43:06.210 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-12-03T11:43:06.210 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-12-03T11:43:06.210 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "user-policy", 2023-12-03T11:43:06.210 INFO:teuthology.orchestra.run.smithi044.stdout: "perm": "*" 2023-12-03T11:43:06.210 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-12-03T11:43:06.210 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2023-12-03T11:43:06.210 INFO:teuthology.orchestra.run.smithi044.stdout: "op_mask": "read, write, delete", 2023-12-03T11:43:06.210 INFO:teuthology.orchestra.run.smithi044.stdout: "default_placement": "", 2023-12-03T11:43:06.210 INFO:teuthology.orchestra.run.smithi044.stdout: "default_storage_class": "", 2023-12-03T11:43:06.210 INFO:teuthology.orchestra.run.smithi044.stdout: "placement_tags": [], 2023-12-03T11:43:06.211 INFO:teuthology.orchestra.run.smithi044.stdout: "bucket_quota": { 2023-12-03T11:43:06.211 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2023-12-03T11:43:06.211 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2023-12-03T11:43:06.211 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2023-12-03T11:43:06.211 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2023-12-03T11:43:06.211 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2023-12-03T11:43:06.211 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-12-03T11:43:06.211 INFO:teuthology.orchestra.run.smithi044.stdout: "user_quota": { 2023-12-03T11:43:06.211 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2023-12-03T11:43:06.211 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2023-12-03T11:43:06.211 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2023-12-03T11:43:06.211 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2023-12-03T11:43:06.211 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2023-12-03T11:43:06.211 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-12-03T11:43:06.211 INFO:teuthology.orchestra.run.smithi044.stdout: "temp_url_keys": [], 2023-12-03T11:43:06.211 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "rgw", 2023-12-03T11:43:06.212 INFO:teuthology.orchestra.run.smithi044.stdout: "mfa_ids": [ 2023-12-03T11:43:06.212 INFO:teuthology.orchestra.run.smithi044.stdout: "1707868811" 2023-12-03T11:43:06.212 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2023-12-03T11:43:06.212 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-12-03T11:43:06.212 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:43:06.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.208+0000 7f17fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:43:06.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.210+0000 7f183b335800 20 remove_watcher() i=0 2023-12-03T11:43:06.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.210+0000 7f183b335800 2 removed watcher, disabling cache 2023-12-03T11:43:06.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.211+0000 7f183b335800 20 remove_watcher() i=1 2023-12-03T11:43:06.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.212+0000 7f183b335800 20 remove_watcher() i=2 2023-12-03T11:43:06.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.213+0000 7f183b335800 20 remove_watcher() i=3 2023-12-03T11:43:06.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.214+0000 7f183b335800 20 remove_watcher() i=4 2023-12-03T11:43:06.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.215+0000 7f183b335800 20 remove_watcher() i=5 2023-12-03T11:43:06.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.216+0000 7f183b335800 20 remove_watcher() i=6 2023-12-03T11:43:06.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T11:43:06.217+0000 7f183b335800 20 remove_watcher() i=7 2023-12-03T11:43:06.223 INFO:tasks.s3tests:Configuring s3-tests... 2023-12-03T11:43:06.224 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:43:06.224 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2023-12-03T11:43:06.252 INFO:tasks.s3tests:Configuring boto... 2023-12-03T11:43:06.252 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-12-03T11:43:06.253 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2023-12-03T11:43:06.320 DEBUG:teuthology.orchestra.run.smithi044:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2023-12-03T11:43:06.491 INFO:teuthology.orchestra.run.smithi044.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2023-12-03T11:43:06.676 INFO:teuthology.orchestra.run.smithi044.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2023-12-03T11:43:06.925 INFO:teuthology.orchestra.run.smithi044.stdout:py installdeps: -rrequirements.txt 2023-12-03T11:44:29.603 INFO:teuthology.orchestra.run.smithi044.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2023-12-03T11:44:31.346 INFO:teuthology.orchestra.run.smithi044.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.3.2,certifi==2023.11.17,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.7,exceptiongroup==1.2.0,filelock==3.13.1,gevent==23.9.1,greenlet==3.0.1,httplib2==0.22.0,idna==3.6,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==4.9.3,munch==4.0.0,packaging==23.2,platformdirs==4.0.0,pluggy==1.3.0,pyparsing==3.1.1,pyproject-api==1.6.1,pytest==7.4.3,python-dateutil==2.8.2,pytz==2023.3.post1,PyYAML==6.0.1,requests==2.31.0,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=4f2bb192d03780bde9cffcc586055d56d2914b5f28f81a344dc8e092c143a394,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.11.4,urllib3==1.26.18,virtualenv==20.25.0,zope.event==5.0,zope.interface==6.1 2023-12-03T11:44:31.346 INFO:teuthology.orchestra.run.smithi044.stdout:py run-test-pre: PYTHONHASHSEED='3623724228' 2023-12-03T11:44:31.346 INFO:teuthology.orchestra.run.smithi044.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2023-12-03T11:44:31.497 INFO:teuthology.orchestra.run.smithi044.stdout:============================= test session starts ============================== 2023-12-03T11:44:31.497 INFO:teuthology.orchestra.run.smithi044.stdout:platform linux -- Python 3.9.17, pytest-7.4.3, pluggy-1.3.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2023-12-03T11:44:31.497 INFO:teuthology.orchestra.run.smithi044.stdout:cachedir: .tox/py/.pytest_cache 2023-12-03T11:44:31.497 INFO:teuthology.orchestra.run.smithi044.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2023-12-03T11:44:31.498 INFO:teuthology.orchestra.run.smithi044.stdout:configfile: pytest.ini 2023-12-03T11:44:33.149 INFO:teuthology.orchestra.run.smithi044.stdout:collecting ... collected 787 items / 124 deselected / 663 selected 2023-12-03T11:44:33.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T11:44:33.271 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2023-12-03T11:44:33.384 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2023-12-03T11:44:33.542 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2023-12-03T11:44:33.700 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2023-12-03T11:44:33.815 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2023-12-03T11:44:33.926 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2023-12-03T11:44:34.089 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 1%] 2023-12-03T11:44:34.198 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2023-12-03T11:44:34.285 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2023-12-03T11:44:34.371 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2023-12-03T11:44:34.485 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2023-12-03T11:44:34.596 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2023-12-03T11:44:34.710 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2023-12-03T11:44:34.823 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 2%] 2023-12-03T11:44:34.910 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2023-12-03T11:44:34.997 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2023-12-03T11:44:35.044 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2023-12-03T11:44:35.090 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2023-12-03T11:44:35.136 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2023-12-03T11:44:35.182 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 3%] 2023-12-03T11:44:35.228 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 3%] 2023-12-03T11:44:35.275 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 3%] 2023-12-03T11:44:35.322 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2023-12-03T11:44:35.369 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2023-12-03T11:44:35.416 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2023-12-03T11:44:35.463 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2023-12-03T11:44:35.511 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 4%] 2023-12-03T11:44:35.558 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 4%] 2023-12-03T11:44:35.605 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 4%] 2023-12-03T11:44:35.652 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2023-12-03T11:44:35.699 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2023-12-03T11:44:35.745 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2023-12-03T11:44:35.793 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2023-12-03T11:44:35.840 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 5%] 2023-12-03T11:44:35.887 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 5%] 2023-12-03T11:44:35.934 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 5%] 2023-12-03T11:44:35.982 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 5%] 2023-12-03T11:44:36.030 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2023-12-03T11:44:36.077 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2023-12-03T11:44:36.125 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 6%] 2023-12-03T11:44:36.172 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 6%] 2023-12-03T11:44:36.220 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 6%] 2023-12-03T11:44:36.268 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 6%] 2023-12-03T11:44:36.314 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 6%] 2023-12-03T11:44:36.361 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2023-12-03T11:44:36.409 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2023-12-03T11:44:36.456 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 7%] 2023-12-03T11:44:36.503 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 7%] 2023-12-03T11:44:36.550 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 7%] 2023-12-03T11:44:36.597 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 7%] 2023-12-03T11:44:36.644 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 7%] 2023-12-03T11:44:36.691 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 7%] 2023-12-03T11:44:36.740 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2023-12-03T11:44:37.007 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 8%] 2023-12-03T11:44:37.493 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 8%] 2023-12-03T11:44:38.479 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 8%] 2023-12-03T11:44:39.325 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 8%] 2023-12-03T11:44:40.852 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 8%] 2023-12-03T11:44:41.360 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 8%] 2023-12-03T11:44:41.927 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 9%] 2023-12-03T11:44:42.129 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 9%] 2023-12-03T11:44:42.199 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 9%] 2023-12-03T11:44:42.347 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 9%] 2023-12-03T11:44:42.494 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 9%] 2023-12-03T11:44:42.659 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 9%] 2023-12-03T11:44:42.780 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 9%] 2023-12-03T11:44:42.848 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 10%] 2023-12-03T11:44:42.849 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 10%] 2023-12-03T11:44:42.850 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 10%] 2023-12-03T11:44:42.852 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 10%] 2023-12-03T11:44:42.853 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 10%] 2023-12-03T11:44:42.854 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 10%] 2023-12-03T11:44:42.855 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 11%] 2023-12-03T11:44:42.855 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 11%] 2023-12-03T11:44:42.856 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 11%] 2023-12-03T11:44:42.857 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 11%] 2023-12-03T11:44:42.858 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 11%] 2023-12-03T11:44:42.859 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 11%] 2023-12-03T11:44:42.860 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 11%] 2023-12-03T11:44:42.861 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 12%] 2023-12-03T11:44:42.862 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 12%] 2023-12-03T11:44:42.863 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 12%] 2023-12-03T11:44:42.864 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 12%] 2023-12-03T11:44:42.864 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 12%] 2023-12-03T11:44:42.866 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 12%] 2023-12-03T11:44:42.866 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 12%] 2023-12-03T11:44:42.867 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 13%] 2023-12-03T11:44:42.868 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 13%] 2023-12-03T11:44:42.869 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 13%] 2023-12-03T11:44:42.870 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 13%] 2023-12-03T11:44:42.871 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 13%] 2023-12-03T11:44:42.874 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 13%] 2023-12-03T11:44:42.874 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 14%] 2023-12-03T11:44:42.874 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 14%] 2023-12-03T11:44:42.934 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 14%] 2023-12-03T11:44:42.946 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 14%] 2023-12-03T11:44:43.131 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 14%] 2023-12-03T11:44:53.077 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 14%] 2023-12-03T11:44:53.196 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 14%] 2023-12-03T11:44:53.368 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 15%] 2023-12-03T11:44:53.538 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 15%] 2023-12-03T11:44:53.709 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 15%] 2023-12-03T11:44:53.879 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 15%] 2023-12-03T11:44:53.991 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 15%] 2023-12-03T11:44:54.163 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 15%] 2023-12-03T11:44:54.357 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 15%] 2023-12-03T11:44:54.516 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 16%] 2023-12-03T11:44:54.628 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 16%] 2023-12-03T11:44:54.735 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 16%] 2023-12-03T11:44:54.840 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 16%] 2023-12-03T11:44:54.880 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 16%] 2023-12-03T11:44:54.992 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 16%] 2023-12-03T11:44:55.157 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 17%] 2023-12-03T11:44:55.320 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 17%] 2023-12-03T11:44:55.467 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 17%] 2023-12-03T11:44:55.580 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 17%] 2023-12-03T11:44:55.692 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 17%] 2023-12-03T11:44:55.805 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 17%] 2023-12-03T11:44:55.919 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 17%] 2023-12-03T11:44:56.024 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 18%] 2023-12-03T11:44:56.130 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 18%] 2023-12-03T11:44:56.171 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 18%] 2023-12-03T11:44:56.211 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 18%] 2023-12-03T11:44:56.286 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 18%] 2023-12-03T11:44:56.325 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 18%] 2023-12-03T11:44:56.365 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 19%] 2023-12-03T11:44:56.476 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 19%] 2023-12-03T11:44:56.516 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 19%] 2023-12-03T11:44:56.562 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 19%] 2023-12-03T11:44:56.703 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 19%] 2023-12-03T11:44:56.841 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 19%] 2023-12-03T11:44:56.880 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 19%] 2023-12-03T11:44:57.020 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 20%] 2023-12-03T11:44:57.195 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 20%] 2023-12-03T11:44:57.428 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 20%] 2023-12-03T11:44:57.522 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 20%] 2023-12-03T11:44:57.661 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 20%] 2023-12-03T11:44:57.798 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 20%] 2023-12-03T11:44:58.133 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 20%] 2023-12-03T11:44:58.279 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 21%] 2023-12-03T11:44:58.451 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 21%] 2023-12-03T11:44:58.597 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 21%] 2023-12-03T11:44:58.939 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 21%] 2023-12-03T11:44:59.143 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 21%] 2023-12-03T11:44:59.425 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 21%] 2023-12-03T11:44:59.616 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 22%] 2023-12-03T11:44:59.879 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 22%] 2023-12-03T11:45:00.051 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 22%] 2023-12-03T11:45:00.323 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 22%] 2023-12-03T11:45:00.503 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 22%] 2023-12-03T11:45:00.689 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 22%] 2023-12-03T11:45:00.964 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 22%] 2023-12-03T11:45:01.186 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 23%] 2023-12-03T11:45:01.407 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 23%] 2023-12-03T11:45:01.624 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 23%] 2023-12-03T11:45:01.806 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 23%] 2023-12-03T11:45:02.026 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 23%] 2023-12-03T11:45:02.212 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 23%] 2023-12-03T11:45:02.393 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 23%] 2023-12-03T11:45:02.622 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 24%] 2023-12-03T11:45:02.854 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 24%] 2023-12-03T11:45:03.052 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 24%] 2023-12-03T11:45:03.218 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 24%] 2023-12-03T11:45:03.399 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 24%] 2023-12-03T11:45:03.585 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 24%] 2023-12-03T11:45:03.816 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 25%] 2023-12-03T11:45:04.086 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 25%] 2023-12-03T11:45:04.270 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 25%] 2023-12-03T11:45:04.453 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 25%] 2023-12-03T11:45:04.634 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 25%] 2023-12-03T11:45:04.818 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 25%] 2023-12-03T11:45:05.001 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 25%] 2023-12-03T11:45:05.185 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 26%] 2023-12-03T11:45:05.404 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 26%] 2023-12-03T11:45:05.589 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 26%] 2023-12-03T11:45:05.772 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 26%] 2023-12-03T11:45:05.956 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 26%] 2023-12-03T11:45:06.141 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 26%] 2023-12-03T11:45:06.323 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 26%] 2023-12-03T11:45:06.536 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 27%] 2023-12-03T11:45:06.711 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 27%] 2023-12-03T11:45:06.886 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 27%] 2023-12-03T11:45:07.069 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 27%] 2023-12-03T11:45:07.253 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 27%] 2023-12-03T11:45:15.267 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 27%] 2023-12-03T11:45:15.443 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 28%] 2023-12-03T11:45:15.622 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 28%] 2023-12-03T11:45:15.834 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 28%] 2023-12-03T11:45:16.014 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 28%] 2023-12-03T11:45:16.191 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 28%] 2023-12-03T11:45:16.369 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 28%] 2023-12-03T11:45:16.545 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 28%] 2023-12-03T11:45:16.722 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 29%] 2023-12-03T11:45:16.936 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 29%] 2023-12-03T11:45:17.113 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 29%] 2023-12-03T11:45:17.289 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 29%] 2023-12-03T11:45:17.466 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 29%] 2023-12-03T11:45:17.651 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 29%] 2023-12-03T11:45:17.833 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 30%] 2023-12-03T11:45:18.020 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 30%] 2023-12-03T11:45:18.245 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 30%] 2023-12-03T11:45:18.427 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 30%] 2023-12-03T11:45:18.614 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 30%] 2023-12-03T11:45:18.799 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 30%] 2023-12-03T11:45:18.981 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 30%] 2023-12-03T11:45:19.165 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 31%] 2023-12-03T11:45:19.385 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 31%] 2023-12-03T11:45:19.613 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 31%] 2023-12-03T11:45:19.839 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 31%] 2023-12-03T11:45:20.025 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 31%] 2023-12-03T11:45:20.211 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 31%] 2023-12-03T11:45:20.397 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 31%] 2023-12-03T11:45:20.581 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 32%] 2023-12-03T11:45:20.661 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 32%] 2023-12-03T11:45:20.824 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 32%] 2023-12-03T11:45:21.328 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 32%] 2023-12-03T11:45:21.822 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 32%] 2023-12-03T11:45:22.006 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 32%] 2023-12-03T11:45:22.190 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 33%] 2023-12-03T11:45:22.412 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 33%] 2023-12-03T11:45:22.595 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 33%] 2023-12-03T11:45:22.820 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 33%] 2023-12-03T11:45:23.045 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 33%] 2023-12-03T11:45:23.231 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 33%] 2023-12-03T11:45:23.415 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 33%] 2023-12-03T11:45:23.639 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 34%] 2023-12-03T11:45:23.822 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 34%] 2023-12-03T11:45:24.004 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 34%] 2023-12-03T11:45:24.186 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 34%] 2023-12-03T11:45:24.544 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 34%] 2023-12-03T11:45:24.985 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 34%] 2023-12-03T11:45:25.109 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 34%] 2023-12-03T11:45:25.263 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 35%] 2023-12-03T11:45:25.376 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 35%] 2023-12-03T11:45:25.488 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 35%] 2023-12-03T11:45:25.530 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 35%] 2023-12-03T11:45:25.573 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 35%] 2023-12-03T11:45:25.614 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 35%] 2023-12-03T11:45:25.782 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 36%] 2023-12-03T11:45:25.960 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 36%] 2023-12-03T11:45:26.001 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 36%] 2023-12-03T11:45:26.202 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 36%] 2023-12-03T11:45:26.311 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 36%] 2023-12-03T11:45:26.426 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 36%] 2023-12-03T11:45:26.539 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 36%] 2023-12-03T11:45:26.941 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 37%] 2023-12-03T11:45:27.249 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 37%] 2023-12-03T11:45:27.554 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 37%] 2023-12-03T11:45:36.302 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 37%] 2023-12-03T11:45:44.925 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 37%] 2023-12-03T11:45:45.122 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 37%] 2023-12-03T11:45:45.284 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 38%] 2023-12-03T11:45:45.446 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 38%] 2023-12-03T11:45:45.609 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 38%] 2023-12-03T11:45:45.829 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 38%] 2023-12-03T11:45:45.995 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 38%] 2023-12-03T11:45:46.163 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 38%] 2023-12-03T11:45:46.342 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 38%] 2023-12-03T11:45:46.514 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 39%] 2023-12-03T11:45:46.754 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 39%] 2023-12-03T11:45:46.956 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 39%] 2023-12-03T11:45:47.117 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 39%] 2023-12-03T11:45:47.317 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 39%] 2023-12-03T11:45:47.424 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 39%] 2023-12-03T11:45:47.577 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 39%] 2023-12-03T11:45:47.732 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 40%] 2023-12-03T11:45:47.909 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 40%] 2023-12-03T11:45:48.072 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 40%] 2023-12-03T11:45:48.276 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 40%] 2023-12-03T11:45:48.436 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 40%] 2023-12-03T11:45:48.599 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 40%] 2023-12-03T11:45:48.801 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 41%] 2023-12-03T11:45:48.913 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 41%] 2023-12-03T11:45:49.025 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 41%] 2023-12-03T11:45:49.136 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 41%] 2023-12-03T11:45:49.246 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 41%] 2023-12-03T11:45:49.358 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 41%] 2023-12-03T11:45:49.506 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 41%] 2023-12-03T11:45:49.669 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 42%] 2023-12-03T11:45:49.780 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 42%] 2023-12-03T11:45:49.891 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 42%] 2023-12-03T11:45:50.001 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 42%] 2023-12-03T11:45:50.114 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 42%] 2023-12-03T11:45:50.297 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 42%] 2023-12-03T11:45:50.406 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 42%] 2023-12-03T11:45:50.515 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 43%] 2023-12-03T11:45:50.663 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 43%] 2023-12-03T11:45:50.775 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 43%] 2023-12-03T11:45:50.889 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 43%] 2023-12-03T11:45:51.000 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 43%] 2023-12-03T11:45:51.111 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 43%] 2023-12-03T11:45:51.289 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 44%] 2023-12-03T11:45:51.404 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 44%] 2023-12-03T11:45:51.610 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 44%] 2023-12-03T11:45:51.820 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 44%] 2023-12-03T11:45:52.028 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 44%] 2023-12-03T11:45:52.241 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 44%] 2023-12-03T11:45:52.450 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 44%] 2023-12-03T11:45:53.641 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 45%] 2023-12-03T11:45:53.858 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 45%] 2023-12-03T11:45:54.071 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 45%] 2023-12-03T11:45:54.329 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 45%] 2023-12-03T11:45:54.625 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 45%] 2023-12-03T11:45:54.921 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 45%] 2023-12-03T11:45:55.123 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 46%] 2023-12-03T11:45:55.384 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 46%] 2023-12-03T11:45:55.685 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 46%] 2023-12-03T11:45:55.892 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 46%] 2023-12-03T11:45:56.189 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 46%] 2023-12-03T11:45:56.355 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 46%] 2023-12-03T11:45:56.441 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 46%] 2023-12-03T11:45:56.563 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 47%] 2023-12-03T11:45:56.693 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 47%] 2023-12-03T11:45:56.806 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 47%] 2023-12-03T11:45:56.847 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 47%] 2023-12-03T11:45:57.043 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 47%] 2023-12-03T11:45:57.204 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 47%] 2023-12-03T11:45:57.367 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 47%] 2023-12-03T11:45:59.829 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 48%] 2023-12-03T11:45:59.994 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 48%] 2023-12-03T11:46:00.162 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 48%] 2023-12-03T11:46:00.327 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 48%] 2023-12-03T11:46:00.491 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 48%] 2023-12-03T11:46:00.615 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 48%] 2023-12-03T11:46:00.784 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 49%] 2023-12-03T11:46:00.946 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 49%] 2023-12-03T11:46:01.161 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 49%] 2023-12-03T11:46:01.362 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 49%] 2023-12-03T11:46:01.525 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 49%] 2023-12-03T11:46:01.685 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 49%] 2023-12-03T11:46:01.851 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 49%] 2023-12-03T11:46:02.022 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 50%] 2023-12-03T11:46:02.184 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 50%] 2023-12-03T11:46:02.346 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 50%] 2023-12-03T11:46:02.388 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 50%] 2023-12-03T11:46:02.468 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 50%] 2023-12-03T11:46:02.510 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 50%] 2023-12-03T11:46:02.617 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 50%] 2023-12-03T11:46:02.723 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 51%] 2023-12-03T11:46:02.830 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 51%] 2023-12-03T11:46:02.938 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 51%] 2023-12-03T11:46:03.089 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 51%] 2023-12-03T11:46:03.132 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 51%] 2023-12-03T11:46:03.176 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 51%] 2023-12-03T11:46:03.283 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 52%] 2023-12-03T11:46:03.326 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 52%] 2023-12-03T11:46:03.368 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 52%] 2023-12-03T11:46:03.410 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 52%] 2023-12-03T11:46:03.451 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 52%] 2023-12-03T11:46:03.569 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 52%] 2023-12-03T11:46:03.718 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 52%] 2023-12-03T11:46:03.833 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 53%] 2023-12-03T11:46:03.984 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 53%] 2023-12-03T11:46:04.174 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 53%] 2023-12-03T11:46:04.285 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 53%] 2023-12-03T11:46:04.435 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 53%] 2023-12-03T11:46:04.631 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 53%] 2023-12-03T11:46:04.779 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 53%] 2023-12-03T11:46:04.928 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 54%] 2023-12-03T11:46:05.133 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 54%] 2023-12-03T11:46:05.338 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 54%] 2023-12-03T11:46:05.591 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 54%] 2023-12-03T11:46:05.797 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 54%] 2023-12-03T11:46:06.038 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 54%] 2023-12-03T11:46:06.293 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 55%] 2023-12-03T11:46:06.547 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 55%] 2023-12-03T11:46:06.763 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 55%] 2023-12-03T11:46:06.942 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 55%] 2023-12-03T11:46:07.056 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 55%] 2023-12-03T11:46:07.308 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 55%] 2023-12-03T11:46:07.567 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 55%] 2023-12-03T11:46:07.855 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 56%] 2023-12-03T11:46:08.110 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 56%] 2023-12-03T11:46:08.365 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 56%] 2023-12-03T11:46:08.605 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 56%] 2023-12-03T11:46:08.792 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 56%] 2023-12-03T11:46:08.979 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 56%] 2023-12-03T11:46:09.218 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 57%] 2023-12-03T11:46:09.447 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 57%] 2023-12-03T11:46:09.566 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 57%] 2023-12-03T11:46:09.797 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_no_grants PASSED [ 57%] 2023-12-03T11:46:09.998 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 57%] 2023-12-03T11:46:10.206 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 57%] 2023-12-03T11:46:10.369 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 57%] 2023-12-03T11:46:10.490 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 58%] 2023-12-03T11:46:10.781 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 58%] 2023-12-03T11:46:11.111 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 58%] 2023-12-03T11:46:11.443 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 58%] 2023-12-03T11:46:11.770 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 58%] 2023-12-03T11:46:12.100 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 58%] 2023-12-03T11:46:12.469 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 58%] 2023-12-03T11:46:12.799 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 59%] 2023-12-03T11:46:13.125 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 59%] 2023-12-03T11:46:13.461 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 59%] 2023-12-03T11:46:13.793 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 59%] 2023-12-03T11:46:14.128 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 59%] 2023-12-03T11:46:14.421 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 59%] 2023-12-03T11:46:14.719 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 60%] 2023-12-03T11:46:15.138 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 60%] 2023-12-03T11:46:15.551 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 60%] 2023-12-03T11:46:15.591 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 60%] 2023-12-03T11:46:15.633 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 60%] 2023-12-03T11:46:15.674 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 60%] 2023-12-03T11:46:15.795 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 60%] 2023-12-03T11:46:15.914 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 61%] 2023-12-03T11:46:16.020 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 61%] 2023-12-03T11:46:16.127 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 61%] 2023-12-03T11:46:16.362 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 61%] 2023-12-03T11:46:17.147 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 61%] 2023-12-03T11:46:17.347 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 61%] 2023-12-03T11:46:17.571 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 61%] 2023-12-03T11:46:17.947 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 62%] 2023-12-03T11:46:18.205 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 62%] 2023-12-03T11:46:18.500 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 62%] 2023-12-03T11:46:18.711 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 62%] 2023-12-03T11:46:18.923 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 62%] 2023-12-03T11:46:19.297 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 62%] 2023-12-03T11:46:19.530 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 63%] 2023-12-03T11:46:19.770 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 63%] 2023-12-03T11:46:20.038 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 63%] 2023-12-03T11:46:20.520 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 63%] 2023-12-03T11:46:20.920 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 63%] 2023-12-03T11:46:21.036 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 63%] 2023-12-03T11:46:21.152 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 63%] 2023-12-03T11:46:22.049 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 64%] 2023-12-03T11:46:22.325 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 64%] 2023-12-03T11:46:23.772 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 64%] 2023-12-03T11:46:23.798 INFO:tasks.rgw.client.0.smithi044.stdout:*** Caught signal (Segmentation fault) ** 2023-12-03T11:46:23.799 INFO:tasks.rgw.client.0.smithi044.stdout: in thread 7f2095f97640 thread_name:radosgw 2023-12-03T11:46:23.799 INFO:tasks.rgw.client.0.smithi044.stdout: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:46:23.799 INFO:tasks.rgw.client.0.smithi044.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7f2154454db0] 2023-12-03T11:46:23.799 INFO:tasks.rgw.client.0.smithi044.stdout: 2: (RGWCompleteMultipart::complete()+0x4a) [0x55a628a3966a] 2023-12-03T11:46:23.799 INFO:tasks.rgw.client.0.smithi044.stdout: 3: (rgw_process_authenticated(RGWHandler_REST*, RGWOp*&, RGWRequest*, req_state*, optional_yield, rgw::sal::Driver*, bool)+0xb91) [0x55a6288cefb1] 2023-12-03T11:46:23.800 INFO:tasks.rgw.client.0.smithi044.stdout: 4: (process_request(RGWProcessEnv const&, RGWRequest*, std::__cxx11::basic_string, std::allocator > const&, RGWRestfulIO*, optional_yield, rgw::dmclock::Scheduler*, std::__cxx11::basic_string, std::allocator >*, std::chrono::duration >*, int*)+0xf75) [0x55a6288d2a75] 2023-12-03T11:46:23.800 INFO:tasks.rgw.client.0.smithi044.stdout: 5: radosgw(+0xc724b0) [0x55a6290c64b0] 2023-12-03T11:46:23.800 INFO:tasks.rgw.client.0.smithi044.stdout: 6: radosgw(+0x3cf496) [0x55a628823496] 2023-12-03T11:46:23.800 INFO:tasks.rgw.client.0.smithi044.stdout: 7: make_fcontext() 2023-12-03T11:46:23.800 INFO:tasks.rgw.client.0.smithi044.stdout:2023-12-03T11:46:23.798+0000 7f2095f97640 -1 *** Caught signal (Segmentation fault) ** 2023-12-03T11:46:23.800 INFO:tasks.rgw.client.0.smithi044.stdout: in thread 7f2095f97640 thread_name:radosgw 2023-12-03T11:46:23.800 INFO:tasks.rgw.client.0.smithi044.stdout: 2023-12-03T11:46:23.800 INFO:tasks.rgw.client.0.smithi044.stdout: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:46:23.800 INFO:tasks.rgw.client.0.smithi044.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7f2154454db0] 2023-12-03T11:46:23.800 INFO:tasks.rgw.client.0.smithi044.stdout: 2: (RGWCompleteMultipart::complete()+0x4a) [0x55a628a3966a] 2023-12-03T11:46:23.800 INFO:tasks.rgw.client.0.smithi044.stdout: 3: (rgw_process_authenticated(RGWHandler_REST*, RGWOp*&, RGWRequest*, req_state*, optional_yield, rgw::sal::Driver*, bool)+0xb91) [0x55a6288cefb1] 2023-12-03T11:46:23.800 INFO:tasks.rgw.client.0.smithi044.stdout: 4: (process_request(RGWProcessEnv const&, RGWRequest*, std::__cxx11::basic_string, std::allocator > const&, RGWRestfulIO*, optional_yield, rgw::dmclock::Scheduler*, std::__cxx11::basic_string, std::allocator >*, std::chrono::duration >*, int*)+0xf75) [0x55a6288d2a75] 2023-12-03T11:46:23.800 INFO:tasks.rgw.client.0.smithi044.stdout: 5: radosgw(+0xc724b0) [0x55a6290c64b0] 2023-12-03T11:46:23.800 INFO:tasks.rgw.client.0.smithi044.stdout: 6: radosgw(+0x3cf496) [0x55a628823496] 2023-12-03T11:46:23.800 INFO:tasks.rgw.client.0.smithi044.stdout: 7: make_fcontext() 2023-12-03T11:46:23.801 INFO:tasks.rgw.client.0.smithi044.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:46:23.801 INFO:tasks.rgw.client.0.smithi044.stdout: 2023-12-03T11:46:23.809 INFO:tasks.rgw.client.0.smithi044.stdout: 0> 2023-12-03T11:46:23.798+0000 7f2095f97640 -1 *** Caught signal (Segmentation fault) ** 2023-12-03T11:46:23.809 INFO:tasks.rgw.client.0.smithi044.stdout: in thread 7f2095f97640 thread_name:radosgw 2023-12-03T11:46:23.809 INFO:tasks.rgw.client.0.smithi044.stdout: 2023-12-03T11:46:23.809 INFO:tasks.rgw.client.0.smithi044.stdout: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:46:23.809 INFO:tasks.rgw.client.0.smithi044.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7f2154454db0] 2023-12-03T11:46:23.809 INFO:tasks.rgw.client.0.smithi044.stdout: 2: (RGWCompleteMultipart::complete()+0x4a) [0x55a628a3966a] 2023-12-03T11:46:23.809 INFO:tasks.rgw.client.0.smithi044.stdout: 3: (rgw_process_authenticated(RGWHandler_REST*, RGWOp*&, RGWRequest*, req_state*, optional_yield, rgw::sal::Driver*, bool)+0xb91) [0x55a6288cefb1] 2023-12-03T11:46:23.809 INFO:tasks.rgw.client.0.smithi044.stdout: 4: (process_request(RGWProcessEnv const&, RGWRequest*, std::__cxx11::basic_string, std::allocator > const&, RGWRestfulIO*, optional_yield, rgw::dmclock::Scheduler*, std::__cxx11::basic_string, std::allocator >*, std::chrono::duration >*, int*)+0xf75) [0x55a6288d2a75] 2023-12-03T11:46:23.809 INFO:tasks.rgw.client.0.smithi044.stdout: 5: radosgw(+0xc724b0) [0x55a6290c64b0] 2023-12-03T11:46:23.809 INFO:tasks.rgw.client.0.smithi044.stdout: 6: radosgw(+0x3cf496) [0x55a628823496] 2023-12-03T11:46:23.810 INFO:tasks.rgw.client.0.smithi044.stdout: 7: make_fcontext() 2023-12-03T11:46:23.810 INFO:tasks.rgw.client.0.smithi044.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:46:23.810 INFO:tasks.rgw.client.0.smithi044.stdout: 2023-12-03T11:46:23.820 INFO:tasks.rgw.client.0.smithi044.stdout: 0> 2023-12-03T11:46:23.798+0000 7f2095f97640 -1 *** Caught signal (Segmentation fault) ** 2023-12-03T11:46:23.820 INFO:tasks.rgw.client.0.smithi044.stdout: in thread 7f2095f97640 thread_name:radosgw 2023-12-03T11:46:23.820 INFO:tasks.rgw.client.0.smithi044.stdout: 2023-12-03T11:46:23.820 INFO:tasks.rgw.client.0.smithi044.stdout: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:46:23.821 INFO:tasks.rgw.client.0.smithi044.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7f2154454db0] 2023-12-03T11:46:23.821 INFO:tasks.rgw.client.0.smithi044.stdout: 2: (RGWCompleteMultipart::complete()+0x4a) [0x55a628a3966a] 2023-12-03T11:46:23.821 INFO:tasks.rgw.client.0.smithi044.stdout: 3: (rgw_process_authenticated(RGWHandler_REST*, RGWOp*&, RGWRequest*, req_state*, optional_yield, rgw::sal::Driver*, bool)+0xb91) [0x55a6288cefb1] 2023-12-03T11:46:23.821 INFO:tasks.rgw.client.0.smithi044.stdout: 4: (process_request(RGWProcessEnv const&, RGWRequest*, std::__cxx11::basic_string, std::allocator > const&, RGWRestfulIO*, optional_yield, rgw::dmclock::Scheduler*, std::__cxx11::basic_string, std::allocator >*, std::chrono::duration >*, int*)+0xf75) [0x55a6288d2a75] 2023-12-03T11:46:23.821 INFO:tasks.rgw.client.0.smithi044.stdout: 5: radosgw(+0xc724b0) [0x55a6290c64b0] 2023-12-03T11:46:23.821 INFO:tasks.rgw.client.0.smithi044.stdout: 6: radosgw(+0x3cf496) [0x55a628823496] 2023-12-03T11:46:23.821 INFO:tasks.rgw.client.0.smithi044.stdout: 7: make_fcontext() 2023-12-03T11:46:23.821 INFO:tasks.rgw.client.0.smithi044.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:46:23.821 INFO:tasks.rgw.client.0.smithi044.stdout: 2023-12-03T11:46:23.915 INFO:tasks.rgw.client.0.smithi044.stderr:daemon-helper: command crashed with signal 11 2023-12-03T11:46:28.139 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2023-12-03T11:46:34.450 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~6s 2023-12-03T11:46:40.760 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~13s 2023-12-03T11:46:40.887 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty FAILED [ 64%] 2023-12-03T11:46:40.887 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty ERROR [ 64%] 2023-12-03T11:46:47.071 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~19s 2023-12-03T11:46:53.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~25s 2023-12-03T11:46:58.115 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small FAILED [ 64%] 2023-12-03T11:46:58.115 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small ERROR [ 64%] 2023-12-03T11:46:59.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~32s 2023-12-03T11:47:06.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~38s 2023-12-03T11:47:12.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~44s 2023-12-03T11:47:14.983 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small FAILED [ 64%] 2023-12-03T11:47:14.983 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small ERROR [ 64%] 2023-12-03T11:47:18.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~50s 2023-12-03T11:47:22.742 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range FAILED [ 65%] 2023-12-03T11:47:22.743 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range ERROR [ 65%] 2023-12-03T11:47:24.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~57s 2023-12-03T11:47:31.244 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~63s 2023-12-03T11:47:37.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~69s 2023-12-03T11:47:43.753 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range FAILED [ 65%] 2023-12-03T11:47:43.753 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range ERROR [ 65%] 2023-12-03T11:47:43.866 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~76s 2023-12-03T11:47:50.177 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~82s 2023-12-03T11:47:56.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~88s 2023-12-03T11:48:02.798 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~95s 2023-12-03T11:48:02.877 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names FAILED [ 65%] 2023-12-03T11:48:02.877 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names ERROR [ 65%] 2023-12-03T11:48:09.109 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~101s 2023-12-03T11:48:15.420 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~107s 2023-12-03T11:48:16.983 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload FAILED [ 65%] 2023-12-03T11:48:16.983 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload ERROR [ 65%] 2023-12-03T11:48:21.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~114s 2023-12-03T11:48:26.106 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned FAILED [ 65%] 2023-12-03T11:48:26.106 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned ERROR [ 65%] 2023-12-03T11:48:28.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~120s 2023-12-03T11:48:34.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~126s 2023-12-03T11:48:40.664 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~133s 2023-12-03T11:48:41.774 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part FAILED [ 65%] 2023-12-03T11:48:41.774 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part ERROR [ 65%] 2023-12-03T11:48:46.975 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~139s 2023-12-03T11:48:53.286 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~145s 2023-12-03T11:48:59.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~151s 2023-12-03T11:49:00.247 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes FAILED [ 65%] 2023-12-03T11:49:00.247 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes ERROR [ 65%] 2023-12-03T11:49:05.908 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~158s 2023-12-03T11:49:12.220 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~164s 2023-12-03T11:49:16.524 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes FAILED [ 66%] 2023-12-03T11:49:16.525 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes ERROR [ 66%] 2023-12-03T11:49:18.531 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~170s 2023-12-03T11:49:24.841 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~177s 2023-12-03T11:49:31.151 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~183s 2023-12-03T11:49:31.508 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small FAILED [ 66%] 2023-12-03T11:49:31.508 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small ERROR [ 66%] 2023-12-03T11:49:37.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~189s 2023-12-03T11:49:40.430 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents FAILED [ 66%] 2023-12-03T11:49:40.430 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents ERROR [ 66%] 2023-12-03T11:49:43.773 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~196s 2023-12-03T11:49:50.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~202s 2023-12-03T11:49:53.954 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object FAILED [ 66%] 2023-12-03T11:49:53.954 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object ERROR [ 66%] 2023-12-03T11:49:56.394 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~208s 2023-12-03T11:50:02.705 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~215s 2023-12-03T11:50:09.016 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~221s 2023-12-03T11:50:09.093 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload FAILED [ 66%] 2023-12-03T11:50:09.093 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload ERROR [ 66%] 2023-12-03T11:50:15.326 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~227s 2023-12-03T11:50:21.636 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~233s 2023-12-03T11:50:26.114 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found FAILED [ 66%] 2023-12-03T11:50:26.115 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found ERROR [ 66%] 2023-12-03T11:50:27.946 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~240s 2023-12-03T11:50:34.256 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~246s 2023-12-03T11:50:40.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~252s 2023-12-03T11:50:44.458 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload FAILED [ 66%] 2023-12-03T11:50:44.458 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload ERROR [ 66%] 2023-12-03T11:50:46.874 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~259s 2023-12-03T11:50:53.185 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~265s 2023-12-03T11:50:53.881 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner FAILED [ 67%] 2023-12-03T11:50:53.881 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner ERROR [ 67%] 2023-12-03T11:50:59.495 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~271s 2023-12-03T11:51:05.804 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~278s 2023-12-03T11:51:12.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~284s 2023-12-03T11:51:13.254 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part FAILED [ 67%] 2023-12-03T11:51:13.302 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part ERROR [ 67%] 2023-12-03T11:51:18.424 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~290s 2023-12-03T11:51:24.735 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~297s 2023-12-03T11:51:31.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~303s 2023-12-03T11:51:31.046 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-12-03T11:51:32.312 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag FAILED [ 67%] 2023-12-03T11:51:32.312 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag ERROR [ 67%] 2023-12-03T11:51:32.355 INFO:tasks.ceph.osd.0:Sent signal 15 2023-12-03T11:51:32.355 INFO:tasks.ceph.osd.1:Sent signal 15 2023-12-03T11:51:32.356 INFO:tasks.ceph.osd.2:Sent signal 15 2023-12-03T11:51:32.356 INFO:tasks.ceph.osd.3:Sent signal 15 2023-12-03T11:51:32.356 INFO:tasks.ceph.osd.4:Sent signal 15 2023-12-03T11:51:32.356 INFO:tasks.ceph.osd.5:Sent signal 15 2023-12-03T11:51:32.356 INFO:tasks.ceph.osd.6:Sent signal 15 2023-12-03T11:51:32.357 INFO:tasks.ceph.osd.7:Sent signal 15 2023-12-03T11:51:32.357 INFO:tasks.ceph.mon.a:Sent signal 15 2023-12-03T11:51:32.357 INFO:tasks.ceph.mon.c:Sent signal 15 2023-12-03T11:51:32.357 INFO:tasks.ceph.mon.b:Sent signal 15 2023-12-03T11:51:32.358 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-12-03T11:51:32.358 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-12-03T11:51:32.359 INFO:tasks.ceph.osd.4.smithi091.stderr:2023-12-03T11:51:32.357+0000 7f078d6b7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 83818) UID: 0 2023-12-03T11:51:32.359 INFO:tasks.ceph.osd.4.smithi091.stderr:2023-12-03T11:51:32.357+0000 7f078d6b7640 -1 osd.4 259 *** Got signal Terminated *** 2023-12-03T11:51:32.359 INFO:tasks.ceph.osd.4.smithi091.stderr:2023-12-03T11:51:32.357+0000 7f078d6b7640 -1 osd.4 259 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-03T11:51:32.359 INFO:tasks.ceph.osd.0.smithi044.stderr:2023-12-03T11:51:32.355+0000 7feffe835640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 84150) UID: 0 2023-12-03T11:51:32.359 INFO:tasks.ceph.osd.0.smithi044.stderr:2023-12-03T11:51:32.355+0000 7feffe835640 -1 osd.0 259 *** Got signal Terminated *** 2023-12-03T11:51:32.359 INFO:tasks.ceph.osd.0.smithi044.stderr:2023-12-03T11:51:32.355+0000 7feffe835640 -1 osd.0 259 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-03T11:51:32.360 INFO:tasks.ceph.osd.6.smithi091.stderr:2023-12-03T11:51:32.357+0000 7f21eb34d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 83825) UID: 0 2023-12-03T11:51:32.360 INFO:tasks.ceph.osd.6.smithi091.stderr:2023-12-03T11:51:32.357+0000 7f21eb34d640 -1 osd.6 259 *** Got signal Terminated *** 2023-12-03T11:51:32.360 INFO:tasks.ceph.osd.6.smithi091.stderr:2023-12-03T11:51:32.357+0000 7f21eb34d640 -1 osd.6 259 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-03T11:51:32.360 INFO:tasks.ceph.osd.1.smithi044.stderr:2023-12-03T11:51:32.355+0000 7f07fc9e8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 84149) UID: 0 2023-12-03T11:51:32.360 INFO:tasks.ceph.osd.1.smithi044.stderr:2023-12-03T11:51:32.355+0000 7f07fc9e8640 -1 osd.1 259 *** Got signal Terminated *** 2023-12-03T11:51:32.360 INFO:tasks.ceph.osd.1.smithi044.stderr:2023-12-03T11:51:32.355+0000 7f07fc9e8640 -1 osd.1 259 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-03T11:51:32.361 INFO:tasks.ceph.osd.7.smithi091.stderr:2023-12-03T11:51:32.357+0000 7f9eaadb4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 83823) UID: 0 2023-12-03T11:51:32.361 INFO:tasks.ceph.osd.7.smithi091.stderr:2023-12-03T11:51:32.357+0000 7f9eaadb4640 -1 osd.7 259 *** Got signal Terminated *** 2023-12-03T11:51:32.361 INFO:tasks.ceph.osd.5.smithi091.stderr:2023-12-03T11:51:32.357+0000 7f046afe8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 83821) UID: 0 2023-12-03T11:51:32.361 INFO:tasks.ceph.osd.5.smithi091.stderr:2023-12-03T11:51:32.357+0000 7f046afe8640 -1 osd.5 259 *** Got signal Terminated *** 2023-12-03T11:51:32.361 INFO:tasks.ceph.osd.5.smithi091.stderr:2023-12-03T11:51:32.357+0000 7f046afe8640 -1 osd.5 259 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-03T11:51:32.361 INFO:tasks.ceph.osd.2.smithi044.stderr:2023-12-03T11:51:32.355+0000 7f2b18bdf640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 84153) UID: 0 2023-12-03T11:51:32.361 INFO:tasks.ceph.osd.2.smithi044.stderr:2023-12-03T11:51:32.355+0000 7f2b18bdf640 -1 osd.2 259 *** Got signal Terminated *** 2023-12-03T11:51:32.361 INFO:tasks.ceph.osd.2.smithi044.stderr:2023-12-03T11:51:32.355+0000 7f2b18bdf640 -1 osd.2 259 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-03T11:51:32.362 INFO:tasks.ceph.osd.3.smithi044.stderr:2023-12-03T11:51:32.355+0000 7fd5010b4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 84154) UID: 0 2023-12-03T11:51:32.362 INFO:tasks.ceph.osd.3.smithi044.stderr:2023-12-03T11:51:32.355+0000 7fd5010b4640 -1 osd.3 259 *** Got signal Terminated *** 2023-12-03T11:51:32.362 INFO:tasks.ceph.osd.3.smithi044.stderr:2023-12-03T11:51:32.355+0000 7fd5010b4640 -1 osd.3 259 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-03T11:51:32.362 INFO:tasks.ceph.mon.a.smithi044.stderr:2023-12-03T11:51:32.357+0000 7f9096822640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 83827) UID: 0 2023-12-03T11:51:32.362 INFO:tasks.ceph.mon.a.smithi044.stderr:2023-12-03T11:51:32.357+0000 7f9096822640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-03T11:51:32.363 INFO:tasks.ceph.osd.7.smithi091.stderr:2023-12-03T11:51:32.357+0000 7f9eaadb4640 -1 osd.7 259 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-03T11:51:32.363 INFO:tasks.ceph.mon.c.smithi044.stderr:2023-12-03T11:51:32.357+0000 7f633221b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 83829) UID: 0 2023-12-03T11:51:32.363 INFO:tasks.ceph.mon.c.smithi044.stderr:2023-12-03T11:51:32.357+0000 7f633221b640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-12-03T11:51:32.363 INFO:tasks.ceph.mon.b.smithi091.stderr:2023-12-03T11:51:32.358+0000 7f19aeb11640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 83291) UID: 0 2023-12-03T11:51:32.363 INFO:tasks.ceph.mon.b.smithi091.stderr:2023-12-03T11:51:32.358+0000 7f19aeb11640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-12-03T11:51:32.364 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:51:32.357+0000 7f78a5a07640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i y (PID: 83867) UID: 0 2023-12-03T11:51:32.364 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-12-03T11:51:32.357+0000 7f78a5a07640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-12-03T11:51:32.559 INFO:tasks.ceph.mgr.x.smithi091.stderr:daemon-helper: command crashed with signal 15 2023-12-03T11:51:45.643 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part FAILED [ 67%] 2023-12-03T11:51:45.643 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part ERROR [ 67%] 2023-12-03T11:52:02.512 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part FAILED [ 67%] 2023-12-03T11:52:02.512 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part ERROR [ 67%] 2023-12-03T11:52:17.095 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue FAILED [ 67%] 2023-12-03T11:52:17.096 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue ERROR [ 67%] 2023-12-03T11:52:37.894 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors FAILED [ 68%] 2023-12-03T11:52:37.894 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors ERROR [ 68%] 2023-12-03T11:52:57.958 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response FAILED [ 68%] 2023-12-03T11:52:57.959 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response ERROR [ 68%] 2023-12-03T11:53:10.643 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard FAILED [ 68%] 2023-12-03T11:53:10.644 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard ERROR [ 68%] 2023-12-03T11:53:25.402 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option FAILED [ 68%] 2023-12-03T11:53:25.402 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option ERROR [ 68%] 2023-12-03T11:53:44.851 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object FAILED [ 68%] 2023-12-03T11:53:44.851 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object ERROR [ 68%] 2023-12-03T11:54:03.643 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant FAILED [ 68%] 2023-12-03T11:54:03.644 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant ERROR [ 68%] 2023-12-03T11:54:16.764 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging FAILED [ 68%] 2023-12-03T11:54:16.764 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging ERROR [ 68%] 2023-12-03T11:54:36.013 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb FAILED [ 69%] 2023-12-03T11:54:36.013 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb ERROR [ 69%] 2023-12-03T11:54:54.253 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb FAILED [ 69%] 2023-12-03T11:54:54.254 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb ERROR [ 69%] 2023-12-03T11:55:11.540 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb FAILED [ 69%] 2023-12-03T11:55:11.540 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb ERROR [ 69%] 2023-12-03T11:55:27.530 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb FAILED [ 69%] 2023-12-03T11:55:27.530 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb ERROR [ 69%] 2023-12-03T11:55:46.985 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb FAILED [ 69%] 2023-12-03T11:55:46.985 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb ERROR [ 69%] 2023-12-03T11:56:09.865 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb FAILED [ 69%] 2023-12-03T11:56:09.865 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb ERROR [ 69%] 2023-12-03T11:56:27.016 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb FAILED [ 69%] 2023-12-03T11:56:27.016 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb ERROR [ 69%] 2023-12-03T11:56:47.339 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb FAILED [ 70%] 2023-12-03T11:56:47.340 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb ERROR [ 70%] 2023-12-03T11:57:01.672 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb FAILED [ 70%] 2023-12-03T11:57:01.672 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb ERROR [ 70%] 2023-12-03T11:57:14.437 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb FAILED [ 70%] 2023-12-03T11:57:14.438 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb ERROR [ 70%] 2023-12-03T11:57:27.121 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write FAILED [ 70%] 2023-12-03T11:57:27.122 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write ERROR [ 70%] 2023-12-03T11:57:36.155 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last FAILED [ 70%] 2023-12-03T11:57:36.156 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last ERROR [ 70%] 2023-12-03T11:57:53.331 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code FAILED [ 70%] 2023-12-03T11:57:53.332 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code ERROR [ 70%] 2023-12-03T11:58:11.555 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code FAILED [ 71%] 2023-12-03T11:58:11.555 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code ERROR [ 71%] 2023-12-03T11:58:34.231 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code FAILED [ 71%] 2023-12-03T11:58:34.231 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code ERROR [ 71%] 2023-12-03T11:58:47.961 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code FAILED [ 71%] 2023-12-03T11:58:47.961 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code ERROR [ 71%] 2023-12-03T11:59:03.699 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range FAILED [ 71%] 2023-12-03T11:59:03.699 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range ERROR [ 71%] 2023-12-03T11:59:14.762 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object FAILED [ 71%] 2023-12-03T11:59:14.763 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object ERROR [ 71%] 2023-12-03T11:59:28.363 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend FAILED [ 71%] 2023-12-03T11:59:28.364 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend ERROR [ 71%] 2023-12-03T11:59:50.307 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove FAILED [ 71%] 2023-12-03T11:59:50.307 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove ERROR [ 71%] 2023-12-03T12:00:10.995 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head FAILED [ 72%] 2023-12-03T12:00:10.995 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head ERROR [ 72%] 2023-12-03T12:00:32.422 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal FAILED [ 72%] 2023-12-03T12:00:32.423 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal ERROR [ 72%] 2023-12-03T12:00:48.809 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite FAILED [ 72%] 2023-12-03T12:00:48.809 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite ERROR [ 72%] 2023-12-03T12:01:02.182 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended FAILED [ 72%] 2023-12-03T12:01:02.182 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended ERROR [ 72%] 2023-12-03T12:01:21.429 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions FAILED [ 72%] 2023-12-03T12:01:21.429 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions ERROR [ 72%] 2023-12-03T12:01:34.355 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all FAILED [ 72%] 2023-12-03T12:01:34.355 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all ERROR [ 72%] 2023-12-03T12:01:46.957 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names FAILED [ 73%] 2023-12-03T12:01:46.958 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names ERROR [ 73%] 2023-12-03T12:02:01.695 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart FAILED [ 73%] 2023-12-03T12:02:01.695 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart ERROR [ 73%] 2023-12-03T12:02:10.504 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker FAILED [ 73%] 2023-12-03T12:02:10.505 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker ERROR [ 73%] 2023-12-03T12:02:30.093 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version FAILED [ 73%] 2023-12-03T12:02:30.093 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version ERROR [ 73%] 2023-12-03T12:02:35.865 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete FAILED [ 73%] 2023-12-03T12:02:35.865 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete ERROR [ 73%] 2023-12-03T12:02:53.401 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker FAILED [ 73%] 2023-12-03T12:02:53.401 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker ERROR [ 73%] 2023-12-03T12:03:13.916 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create FAILED [ 73%] 2023-12-03T12:03:13.916 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create ERROR [ 73%] 2023-12-03T12:03:23.096 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl FAILED [ 74%] 2023-12-03T12:03:23.097 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl ERROR [ 74%] 2023-12-03T12:03:43.504 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified FAILED [ 74%] 2023-12-03T12:03:43.505 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified ERROR [ 74%] 2023-12-03T12:04:00.931 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove FAILED [ 74%] 2023-12-03T12:04:00.932 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove ERROR [ 74%] 2023-12-03T12:04:15.931 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set FAILED [ 74%] 2023-12-03T12:04:15.931 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set ERROR [ 74%] 2023-12-03T12:04:37.177 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get FAILED [ 74%] 2023-12-03T12:04:37.178 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get ERROR [ 74%] 2023-12-03T12:04:48.656 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id FAILED [ 74%] 2023-12-03T12:04:48.656 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id ERROR [ 74%] 2023-12-03T12:05:00.371 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long FAILED [ 74%] 2023-12-03T12:05:00.371 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long ERROR [ 74%] 2023-12-03T12:05:10.665 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id FAILED [ 75%] 2023-12-03T12:05:10.666 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id ERROR [ 75%] 2023-12-03T12:05:23.498 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status FAILED [ 75%] 2023-12-03T12:05:23.499 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status ERROR [ 75%] 2023-12-03T12:05:36.190 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date FAILED [ 75%] 2023-12-03T12:05:36.190 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date ERROR [ 75%] 2023-12-03T12:05:58.461 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date FAILED [ 75%] 2023-12-03T12:05:58.461 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date ERROR [ 75%] 2023-12-03T12:06:09.140 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent FAILED [ 75%] 2023-12-03T12:06:09.140 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent ERROR [ 75%] 2023-12-03T12:06:21.613 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker FAILED [ 75%] 2023-12-03T12:06:21.613 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker ERROR [ 75%] 2023-12-03T12:06:37.615 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter FAILED [ 76%] 2023-12-03T12:06:37.616 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter ERROR [ 76%] 2023-12-03T12:06:54.546 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter FAILED [ 76%] 2023-12-03T12:06:54.546 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter ERROR [ 76%] 2023-12-03T12:07:15.668 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart FAILED [ 76%] 2023-12-03T12:07:15.669 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart ERROR [ 76%] 2023-12-03T12:07:34.808 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date FAILED [ 76%] 2023-12-03T12:07:34.808 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date ERROR [ 76%] 2023-12-03T12:07:53.375 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b FAILED [ 76%] 2023-12-03T12:07:53.375 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b ERROR [ 76%] 2023-12-03T12:08:11.299 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb FAILED [ 76%] 2023-12-03T12:08:11.299 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb ERROR [ 76%] 2023-12-03T12:08:26.674 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB FAILED [ 76%] 2023-12-03T12:08:26.674 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB ERROR [ 76%] 2023-12-03T12:08:40.225 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b FAILED [ 77%] 2023-12-03T12:08:40.226 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b ERROR [ 77%] 2023-12-03T12:08:55.779 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head FAILED [ 77%] 2023-12-03T12:08:55.779 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head ERROR [ 77%] 2023-12-03T12:09:10.120 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present FAILED [ 77%] 2023-12-03T12:09:10.121 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present ERROR [ 77%] 2023-12-03T12:09:20.462 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key FAILED [ 77%] 2023-12-03T12:09:20.462 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key ERROR [ 77%] 2023-12-03T12:09:35.108 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 FAILED [ 77%] 2023-12-03T12:09:35.108 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 ERROR [ 77%] 2023-12-03T12:09:47.389 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 FAILED [ 77%] 2023-12-03T12:09:47.389 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 ERROR [ 77%] 2023-12-03T12:10:04.865 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key FAILED [ 77%] 2023-12-03T12:10:04.866 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key ERROR [ 77%] 2023-12-03T12:10:20.593 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c FAILED [ 78%] 2023-12-03T12:10:20.593 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c ERROR [ 78%] 2023-12-03T12:10:41.666 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload FAILED [ 78%] 2023-12-03T12:10:41.666 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload ERROR [ 78%] 2023-12-03T12:11:01.745 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload FAILED [ 78%] 2023-12-03T12:11:01.745 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload ERROR [ 78%] 2023-12-03T12:11:10.636 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download FAILED [ 78%] 2023-12-03T12:11:10.636 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download ERROR [ 78%] 2023-12-03T12:11:30.431 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request FAILED [ 78%] 2023-12-03T12:11:30.431 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request ERROR [ 78%] 2023-12-03T12:11:47.212 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head FAILED [ 78%] 2023-12-03T12:11:47.212 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head ERROR [ 78%] 2023-12-03T12:12:04.493 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present FAILED [ 79%] 2023-12-03T12:12:04.493 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present ERROR [ 79%] 2023-12-03T12:12:18.658 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key FAILED [ 79%] 2023-12-03T12:12:18.658 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key ERROR [ 79%] 2023-12-03T12:12:31.644 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared FAILED [ 79%] 2023-12-03T12:12:31.644 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared ERROR [ 79%] 2023-12-03T12:12:49.853 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload FAILED [ 79%] 2023-12-03T12:12:49.854 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload ERROR [ 79%] 2023-12-03T12:13:11.572 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 FAILED [ 79%] 2023-12-03T12:13:11.572 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 ERROR [ 79%] 2023-12-03T12:13:29.404 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 FAILED [ 79%] 2023-12-03T12:13:29.404 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 ERROR [ 79%] 2023-12-03T12:13:42.100 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request FAILED [ 79%] 2023-12-03T12:13:42.101 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request ERROR [ 79%] 2023-12-03T12:13:55.571 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b FAILED [ 80%] 2023-12-03T12:13:55.571 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b ERROR [ 80%] 2023-12-03T12:14:03.918 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb FAILED [ 80%] 2023-12-03T12:14:03.918 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb ERROR [ 80%] 2023-12-03T12:14:16.872 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB FAILED [ 80%] 2023-12-03T12:14:16.873 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB ERROR [ 80%] 2023-12-03T12:14:27.981 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b FAILED [ 80%] 2023-12-03T12:14:27.981 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b ERROR [ 80%] 2023-12-03T12:14:42.662 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare FAILED [ 80%] 2023-12-03T12:14:42.662 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare ERROR [ 80%] 2023-12-03T12:15:01.604 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy FAILED [ 80%] 2023-12-03T12:15:01.604 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy ERROR [ 80%] 2023-12-03T12:15:08.678 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy FAILED [ 80%] 2023-12-03T12:15:08.678 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy ERROR [ 80%] 2023-12-03T12:15:27.756 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl FAILED [ 81%] 2023-12-03T12:15:27.757 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl ERROR [ 81%] 2023-12-03T12:15:40.858 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl FAILED [ 81%] 2023-12-03T12:15:40.858 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl ERROR [ 81%] 2023-12-03T12:16:02.001 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket FAILED [ 81%] 2023-12-03T12:16:02.001 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket ERROR [ 81%] 2023-12-03T12:16:15.254 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket FAILED [ 81%] 2023-12-03T12:16:15.254 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket ERROR [ 81%] 2023-12-03T12:16:36.690 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging FAILED [ 81%] 2023-12-03T12:16:36.690 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging ERROR [ 81%] 2023-12-03T12:16:55.086 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging FAILED [ 81%] 2023-12-03T12:16:55.086 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging ERROR [ 81%] 2023-12-03T12:17:10.422 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags FAILED [ 82%] 2023-12-03T12:17:10.422 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags ERROR [ 82%] 2023-12-03T12:17:20.185 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags FAILED [ 82%] 2023-12-03T12:17:20.185 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags ERROR [ 82%] 2023-12-03T12:17:40.175 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags FAILED [ 82%] 2023-12-03T12:17:40.175 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags ERROR [ 82%] 2023-12-03T12:17:51.841 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags FAILED [ 82%] 2023-12-03T12:17:51.841 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags ERROR [ 82%] 2023-12-03T12:18:13.729 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags FAILED [ 82%] 2023-12-03T12:18:13.729 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags ERROR [ 82%] 2023-12-03T12:18:29.058 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags FAILED [ 82%] 2023-12-03T12:18:29.059 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags ERROR [ 82%] 2023-12-03T12:18:43.521 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags FAILED [ 82%] 2023-12-03T12:18:43.521 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags ERROR [ 82%] 2023-12-03T12:18:58.501 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request FAILED [ 83%] 2023-12-03T12:18:58.501 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request ERROR [ 83%] 2023-12-03T12:19:09.131 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request FAILED [ 83%] 2023-12-03T12:19:09.132 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request ERROR [ 83%] 2023-12-03T12:19:17.289 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags FAILED [ 83%] 2023-12-03T12:19:17.289 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags ERROR [ 83%] 2023-12-03T12:19:27.380 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public FAILED [ 83%] 2023-12-03T12:19:27.380 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public ERROR [ 83%] 2023-12-03T12:19:43.271 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public FAILED [ 83%] 2023-12-03T12:19:43.272 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public ERROR [ 83%] 2023-12-03T12:20:00.361 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public FAILED [ 83%] 2023-12-03T12:20:00.361 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public ERROR [ 83%] 2023-12-03T12:20:12.617 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id FAILED [ 84%] 2023-12-03T12:20:12.617 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id ERROR [ 84%] 2023-12-03T12:20:29.367 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id FAILED [ 84%] 2023-12-03T12:20:29.367 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id ERROR [ 84%] 2023-12-03T12:20:47.721 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag FAILED [ 84%] 2023-12-03T12:20:47.721 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag ERROR [ 84%] 2023-12-03T12:21:07.181 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag FAILED [ 84%] 2023-12-03T12:21:07.182 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag ERROR [ 84%] 2023-12-03T12:21:31.128 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag FAILED [ 84%] 2023-12-03T12:21:31.128 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag ERROR [ 84%] 2023-12-03T12:21:44.143 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source FAILED [ 84%] 2023-12-03T12:21:44.144 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source ERROR [ 84%] 2023-12-03T12:21:55.504 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta FAILED [ 84%] 2023-12-03T12:21:55.504 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta ERROR [ 84%] 2023-12-03T12:22:08.081 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl FAILED [ 85%] 2023-12-03T12:22:08.081 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl ERROR [ 85%] 2023-12-03T12:22:27.123 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant FAILED [ 85%] 2023-12-03T12:22:27.125 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant ERROR [ 85%] 2023-12-03T12:22:39.443 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 FAILED [ 85%] 2023-12-03T12:22:39.443 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 ERROR [ 85%] 2023-12-03T12:22:54.935 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms FAILED [ 85%] 2023-12-03T12:22:54.936 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms ERROR [ 85%] 2023-12-03T12:23:09.395 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms FAILED [ 85%] 2023-12-03T12:23:09.395 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms ERROR [ 85%] 2023-12-03T12:23:22.340 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms FAILED [ 85%] 2023-12-03T12:23:22.340 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms ERROR [ 85%] 2023-12-03T12:23:37.521 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc FAILED [ 85%] 2023-12-03T12:23:37.522 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc ERROR [ 85%] 2023-12-03T12:23:50.336 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 FAILED [ 86%] 2023-12-03T12:23:50.336 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 ERROR [ 86%] 2023-12-03T12:24:06.892 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag FAILED [ 86%] 2023-12-03T12:24:06.892 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag ERROR [ 86%] 2023-12-03T12:24:28.657 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock FAILED [ 86%] 2023-12-03T12:24:28.657 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock ERROR [ 86%] 2023-12-03T12:24:40.869 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket FAILED [ 86%] 2023-12-03T12:24:40.869 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket ERROR [ 86%] 2023-12-03T12:24:58.576 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years FAILED [ 86%] 2023-12-03T12:24:58.576 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years ERROR [ 86%] 2023-12-03T12:25:16.128 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days FAILED [ 86%] 2023-12-03T12:25:16.128 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days ERROR [ 86%] 2023-12-03T12:25:33.046 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years FAILED [ 87%] 2023-12-03T12:25:33.046 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years ERROR [ 87%] 2023-12-03T12:25:45.366 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode FAILED [ 87%] 2023-12-03T12:25:45.366 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode ERROR [ 87%] 2023-12-03T12:26:02.895 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status FAILED [ 87%] 2023-12-03T12:26:02.896 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status ERROR [ 87%] 2023-12-03T12:26:21.463 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning FAILED [ 87%] 2023-12-03T12:26:21.464 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning ERROR [ 87%] 2023-12-03T12:26:45.391 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock FAILED [ 87%] 2023-12-03T12:26:45.392 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock ERROR [ 87%] 2023-12-03T12:26:56.674 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket FAILED [ 87%] 2023-12-03T12:26:56.674 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket ERROR [ 87%] 2023-12-03T12:27:11.546 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention FAILED [ 87%] 2023-12-03T12:27:11.546 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention ERROR [ 87%] 2023-12-03T12:27:25.867 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket FAILED [ 88%] 2023-12-03T12:27:25.867 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket ERROR [ 88%] 2023-12-03T12:27:39.058 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode FAILED [ 88%] 2023-12-03T12:27:39.058 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode ERROR [ 88%] 2023-12-03T12:27:57.631 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention FAILED [ 88%] 2023-12-03T12:27:57.631 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention ERROR [ 88%] 2023-12-03T12:28:13.906 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 FAILED [ 88%] 2023-12-03T12:28:13.907 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 ERROR [ 88%] 2023-12-03T12:28:32.197 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket FAILED [ 88%] 2023-12-03T12:28:32.197 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket ERROR [ 88%] 2023-12-03T12:28:50.412 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid FAILED [ 88%] 2023-12-03T12:28:50.413 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid ERROR [ 88%] 2023-12-03T12:29:06.516 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention FAILED [ 88%] 2023-12-03T12:29:06.516 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention ERROR [ 88%] 2023-12-03T12:29:27.187 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period FAILED [ 89%] 2023-12-03T12:29:27.187 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period ERROR [ 89%] 2023-12-03T12:29:44.131 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period FAILED [ 89%] 2023-12-03T12:29:44.131 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period ERROR [ 89%] 2023-12-03T12:30:01.630 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass FAILED [ 89%] 2023-12-03T12:30:01.630 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass ERROR [ 89%] 2023-12-03T12:30:20.491 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention FAILED [ 89%] 2023-12-03T12:30:20.491 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention ERROR [ 89%] 2023-12-03T12:30:38.096 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker FAILED [ 89%] 2023-12-03T12:30:38.096 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker ERROR [ 89%] 2023-12-03T12:30:57.697 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention FAILED [ 89%] 2023-12-03T12:30:57.697 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention ERROR [ 89%] 2023-12-03T12:31:12.884 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold FAILED [ 90%] 2023-12-03T12:31:12.885 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold ERROR [ 90%] 2023-12-03T12:31:28.587 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket FAILED [ 90%] 2023-12-03T12:31:28.587 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket ERROR [ 90%] 2023-12-03T12:31:36.978 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status FAILED [ 90%] 2023-12-03T12:31:36.978 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status ERROR [ 90%] 2023-12-03T12:31:55.144 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold FAILED [ 90%] 2023-12-03T12:31:55.144 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold ERROR [ 90%] 2023-12-03T12:32:14.030 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket FAILED [ 90%] 2023-12-03T12:32:14.030 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket ERROR [ 90%] 2023-12-03T12:32:19.349 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on FAILED [ 90%] 2023-12-03T12:32:19.350 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on ERROR [ 90%] 2023-12-03T12:32:37.011 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off FAILED [ 90%] 2023-12-03T12:32:37.012 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off ERROR [ 90%] 2023-12-03T12:32:56.578 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata FAILED [ 91%] 2023-12-03T12:32:56.579 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata ERROR [ 91%] 2023-12-03T12:33:06.396 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj FAILED [ 91%] 2023-12-03T12:33:06.396 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj ERROR [ 91%] 2023-12-03T12:33:12.507 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass FAILED [ 91%] 2023-12-03T12:33:12.507 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass ERROR [ 91%] 2023-12-03T12:33:28.021 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass FAILED [ 91%] 2023-12-03T12:33:28.021 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass ERROR [ 91%] 2023-12-03T12:33:42.518 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance FAILED [ 91%] 2023-12-03T12:33:42.518 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance ERROR [ 91%] 2023-12-03T12:33:53.606 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good FAILED [ 91%] 2023-12-03T12:33:53.606 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good ERROR [ 91%] 2023-12-03T12:34:12.928 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed FAILED [ 92%] 2023-12-03T12:34:12.928 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed ERROR [ 92%] 2023-12-03T12:34:24.611 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status FAILED [ 92%] 2023-12-03T12:34:24.611 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status ERROR [ 92%] 2023-12-03T12:34:45.866 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status FAILED [ 92%] 2023-12-03T12:34:45.866 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status ERROR [ 92%] 2023-12-03T12:34:57.771 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status FAILED [ 92%] 2023-12-03T12:34:57.771 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status ERROR [ 92%] 2023-12-03T12:35:07.503 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status FAILED [ 92%] 2023-12-03T12:35:07.503 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status ERROR [ 92%] 2023-12-03T12:35:26.049 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status FAILED [ 92%] 2023-12-03T12:35:26.049 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status ERROR [ 92%] 2023-12-03T12:35:43.294 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status FAILED [ 92%] 2023-12-03T12:35:43.295 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status ERROR [ 92%] 2023-12-03T12:36:02.553 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_default_public_block FAILED [ 93%] 2023-12-03T12:36:02.553 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_default_public_block ERROR [ 93%] 2023-12-03T12:36:26.188 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block FAILED [ 93%] 2023-12-03T12:36:26.188 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block ERROR [ 93%] 2023-12-03T12:36:38.735 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls FAILED [ 93%] 2023-12-03T12:36:38.735 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls ERROR [ 93%] 2023-12-03T12:36:48.044 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls FAILED [ 93%] 2023-12-03T12:36:48.045 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls ERROR [ 93%] 2023-12-03T12:37:08.623 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy FAILED [ 93%] 2023-12-03T12:37:08.624 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy ERROR [ 93%] 2023-12-03T12:37:26.247 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls FAILED [ 93%] 2023-12-03T12:37:26.247 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls ERROR [ 93%] 2023-12-03T12:37:33.708 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy FAILED [ 93%] 2023-12-03T12:37:33.708 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy ERROR [ 93%] 2023-12-03T12:37:52.079 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms FAILED [ 94%] 2023-12-03T12:37:52.079 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms ERROR [ 94%] 2023-12-03T12:38:12.808 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms FAILED [ 94%] 2023-12-03T12:38:12.808 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms ERROR [ 94%] 2023-12-03T12:38:21.857 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms FAILED [ 94%] 2023-12-03T12:38:21.857 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms ERROR [ 94%] 2023-12-03T12:38:37.972 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request FAILED [ 94%] 2023-12-03T12:38:37.972 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request ERROR [ 94%] 2023-12-03T12:38:53.015 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent FAILED [ 94%] 2023-12-03T12:38:53.015 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent ERROR [ 94%] 2023-12-03T12:39:05.319 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause ERROR [ 94%] 2023-12-03T12:39:05.506 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection ERROR [ 95%] 2023-12-03T12:39:05.770 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation ERROR [ 95%] 2023-12-03T12:39:05.959 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation ERROR [ 95%] 2023-12-03T12:39:06.219 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max ERROR [ 95%] 2023-12-03T12:39:06.489 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions ERROR [ 95%] 2023-12-03T12:39:06.677 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max ERROR [ 95%] 2023-12-03T12:39:06.937 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions ERROR [ 95%] 2023-12-03T12:39:07.127 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions ERROR [ 96%] 2023-12-03T12:39:07.378 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions ERROR [ 96%] 2023-12-03T12:39:07.646 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions ERROR [ 96%] 2023-12-03T12:39:07.834 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions ERROR [ 96%] 2023-12-03T12:39:08.092 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions ERROR [ 96%] 2023-12-03T12:39:08.362 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions ERROR [ 96%] 2023-12-03T12:39:08.544 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions ERROR [ 96%] 2023-12-03T12:39:08.802 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions ERROR [ 97%] 2023-12-03T12:39:08.989 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_alias ERROR [ 97%] 2023-12-03T12:39:09.243 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce ERROR [ 97%] 2023-12-03T12:39:09.511 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime ERROR [ 97%] 2023-12-03T12:39:09.699 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime ERROR [ 97%] 2023-12-03T12:39:09.959 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser ERROR [ 97%] 2023-12-03T12:39:10.137 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition ERROR [ 98%] 2023-12-03T12:39:10.388 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition ERROR [ 98%] 2023-12-03T12:39:10.649 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions ERROR [ 98%] 2023-12-03T12:39:10.839 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions ERROR [ 98%] 2023-12-03T12:39:11.103 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions ERROR [ 98%] 2023-12-03T12:39:11.367 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_version ERROR [ 98%] 2023-12-03T12:39:11.549 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions ERROR [ 98%] 2023-12-03T12:39:11.815 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions ERROR [ 99%] 2023-12-03T12:39:12.006 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions ERROR [ 99%] 2023-12-03T12:39:12.260 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions ERROR [ 99%] 2023-12-03T12:39:12.523 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions ERROR [ 99%] 2023-12-03T12:39:12.704 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions ERROR [ 99%] 2023-12-03T12:39:12.963 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions ERROR [ 99%] 2023-12-03T12:39:12.984 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2023-12-03T12:39:12.984 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.984 INFO:teuthology.orchestra.run.smithi044.stdout:==================================== ERRORS ==================================== 2023-12-03T12:39:12.984 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ ERROR at teardown of test_multipart_upload_empty _______________ 2023-12-03T12:39:12.984 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.984 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:12.984 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.984 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:12.984 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:12.984 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.985 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:12.985 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:12.985 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:12.985 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:12.985 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:12.985 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.985 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:12.985 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:12.985 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.985 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:12.985 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:12.985 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:12.985 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:12.985 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.986 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:12.986 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:12.986 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:12.986 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:12.986 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:12.986 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.986 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:12.986 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:12.986 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.986 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:12.986 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:12.986 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:12.986 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:12.987 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:12.987 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:12.987 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:12.987 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.987 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:12.987 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:12.987 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:12.987 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:12.987 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:12.987 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:12.987 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:12.987 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:12.987 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:12.988 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.988 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:12.988 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:12.988 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:12.988 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:12.988 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.988 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:12.988 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:12.988 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:12.988 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:12.988 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.988 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:12.988 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:12.989 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:12.989 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:12.989 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:12.989 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:12.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.989 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:12.989 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:12.989 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:12.989 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:12.989 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:12.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.989 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:12.989 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:12.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.989 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:12.990 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:12.990 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:12.990 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:12.990 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:12.990 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:12.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.990 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:12.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.990 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:12.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.990 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:12.990 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:12.991 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.991 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:12.991 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:12.991 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:12.991 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:12.991 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:12.991 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:12.991 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:12.991 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:12.991 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:12.991 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:12.991 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:12.991 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:12.991 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:12.992 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:12.992 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:12.992 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.992 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:12.992 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:12.992 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:12.992 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:12.992 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:12.992 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:12.992 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:12.992 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:12.992 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:12.992 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:12.992 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:12.993 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:12.993 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:12.993 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:12.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:12.993 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:12.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:12.993 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:12.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:12.993 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:12.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:12.993 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:12.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:12.993 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:12.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:12.993 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:12.994 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:12.994 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:12.994 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:12.994 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:12.994 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:12.994 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:12.994 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:12.994 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:12.994 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:12.994 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:12.994 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:12.994 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:12.994 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:12.994 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:12.995 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:12.995 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:12.995 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:12.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.995 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:12.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.995 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:12.995 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:12.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.995 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:12.995 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:12.995 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:12.995 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:12.995 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:12.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.996 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:12.996 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:12.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.996 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:12.996 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:12.996 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:12.996 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:12.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.996 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:12.996 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:12.996 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:12.996 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:12.996 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:12.996 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:12.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:12.997 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:12.997 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:12.997 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:12.997 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:12.997 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:12.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.002 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.002 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.003 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.003 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.003 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.003 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.003 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.003 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.003 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.003 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.003 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.003 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.003 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.003 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.003 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.003 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.004 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.004 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.004 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.004 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.004 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.004 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.004 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.004 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.004 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.004 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.004 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.004 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.005 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.005 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.005 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.005 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.005 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.005 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.005 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.006 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.006 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.006 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.006 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.006 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.006 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.007 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.007 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.007 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.007 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.007 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.007 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.007 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.007 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.007 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.007 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.007 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.007 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.007 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.007 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.008 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.008 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.008 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.008 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.008 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.008 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.008 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.008 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.008 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.008 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.008 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.008 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.008 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.008 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.008 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.009 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.009 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.009 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.009 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.009 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.009 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.009 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.009 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.009 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.009 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.009 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.010 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.010 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.010 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.010 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.010 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.010 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.010 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.010 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.010 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.010 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ ERROR at teardown of test_multipart_upload_small _______________ 2023-12-03T12:39:13.010 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.010 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.010 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.011 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.011 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.011 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.011 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.011 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.011 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.011 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.011 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.011 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.011 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.011 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.011 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.011 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.012 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.012 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.012 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.012 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.012 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.012 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.012 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.012 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.012 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.012 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.012 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.012 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.012 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.012 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.013 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.013 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.013 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.013 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.013 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.013 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.013 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.013 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.013 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.013 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.013 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.013 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.013 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.014 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.014 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.014 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.014 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.014 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.014 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.014 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.014 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.014 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.014 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.014 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.014 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.014 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.014 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.014 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.015 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.015 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.015 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.015 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.015 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.015 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.015 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.015 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.015 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.015 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.015 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.015 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.016 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.016 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.016 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.016 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.016 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.016 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.016 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.016 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.017 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.017 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.017 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.017 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.017 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.017 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.017 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.017 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.017 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.017 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.017 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.017 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.018 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.018 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.018 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.018 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.018 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.018 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.018 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.018 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.018 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.018 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.018 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.019 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.019 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.019 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.019 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.019 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.019 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.019 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.019 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.020 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.020 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.020 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.020 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.020 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.020 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.020 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.020 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.020 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.020 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.020 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.020 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.020 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.021 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.021 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.021 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.021 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.021 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.021 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.021 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.022 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.022 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.022 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.022 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.022 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.022 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.023 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.023 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.023 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.023 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.023 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.024 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.024 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.024 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.024 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.024 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.024 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.024 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.024 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.024 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.024 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.024 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.024 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.024 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.025 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.025 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.025 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.025 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.025 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.025 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.026 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.026 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.026 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.026 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.026 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.026 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.026 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.026 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.026 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.026 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.026 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.026 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.027 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.027 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.027 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.027 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.027 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.027 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.027 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.027 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.027 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.028 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.028 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.028 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.028 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.028 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.028 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.028 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.028 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.028 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.028 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.028 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.028 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.028 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.029 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.029 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.029 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.029 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.029 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.029 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.029 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.029 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.029 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.029 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.029 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.029 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.029 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.029 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.029 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.030 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.030 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.030 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.030 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.030 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.030 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.030 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.030 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.030 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.030 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.030 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.030 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.030 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.030 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.030 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.031 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.031 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.031 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.031 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.031 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.031 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.031 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.031 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.031 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.031 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.031 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.031 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.032 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.032 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.032 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.032 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.032 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.032 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.032 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.032 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.032 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.032 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.032 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.032 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.032 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.032 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.032 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.032 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.033 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.033 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.033 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.033 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.033 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.033 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.033 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.033 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.033 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.033 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.033 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.033 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.033 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.034 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.034 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.034 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.034 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.034 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.034 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.034 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.034 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.034 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.034 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.034 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.034 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.034 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at teardown of test_multipart_copy_small ________________ 2023-12-03T12:39:13.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.035 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.035 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.035 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.035 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.035 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.035 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.035 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.035 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.035 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.035 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.035 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.036 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.036 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.036 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.036 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.036 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.036 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.036 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.036 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.036 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.036 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.036 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.036 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.036 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.036 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.036 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.037 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.037 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.037 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.037 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.037 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.037 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.037 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.037 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.037 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.037 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.037 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.037 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.037 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.037 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.038 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.038 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.038 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.038 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.038 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.038 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.038 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.038 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.038 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.038 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.038 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.038 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.038 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.038 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.039 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.039 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.039 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.039 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.039 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.039 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.039 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.039 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.039 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.039 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.039 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.039 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.039 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.040 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.040 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.040 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.040 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.040 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.040 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.040 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.040 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.040 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.040 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.040 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.040 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.040 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.040 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.040 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.041 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.041 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.041 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.041 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.041 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.041 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.041 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.041 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.041 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.041 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.041 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.041 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.041 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.041 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.042 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.042 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.042 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.042 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.042 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.042 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.042 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.042 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.042 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.042 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.042 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.042 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.042 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.042 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.042 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.043 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.043 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.043 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.043 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.043 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.043 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.043 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.043 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.043 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.044 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.044 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.044 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.044 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.044 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.044 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.044 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.044 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.044 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.044 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.044 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.044 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.045 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.045 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.045 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.045 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.045 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.045 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.045 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.045 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.045 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.045 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.045 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.046 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.046 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.046 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.046 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.046 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.046 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.046 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.046 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.046 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.046 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.046 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.046 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.046 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.046 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.047 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.047 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.047 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.047 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.047 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.047 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.047 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.047 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.047 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.047 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.048 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.048 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.048 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.048 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.048 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.048 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.048 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.048 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.048 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.048 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.049 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.049 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.049 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.049 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.049 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.049 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.049 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.049 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.049 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.049 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.049 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.049 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.049 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.049 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.049 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.050 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.050 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.050 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.050 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.050 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.050 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.050 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.050 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.050 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.050 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.050 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.050 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.050 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.050 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.051 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.051 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.051 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.051 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.051 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.051 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.051 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.051 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.051 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.051 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.051 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.051 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.051 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.051 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.052 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.052 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.052 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.052 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.052 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.052 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.052 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.052 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.052 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.052 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.052 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.052 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.052 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.052 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.052 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.052 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.053 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.053 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.053 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.053 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.053 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.053 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.053 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.053 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.053 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.053 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.053 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.053 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.053 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.053 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.053 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.054 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.054 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.054 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.054 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.054 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.054 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.054 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.054 INFO:teuthology.orchestra.run.smithi044.stdout:____________ ERROR at teardown of test_multipart_copy_invalid_range ____________ 2023-12-03T12:39:13.054 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.054 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.054 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.054 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.054 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.054 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.055 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.055 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.055 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.055 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.055 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.055 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.055 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.055 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.055 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.055 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.055 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.055 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.055 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.055 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.056 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.056 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.056 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.056 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.056 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.056 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.056 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.056 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.056 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.056 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.056 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.056 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.056 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.056 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.056 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.057 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.057 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.057 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.057 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.057 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.057 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.057 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.057 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.057 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.057 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.057 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.057 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.057 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.057 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.057 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.059 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.059 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.059 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.060 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.060 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.060 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.061 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.061 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.061 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.061 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.061 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.061 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.061 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.061 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.061 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.061 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.061 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.061 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.061 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.061 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.061 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.062 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.062 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.062 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.062 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.062 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.062 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.062 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.062 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.062 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.062 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.062 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.062 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.062 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.063 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.063 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.063 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.063 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.063 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.063 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.063 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.063 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.063 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.063 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.063 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.063 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.063 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.063 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.064 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.064 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.064 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.064 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.064 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.064 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.064 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.064 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.064 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.064 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.064 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.064 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.064 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.064 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.064 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.066 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.066 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.066 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.067 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.067 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.067 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.067 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.067 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.067 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.067 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.067 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.067 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.067 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.067 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.067 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.067 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.068 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.068 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.068 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.068 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.068 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.068 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.068 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.068 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.068 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.068 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.068 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.068 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.068 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.068 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.068 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.068 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.069 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.069 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.069 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.069 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.069 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.069 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.069 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.069 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.069 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.069 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.069 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.069 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.069 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.069 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.069 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.070 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.070 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.070 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.070 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.070 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.070 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.073 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.073 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.073 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.073 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.073 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.073 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.073 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.073 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.073 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.073 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.075 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.075 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.075 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.075 INFO:teuthology.orchestra.run.smithi044.stdout:____________ ERROR at teardown of test_multipart_copy_without_range ____________ 2023-12-03T12:39:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.075 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.076 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.077 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.077 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.077 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.077 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.077 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.077 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.080 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.080 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.081 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.081 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.081 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.081 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.082 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.083 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.083 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.083 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.083 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.084 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.084 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.084 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.084 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.084 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.084 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.084 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.084 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.085 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.085 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.085 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.085 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.085 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.085 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.085 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.085 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.085 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.085 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.085 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.085 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.085 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.085 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.085 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.086 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.086 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.088 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.088 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.088 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.088 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.088 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.088 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.088 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.088 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.089 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.089 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.089 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.089 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.089 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.089 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.089 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.089 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.089 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.089 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.089 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.089 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.089 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.089 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.090 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.090 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.090 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.090 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.090 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.090 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.090 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.090 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.090 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.090 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.090 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.090 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.090 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.090 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.091 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.091 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.091 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.091 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.091 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.091 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.091 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.092 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.092 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.092 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.095 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.095 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.095 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.096 INFO:teuthology.orchestra.run.smithi044.stdout:____________ ERROR at teardown of test_multipart_copy_special_names ____________ 2023-12-03T12:39:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.096 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.097 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.097 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.097 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.097 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.097 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.097 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.097 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.097 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.097 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.097 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.097 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.101 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.101 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.101 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.101 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.101 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.101 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.101 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.101 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.101 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.101 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.101 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.103 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.103 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.103 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.103 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.104 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.104 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.104 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.104 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.104 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.104 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.104 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.104 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.104 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.104 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.104 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.104 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.104 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.104 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.105 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.105 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.105 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.105 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.105 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.105 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.105 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.105 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.105 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.105 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.105 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.105 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.105 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.106 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.106 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.108 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.108 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.108 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.108 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.108 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.109 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.109 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.109 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.109 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.109 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.109 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.109 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.109 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.109 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.109 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.109 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.109 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.109 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.109 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.110 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.110 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.110 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.110 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.110 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.110 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.110 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.110 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.110 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.110 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.110 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.110 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.110 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.110 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.112 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.112 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.112 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.112 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.115 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.115 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.115 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ ERROR at teardown of test_multipart_upload __________________ 2023-12-03T12:39:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.115 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.116 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.117 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.117 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.117 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.117 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.117 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.117 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.117 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.117 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.117 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.117 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.117 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.117 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.121 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.121 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.121 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.121 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.121 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.121 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.121 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.121 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.121 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.121 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.123 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.124 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.124 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.124 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.124 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.124 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.124 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.124 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.124 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.124 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.124 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.124 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.124 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.124 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.124 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.124 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.124 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.125 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.125 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.125 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.125 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.125 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.125 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.125 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.125 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.125 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.125 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.125 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.125 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.125 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.126 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.126 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.126 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.126 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.126 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.126 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.126 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.128 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.128 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.128 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.128 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.128 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.128 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.128 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.128 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.129 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.129 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.129 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.129 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.130 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.130 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.130 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.130 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.130 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.130 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.130 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.131 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.131 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.131 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.131 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.131 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.131 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.131 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.131 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.131 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.131 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.131 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.131 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.132 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.132 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.132 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.132 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.132 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.132 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.132 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.133 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.133 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.133 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.133 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.133 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.133 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.133 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.133 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.133 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.133 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.133 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.134 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.134 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.134 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.134 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.134 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.134 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.134 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.134 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.134 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.134 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.134 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.134 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.134 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.135 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.135 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.135 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.138 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.138 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.138 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.138 INFO:teuthology.orchestra.run.smithi044.stdout:______________ ERROR at teardown of test_multipart_copy_versioned ______________ 2023-12-03T12:39:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.138 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.139 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.140 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.140 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.140 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.140 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.140 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.140 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.144 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.144 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.144 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.144 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.144 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.144 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.144 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.144 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.144 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.144 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.145 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.146 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.146 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.146 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.146 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.147 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.147 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.147 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.147 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.147 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.147 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.147 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.147 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.147 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.147 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.147 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.147 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.147 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.147 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.147 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.148 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.148 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.148 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.148 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.148 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.148 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.150 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.150 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.150 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.151 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.151 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.151 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.151 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.151 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.151 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.151 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.151 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.151 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.151 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.151 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.151 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.151 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.151 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.151 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.152 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.153 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.153 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.153 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.153 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.153 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.153 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.153 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.154 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.154 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.154 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.154 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.154 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.157 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.157 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.158 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.158 INFO:teuthology.orchestra.run.smithi044.stdout:____________ ERROR at teardown of test_multipart_upload_resend_part ____________ 2023-12-03T12:39:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.158 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.159 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.159 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.159 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.159 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.159 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.159 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.160 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.163 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.163 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.163 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.163 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.163 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.163 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.163 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.163 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.163 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.164 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.164 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.164 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.164 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.164 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.164 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.164 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.164 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.164 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.164 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.164 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.164 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.164 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.164 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.164 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.165 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.166 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.166 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.166 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.166 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.166 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.166 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.166 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.166 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.166 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.166 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.166 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.166 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.166 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.166 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.167 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.167 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.167 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.167 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.167 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.167 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.167 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.167 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.167 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.167 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.167 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.167 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.167 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.167 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.168 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.168 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.168 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.168 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.170 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.170 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.170 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.170 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.170 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.170 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.170 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.170 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.170 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.171 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.171 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.171 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.171 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.171 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.171 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.171 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.171 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.171 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.171 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.171 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.171 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.171 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.171 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.172 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.172 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.172 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.172 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.172 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.172 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.172 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.173 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.173 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.173 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.173 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.173 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.173 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.173 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.174 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.174 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.174 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.177 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.177 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.178 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.178 INFO:teuthology.orchestra.run.smithi044.stdout:__________ ERROR at teardown of test_multipart_upload_multiple_sizes ___________ 2023-12-03T12:39:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.178 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.179 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.179 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.179 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.179 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.179 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.180 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.180 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.183 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.183 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.183 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.183 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.184 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.184 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.185 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.186 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.186 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.186 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.186 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.186 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.187 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.187 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.187 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.187 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.187 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.187 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.187 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.187 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.188 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.188 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.188 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.190 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.190 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.191 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.191 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.191 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.191 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.191 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.191 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.191 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.192 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.192 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.192 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.192 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.192 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.192 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.192 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.192 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.192 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.192 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.192 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.192 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.192 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.193 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.193 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.193 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.193 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.193 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.193 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.193 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.194 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.194 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.194 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.194 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.194 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.194 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.194 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.194 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.195 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.195 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.195 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.198 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.198 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.198 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.198 INFO:teuthology.orchestra.run.smithi044.stdout:___________ ERROR at teardown of test_multipart_copy_multiple_sizes ____________ 2023-12-03T12:39:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.198 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.199 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.200 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.200 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.200 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.200 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.200 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.200 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.200 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.200 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.200 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.200 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.200 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.204 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.204 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.204 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.204 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.204 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.204 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.204 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.204 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.204 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.204 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.204 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.204 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.204 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.204 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.204 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.205 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.205 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.205 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.205 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.205 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.205 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.205 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.205 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.205 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.205 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.205 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.205 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.206 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.206 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.206 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.206 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.206 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.206 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.206 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.206 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.206 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.206 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.206 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.206 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.206 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.206 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.206 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.207 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.207 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.207 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.207 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.207 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.207 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.207 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.207 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.207 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.207 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.207 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.207 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.208 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.208 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.208 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.208 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.208 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.208 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.208 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.208 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.208 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.208 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.208 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.208 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.208 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.208 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.208 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.208 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.209 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.209 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.209 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.209 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.209 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.209 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.209 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.209 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.209 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.209 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.209 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.209 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.210 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.210 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.210 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.210 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.210 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.210 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.210 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.210 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.210 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.210 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.211 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.211 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.211 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.211 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.211 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.211 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.211 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.211 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.211 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.211 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.212 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.212 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.212 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.212 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.212 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.212 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.212 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.212 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.212 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.212 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.212 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.212 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.212 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.212 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.212 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.212 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.212 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.213 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.213 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.213 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.213 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.213 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.213 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.213 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.214 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.214 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.214 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.214 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.214 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.214 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.214 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.215 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.215 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.215 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.215 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.215 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.215 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.215 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.215 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.215 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.215 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.215 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.215 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.215 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.215 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.215 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.216 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.216 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.216 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.216 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.216 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.216 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.216 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.216 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.216 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.216 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.216 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.216 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.216 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.216 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.217 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.217 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.217 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.217 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.217 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.217 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.217 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.217 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.217 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.217 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.217 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.217 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.217 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.217 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.218 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.218 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.218 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.218 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.218 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.218 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.218 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.218 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.218 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.218 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.218 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.218 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.218 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.219 INFO:teuthology.orchestra.run.smithi044.stdout:__________ ERROR at teardown of test_multipart_upload_size_too_small ___________ 2023-12-03T12:39:13.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.219 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.219 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.219 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.219 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.219 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.219 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.219 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.219 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.219 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.219 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.220 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.220 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.220 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.220 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.220 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.220 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.220 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.220 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.220 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.220 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.220 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.220 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.220 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.221 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.221 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.221 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.221 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.221 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.221 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.221 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.221 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.221 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.221 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.221 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.221 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.221 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.221 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.222 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.222 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.222 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.222 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.222 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.222 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.222 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.222 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.222 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.222 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.222 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.222 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.222 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.222 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.223 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.223 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.223 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.223 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.223 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.223 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.223 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.223 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.223 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.223 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.223 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.223 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.223 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.223 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.223 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.224 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.224 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.224 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.224 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.224 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.224 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.224 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.224 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.224 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.224 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.224 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.224 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.224 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.224 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.225 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.225 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.225 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.225 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.225 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.225 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.225 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.225 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.225 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.225 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.225 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.225 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.225 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.225 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.225 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.225 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.226 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.226 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.226 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.226 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.226 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.226 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.226 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.226 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.226 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.226 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.226 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.226 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.226 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.226 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.227 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.227 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.227 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.227 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.227 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.227 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.227 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.227 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.227 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.227 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.227 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.228 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.228 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.228 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.228 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.228 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.228 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.228 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.228 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.228 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.228 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.228 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.228 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.228 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.228 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.228 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.229 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.229 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.229 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.229 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.229 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.229 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.229 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.229 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.229 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.229 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.229 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.229 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.229 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.229 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.229 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.230 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.230 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.230 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.230 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.230 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.230 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.230 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.230 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.230 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.230 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.230 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.230 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.231 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.231 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.231 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.231 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.231 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.231 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.231 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.231 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.232 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.232 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.232 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.232 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.232 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.232 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.232 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.232 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.232 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.232 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.232 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.233 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.233 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.233 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.233 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.233 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.233 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.233 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.233 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.233 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.233 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.233 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.234 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.234 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.234 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.234 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.234 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.234 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.234 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.234 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.234 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.234 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.234 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.234 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.234 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.234 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.234 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.235 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.235 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.235 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.235 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.235 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.235 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.235 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.236 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.236 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.236 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.236 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.236 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.236 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.237 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.237 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.237 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.237 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.237 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.237 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.238 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.238 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.238 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.238 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.238 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.238 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.238 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.238 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.238 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.238 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.238 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.239 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.239 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.239 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.239 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.239 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.239 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.239 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.240 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.240 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.240 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.240 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.240 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.240 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.240 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.240 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.240 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.241 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.241 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.241 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.241 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.241 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.241 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.241 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.241 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.241 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.241 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.241 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.242 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.242 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.242 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.242 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.242 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.242 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.242 INFO:teuthology.orchestra.run.smithi044.stdout:_____________ ERROR at teardown of test_multipart_upload_contents ______________ 2023-12-03T12:39:13.242 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.242 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.242 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.242 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.242 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.243 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.243 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.243 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.243 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.243 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.243 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.243 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.243 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.243 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.243 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.243 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.243 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.243 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.244 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.244 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.244 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.244 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.244 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.244 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.244 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.244 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.244 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.244 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.244 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.244 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.245 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.245 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.245 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.245 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.245 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.245 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.245 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.245 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.245 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.245 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.245 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.245 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.245 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.245 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.245 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.246 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.246 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.246 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.246 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.246 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.246 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.246 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.246 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.246 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.246 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.246 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.246 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.246 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.246 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.247 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.247 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.247 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.247 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.247 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.247 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.247 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.247 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.247 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.247 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.247 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.248 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.248 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.248 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.248 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.248 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.248 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.248 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.248 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.248 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.248 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.248 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.248 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.248 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.248 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.249 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.249 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.249 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.249 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.249 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.249 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.249 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.249 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.249 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.249 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.249 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.249 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.249 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.249 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.249 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.250 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.250 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.250 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.250 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.250 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.250 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.250 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.250 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.250 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.250 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.250 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.250 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.250 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.250 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.251 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.251 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.251 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.251 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.251 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.251 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.251 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.251 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.251 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.251 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.251 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.251 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.251 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.251 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.252 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.252 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.252 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.252 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.252 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.252 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.252 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.252 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.252 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.252 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.252 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.252 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.252 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.252 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.252 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.252 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.253 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.253 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.253 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.253 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.253 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.253 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.253 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.253 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.253 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.253 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.253 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.253 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.253 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.253 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.253 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.254 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.254 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.254 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.254 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.254 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.254 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.254 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.254 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.254 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.254 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.254 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.254 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.254 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.254 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.254 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.255 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.255 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.255 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.255 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.255 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.255 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.255 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.255 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.255 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.255 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.255 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.255 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.255 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.255 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.255 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.255 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.256 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.256 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.256 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.256 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.256 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.256 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.256 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.256 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.256 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.256 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.256 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.256 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.256 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.256 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.257 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.257 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.257 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.257 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.257 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.257 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.257 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.257 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.257 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.257 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.257 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.257 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.257 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.257 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.258 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.258 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.258 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.258 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.258 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.258 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.258 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.258 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.258 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.258 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.258 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.258 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.258 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.259 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.259 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.259 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.259 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.259 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.259 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.259 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.259 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.259 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.259 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.259 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.259 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.259 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.259 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.259 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.259 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.260 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.260 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.260 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.260 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.260 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.260 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.260 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.260 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.260 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.260 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.260 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.260 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.260 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.260 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.260 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.260 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.261 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.261 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.261 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.261 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.261 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.261 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.261 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.261 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.261 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.261 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.261 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.261 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.261 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.261 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.262 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.262 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.262 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.262 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.262 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.262 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.262 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.262 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.262 INFO:teuthology.orchestra.run.smithi044.stdout:_____ ERROR at teardown of test_multipart_upload_overwrite_existing_object _____ 2023-12-03T12:39:13.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.262 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.263 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.263 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.263 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.263 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.263 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.263 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.263 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.263 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.263 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.263 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.264 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.264 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.264 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.264 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.264 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.264 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.264 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.268 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.268 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.268 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.268 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.268 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.268 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.270 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.270 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.270 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.271 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.271 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.271 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.271 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.271 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.271 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.271 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.271 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.271 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.271 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.271 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.271 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.271 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.271 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.272 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.272 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.272 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.272 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.272 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.272 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.272 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.273 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.273 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.274 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.275 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.275 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.275 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.275 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.275 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.275 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.276 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.276 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.276 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.276 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.276 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.276 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.276 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.276 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.276 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.276 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.276 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.276 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.276 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.276 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.276 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.276 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.277 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.277 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.277 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.277 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.277 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.277 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.277 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.278 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.278 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.278 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.278 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.278 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.278 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.278 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.278 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.278 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.278 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.278 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.278 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.278 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.278 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.279 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.279 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.284 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.284 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.284 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.284 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ ERROR at teardown of test_abort_multipart_upload _______________ 2023-12-03T12:39:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.284 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.285 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.286 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.286 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.286 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.286 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.286 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.286 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.286 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.287 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.290 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.290 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.290 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.290 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.291 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.291 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.292 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.293 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.293 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.293 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.293 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.293 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.293 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.293 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.293 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.293 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.293 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.293 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.293 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.293 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.293 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.293 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.294 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.294 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.294 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.294 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.294 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.294 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.294 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.294 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.294 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.294 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.294 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.294 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.294 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.294 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.295 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.295 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.295 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.295 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.295 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.297 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.297 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.297 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.297 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.298 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.298 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.298 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.298 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.298 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.298 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.298 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.298 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.298 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.298 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.298 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.298 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.298 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.298 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.299 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.299 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.299 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.299 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.299 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.299 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.299 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.300 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.300 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.300 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.300 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.300 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.300 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.300 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.301 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.301 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.301 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.301 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.301 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.301 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.304 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.304 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.305 INFO:teuthology.orchestra.run.smithi044.stdout:__________ ERROR at teardown of test_abort_multipart_upload_not_found __________ 2023-12-03T12:39:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.305 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.306 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.306 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.306 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.306 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.306 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.306 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.306 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.306 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.306 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.306 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.307 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.307 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.307 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.307 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.307 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.307 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.307 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.307 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.307 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.307 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.307 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.307 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.311 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.311 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.311 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.311 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.311 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.311 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.312 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.313 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.314 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.314 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.314 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.314 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.314 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.314 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.314 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.314 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.314 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.314 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.314 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.314 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.314 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.315 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.315 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.315 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.315 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.315 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.315 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.315 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.315 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.315 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.315 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.315 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.315 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.315 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.315 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.315 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.316 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.317 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.318 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.318 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.318 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.318 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.319 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.319 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.319 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.319 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.319 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.319 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.319 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.319 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.319 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.319 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.319 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.319 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.319 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.319 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.320 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.320 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.320 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.320 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.320 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.320 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.320 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.321 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.321 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.321 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.321 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.321 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.321 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.321 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.321 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.321 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.321 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.321 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.321 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.321 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.321 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.322 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.322 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.322 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.322 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.325 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.325 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.325 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.325 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ ERROR at teardown of test_list_multipart_upload ________________ 2023-12-03T12:39:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.326 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.327 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.327 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.327 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.327 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.327 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.328 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.328 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.331 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.331 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.331 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.331 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.331 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.331 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.333 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.334 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.334 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.334 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.334 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.334 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.334 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.334 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.334 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.335 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.335 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.335 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.335 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.335 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.335 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.335 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.336 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.336 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.336 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.338 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.338 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.338 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.338 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.338 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.339 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.339 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.339 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.339 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.339 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.339 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.339 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.339 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.341 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.341 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.341 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.341 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.341 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.341 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.342 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.342 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.342 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.342 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.342 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.345 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.345 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.345 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.345 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.345 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.345 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.346 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.346 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.346 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.346 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.346 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.346 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.347 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.347 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.347 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.347 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.347 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.347 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.347 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.348 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.348 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.348 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.348 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.348 INFO:teuthology.orchestra.run.smithi044.stdout:____________ ERROR at teardown of test_list_multipart_upload_owner _____________ 2023-12-03T12:39:13.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.348 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.348 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.348 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.350 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.350 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.350 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.350 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.350 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.350 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.351 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.354 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.354 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.354 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.354 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.354 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.354 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.354 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.354 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.354 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.354 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.354 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.354 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.354 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.354 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.356 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.357 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.357 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.357 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.357 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.357 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.357 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.357 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.357 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.357 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.358 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.358 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.358 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.358 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.358 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.358 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.359 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.359 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.359 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.361 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.361 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.361 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.361 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.362 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.362 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.362 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.362 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.362 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.362 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.363 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.363 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.363 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.363 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.363 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.363 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.363 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.363 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.364 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.364 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.364 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.364 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.364 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.364 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.365 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.365 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.365 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.365 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.368 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.368 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.368 INFO:teuthology.orchestra.run.smithi044.stdout:___________ ERROR at teardown of test_multipart_upload_missing_part ____________ 2023-12-03T12:39:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.369 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.370 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.370 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.370 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.370 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.370 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.370 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.370 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.374 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.374 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.374 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.374 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.374 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.375 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.376 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.376 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.376 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.376 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.376 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.376 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.376 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.376 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.376 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.376 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.376 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.376 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.376 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.377 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.377 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.377 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.377 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.377 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.377 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.377 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.377 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.377 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.377 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.377 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.377 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.377 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.377 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.377 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.378 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.378 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.378 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.378 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.378 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.378 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.378 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.378 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.378 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.378 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.378 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.378 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.378 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.378 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.378 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.379 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.379 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.379 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.379 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.379 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.379 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.379 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.379 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.379 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.379 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.379 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.379 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.379 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.379 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.381 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.381 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.381 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.381 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.381 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.381 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.381 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.381 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.381 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.381 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.381 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.381 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.381 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.382 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.382 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.382 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.382 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.382 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.382 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.382 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.382 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.382 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.382 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.382 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.382 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.382 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.382 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.383 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.383 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.383 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.383 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.383 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.383 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.383 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.383 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.383 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.383 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.383 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.383 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.383 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.383 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.384 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.384 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.384 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.384 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.384 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.384 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.384 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.384 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.384 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.384 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.384 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.384 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.384 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.384 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.384 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.384 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.384 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.385 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.385 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.385 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.385 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.385 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.385 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.385 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.385 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.385 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.385 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.385 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.385 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.386 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.386 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.386 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.386 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.386 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.386 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.386 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.386 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.386 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.386 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.386 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.386 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.386 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.386 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.387 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.387 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.387 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.387 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.387 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.387 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.387 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.387 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.387 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.387 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.387 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.387 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.387 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.388 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.388 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.388 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.388 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.388 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.388 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.388 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.388 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.388 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.388 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.388 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.388 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.389 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.389 INFO:teuthology.orchestra.run.smithi044.stdout:__________ ERROR at teardown of test_multipart_upload_incorrect_etag ___________ 2023-12-03T12:39:13.389 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.389 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.389 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.389 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.389 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.389 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.389 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.389 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.389 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.389 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.389 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.389 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.389 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.390 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.390 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.390 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.390 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.390 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.390 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.390 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.390 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.390 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.390 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.390 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.391 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.391 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.391 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.391 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.391 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.391 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.391 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.391 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.391 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.391 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.391 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.393 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.393 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.393 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.393 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.417 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.417 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.417 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.417 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.417 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.417 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.417 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.417 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.417 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.417 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.417 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.418 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.418 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.418 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.418 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.418 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.418 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.418 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.418 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.418 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.419 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.419 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.419 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.419 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.419 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.419 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.419 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.419 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.419 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.419 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.419 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.419 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.419 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.419 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.420 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.421 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.421 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.421 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.421 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.421 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.421 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.421 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.421 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.421 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.421 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.422 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.422 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.422 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.422 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.422 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.422 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.422 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.422 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.422 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.422 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.422 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.422 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.422 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.422 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.423 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.423 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.423 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.423 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.423 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.423 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.423 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.423 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.423 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.423 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.423 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.423 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.423 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.423 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.425 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.425 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.425 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.425 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.425 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.425 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.425 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.425 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.425 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.425 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.425 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.425 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.426 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.426 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.426 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.426 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.426 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.426 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.426 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.426 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.426 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.426 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.426 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.426 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.426 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.426 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.426 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.427 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.427 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.427 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.427 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.427 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.427 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.427 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.427 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.427 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.427 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.427 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.427 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.428 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.428 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.428 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.428 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.428 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.428 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.428 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.428 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.428 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.428 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.428 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.428 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.428 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.428 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.428 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.428 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.429 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.429 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.429 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.429 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.429 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.429 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.429 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.429 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.429 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.429 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.429 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.429 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.429 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.430 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.430 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.430 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.430 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.430 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.430 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.430 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.430 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.430 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.430 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.430 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.430 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.430 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.430 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.431 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.431 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.431 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.431 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.431 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.431 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.431 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.431 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.431 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.431 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.431 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.431 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.431 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.431 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.432 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.432 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.432 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.432 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.432 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.432 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.432 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.432 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.432 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.432 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.432 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.432 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.432 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.432 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.432 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.433 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.433 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.433 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.433 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.433 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.433 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.433 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ ERROR at teardown of test_multipart_get_part _________________ 2023-12-03T12:39:13.433 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.433 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.433 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.433 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.433 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.433 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.433 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.433 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.433 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.434 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.434 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.434 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.434 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.434 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.434 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.434 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.434 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.434 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.434 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.434 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.434 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.434 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.434 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.435 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.435 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.435 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.435 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.435 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.435 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.435 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.435 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.435 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.435 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.435 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.435 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.436 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.436 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.436 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.436 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.436 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.436 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.436 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.436 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.436 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.436 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.436 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.436 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.436 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.436 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.436 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.436 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.437 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.437 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.437 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.437 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.437 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.437 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.437 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.437 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.437 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.437 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.437 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.437 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.437 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.437 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.437 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.437 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.438 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.438 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.438 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.438 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.438 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.438 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.438 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.438 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.438 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.438 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.438 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.439 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.439 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.439 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.439 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.439 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.439 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.439 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.439 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.439 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.439 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.439 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.439 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.439 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.439 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.439 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.440 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.441 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.441 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.441 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.441 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.441 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.441 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.441 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.441 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.441 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.441 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.441 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.441 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.442 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.442 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.442 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.442 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.442 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.442 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.442 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.442 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.442 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.442 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.442 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.442 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.442 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.442 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.443 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.443 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.443 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.443 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.443 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.443 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.443 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.443 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.443 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.443 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.443 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.443 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.444 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.444 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.444 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.444 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.444 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.444 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.444 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.444 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.444 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.444 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.444 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.444 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.445 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.445 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.445 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.445 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.445 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.445 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.445 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.445 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.445 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.445 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.445 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.446 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.446 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.446 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.446 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.446 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.446 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.446 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.446 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.446 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.446 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.446 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.446 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.446 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.446 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.447 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.447 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.447 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.447 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.447 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.447 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.447 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.447 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.447 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.447 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.447 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.447 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.447 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.447 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.447 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.448 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.448 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.448 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.448 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.448 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.448 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.448 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.449 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.449 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.449 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.449 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.449 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.449 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.449 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.449 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.449 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.449 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.449 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.449 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.449 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.450 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.450 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.450 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.450 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.450 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.450 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.450 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.450 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.450 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.451 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.451 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.451 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.451 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.451 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.451 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.451 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.451 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.451 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.451 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.451 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.451 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.451 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.451 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.452 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.452 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.452 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.452 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.452 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.452 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.452 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.452 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.452 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.452 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.452 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.453 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.453 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.453 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.453 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.453 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.454 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.454 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.454 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.454 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.454 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.455 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.455 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ ERROR at teardown of test_non_multipart_get_part _______________ 2023-12-03T12:39:13.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.455 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.455 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.455 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.456 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.456 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.456 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.456 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.456 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.456 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.456 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.456 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.456 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.456 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.457 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.457 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.457 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.457 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.457 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.457 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.457 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.458 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.458 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.458 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.458 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.458 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.458 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.458 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.458 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.458 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.458 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.459 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.459 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.459 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.459 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.459 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.459 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.459 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.459 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.459 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.459 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.459 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.459 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.459 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.459 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.460 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.460 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.460 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.460 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.460 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.460 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.460 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.460 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.460 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.460 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.460 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.460 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.460 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.460 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.460 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.460 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.461 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.461 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.461 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.461 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.461 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.461 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.461 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.461 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.461 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.461 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.462 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.462 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.462 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.462 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.462 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.462 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.462 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.462 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.462 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.462 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.462 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.462 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.462 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.463 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.463 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.463 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.463 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.463 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.463 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.463 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.463 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.463 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.463 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.463 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.463 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.463 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.463 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.464 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.464 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.464 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.464 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.464 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.464 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.464 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.464 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.464 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.464 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.464 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.464 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.464 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.465 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.465 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.465 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.465 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.465 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.465 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.465 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.465 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.465 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.465 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.465 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.465 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.465 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.465 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.465 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.466 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.466 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.466 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.466 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.466 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.466 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.466 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.466 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.466 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.466 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.467 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.467 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.467 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.467 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.467 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.467 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.467 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.467 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.467 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.467 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.467 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.467 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.467 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.468 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.468 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.468 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.468 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.468 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.468 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.468 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.468 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.468 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.469 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.469 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.469 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.469 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.469 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.469 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.469 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.469 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.469 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.469 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.469 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.470 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.470 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.470 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.470 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.470 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.470 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.470 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.470 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.471 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.471 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.471 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.471 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.471 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.471 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.471 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.471 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.471 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.471 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.471 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.471 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.471 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.471 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.472 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.472 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.472 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.472 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.472 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.472 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.472 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.472 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.472 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.472 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.472 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.472 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.472 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.475 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.475 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.475 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.475 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.475 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.475 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.475 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.475 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.475 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.476 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.476 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.476 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.476 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.476 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.476 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.476 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.476 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.476 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.476 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.476 INFO:teuthology.orchestra.run.smithi044.stdout:____________________ ERROR at teardown of test_100_continue ____________________ 2023-12-03T12:39:13.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.476 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.477 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.477 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.477 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.477 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.477 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.477 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.477 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.477 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.477 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.477 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.477 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.477 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.478 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.478 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.478 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.478 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.478 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.478 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.478 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.478 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.478 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.478 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.478 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.478 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.478 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.482 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.482 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.482 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.482 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.482 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.482 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.482 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.482 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.482 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.482 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.483 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.483 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.485 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.485 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.485 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.485 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.485 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.485 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.485 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.485 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.485 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.485 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.486 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.486 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.486 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.486 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.486 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.486 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.486 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.486 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.486 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.486 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.486 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.486 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.486 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.486 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.486 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.487 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.487 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.487 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.487 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.487 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.487 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.487 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.487 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.487 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.487 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.487 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.487 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.487 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.487 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.487 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.487 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.488 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.488 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.488 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.488 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.488 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.488 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.488 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.488 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.488 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.488 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.488 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.489 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.489 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.489 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.489 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.489 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.490 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.490 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.490 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.490 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.490 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.490 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.490 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.490 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.490 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.490 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.490 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.490 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.491 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.491 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.491 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.491 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.491 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.491 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.491 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.491 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.491 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.491 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.491 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.491 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.491 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.492 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.492 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.492 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.492 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.492 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.492 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.492 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.492 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.492 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.493 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.493 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.493 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.493 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.493 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.493 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.493 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.493 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.493 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.493 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.493 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.493 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.493 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.493 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.494 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.494 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.494 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.494 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.494 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.494 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.494 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.494 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.494 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.494 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.494 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.494 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.494 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.494 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.495 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.495 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.495 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.495 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.495 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.495 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.495 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.496 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.496 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.496 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.496 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.496 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.496 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.496 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.496 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.496 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.497 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.497 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.497 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.497 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.497 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.497 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.497 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.497 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.497 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.497 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.497 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.497 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.497 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.497 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.497 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.498 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.498 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.498 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.498 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.498 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.498 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.498 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.498 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.498 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.498 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.498 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.498 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.499 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.499 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.499 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.499 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.499 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.499 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.499 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.499 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.499 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.499 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.499 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.499 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.499 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.499 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.499 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.500 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.500 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.500 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.500 INFO:teuthology.orchestra.run.smithi044.stdout:______________________ ERROR at teardown of test_set_cors ______________________ 2023-12-03T12:39:13.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.500 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.500 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.500 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.500 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.500 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.500 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.501 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.501 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.501 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.501 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.501 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.501 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.501 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.501 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.501 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.501 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.501 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.501 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.502 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.502 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.502 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.502 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.502 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.502 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.502 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.502 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.502 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.502 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.502 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.502 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.502 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.503 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.503 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.503 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.503 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.503 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.503 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.503 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.503 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.503 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.503 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.503 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.503 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.503 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.503 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.503 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.503 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.504 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.504 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.504 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.504 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.504 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.504 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.504 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.504 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.504 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.504 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.504 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.504 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.504 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.504 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.504 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.505 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.505 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.505 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.505 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.505 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.505 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.505 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.505 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.505 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.505 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.505 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.505 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.505 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.505 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.505 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.506 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.506 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.506 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.506 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.506 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.506 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.506 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.506 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.506 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.506 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.506 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.506 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.506 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.506 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.507 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.507 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.507 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.507 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.507 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.507 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.507 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.507 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.507 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.507 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.507 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.508 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.508 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.508 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.508 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.508 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.508 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.508 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.508 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.508 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.508 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.509 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.509 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.509 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.509 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.509 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.509 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.509 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.510 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.510 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.510 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.510 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.510 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.510 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.510 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.510 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.510 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.510 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.510 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.510 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.510 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.510 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.511 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.511 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.511 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.511 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.511 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.511 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.511 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.511 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.511 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.511 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.511 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.511 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.511 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.511 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.512 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.512 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.512 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.512 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.512 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.512 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.512 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.512 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.512 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.512 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.512 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.512 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.512 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.513 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.513 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.513 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.513 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.513 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.513 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.513 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.513 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.513 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.513 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.513 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.514 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.514 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.514 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.514 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.514 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.514 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.514 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.514 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.514 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.514 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.514 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.514 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.514 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.515 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.515 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.515 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.515 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.515 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.515 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.515 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.515 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.516 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.516 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.516 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.516 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.516 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.516 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.516 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.516 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.516 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.517 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.517 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.517 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.517 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.517 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.517 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.517 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.517 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.517 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.517 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.517 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.517 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.517 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.517 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.517 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.517 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.518 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.518 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.518 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.518 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.518 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.518 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.518 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.518 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.518 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.518 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.518 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.518 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.519 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.519 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.519 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.519 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.519 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.519 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.519 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.519 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.519 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.519 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.519 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.519 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.519 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.520 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.520 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.520 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.520 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.520 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.520 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.520 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.520 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.520 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.520 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at teardown of test_cors_origin_response ________________ 2023-12-03T12:39:13.521 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.521 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.521 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.521 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.521 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.521 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.521 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.521 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.521 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.521 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.521 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.521 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.521 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.521 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.522 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.522 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.522 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.522 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.522 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.522 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.522 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.522 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.522 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.522 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.522 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.522 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.522 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.522 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.523 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.523 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.523 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.523 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.523 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.523 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.523 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.523 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.523 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.523 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.523 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.523 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.523 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.523 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.524 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.524 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.524 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.524 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.524 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.524 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.524 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.524 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.524 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.524 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.524 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.524 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.525 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.525 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.525 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.525 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.525 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.525 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.525 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.525 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.525 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.525 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.525 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.525 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.525 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.525 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.525 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.526 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.526 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.526 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.526 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.526 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.526 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.526 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.526 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.526 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.526 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.526 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.526 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.526 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.526 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.526 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.527 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.527 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.527 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.527 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.527 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.527 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.527 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.527 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.527 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.527 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.527 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.527 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.527 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.527 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.527 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.527 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.528 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.528 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.528 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.528 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.528 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.528 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.528 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.528 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.528 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.528 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.528 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.528 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.528 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.529 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.529 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.529 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.529 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.529 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.529 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.529 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.529 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.529 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.529 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.529 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.529 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.529 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.529 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.529 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.529 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.530 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.530 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.530 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.530 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.530 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.530 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.530 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.530 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.530 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.530 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.530 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.530 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.530 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.531 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.531 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.531 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.531 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.531 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.531 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.531 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.531 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.531 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.531 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.531 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.532 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.532 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.532 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.532 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.532 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.532 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.532 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.532 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.532 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.532 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.532 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.532 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.533 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.533 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.533 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.533 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.533 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.533 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.533 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.533 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.533 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.534 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.534 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.534 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.534 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.534 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.534 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.534 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.534 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.534 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.534 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.534 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.534 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.534 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.534 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.535 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.535 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.535 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.535 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.535 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.535 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.535 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.536 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.536 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.536 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.536 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.536 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.536 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.536 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.536 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.537 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.537 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.537 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.537 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.537 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.537 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.537 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.537 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.537 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.537 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.537 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.537 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.537 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.537 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.537 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.538 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.538 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.538 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.538 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.538 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.538 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.538 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.538 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.538 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.538 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.538 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.539 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.539 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.539 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.539 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.539 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.539 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.539 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.539 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.539 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.539 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.539 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.539 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.539 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.539 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.539 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.540 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.540 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.540 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.540 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.540 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.540 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.540 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.540 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.540 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.540 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.540 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.540 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.541 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at teardown of test_cors_origin_wildcard ________________ 2023-12-03T12:39:13.541 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.541 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.541 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.541 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.541 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.541 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.541 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.541 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.541 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.541 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.541 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.541 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.541 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.541 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.542 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.542 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.542 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.542 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.542 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.542 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.542 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.542 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.542 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.542 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.542 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.542 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.542 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.542 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.542 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.543 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.543 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.543 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.543 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.543 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.543 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.543 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.543 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.543 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.543 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.543 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.543 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.543 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.543 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.544 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.544 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.544 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.544 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.544 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.544 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.544 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.544 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.544 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.544 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.544 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.544 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.544 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.544 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.544 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.544 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.545 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.545 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.545 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.545 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.545 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.545 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.545 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.545 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.545 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.546 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.546 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.546 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.546 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.546 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.546 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.546 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.546 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.546 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.546 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.546 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.546 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.546 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.546 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.547 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.547 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.547 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.547 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.547 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.547 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.547 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.547 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.547 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.547 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.547 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.547 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.547 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.547 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.548 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.548 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.548 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.548 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.548 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.548 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.548 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.548 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.548 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.548 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.548 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.548 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.548 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.548 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.549 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.549 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.549 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.549 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.549 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.549 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.549 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.549 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.549 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.549 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.550 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.550 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.550 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.550 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.550 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.550 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.550 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.550 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.550 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.550 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.550 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.550 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.550 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.551 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.551 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.551 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.551 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.551 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.551 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.551 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.551 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.551 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.551 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.551 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.551 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.552 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.552 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.552 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.552 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.552 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.552 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.552 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.552 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.552 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.552 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.552 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.552 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.552 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.552 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.552 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.552 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.553 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.553 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.553 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.553 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.553 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.553 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.553 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.553 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.553 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.553 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.553 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.554 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.554 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.554 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.554 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.554 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.554 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.554 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.554 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.554 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.554 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.554 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.554 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.554 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.555 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.555 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.555 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.555 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.555 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.555 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.555 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.555 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.556 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.556 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.556 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.556 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.556 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.556 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.556 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.556 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.557 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.557 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.557 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.557 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.557 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.557 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.558 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.558 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.558 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.558 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.558 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.558 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.558 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.558 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.558 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.558 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.558 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.559 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.559 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.559 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.559 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.559 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.559 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.559 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.559 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.559 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.559 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.559 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.559 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.560 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.560 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.560 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.560 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.560 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.560 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.561 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.561 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.561 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.561 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.561 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.561 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.562 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.562 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.562 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.562 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.562 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.562 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.562 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.562 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.563 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.563 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.563 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.563 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.563 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.563 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.563 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ ERROR at teardown of test_cors_header_option _________________ 2023-12-03T12:39:13.563 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.563 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.563 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.563 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.563 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.564 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.564 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.564 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.564 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.564 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.564 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.564 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.564 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.565 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.565 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.565 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.565 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.565 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.565 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.565 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.565 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.565 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.565 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.565 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.565 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.565 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.565 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.565 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.566 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.566 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.566 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.566 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.566 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.566 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.566 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.566 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.566 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.566 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.566 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.566 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.567 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.567 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.567 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.567 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.567 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.567 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.567 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.567 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.567 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.567 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.567 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.567 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.567 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.567 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.567 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.568 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.568 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.568 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.568 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.568 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.568 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.568 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.568 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.568 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.568 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.568 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.568 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.568 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.568 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.568 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.569 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.569 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.569 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.569 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.569 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.569 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.569 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.569 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.569 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.569 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.570 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.570 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.570 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.570 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.570 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.570 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.570 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.570 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.570 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.570 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.570 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.570 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.570 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.570 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.571 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.571 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.571 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.571 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.571 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.571 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.571 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.571 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.571 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.571 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.571 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.571 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.571 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.572 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.572 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.572 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.572 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.572 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.572 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.572 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.572 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.572 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.572 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.572 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.572 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.572 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.572 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.573 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.573 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.573 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.573 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.573 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.573 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.573 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.573 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.573 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.573 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.573 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.573 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.573 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.573 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.574 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.574 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.574 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.576 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.576 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.576 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.576 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.576 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.576 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.576 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.576 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.576 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.576 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.577 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.577 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.577 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.577 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.577 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.577 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.577 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.577 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.577 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.577 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.577 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.577 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.577 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.577 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.577 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.578 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.578 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.578 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.578 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.578 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.578 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.578 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.578 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.578 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.578 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.578 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.578 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.578 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.579 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.579 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.579 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.579 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.579 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.579 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.579 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.579 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.580 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.580 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.580 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.580 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.580 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.580 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.580 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.580 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.580 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.580 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.580 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.580 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.580 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.580 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.580 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.583 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.583 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.583 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.583 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.583 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.583 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.583 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.583 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.583 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.583 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.583 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.584 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.584 INFO:teuthology.orchestra.run.smithi044.stdout:_____________ ERROR at teardown of test_cors_presigned_get_object ______________ 2023-12-03T12:39:13.584 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.584 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.584 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.584 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.584 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.584 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.584 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.584 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.584 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.584 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.584 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.584 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.584 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.585 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.585 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.585 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.585 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.585 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.585 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.585 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.585 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.585 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.585 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.585 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.585 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.585 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.585 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.585 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.586 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.586 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.586 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.586 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.586 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.586 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.586 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.586 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.586 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.586 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.586 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.586 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.587 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.587 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.587 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.587 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.587 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.587 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.587 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.587 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.587 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.587 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.587 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.587 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.588 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.588 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.588 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.588 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.588 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.588 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.588 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.588 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.588 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.588 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.588 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.588 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.588 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.588 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.588 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.588 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.589 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.589 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.589 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.589 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.589 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.589 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.589 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.589 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.589 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.589 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.589 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.590 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.590 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.590 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.590 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.590 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.590 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.590 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.590 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.590 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.590 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.590 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.590 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.591 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.591 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.591 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.591 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.591 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.591 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.591 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.591 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.591 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.591 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.592 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.592 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.592 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.592 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.592 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.592 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.592 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.592 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.592 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.592 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.592 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.592 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.592 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.592 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.593 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.593 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.593 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.593 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.593 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.593 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.593 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.594 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.594 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.594 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.594 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.594 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.594 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.594 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.594 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.594 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.594 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.594 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.595 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.595 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.595 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.595 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.595 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.595 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.595 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.595 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.595 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.595 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.595 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.595 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.595 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.595 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.595 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.596 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.596 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.596 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.596 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.596 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.596 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.596 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.596 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.596 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.596 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.596 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.597 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.597 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.597 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.597 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.597 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.597 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.597 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.597 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.597 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.597 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.598 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.598 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.598 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.598 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.598 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.598 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.598 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.598 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.598 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.598 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.598 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.598 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.598 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.598 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.598 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.599 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.599 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.599 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.599 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.599 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.599 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.599 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.599 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.599 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.599 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.599 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.599 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.599 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.599 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.600 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.600 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.600 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.600 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.600 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.600 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.600 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.600 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.600 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.600 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.601 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.601 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.601 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.601 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.601 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.601 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.601 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.601 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.601 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.601 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.601 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.601 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.601 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.601 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.602 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.602 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.602 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.602 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.602 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.602 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.602 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.602 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.602 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.602 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.602 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.602 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.602 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.602 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.603 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.603 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.603 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.603 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.603 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.603 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.603 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.603 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.603 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.603 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.603 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.603 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.603 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.603 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.603 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.604 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.604 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.604 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.604 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.604 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.604 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.604 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.604 INFO:teuthology.orchestra.run.smithi044.stdout:__________ ERROR at teardown of test_cors_presigned_get_object_tenant __________ 2023-12-03T12:39:13.604 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.604 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.604 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.604 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.604 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.604 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.604 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.604 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.605 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.605 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.605 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.605 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.605 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.605 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.605 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.605 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.605 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.605 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.606 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.606 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.606 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.606 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.606 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.606 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.606 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.606 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.606 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.606 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.606 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.606 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.606 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.607 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.607 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.607 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.607 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.607 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.607 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.607 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.607 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.607 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.607 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.607 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.607 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.608 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.608 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.608 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.608 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.608 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.608 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.608 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.608 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.608 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.608 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.609 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.609 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.609 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.609 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.609 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.609 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.609 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.609 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.609 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.609 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.610 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.610 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.610 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.610 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.610 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.610 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.610 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.610 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.610 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.610 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.611 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.611 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.611 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.611 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.611 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.611 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.611 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.611 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.611 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.611 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.611 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.611 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.611 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.611 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.611 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.612 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.612 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.612 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.612 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.612 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.612 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.612 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.612 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.612 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.612 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.612 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.612 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.612 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.613 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.613 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.613 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.613 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.613 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.613 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.613 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.613 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.613 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.614 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.614 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.614 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.614 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.614 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.614 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.614 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.614 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.614 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.614 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.614 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.614 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.614 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.614 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.615 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.615 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.615 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.615 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.615 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.615 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.615 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.615 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.615 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.615 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.615 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.616 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.616 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.616 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.616 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.616 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.616 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.616 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.616 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.616 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.616 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.616 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.616 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.617 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.617 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.617 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.617 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.617 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.617 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.617 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.617 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.617 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.617 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.618 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.618 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.618 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.618 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.618 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.618 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.618 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.618 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.618 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.618 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.618 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.618 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.618 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.618 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.618 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.619 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.619 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.619 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.619 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.619 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.619 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.619 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.620 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.620 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.620 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.620 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.620 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.620 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.620 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.621 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.621 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.621 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.621 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.621 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.621 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.621 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.621 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.621 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.621 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.622 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.622 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.622 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.622 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.622 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.622 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.622 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.622 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.622 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.622 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.622 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.622 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.622 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.623 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.623 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.623 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.623 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.623 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.623 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.623 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.623 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.623 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.623 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.623 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.623 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.623 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.624 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.624 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.624 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.624 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.624 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.624 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.624 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.624 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.624 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.624 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.624 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.624 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.625 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.625 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ ERROR at teardown of test_set_bucket_tagging _________________ 2023-12-03T12:39:13.625 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.625 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.625 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.625 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.625 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.625 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.625 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.625 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.625 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.625 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.625 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.626 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.626 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.626 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.626 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.626 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.626 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.626 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.626 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.626 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.626 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.626 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.626 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.626 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.627 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.627 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.627 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.627 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.627 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.627 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.627 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.627 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.627 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.627 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.627 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.627 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.627 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.627 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.627 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.628 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.628 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.628 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.628 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.628 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.628 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.628 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.628 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.628 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.628 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.628 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.628 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.628 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.629 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.629 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.629 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.629 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.629 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.629 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.629 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.629 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.629 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.629 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.629 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.629 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.629 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.629 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.629 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.630 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.630 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.630 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.630 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.630 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.630 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.630 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.630 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.630 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.630 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.630 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.630 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.630 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.631 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.631 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.631 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.631 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.631 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.631 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.631 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.631 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.631 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.631 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.631 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.631 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.631 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.631 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.631 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.632 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.632 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.632 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.632 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.632 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.632 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.632 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.632 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.632 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.632 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.632 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.632 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.632 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.632 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.632 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.633 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.633 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.633 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.633 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.633 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.633 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.633 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.633 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.634 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.634 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.634 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.634 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.634 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.634 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.634 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.634 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.634 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.634 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.634 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.634 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.634 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.634 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.635 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.635 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.635 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.635 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.635 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.635 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.635 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.635 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.635 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.635 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.635 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.636 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.636 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.636 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.636 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.636 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.636 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.636 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.636 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.636 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.636 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.636 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.636 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.637 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.637 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.637 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.637 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.637 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.637 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.637 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.637 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.637 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.637 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.637 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.637 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.637 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.637 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.637 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.638 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.638 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.638 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.638 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.638 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.638 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.638 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.638 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.638 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.638 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.638 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.638 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.638 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.639 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.639 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.639 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.639 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.639 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.639 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.639 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.639 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.640 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.640 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.640 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.640 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.640 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.640 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.640 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.640 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.640 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.640 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.640 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.640 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.640 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.640 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.641 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.641 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.641 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.641 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.641 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.641 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.641 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.641 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.641 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.641 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.641 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.641 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.641 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.641 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.642 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.642 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.642 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.642 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.642 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.642 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.642 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.642 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.642 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.642 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.642 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.642 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.642 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.642 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.642 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.643 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.643 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.643 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.643 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.643 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.643 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.643 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.643 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.643 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.643 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.643 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.643 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.644 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.644 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.644 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.644 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.644 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.644 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.644 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.644 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.644 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.644 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.644 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.644 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.644 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.644 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.644 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.645 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.645 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.645 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.645 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.645 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.645 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ ERROR at teardown of test_atomic_read_1mb ___________________ 2023-12-03T12:39:13.645 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.645 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.645 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.645 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.645 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.645 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.646 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.646 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.646 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.646 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.646 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.646 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.646 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.646 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.646 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.646 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.646 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.646 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.646 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.646 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.647 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.647 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.647 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.647 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.647 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.647 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.647 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.647 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.647 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.647 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.647 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.647 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.647 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.647 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.647 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.648 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.648 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.648 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.648 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.648 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.648 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.648 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.648 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.648 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.648 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.648 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.648 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.648 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.648 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.649 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.649 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.649 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.649 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.649 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.649 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.649 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.649 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.649 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.649 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.649 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.649 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.649 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.650 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.650 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.650 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.650 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.650 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.650 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.650 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.650 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.650 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.650 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.650 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.650 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.650 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.651 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.651 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.651 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.651 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.651 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.651 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.651 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.651 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.651 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.651 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.651 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.651 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.651 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.651 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.652 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.652 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.652 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.652 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.652 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.652 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.652 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.652 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.652 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.652 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.652 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.652 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.652 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.652 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.652 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.653 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.653 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.653 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.653 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.653 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.653 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.653 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.653 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.653 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.653 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.653 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.653 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.653 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.653 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.654 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.654 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.654 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.654 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.654 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.654 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.654 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.654 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.654 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.654 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.654 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.654 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.654 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.654 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.655 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.655 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.655 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.655 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.655 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.655 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.655 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.655 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.655 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.655 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.655 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.655 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.655 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.656 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.656 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.656 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.656 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.656 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.656 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.656 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.656 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.656 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.656 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.656 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.656 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.657 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.657 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.657 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.657 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.657 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.657 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.657 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.657 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.657 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.657 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.657 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.657 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.657 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.657 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.657 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.658 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.658 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.658 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.658 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.658 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.658 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.658 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.658 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.658 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.658 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.658 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.658 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.659 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.659 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.659 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.659 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.659 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.659 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.659 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.659 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.659 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.659 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.659 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.659 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.659 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.659 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.659 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.660 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.660 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.660 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.660 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.660 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.660 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.660 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.660 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.660 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.660 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.660 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.660 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.660 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.660 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.661 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.661 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.661 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.661 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.661 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.661 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.661 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.661 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.661 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.661 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.661 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.661 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.661 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.661 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.661 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.662 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.662 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.662 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.662 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.662 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.662 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.662 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.662 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.662 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.662 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.662 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.662 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.663 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.663 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.663 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.663 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.663 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.663 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.663 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.663 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.663 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.663 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.663 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.663 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.663 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.663 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.663 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.664 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.664 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.664 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.664 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.664 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.664 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.664 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.664 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.664 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.664 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.664 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.664 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.664 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.665 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.665 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.665 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.665 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.665 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.665 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.665 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.665 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.665 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.666 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.666 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.666 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ ERROR at teardown of test_atomic_read_4mb ___________________ 2023-12-03T12:39:13.666 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.666 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.666 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.666 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.666 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.666 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.666 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.666 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.667 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.667 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.667 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.667 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.667 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.667 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.667 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.667 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.667 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.667 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.667 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.667 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.668 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.668 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.668 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.668 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.668 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.668 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.668 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.668 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.668 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.669 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.669 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.669 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.669 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.669 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.670 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.670 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.670 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.670 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.670 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.670 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.671 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.671 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.671 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.671 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.671 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.671 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.671 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.671 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.671 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.671 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.671 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.671 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.671 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.672 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.672 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.672 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.672 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.672 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.672 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.673 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.673 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.673 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.673 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.673 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.673 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.673 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.673 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.673 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.673 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.674 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.674 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.674 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.674 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.674 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.674 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.674 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.674 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.674 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.674 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.675 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.675 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.675 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.675 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.675 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.675 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.675 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.675 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.675 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.675 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.675 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.675 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.675 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.675 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.676 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.676 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.676 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.676 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.676 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.676 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.676 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.676 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.676 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.676 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.676 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.676 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.676 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.677 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.677 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.677 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.677 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.677 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.677 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.677 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.677 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.677 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.677 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.677 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.677 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.677 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.677 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.677 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.678 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.678 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.678 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.678 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.678 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.678 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.678 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.678 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.678 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.678 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.678 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.678 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.678 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.678 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.679 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.679 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.679 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.679 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.679 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.679 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.679 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.679 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.679 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.679 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.679 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.679 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.679 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.679 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.679 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.679 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.680 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.680 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.680 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.680 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.680 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.680 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.680 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.680 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.680 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.680 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.680 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.680 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.680 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.681 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.681 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.681 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.681 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.681 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.681 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.681 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.681 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.681 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.681 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.681 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.682 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.682 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.682 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.682 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.682 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.682 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.682 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.682 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.682 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.682 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.682 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.682 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.682 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.683 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.683 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.683 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.683 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.683 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.683 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.683 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.683 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.683 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.683 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.683 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.683 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.684 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.684 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.684 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.684 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.684 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.684 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.684 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.684 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.685 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.685 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.685 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.685 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.685 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.685 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.685 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.685 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.685 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.685 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.685 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.685 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.685 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.686 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.686 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.686 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.686 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.686 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.686 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.686 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.686 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.686 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.689 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.689 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.689 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.689 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.689 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.689 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.689 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.689 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.689 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.689 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.689 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.690 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.690 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.690 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.690 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.690 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.690 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.690 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.690 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.690 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.690 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.690 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.690 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.690 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.691 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.691 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.691 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.691 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.691 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.691 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.691 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.691 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.691 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.691 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.691 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.691 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ ERROR at teardown of test_atomic_read_8mb ___________________ 2023-12-03T12:39:13.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.692 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.692 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.692 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.692 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.692 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.693 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.693 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.693 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.693 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.693 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.693 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.693 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.693 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.693 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.693 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.694 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.694 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.694 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.694 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.694 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.694 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.694 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.694 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.694 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.694 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.694 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.694 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.695 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.695 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.695 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.695 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.695 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.695 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.695 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.695 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.695 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.695 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.695 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.695 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.695 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.695 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.695 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.696 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.696 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.696 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.696 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.696 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.696 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.696 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.696 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.696 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.696 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.696 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.696 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.697 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.697 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.697 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.697 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.697 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.697 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.697 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.697 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.697 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.697 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.697 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.697 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.698 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.698 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.698 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.698 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.698 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.698 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.698 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.698 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.698 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.698 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.698 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.699 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.699 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.699 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.699 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.699 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.699 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.699 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.699 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.699 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.699 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.699 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.699 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.699 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.699 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.700 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.700 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.700 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.700 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.700 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.700 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.700 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.700 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.700 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.700 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.700 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.700 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.700 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.701 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.701 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.701 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.701 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.701 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.701 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.701 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.701 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.701 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.701 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.701 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.701 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.702 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.702 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.702 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.702 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.702 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.702 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.702 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.702 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.702 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.702 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.703 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.703 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.703 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.703 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.703 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.703 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.703 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.703 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.703 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.703 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.703 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.703 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.703 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.703 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.703 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.704 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.704 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.704 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.704 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.704 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.704 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.704 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.704 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.704 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.704 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.704 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.704 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.704 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.704 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.705 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.705 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.705 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.705 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.705 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.705 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.705 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.705 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.705 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.705 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.705 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.705 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.705 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.705 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.705 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.706 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.706 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.706 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.706 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.706 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.706 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.706 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.706 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.706 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.706 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.706 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.706 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.706 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.707 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.707 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.707 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.707 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.707 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.707 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.707 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.707 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.707 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.707 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.707 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.707 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.707 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.707 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.707 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.708 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.708 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.708 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.708 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.708 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.709 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.709 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.709 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.709 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.709 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.709 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.709 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.709 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.709 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.709 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.709 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.709 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.709 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.709 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.709 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.710 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.710 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.710 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.710 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.710 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.710 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.710 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.710 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.710 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.710 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.710 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.710 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.710 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.710 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.711 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.711 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.711 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.711 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.711 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.711 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.711 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.711 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.711 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.711 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.711 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.711 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.711 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.711 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.712 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.712 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.712 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.712 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.712 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.712 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.712 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.712 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.712 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.712 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.712 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.712 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.712 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ ERROR at teardown of test_atomic_write_1mb __________________ 2023-12-03T12:39:13.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.713 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.713 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.713 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.713 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.713 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.713 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.713 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.713 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.713 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.714 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.714 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.714 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.714 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.714 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.714 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.714 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.714 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.714 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.714 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.714 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.714 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.714 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.714 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.715 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.715 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.715 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.715 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.715 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.715 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.715 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.715 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.715 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.715 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.715 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.715 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.715 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.716 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.716 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.716 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.716 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.716 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.716 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.716 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.716 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.716 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.716 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.716 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.716 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.716 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.716 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.716 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.717 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.717 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.717 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.717 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.717 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.717 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.717 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.717 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.717 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.717 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.717 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.717 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.718 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.718 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.718 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.718 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.718 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.718 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.718 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.718 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.718 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.718 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.718 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.719 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.719 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.719 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.719 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.719 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.719 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.719 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.719 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.719 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.719 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.719 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.719 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.720 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.720 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.720 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.720 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.720 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.720 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.720 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.720 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.720 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.720 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.720 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.720 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.720 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.721 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.721 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.721 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.721 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.721 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.721 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.721 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.721 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.721 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.721 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.721 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.722 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.722 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.722 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.722 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.722 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.722 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.722 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.722 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.722 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.722 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.723 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.723 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.723 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.723 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.723 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.723 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.723 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.723 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.723 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.723 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.723 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.723 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.723 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.723 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.724 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.724 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.724 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.724 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.724 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.724 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.724 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.724 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.724 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.724 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.724 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.725 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.725 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.725 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.725 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.725 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.725 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.725 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.725 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.725 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.725 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.725 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.725 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.725 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.725 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.725 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.726 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.726 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.726 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.726 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.726 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.726 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.726 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.726 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.726 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.726 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.726 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.726 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.727 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.727 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.727 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.727 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.727 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.727 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.727 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.727 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.727 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.727 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.728 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.728 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.728 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.728 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.728 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.729 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.729 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.729 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.729 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.729 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.729 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.729 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.729 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.729 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.729 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.729 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.729 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.729 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.729 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.729 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.730 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.730 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.730 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.730 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.730 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.730 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.730 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.730 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.730 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.730 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.730 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.730 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.730 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.730 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.731 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.731 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.731 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.731 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.731 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.731 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.731 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.731 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.731 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.731 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.731 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.731 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.731 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.731 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.732 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.732 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.732 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.732 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.732 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.732 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.732 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.732 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.732 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.732 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.732 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.732 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.732 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.732 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.732 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.733 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.733 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.733 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.733 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.733 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.733 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.733 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ ERROR at teardown of test_atomic_write_4mb __________________ 2023-12-03T12:39:13.733 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.733 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.733 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.734 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.734 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.734 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.734 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.734 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.734 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.734 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.734 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.734 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.734 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.734 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.734 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.734 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.734 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.734 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.735 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.735 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.735 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.735 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.735 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.735 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.735 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.735 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.735 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.735 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.735 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.735 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.735 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.735 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.736 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.736 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.736 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.736 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.736 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.736 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.736 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.736 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.736 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.736 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.736 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.736 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.736 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.736 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.736 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.737 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.737 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.737 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.737 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.737 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.737 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.737 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.737 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.737 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.737 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.737 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.737 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.737 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.738 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.738 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.738 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.738 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.738 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.738 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.738 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.738 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.739 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.739 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.739 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.739 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.739 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.739 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.739 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.739 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.739 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.740 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.740 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.740 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.740 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.740 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.740 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.740 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.740 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.740 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.740 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.740 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.740 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.740 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.740 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.740 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.741 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.741 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.741 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.741 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.741 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.741 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.741 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.741 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.741 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.741 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.741 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.741 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.741 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.741 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.742 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.742 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.742 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.742 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.742 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.742 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.742 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.742 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.742 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.742 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.742 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.742 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.742 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.742 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.743 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.743 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.743 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.743 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.743 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.743 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.743 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.743 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.743 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.743 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.743 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.743 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.743 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.743 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.744 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.744 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.744 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.744 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.744 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.744 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.744 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.744 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.744 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.744 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.744 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.744 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.744 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.744 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.744 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.745 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.745 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.745 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.745 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.745 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.745 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.745 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.745 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.745 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.745 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.745 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.745 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.745 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.745 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.745 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.746 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.746 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.746 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.746 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.746 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.746 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.746 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.746 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.746 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.746 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.746 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.746 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.746 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.746 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.746 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.747 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.747 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.747 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.747 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.747 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.747 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.747 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.747 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.747 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.747 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.747 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.748 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.748 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.748 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.748 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.748 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.748 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.748 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.748 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.748 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.748 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.748 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.748 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.748 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.748 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.748 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.749 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.749 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.749 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.749 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.749 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.749 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.749 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.749 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.749 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.749 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.749 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.749 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.749 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.749 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.749 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.750 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.750 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.750 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.750 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.750 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.750 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.750 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.750 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.750 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.750 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.750 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.750 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.751 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.751 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.751 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.751 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.751 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.751 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.751 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.751 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.751 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.751 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.751 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.751 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.751 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.751 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.752 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.752 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.752 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.752 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.752 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.752 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.752 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.752 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.752 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.752 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.752 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.752 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.752 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.752 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.753 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.753 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.753 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.753 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.753 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.753 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.753 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.753 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.753 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.753 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.753 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.753 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.753 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.753 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.753 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ ERROR at teardown of test_atomic_write_8mb __________________ 2023-12-03T12:39:13.754 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.754 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.754 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.754 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.754 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.754 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.754 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.754 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.754 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.754 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.754 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.754 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.754 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.754 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.755 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.755 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.755 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.755 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.755 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.755 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.755 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.755 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.755 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.755 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.755 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.755 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.756 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.756 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.756 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.756 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.756 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.756 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.756 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.756 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.756 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.756 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.756 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.756 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.756 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.757 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.757 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.757 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.757 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.757 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.757 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.757 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.757 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.757 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.757 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.757 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.758 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.758 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.758 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.758 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.758 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.758 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.758 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.758 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.758 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.758 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.758 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.758 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.758 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.758 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.759 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.759 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.759 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.759 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.759 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.759 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.759 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.759 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.760 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.760 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.760 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.760 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.760 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.760 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.760 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.760 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.760 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.760 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.760 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.760 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.760 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.761 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.761 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.761 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.761 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.761 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.761 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.761 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.761 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.761 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.761 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.761 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.761 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.761 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.761 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.762 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.762 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.762 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.762 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.762 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.762 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.762 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.762 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.762 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.762 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.762 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.762 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.762 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.763 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.763 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.763 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.763 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.763 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.763 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.763 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.763 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.763 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.763 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.764 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.764 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.764 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.764 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.764 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.764 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.764 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.764 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.764 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.764 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.764 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.764 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.765 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.765 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.765 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.765 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.765 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.765 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.765 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.765 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.765 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.765 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.765 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.765 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.766 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.766 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.766 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.766 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.766 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.766 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.766 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.766 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.766 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.766 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.766 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.766 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.766 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.766 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.767 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.767 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.767 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.767 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.767 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.767 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.767 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.767 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.767 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.767 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.768 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.768 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.768 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.768 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.768 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.768 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.768 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.768 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.768 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.768 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.768 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.768 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.768 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.768 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.769 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.769 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.769 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.769 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.769 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.769 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.770 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.770 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.770 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.770 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.770 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.770 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.771 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.771 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.771 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.771 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.771 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.771 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.771 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.771 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.771 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.771 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.771 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.771 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.772 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.772 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.772 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.772 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.772 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.772 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.772 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.772 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.772 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.772 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.772 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.772 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.772 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.772 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.772 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.773 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.773 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.773 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.773 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.773 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.773 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.773 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.773 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.773 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.773 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.773 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.774 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.774 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.774 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.774 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.774 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.774 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.775 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.775 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.775 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.775 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.775 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.775 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.775 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.775 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.775 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.775 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ ERROR at teardown of test_atomic_dual_write_1mb ________________ 2023-12-03T12:39:13.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.775 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.776 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.776 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.776 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.776 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.776 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.776 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.777 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.777 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.777 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.777 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.777 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.777 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.778 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.778 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.778 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.778 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.778 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.778 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.779 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.779 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.779 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.779 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.779 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.779 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.779 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.779 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.780 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.780 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.780 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.780 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.780 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.780 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.780 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.780 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.780 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.780 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.780 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.781 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.781 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.781 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.781 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.781 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.781 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.781 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.781 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.782 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.782 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.782 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.782 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.782 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.782 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.782 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.782 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.782 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.782 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.782 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.782 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.782 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.782 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.783 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.783 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.783 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.783 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.783 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.783 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.783 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.783 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.784 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.784 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.784 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.784 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.784 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.784 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.784 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.784 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.784 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.784 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.784 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.784 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.784 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.785 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.785 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.785 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.785 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.785 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.785 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.785 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.785 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.785 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.785 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.785 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.785 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.785 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.785 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.786 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.786 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.786 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.786 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.786 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.786 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.786 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.786 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.786 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.786 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.786 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.786 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.786 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.787 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.787 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.787 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.787 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.787 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.787 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.787 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.787 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.787 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.787 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.787 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.787 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.787 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.787 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.788 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.788 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.788 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.788 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.788 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.788 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.788 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.788 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.789 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.789 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.789 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.789 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.789 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.789 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.789 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.789 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.789 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.789 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.789 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.789 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.789 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.789 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.790 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.790 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.790 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.790 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.790 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.790 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.790 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.790 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.790 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.790 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.790 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.790 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.790 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.790 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.790 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.791 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.791 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.791 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.791 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.791 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.791 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.791 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.791 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.791 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.791 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.791 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.791 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.791 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.791 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.792 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.792 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.792 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.792 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.792 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.792 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.792 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.792 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.792 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.792 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.792 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.792 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.793 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.793 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.793 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.793 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.793 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.793 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.793 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.793 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.793 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.793 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.793 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.793 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.794 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.794 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.794 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.794 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.794 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.794 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.794 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.794 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.794 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.794 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.795 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.795 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.795 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.795 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.795 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.795 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.795 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.795 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.795 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.795 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.795 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.796 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.796 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.796 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.796 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.796 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.796 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.796 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.796 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.796 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.796 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.796 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.796 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.796 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.797 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.797 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.797 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.797 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.797 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.797 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.797 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.797 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.797 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.797 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.797 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.797 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.797 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.797 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.797 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.798 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.798 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.798 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.798 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.798 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.798 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.798 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.798 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.798 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.798 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.798 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.798 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.798 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.798 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.799 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.799 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.799 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.799 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.799 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.799 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.799 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.799 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.799 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ ERROR at teardown of test_atomic_dual_write_4mb ________________ 2023-12-03T12:39:13.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.799 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.799 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.800 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.800 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.800 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.800 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.800 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.800 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.800 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.800 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.800 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.800 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.800 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.800 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.800 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.800 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.801 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.801 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.801 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.801 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.801 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.801 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.801 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.801 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.801 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.801 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.801 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.801 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.801 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.801 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.801 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.801 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.802 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.802 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.802 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.802 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.802 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.802 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.802 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.802 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.802 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.802 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.802 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.802 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.802 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.802 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.803 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.803 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.803 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.803 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.803 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.803 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.803 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.803 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.803 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.803 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.803 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.803 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.803 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.803 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.804 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.804 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.804 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.804 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.804 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.804 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.804 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.804 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.804 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.804 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.804 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.804 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.805 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.805 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.805 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.805 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.805 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.805 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.805 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.805 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.805 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.806 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.806 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.806 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.806 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.806 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.806 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.806 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.806 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.806 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.806 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.806 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.806 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.806 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.806 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.807 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.807 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.807 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.807 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.807 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.807 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.807 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.807 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.807 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.807 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.807 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.807 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.807 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.807 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.808 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.808 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.808 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.808 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.808 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.808 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.809 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.809 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.809 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.809 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.809 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.809 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.809 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.809 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.809 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.809 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.810 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.810 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.810 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.810 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.810 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.810 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.810 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.810 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.810 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.810 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.810 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.810 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.810 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.810 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.811 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.811 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.811 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.811 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.811 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.811 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.811 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.811 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.811 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.811 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.811 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.811 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.811 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.811 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.811 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.812 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.812 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.812 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.812 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.812 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.812 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.812 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.812 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.812 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.812 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.812 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.812 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.812 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.812 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.813 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.813 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.813 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.813 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.813 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.813 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.813 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.813 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.813 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.813 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.813 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.813 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.813 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.813 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.813 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.813 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.814 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.814 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.814 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.814 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.814 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.814 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.814 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.814 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.814 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.814 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.814 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.814 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.814 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.814 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.815 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.815 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.815 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.815 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.815 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.815 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.815 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.815 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.815 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.815 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.815 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.815 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.815 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.815 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.816 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.816 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.816 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.816 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.816 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.816 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.816 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.816 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.816 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.816 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.816 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.816 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.817 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.817 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.817 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.817 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.817 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.817 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.817 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.817 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.817 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.817 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.817 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.817 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.817 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.817 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.817 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.818 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.818 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.818 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.818 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.818 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.818 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.818 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.818 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.818 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.818 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.818 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.818 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.818 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.818 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.819 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.819 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.819 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.819 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.819 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.819 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.819 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.819 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.819 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.819 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.819 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.819 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.819 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.819 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.820 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.820 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.820 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.820 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.820 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.820 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.820 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ ERROR at teardown of test_atomic_dual_write_8mb ________________ 2023-12-03T12:39:13.820 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.820 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.820 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.820 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.820 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.820 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.820 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.821 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.821 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.821 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.821 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.821 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.821 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.821 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.821 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.821 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.821 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.821 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.821 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.821 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.822 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.822 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.822 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.822 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.822 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.822 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.822 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.822 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.822 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.822 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.822 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.822 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.822 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.822 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.823 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.823 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.823 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.823 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.823 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.823 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.823 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.823 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.823 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.823 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.823 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.823 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.823 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.824 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.824 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.824 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.824 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.824 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.824 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.824 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.824 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.824 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.824 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.824 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.824 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.824 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.824 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.824 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.825 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.825 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.825 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.825 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.825 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.825 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.825 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.825 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.825 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.825 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.825 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.826 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.826 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.826 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.826 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.826 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.826 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.826 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.826 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.826 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.827 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.827 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.827 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.827 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.827 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.827 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.827 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.827 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.827 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.827 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.827 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.827 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.827 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.827 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.827 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.828 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.828 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.828 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.828 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.828 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.828 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.828 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.828 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.828 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.828 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.828 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.828 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.828 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.828 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.828 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.828 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.829 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.829 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.829 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.829 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.829 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.829 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.829 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.829 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.829 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.830 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.830 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.830 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.830 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.830 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.830 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.830 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.830 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.830 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.830 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.830 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.830 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.830 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.831 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.831 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.831 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.831 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.831 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.831 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.831 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.831 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.831 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.831 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.831 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.831 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.831 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.831 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.831 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.832 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.832 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.832 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.832 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.832 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.832 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.832 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.832 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.832 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.832 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.832 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.832 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.832 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.832 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.833 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.833 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.833 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.833 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.833 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.833 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.833 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.833 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.833 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.833 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.834 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.834 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.834 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.834 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.834 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.834 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.834 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.834 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.834 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.834 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.834 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.834 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.834 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.834 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.835 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.835 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.835 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.835 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.835 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.835 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.835 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.835 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.835 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.835 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.835 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.835 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.835 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.835 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.836 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.836 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.836 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.836 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.836 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.836 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.836 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.836 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.836 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.836 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.836 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.836 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.836 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.836 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.836 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.837 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.837 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.837 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.837 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.837 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.837 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.837 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.837 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.837 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.837 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.837 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.837 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.838 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.838 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.838 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.838 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.838 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.838 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.838 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.838 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.838 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.838 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.838 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.838 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.838 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.838 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.839 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.839 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.839 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.839 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.839 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.839 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.839 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.839 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.839 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.839 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.839 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.839 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.840 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.840 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.840 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.840 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.840 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.840 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.840 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.840 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.840 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.840 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.840 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.840 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.840 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.840 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.840 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.841 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.841 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.841 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.841 INFO:teuthology.orchestra.run.smithi044.stdout:____________ ERROR at teardown of test_atomic_conditional_write_1mb ____________ 2023-12-03T12:39:13.841 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.841 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.841 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.841 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.841 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.841 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.841 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.841 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.842 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.842 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.842 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.842 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.842 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.842 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.842 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.842 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.842 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.842 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.842 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.842 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.842 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.843 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.843 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.843 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.843 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.843 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.843 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.843 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.843 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.843 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.843 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.843 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.843 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.843 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.843 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.844 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.844 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.844 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.844 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.844 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.844 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.844 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.844 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.844 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.844 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.844 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.844 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.844 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.845 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.845 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.845 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.845 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.845 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.845 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.845 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.845 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.845 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.845 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.845 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.845 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.845 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.845 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.846 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.846 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.846 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.846 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.846 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.846 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.846 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.846 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.846 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.846 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.846 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.846 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.846 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.846 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.846 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.847 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.847 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.847 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.847 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.847 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.847 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.847 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.847 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.847 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.847 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.847 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.847 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.847 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.847 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.848 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.848 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.848 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.848 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.848 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.848 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.848 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.848 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.848 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.848 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.848 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.848 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.848 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.848 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.848 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.848 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.849 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.849 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.849 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.849 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.849 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.849 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.849 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.849 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.849 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.849 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.849 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.849 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.849 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.849 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.850 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.850 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.850 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.850 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.850 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.850 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.850 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.850 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.850 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.850 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.850 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.850 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.850 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.850 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.850 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.851 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.851 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.851 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.851 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.851 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.851 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.851 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.851 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.851 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.851 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.851 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.851 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.851 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.852 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.852 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.852 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.852 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.852 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.852 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.852 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.852 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.852 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.852 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.852 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.852 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.852 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.852 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.852 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.853 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.853 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.853 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.853 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.853 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.853 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.853 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.853 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.853 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.853 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.853 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.853 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.853 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.853 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.853 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.854 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.854 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.854 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.854 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.854 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.854 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.854 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.854 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.854 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.854 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.854 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.854 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.855 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.855 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.855 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.855 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.855 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.855 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.855 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.855 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.855 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.855 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.855 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.855 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.855 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.855 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.855 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.856 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.856 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.856 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.856 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.856 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.856 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.856 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.856 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.856 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.856 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.856 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.856 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.856 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.856 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.856 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.857 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.857 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.857 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.857 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.857 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.857 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.857 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.857 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.857 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.857 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.857 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.857 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.857 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.857 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.858 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.858 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.858 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.858 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.858 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.858 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.858 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.858 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.858 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.858 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.858 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.858 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.858 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.858 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.859 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.859 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.859 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.859 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.859 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.859 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.859 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.859 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.859 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.859 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.859 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.859 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.859 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.859 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.859 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.859 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.860 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.860 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.860 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.860 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.860 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.860 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.860 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.860 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.860 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.860 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.860 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.860 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.861 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.861 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.861 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.861 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.861 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.861 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.861 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.861 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.861 INFO:teuthology.orchestra.run.smithi044.stdout:___________ ERROR at teardown of test_atomic_multipart_upload_write ____________ 2023-12-03T12:39:13.861 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.861 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.861 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.861 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.862 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.862 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.862 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.862 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.862 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.862 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.862 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.862 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.862 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.862 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.862 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.862 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.862 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.862 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.862 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.863 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.863 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.863 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.863 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.863 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.863 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.863 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.863 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.863 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.863 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.863 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.863 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.863 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.863 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.863 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.864 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.864 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.864 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.864 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.864 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.864 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.864 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.864 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.864 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.864 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.864 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.864 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.864 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.864 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.865 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.865 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.865 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.865 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.865 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.865 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.865 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.865 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.865 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.865 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.865 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.865 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.865 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.866 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.866 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.866 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.866 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.866 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.866 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.866 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.866 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.866 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.866 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.866 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.866 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.866 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.867 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.867 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.867 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.867 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.867 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.867 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.867 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.867 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.867 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.867 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.868 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.868 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.868 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.868 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.868 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.868 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.868 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.868 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.868 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.868 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.868 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.868 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.868 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.868 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.869 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.869 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.869 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.869 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.869 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.869 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.869 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.869 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.869 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.869 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.869 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.869 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.870 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.870 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.870 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.870 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.870 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.870 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.870 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.871 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.871 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.871 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.871 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.871 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.871 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.871 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.871 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.871 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.872 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.872 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.872 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.872 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.872 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.872 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.872 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.872 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.872 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.872 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.872 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.872 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.872 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.872 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.872 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.873 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.873 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.873 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.873 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.873 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.873 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.873 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.873 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.873 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.873 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.873 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.873 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.873 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.873 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.873 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.874 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.874 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.874 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.874 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.874 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.874 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.874 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.874 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.874 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.874 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.874 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.874 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.874 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.874 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.875 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.875 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.875 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.875 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.875 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.875 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.875 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.875 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.875 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.875 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.875 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.875 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.875 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.876 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.876 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.876 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.876 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.876 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.876 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.876 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.876 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.876 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.876 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.876 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.876 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.876 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.876 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.876 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.877 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.877 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.877 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.877 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.877 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.877 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.877 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.877 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.877 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.877 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.877 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.877 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.877 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.877 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.878 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.878 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.878 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.878 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.878 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.878 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.878 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.878 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.878 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.878 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.879 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.879 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.879 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.879 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.879 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.879 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.879 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.879 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.879 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.879 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.879 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.879 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.879 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.880 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.880 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.880 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.880 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.880 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.880 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.880 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.880 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.880 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.880 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.880 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.880 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.880 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.881 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.881 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.881 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.881 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.881 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.881 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.881 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.881 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.881 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.881 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.881 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.882 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.882 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.882 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.882 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.882 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.882 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.882 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.882 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.882 INFO:teuthology.orchestra.run.smithi044.stdout:________ ERROR at teardown of test_multipart_resend_first_finishes_last ________ 2023-12-03T12:39:13.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.882 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.883 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.883 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.883 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.883 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.883 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.883 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.883 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.883 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.883 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.883 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.883 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.883 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.883 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.883 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.884 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.884 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.884 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.884 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.884 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.884 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.884 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.884 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.884 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.884 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.884 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.884 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.884 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.884 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.885 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.885 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.885 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.885 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.885 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.885 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.885 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.885 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.885 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.885 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.885 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.885 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.885 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.885 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.886 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.886 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.886 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.886 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.886 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.886 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.886 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.886 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.886 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.886 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.886 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.886 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.886 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.887 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.887 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.887 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.887 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.887 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.887 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.887 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.887 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.887 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.887 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.887 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.887 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.888 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.888 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.888 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.888 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.888 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.888 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.888 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.888 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.888 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.888 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.889 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.889 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.889 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.889 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.889 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.889 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.889 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.889 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.889 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.889 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.889 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.889 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.889 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.889 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.889 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.890 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.890 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.890 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.890 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.890 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.890 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.890 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.890 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.890 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.890 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.891 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.891 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.891 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.891 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.891 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.891 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.891 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.891 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.891 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.891 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.891 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.891 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.892 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.892 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.892 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.892 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.892 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.892 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.892 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.892 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.892 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.892 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.893 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.893 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.893 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.893 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.893 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.893 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.894 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.894 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.894 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.894 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.894 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.894 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.895 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.895 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.895 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.895 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.895 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.896 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.896 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.896 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.896 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.896 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.896 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.896 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.896 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.897 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.897 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.897 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.897 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.897 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.897 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.897 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.898 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.898 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.898 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.898 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.898 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.898 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.898 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.898 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.898 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.898 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.899 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.899 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.899 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.899 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.899 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.899 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.899 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.899 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.899 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.899 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.900 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.900 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.900 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.900 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.900 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.900 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.900 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.900 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.900 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.900 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.900 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.900 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.901 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.901 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.901 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.901 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.901 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.901 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.901 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.902 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.902 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.902 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.902 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.902 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.902 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.902 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.902 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.902 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.902 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.902 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.902 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.902 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.903 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.903 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.903 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.903 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.903 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.903 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.903 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.903 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.903 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.903 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.903 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.903 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.903 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.903 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.904 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.904 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.904 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.904 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.904 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.904 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.904 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.904 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.904 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.904 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.904 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.904 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.904 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.904 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.904 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.905 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.905 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.905 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.905 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.905 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.905 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.905 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.905 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.905 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.905 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.905 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.905 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.905 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.906 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.906 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.907 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.907 INFO:teuthology.orchestra.run.smithi044.stdout:____________ ERROR at teardown of test_ranged_request_response_code ____________ 2023-12-03T12:39:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.907 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.908 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.908 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.908 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.908 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.908 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.909 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.909 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.912 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.913 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.913 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.913 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.913 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.913 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.914 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.915 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.915 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.915 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.915 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.916 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.916 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.916 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.916 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.916 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.916 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.916 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.916 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.916 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.916 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.916 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.916 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.916 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.917 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.917 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.917 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.917 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.917 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.917 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.917 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.917 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.917 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.917 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.917 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.917 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.917 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.917 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.919 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.920 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.920 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.920 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.920 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.920 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.920 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.920 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.920 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.920 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.920 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.920 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.920 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.920 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.920 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.921 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.921 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.921 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.921 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.921 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.921 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.921 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.921 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.921 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.922 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.922 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.922 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.922 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.922 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.922 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.922 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.922 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.922 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.922 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.922 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.922 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.922 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.922 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.922 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.923 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.923 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.923 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.923 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.923 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.923 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.923 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.923 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.923 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.923 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.923 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.923 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.923 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.923 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.924 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.924 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.924 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.924 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.927 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.928 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.928 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.928 INFO:teuthology.orchestra.run.smithi044.stdout:__________ ERROR at teardown of test_ranged_big_request_response_code __________ 2023-12-03T12:39:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.928 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.929 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.929 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.929 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.930 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.930 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.930 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.930 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.930 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.930 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.930 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.930 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.930 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.930 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.930 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.930 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.934 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.934 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.934 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.934 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.934 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.934 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.936 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.936 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.936 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.936 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.937 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.937 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.937 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.937 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.937 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.937 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.937 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.937 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.937 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.937 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.937 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.937 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.937 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.938 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.938 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.938 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.938 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.938 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.938 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.938 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.938 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.938 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.938 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.938 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.938 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.938 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.938 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.939 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.939 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.941 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.941 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.941 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.941 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.941 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.942 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.942 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.942 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.942 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.942 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.942 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.942 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.942 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.942 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.942 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.942 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.942 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.942 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.942 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.942 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.943 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.943 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.943 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.943 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.943 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.943 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.943 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.943 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.943 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.943 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.943 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.943 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.943 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.943 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.945 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.945 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.945 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.948 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.948 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.949 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.949 INFO:teuthology.orchestra.run.smithi044.stdout:__ ERROR at teardown of test_ranged_request_skip_leading_bytes_response_code ___ 2023-12-03T12:39:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.949 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.950 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.950 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.950 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.950 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.950 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.950 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.950 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.950 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.950 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.951 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.951 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.951 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.951 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.951 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.951 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.951 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.951 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.954 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.954 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.954 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.954 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.954 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.954 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.954 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.954 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.954 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.954 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.954 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.954 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.954 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.954 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.954 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.955 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.955 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.955 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.955 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.955 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.955 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.955 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.955 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.955 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.955 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.955 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.956 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.956 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.956 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.956 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.956 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.956 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.956 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.956 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.956 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.956 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.956 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.956 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.956 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.956 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.956 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.956 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.957 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.957 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.957 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.957 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.957 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.957 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.957 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.957 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.957 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.957 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.957 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.957 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.957 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.957 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.958 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.958 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.958 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.958 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.958 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.958 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.958 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.958 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.958 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.958 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.958 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.958 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.959 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.959 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.959 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.959 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.959 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.959 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.959 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.959 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.959 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.959 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.959 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.959 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.959 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.959 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.959 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.960 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.960 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.960 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.960 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.960 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.960 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.960 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.960 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.960 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.960 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.960 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.960 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.960 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.961 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.961 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.961 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.961 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.961 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.961 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.961 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.961 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.961 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.961 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.961 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.961 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.961 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.961 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.962 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.962 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.962 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.962 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.962 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.962 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.962 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.962 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.962 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.962 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.962 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.962 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.962 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.963 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.963 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.963 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.963 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.963 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.963 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.963 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.963 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.963 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.963 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.963 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.963 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.963 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.963 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.963 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.963 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.964 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.964 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.964 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.964 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.964 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.964 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.964 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.964 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.964 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.964 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.964 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.964 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.964 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.964 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.964 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.965 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.965 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.965 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.965 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.965 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.965 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.965 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.965 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.965 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.965 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.965 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.965 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.965 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.966 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.966 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.966 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.966 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.966 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.966 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.966 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.966 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.966 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.966 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.966 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.966 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.967 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.967 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.967 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.967 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.967 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.967 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.967 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.967 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.967 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.967 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.967 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.967 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.967 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.967 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.967 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.968 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.968 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.968 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.968 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.968 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.968 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.968 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.968 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.968 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.968 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.968 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.968 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.968 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.968 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.969 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.969 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.969 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.969 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.969 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.969 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.969 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.969 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.969 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.969 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.969 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.970 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.970 INFO:teuthology.orchestra.run.smithi044.stdout:_ ERROR at teardown of test_ranged_request_return_trailing_bytes_response_code _ 2023-12-03T12:39:13.970 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.970 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.970 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.970 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.970 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.970 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.970 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.970 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.970 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.970 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.970 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.970 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.971 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.971 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.971 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.971 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.971 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.971 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.971 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.971 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.971 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.971 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.971 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.971 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.971 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.972 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.972 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.972 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.972 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.972 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.972 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.972 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.972 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.972 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.972 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.972 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.972 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.973 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.973 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.973 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.973 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.973 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.973 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.973 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.973 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.973 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.973 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.973 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.973 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.973 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.973 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.974 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.974 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.974 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.974 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.974 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.974 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.974 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.974 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.974 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.974 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.974 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.974 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.974 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.974 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.975 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.975 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.975 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.975 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.975 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.975 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.975 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.975 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.975 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.975 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.975 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.975 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.975 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.975 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.976 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.976 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.976 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.976 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.976 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.976 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.976 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.976 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.976 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.976 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.977 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.977 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.977 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.977 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.977 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.977 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.977 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.977 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.977 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.977 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.977 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.977 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.977 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.978 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.978 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.978 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.978 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.978 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.978 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.978 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.978 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.978 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.978 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:13.978 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.978 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:13.978 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:13.978 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:13.979 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:13.979 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:13.979 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:13.979 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:13.979 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:13.979 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:13.979 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:13.979 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:13.979 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:13.979 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:13.979 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:13.979 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:13.979 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:13.979 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:13.979 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.980 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:13.980 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:13.980 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:13.980 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:13.980 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:13.980 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:13.980 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:13.980 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:13.980 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:13.980 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:13.980 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.980 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.980 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.980 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.980 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.981 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.981 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.981 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.981 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.981 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.981 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.981 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.981 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.981 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.981 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.981 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.981 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.981 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:13.981 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.982 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.982 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.982 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:13.982 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:13.982 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:13.982 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:13.982 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:13.982 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.982 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.982 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:13.982 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:13.982 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:13.982 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.982 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:13.983 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.983 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:13.983 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.983 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.983 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.983 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:13.983 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.983 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:13.983 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:13.983 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:13.983 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:13.983 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.983 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:13.983 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.983 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:13.984 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:13.984 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:13.984 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:13.984 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:13.984 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:13.984 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:13.984 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:13.984 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:13.984 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:13.984 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:13.984 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:13.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:13.985 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:13.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:13.985 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:13.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:13.985 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:13.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:13.985 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:13.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:13.985 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:13.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:13.985 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:13.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:13.986 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:13.986 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:13.986 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:13.986 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:13.986 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:13.986 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:13.986 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:13.986 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:13.986 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:13.986 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:13.986 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:13.986 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:13.986 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:13.987 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:13.987 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:13.987 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.987 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.987 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.987 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.987 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.987 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.987 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.987 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.987 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.987 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.987 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.987 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.988 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.988 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.988 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.988 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.988 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.988 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.988 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.988 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.988 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.988 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.988 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:13.988 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.988 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.988 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.988 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.989 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.989 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.989 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.989 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.989 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.989 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.989 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:13.989 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:13.989 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:13.989 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:13.989 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:13.989 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.990 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:13.990 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:13.990 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:13.990 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:13.990 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:13.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.990 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:13.990 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:13.990 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.990 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:13.990 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:13.990 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:13.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.990 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:13.990 INFO:teuthology.orchestra.run.smithi044.stdout:____________ ERROR at teardown of test_ranged_request_invalid_range ____________ 2023-12-03T12:39:13.991 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.991 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.991 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.991 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:13.991 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:13.991 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.991 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:13.991 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.991 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:13.991 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:13.991 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:13.991 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.991 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:13.991 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:13.992 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.992 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.992 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:13.992 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:13.992 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.992 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:13.992 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:13.992 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:13.992 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:13.992 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.992 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:13.992 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:13.993 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.993 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:13.993 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:13.993 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:13.993 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:13.993 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:13.993 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.993 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:13.993 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.993 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:13.993 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:13.993 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:13.993 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:13.993 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:13.993 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:13.994 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:13.994 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:13.994 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:13.994 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.994 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:13.994 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:13.994 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:13.994 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:13.994 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.994 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:13.994 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:13.994 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:13.994 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:13.994 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.995 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.995 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:13.995 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:13.995 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:13.995 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:13.995 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.995 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:13.995 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:13.995 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:13.995 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.995 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:13.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.995 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:13.996 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:13.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.996 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:13.996 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:13.996 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:13.996 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:13.996 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:13.996 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:13.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.997 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:13.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.997 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:13.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.997 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:13.997 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:13.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.997 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:13.997 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:13.997 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:13.998 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:13.998 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:13.998 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:13.998 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:13.998 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:13.998 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:13.998 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:13.998 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:13.998 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:13.998 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:13.998 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:13.998 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:13.999 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:13.999 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:13.999 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:13.999 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:13.999 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:13.999 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:13.999 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:13.999 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:13.999 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:13.999 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:13.999 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:13.999 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:13.999 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:13.999 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.000 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.000 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.000 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.000 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.000 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.000 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.000 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.000 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.000 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.000 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.000 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.000 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.000 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.000 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.000 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.001 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.001 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.001 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.001 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.001 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.001 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.001 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.001 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.001 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.001 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.001 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.001 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.001 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.001 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.002 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.002 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.002 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.002 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.002 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.002 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.002 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.002 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.002 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.002 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.002 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.003 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.003 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.003 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.003 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.003 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.003 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.003 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.003 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.003 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.003 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.003 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.003 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.003 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.003 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.004 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.004 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.004 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.004 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.004 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.004 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.004 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.004 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.004 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.004 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.004 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.004 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.004 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.004 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.004 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.005 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.005 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.005 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.005 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.005 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.005 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.005 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.005 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.005 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.005 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.005 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.005 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.006 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.006 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.006 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.006 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.006 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.006 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.007 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.007 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.007 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.007 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.007 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.007 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.007 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.007 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.007 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.008 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.008 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.008 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.008 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.008 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.008 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.008 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.008 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.008 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.008 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.008 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.008 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.008 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.009 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.009 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.009 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.009 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.009 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.009 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.009 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.009 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.009 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.009 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.009 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.010 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.010 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.010 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.010 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.010 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.010 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.011 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.011 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.011 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.011 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.011 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.012 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.012 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.012 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.012 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.012 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.012 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.012 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.013 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.013 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.013 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.013 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.013 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.013 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.013 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.013 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.014 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.014 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.014 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.014 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.014 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.014 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.014 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.014 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.014 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.015 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.015 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.015 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.015 INFO:teuthology.orchestra.run.smithi044.stdout:____________ ERROR at teardown of test_ranged_request_empty_object _____________ 2023-12-03T12:39:14.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.015 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.015 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.015 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.015 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.015 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.015 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.016 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.016 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.016 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.016 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.016 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.016 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.016 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.016 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.016 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.016 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.016 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.017 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.017 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.017 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.017 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.017 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.017 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.017 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.017 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.017 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.017 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.017 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.017 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.017 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.017 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.017 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.018 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.018 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.018 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.018 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.018 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.018 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.018 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.018 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.018 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.018 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.018 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.018 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.018 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.018 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.018 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.019 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.019 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.019 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.019 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.019 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.019 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.019 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.019 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.019 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.019 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.019 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.019 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.019 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.019 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.019 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.020 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.020 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.020 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.020 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.020 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.020 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.020 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.020 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.020 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.021 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.021 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.021 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.021 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.021 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.021 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.021 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.021 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.021 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.021 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.021 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.021 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.021 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.021 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.022 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.022 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.022 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.022 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.022 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.022 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.022 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.022 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.022 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.022 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.022 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.022 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.023 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.023 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.023 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.023 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.023 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.023 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.023 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.023 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.023 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.023 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.023 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.023 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.024 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.024 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.024 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.024 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.024 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.024 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.024 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.024 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.024 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.024 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.024 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.024 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.025 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.025 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.025 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.025 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.025 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.025 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.025 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.025 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.025 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.025 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.025 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.025 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.025 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.026 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.026 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.026 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.026 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.026 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.026 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.026 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.026 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.026 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.026 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.026 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.026 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.026 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.027 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.027 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.027 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.027 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.027 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.027 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.027 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.027 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.027 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.027 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.027 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.028 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.028 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.028 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.028 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.028 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.028 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.028 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.028 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.028 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.028 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.028 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.028 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.028 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.028 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.028 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.029 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.029 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.029 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.029 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.029 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.029 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.029 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.029 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.029 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.029 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.029 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.029 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.030 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.030 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.030 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.030 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.030 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.030 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.030 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.030 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.030 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.030 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.030 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.030 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.030 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.031 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.031 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.031 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.031 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.031 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.031 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.031 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.031 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.031 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.031 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.031 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.031 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.031 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.031 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.032 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.032 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.032 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.032 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.032 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.032 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.032 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.032 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.032 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.032 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.032 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.032 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.032 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.032 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.032 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.033 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.033 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.033 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.033 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.033 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.033 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.033 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.033 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.033 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.033 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.033 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.033 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.033 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.033 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.033 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.034 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.034 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.034 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.034 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.034 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.034 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.034 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.034 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.034 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.034 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.034 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.034 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.034 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.034 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.035 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.035 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.035 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.035 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.035 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.035 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.035 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.035 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.035 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.035 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.035 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.035 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.035 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.036 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.036 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.036 INFO:teuthology.orchestra.run.smithi044.stdout:__________ ERROR at teardown of test_versioning_bucket_create_suspend __________ 2023-12-03T12:39:14.036 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.036 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.036 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.036 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.036 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.036 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.036 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.036 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.036 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.036 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.036 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.036 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.036 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.037 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.037 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.037 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.037 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.037 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.037 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.037 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.037 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.037 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.037 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.037 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.037 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.037 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.038 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.038 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.038 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.038 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.038 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.038 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.038 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.038 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.038 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.038 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.038 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.038 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.038 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.039 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.039 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.039 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.039 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.039 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.039 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.039 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.039 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.039 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.039 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.039 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.039 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.039 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.040 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.040 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.040 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.040 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.040 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.040 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.040 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.040 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.040 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.040 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.040 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.040 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.040 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.040 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.041 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.041 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.041 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.041 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.041 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.041 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.041 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.041 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.041 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.041 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.041 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.041 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.041 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.041 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.042 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.042 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.042 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.042 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.042 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.042 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.042 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.042 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.042 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.042 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.042 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.042 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.042 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.042 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.043 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.043 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.043 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.043 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.043 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.043 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.043 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.043 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.043 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.043 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.043 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.043 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.043 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.043 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.043 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.043 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.043 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.044 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.044 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.044 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.044 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.044 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.044 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.044 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.044 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.044 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.045 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.045 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.045 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.045 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.045 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.045 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.045 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.045 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.045 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.045 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.045 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.045 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.045 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.045 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.045 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.045 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.046 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.046 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.046 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.046 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.046 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.046 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.046 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.046 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.046 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.046 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.046 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.046 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.046 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.046 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.047 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.047 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.047 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.047 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.047 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.047 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.047 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.047 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.047 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.047 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.047 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.047 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.048 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.048 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.048 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.048 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.048 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.048 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.048 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.048 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.048 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.048 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.049 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.049 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.049 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.049 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.049 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.049 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.049 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.049 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.049 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.049 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.049 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.049 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.049 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.049 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.049 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.050 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.050 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.050 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.050 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.050 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.050 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.050 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.050 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.050 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.050 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.050 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.050 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.050 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.050 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.051 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.051 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.051 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.051 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.051 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.051 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.051 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.051 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.051 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.051 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.051 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.051 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.052 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.052 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.052 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.052 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.052 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.052 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.052 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.052 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.052 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.052 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.052 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.052 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.052 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.053 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.053 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.053 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.053 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.053 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.053 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.053 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.053 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.053 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.053 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.053 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.053 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.053 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.053 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.053 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.053 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.054 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.054 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.054 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.054 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.054 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.054 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.054 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.054 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.054 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.054 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.054 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.054 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.054 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.055 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.055 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.055 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.055 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.055 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.055 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.055 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.055 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.055 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.055 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.055 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.055 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.055 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.055 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.055 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.055 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.056 INFO:teuthology.orchestra.run.smithi044.stdout:_________ ERROR at teardown of test_versioning_obj_create_read_remove __________ 2023-12-03T12:39:14.056 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.056 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.056 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.056 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.056 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.056 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.057 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.057 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.057 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.057 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.057 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.057 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.057 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.057 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.057 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.057 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.057 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.057 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.057 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.057 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.058 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.058 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.058 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.058 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.058 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.058 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.058 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.058 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.058 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.058 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.058 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.058 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.058 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.059 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.059 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.059 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.059 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.059 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.059 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.059 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.059 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.059 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.059 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.059 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.059 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.059 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.060 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.060 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.060 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.060 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.060 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.060 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.060 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.060 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.060 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.060 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.060 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.060 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.060 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.060 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.061 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.061 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.061 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.061 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.061 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.061 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.061 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.061 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.061 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.061 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.061 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.062 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.062 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.062 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.062 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.062 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.062 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.062 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.062 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.063 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.063 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.063 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.063 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.063 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.063 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.063 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.063 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.063 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.063 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.063 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.063 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.063 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.063 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.064 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.064 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.064 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.064 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.064 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.064 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.064 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.064 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.064 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.064 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.064 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.064 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.064 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.064 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.065 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.065 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.065 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.065 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.065 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.065 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.065 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.065 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.065 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.065 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.065 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.065 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.065 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.065 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.065 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.066 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.066 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.066 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.066 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.066 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.066 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.066 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.066 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.066 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.066 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.066 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.067 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.067 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.067 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.067 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.067 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.067 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.067 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.067 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.067 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.067 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.067 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.067 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.067 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.067 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.067 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.068 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.068 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.068 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.068 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.068 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.068 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.068 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.068 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.068 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.068 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.068 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.068 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.069 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.069 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.069 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.069 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.069 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.069 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.069 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.069 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.069 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.069 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.070 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.070 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.070 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.070 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.070 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.070 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.070 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.070 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.070 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.070 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.070 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.070 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.070 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.071 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.071 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.071 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.071 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.071 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.071 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.071 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.071 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.071 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.071 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.071 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.071 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.071 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.071 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.072 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.072 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.072 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.072 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.072 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.072 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.073 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.073 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.073 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.073 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.073 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.073 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.073 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.073 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.073 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.073 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.073 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.073 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.073 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.073 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.073 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.074 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.074 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.074 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.074 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.074 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.074 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.074 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.074 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.074 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.074 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.074 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.075 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.075 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.075 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.075 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.075 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.075 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.075 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.075 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.075 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.075 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.075 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.075 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.075 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.075 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.076 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.076 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.076 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.076 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.076 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.076 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.076 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.076 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.076 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.076 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.076 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.076 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.077 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.077 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.077 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.077 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.077 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.077 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.077 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.077 INFO:teuthology.orchestra.run.smithi044.stdout:_______ ERROR at teardown of test_versioning_obj_create_read_remove_head _______ 2023-12-03T12:39:14.077 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.077 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.077 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.077 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.077 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.077 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.078 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.078 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.078 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.078 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.078 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.078 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.078 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.078 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.078 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.078 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.078 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.079 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.079 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.079 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.079 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.079 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.079 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.079 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.079 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.079 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.079 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.079 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.079 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.079 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.079 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.080 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.080 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.080 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.080 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.080 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.080 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.080 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.080 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.080 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.080 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.080 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.080 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.081 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.081 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.081 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.081 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.081 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.081 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.081 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.081 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.081 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.081 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.081 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.081 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.082 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.082 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.082 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.082 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.082 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.082 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.082 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.082 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.082 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.082 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.082 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.083 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.083 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.083 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.083 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.083 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.083 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.083 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.083 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.083 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.083 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.083 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.083 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.084 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.084 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.084 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.084 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.084 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.084 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.084 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.084 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.084 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.084 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.084 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.084 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.084 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.084 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.085 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.085 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.085 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.085 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.085 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.085 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.085 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.085 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.085 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.085 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.085 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.085 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.085 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.086 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.086 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.086 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.086 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.086 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.086 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.086 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.086 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.086 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.086 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.086 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.086 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.087 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.087 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.087 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.087 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.087 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.087 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.087 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.087 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.087 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.087 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.087 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.087 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.087 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.087 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.088 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.088 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.088 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.088 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.088 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.088 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.088 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.088 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.088 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.088 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.089 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.089 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.089 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.089 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.089 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.089 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.089 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.089 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.089 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.089 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.089 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.089 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.089 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.090 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.090 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.090 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.090 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.090 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.090 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.090 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.090 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.090 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.090 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.091 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.091 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.091 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.091 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.091 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.091 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.091 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.091 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.091 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.091 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.091 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.091 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.092 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.092 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.092 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.092 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.092 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.092 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.092 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.093 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.093 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.093 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.093 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.093 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.093 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.093 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.093 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.093 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.093 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.093 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.093 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.093 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.093 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.093 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.093 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.094 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.094 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.094 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.094 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.094 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.094 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.094 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.094 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.094 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.094 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.094 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.095 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.095 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.095 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.095 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.095 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.095 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.095 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.095 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.095 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.095 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.095 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.095 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.095 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.095 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.095 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.096 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.096 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.096 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.096 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.096 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.096 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.096 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.096 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.096 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.096 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.096 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.096 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.096 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.097 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.097 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.097 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.097 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.097 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.097 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.097 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.097 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.097 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.097 INFO:teuthology.orchestra.run.smithi044.stdout:_____ ERROR at teardown of test_versioning_obj_plain_null_version_removal ______ 2023-12-03T12:39:14.098 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.098 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.098 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.098 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.098 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.098 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.098 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.098 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.098 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.098 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.099 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.099 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.099 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.099 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.099 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.101 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.101 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.101 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.101 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.102 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.102 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.102 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.102 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.102 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.102 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.102 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.102 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.102 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.102 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.102 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.102 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.102 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.103 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.103 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.103 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.103 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.103 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.103 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.103 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.103 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.103 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.103 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.103 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.103 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.103 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.103 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.104 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.104 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.104 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.104 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.104 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.104 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.104 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.104 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.104 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.104 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.104 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.104 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.104 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.104 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.105 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.105 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.105 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.105 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.105 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.105 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.105 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.105 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.105 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.105 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.106 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.106 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.106 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.106 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.106 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.106 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.106 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.106 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.106 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.106 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.107 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.107 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.107 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.107 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.107 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.107 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.107 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.107 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.107 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.107 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.107 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.107 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.107 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.107 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.107 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.108 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.108 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.108 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.108 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.108 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.108 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.108 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.108 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.108 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.108 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.108 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.108 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.109 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.109 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.109 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.109 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.109 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.109 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.109 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.109 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.109 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.109 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.109 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.109 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.109 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.109 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.109 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.110 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.110 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.110 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.110 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.110 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.110 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.110 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.110 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.110 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.110 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.110 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.111 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.111 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.111 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.111 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.111 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.111 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.111 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.111 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.111 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.111 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.111 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.111 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.111 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.112 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.112 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.112 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.112 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.112 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.112 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.112 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.112 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.112 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.112 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.112 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.112 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.112 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.112 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.113 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.113 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.113 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.113 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.113 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.113 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.113 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.113 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.113 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.113 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.113 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.113 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.113 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.113 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.113 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.114 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.114 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.114 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.114 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.114 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.114 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.114 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.114 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.114 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.114 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.114 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.114 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.115 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.115 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.115 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.115 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.115 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.115 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.115 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.116 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.116 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.116 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.116 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.116 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.116 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.116 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.116 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.117 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.117 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.117 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.117 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.117 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.117 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.117 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.117 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.117 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.117 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.117 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.117 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.117 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.117 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.117 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.118 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.118 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.118 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.118 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.118 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.118 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.118 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.118 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.118 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.118 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.118 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.118 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.118 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.119 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.119 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.119 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.119 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.119 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.119 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.119 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.119 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.119 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.119 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.119 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.119 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.119 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.120 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.120 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.120 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.120 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.120 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.120 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.120 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.120 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.120 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.120 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.120 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.120 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.120 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.120 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.120 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.120 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.121 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.121 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.121 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.121 INFO:teuthology.orchestra.run.smithi044.stdout:____ ERROR at teardown of test_versioning_obj_plain_null_version_overwrite _____ 2023-12-03T12:39:14.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.121 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.121 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.121 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.121 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.122 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.122 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.122 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.122 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.122 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.122 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.122 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.123 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.123 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.123 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.123 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.123 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.123 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.123 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.123 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.123 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.123 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.123 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.123 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.123 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.123 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.123 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.123 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.124 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.124 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.124 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.124 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.124 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.124 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.124 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.124 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.124 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.124 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.125 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.125 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.125 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.125 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.125 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.126 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.126 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.126 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.126 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.126 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.126 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.126 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.127 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.127 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.127 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.127 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.127 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.127 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.127 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.127 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.127 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.128 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.128 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.128 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.128 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.128 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.128 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.128 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.128 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.129 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.129 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.129 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.129 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.129 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.129 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.130 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.130 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.130 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.130 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.130 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.130 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.130 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.130 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.130 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.130 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.130 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.131 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.131 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.131 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.131 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.131 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.131 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.131 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.131 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.131 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.131 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.131 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.131 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.131 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.132 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.132 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.132 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.132 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.132 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.132 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.132 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.132 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.132 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.132 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.132 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.132 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.132 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.133 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.133 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.133 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.133 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.133 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.133 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.133 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.133 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.133 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.133 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.133 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.133 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.133 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.133 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.133 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.133 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.134 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.134 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.134 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.134 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.134 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.134 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.134 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.134 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.134 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.134 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.134 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.134 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.134 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.134 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.135 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.135 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.135 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.135 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.135 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.135 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.135 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.135 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.135 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.135 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.135 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.135 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.135 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.135 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.135 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.136 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.136 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.136 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.136 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.136 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.136 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.136 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.136 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.136 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.136 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.136 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.136 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.136 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.136 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.137 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.137 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.137 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.137 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.137 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.137 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.137 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.137 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.137 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.137 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.137 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.138 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.138 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.138 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.138 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.138 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.138 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.138 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.138 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.138 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.138 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.138 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.138 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.138 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.139 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.139 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.139 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.139 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.139 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.139 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.139 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.139 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.139 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.139 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.139 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.139 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.139 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.139 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.139 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.140 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.140 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.140 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.140 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.140 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.140 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.140 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.140 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.140 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.140 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.140 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.140 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.140 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.140 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.141 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.141 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.141 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.141 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.141 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.141 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.141 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.141 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.141 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.141 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.141 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.142 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.142 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.142 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.142 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.142 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.142 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.142 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.142 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.142 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.142 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.142 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.142 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.142 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.143 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.143 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.143 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.143 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.143 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.143 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.143 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.143 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.143 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.143 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.143 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.143 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.143 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.143 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.143 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.143 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.144 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.144 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.144 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.144 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.144 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.144 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.144 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.144 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.144 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.144 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.144 INFO:teuthology.orchestra.run.smithi044.stdout:_ ERROR at teardown of test_versioning_obj_plain_null_version_overwrite_suspended _ 2023-12-03T12:39:14.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.144 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.145 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.145 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.145 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.145 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.145 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.145 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.145 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.145 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.145 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.145 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.145 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.145 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.146 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.146 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.146 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.146 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.146 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.146 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.146 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.146 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.146 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.146 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.146 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.146 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.146 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.146 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.147 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.147 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.147 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.147 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.147 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.147 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.147 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.147 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.147 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.147 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.147 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.147 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.147 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.147 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.147 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.147 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.148 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.148 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.148 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.148 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.148 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.148 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.148 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.148 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.148 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.148 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.148 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.148 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.148 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.148 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.148 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.149 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.149 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.149 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.149 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.149 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.149 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.149 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.149 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.149 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.149 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.149 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.149 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.149 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.150 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.150 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.150 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.150 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.150 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.150 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.150 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.150 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.150 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.150 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.151 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.151 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.151 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.151 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.151 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.151 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.151 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.151 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.151 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.151 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.151 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.151 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.151 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.151 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.151 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.152 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.152 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.152 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.152 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.152 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.152 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.152 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.152 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.152 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.152 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.152 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.153 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.153 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.153 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.153 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.153 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.153 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.153 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.154 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.154 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.154 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.154 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.154 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.154 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.154 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.154 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.154 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.154 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.154 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.154 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.154 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.154 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.155 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.155 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.155 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.155 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.155 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.155 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.155 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.155 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.155 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.155 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.155 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.155 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.155 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.155 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.156 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.156 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.156 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.156 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.156 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.156 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.156 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.156 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.156 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.156 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.156 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.156 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.156 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.156 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.156 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.156 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.157 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.157 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.157 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.157 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.157 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.157 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.157 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.157 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.157 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.157 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.157 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.157 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.157 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.157 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.157 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.158 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.158 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.158 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.158 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.158 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.158 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.158 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.158 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.158 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.158 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.158 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.158 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.158 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.158 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.159 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.159 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.159 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.159 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.159 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.159 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.159 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.159 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.159 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.159 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.159 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.159 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.159 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.159 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.160 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.160 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.160 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.160 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.160 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.160 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.160 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.160 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.160 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.160 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.160 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.160 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.160 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.160 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.161 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.161 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.161 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.161 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.161 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.161 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.161 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.161 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.161 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.161 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.161 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.161 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.161 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.161 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.161 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.162 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.162 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.162 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.162 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.162 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.162 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.162 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.162 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.162 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.162 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.162 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.162 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.162 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.162 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.163 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.163 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.163 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.163 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.163 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.163 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.163 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.163 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.163 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.163 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.163 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.163 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.164 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.164 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.164 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.164 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.164 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.164 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.164 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.164 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.164 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.164 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.164 INFO:teuthology.orchestra.run.smithi044.stdout:__________ ERROR at teardown of test_versioning_obj_suspend_versions ___________ 2023-12-03T12:39:14.164 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.164 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.164 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.164 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.165 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.165 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.165 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.165 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.165 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.165 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.165 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.165 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.165 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.165 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.165 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.165 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.166 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.166 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.166 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.166 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.166 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.166 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.166 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.166 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.166 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.166 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.167 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.167 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.167 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.167 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.167 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.167 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.167 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.167 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.167 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.167 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.167 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.167 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.167 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.167 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.167 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.168 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.168 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.168 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.168 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.168 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.168 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.168 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.168 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.168 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.168 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.168 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.168 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.168 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.169 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.169 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.169 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.169 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.169 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.169 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.169 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.169 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.169 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.169 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.169 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.170 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.170 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.170 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.170 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.170 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.170 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.170 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.170 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.170 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.171 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.171 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.171 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.171 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.171 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.171 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.171 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.171 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.171 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.171 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.171 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.171 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.171 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.171 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.171 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.172 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.172 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.172 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.172 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.172 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.172 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.172 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.172 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.172 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.172 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.172 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.172 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.172 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.172 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.173 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.173 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.173 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.173 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.173 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.173 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.173 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.173 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.173 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.174 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.174 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.174 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.174 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.174 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.174 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.174 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.174 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.174 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.175 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.175 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.175 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.175 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.175 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.175 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.175 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.175 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.175 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.175 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.175 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.175 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.175 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.175 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.175 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.175 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.176 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.176 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.176 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.176 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.176 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.176 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.176 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.176 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.176 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.176 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.176 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.177 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.177 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.177 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.177 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.177 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.177 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.177 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.177 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.177 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.177 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.177 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.177 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.177 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.177 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.178 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.178 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.178 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.178 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.178 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.178 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.178 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.178 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.178 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.178 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.178 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.178 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.178 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.179 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.179 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.179 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.179 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.179 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.179 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.179 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.179 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.179 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.179 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.179 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.179 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.179 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.179 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.180 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.180 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.180 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.180 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.180 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.180 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.180 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.180 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.180 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.180 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.180 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.180 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.180 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.180 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.181 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.181 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.181 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.181 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.181 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.181 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.181 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.181 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.181 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.181 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.181 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.181 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.181 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.182 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.182 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.182 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.182 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.182 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.182 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.182 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.182 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.182 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.182 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.182 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.182 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.182 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.182 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.183 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.183 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.183 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.183 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.183 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.183 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.183 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.183 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.183 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.183 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.183 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.183 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.183 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.183 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.184 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.184 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.184 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.184 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.184 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.184 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.184 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.184 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.184 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.184 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.184 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.184 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.184 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.184 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.184 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.184 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.185 INFO:teuthology.orchestra.run.smithi044.stdout:_____ ERROR at teardown of test_versioning_obj_create_versions_remove_all ______ 2023-12-03T12:39:14.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.185 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.185 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.185 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.185 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.185 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.185 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.185 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.185 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.186 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.186 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.186 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.186 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.186 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.186 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.186 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.186 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.186 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.186 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.186 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.186 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.186 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.186 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.187 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.187 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.187 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.187 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.187 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.187 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.187 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.187 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.187 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.187 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.187 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.187 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.187 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.187 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.188 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.188 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.188 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.188 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.188 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.188 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.188 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.188 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.188 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.188 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.188 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.188 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.188 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.188 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.188 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.189 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.189 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.189 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.189 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.189 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.189 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.189 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.189 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.189 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.189 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.189 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.189 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.189 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.189 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.189 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.190 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.190 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.190 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.190 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.190 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.190 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.190 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.190 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.190 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.190 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.191 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.191 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.191 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.191 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.191 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.191 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.191 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.191 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.191 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.191 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.192 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.192 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.192 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.192 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.192 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.192 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.192 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.192 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.192 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.192 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.192 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.192 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.192 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.192 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.192 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.193 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.193 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.193 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.193 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.193 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.193 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.193 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.193 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.193 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.193 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.194 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.194 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.194 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.194 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.194 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.194 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.194 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.194 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.194 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.194 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.195 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.195 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.195 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.195 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.195 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.195 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.195 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.195 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.195 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.195 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.195 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.195 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.195 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.195 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.195 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.196 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.196 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.196 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.196 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.196 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.196 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.196 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.196 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.196 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.196 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.196 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.196 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.196 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.196 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.196 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.197 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.197 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.197 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.197 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.197 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.197 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.197 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.197 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.197 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.197 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.197 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.197 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.197 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.197 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.197 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.197 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.198 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.198 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.198 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.198 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.198 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.198 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.198 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.198 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.198 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.199 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.199 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.199 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.199 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.199 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.199 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.199 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.199 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.199 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.199 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.199 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.199 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.200 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.200 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.200 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.200 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.200 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.200 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.200 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.200 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.200 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.200 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.200 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.200 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.200 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.200 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.200 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.201 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.201 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.201 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.201 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.201 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.201 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.201 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.201 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.201 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.201 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.201 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.201 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.201 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.202 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.202 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.202 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.202 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.202 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.202 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.202 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.202 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.202 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.202 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.202 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.202 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.203 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.203 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.203 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.203 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.203 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.203 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.203 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.203 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.203 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.203 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.203 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.203 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.204 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.204 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.204 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.204 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.204 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.204 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.204 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.204 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.204 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.204 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.204 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.204 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.204 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.204 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.204 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.205 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.205 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.205 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.205 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.205 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.205 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.205 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.205 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.205 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.205 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.205 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.205 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.205 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.206 INFO:teuthology.orchestra.run.smithi044.stdout:_ ERROR at teardown of test_versioning_obj_create_versions_remove_special_names _ 2023-12-03T12:39:14.206 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.206 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.206 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.206 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.206 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.206 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.206 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.206 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.206 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.206 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.206 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.206 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.206 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.207 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.207 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.207 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.207 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.207 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.207 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.207 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.207 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.207 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.207 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.207 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.207 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.207 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.207 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.208 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.208 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.208 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.208 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.208 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.208 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.208 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.208 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.208 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.208 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.208 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.208 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.208 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.208 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.208 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.208 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.209 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.209 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.209 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.209 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.209 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.209 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.209 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.209 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.209 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.209 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.209 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.209 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.210 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.210 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.210 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.210 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.210 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.210 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.210 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.210 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.210 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.210 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.210 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.211 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.211 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.211 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.211 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.211 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.211 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.211 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.211 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.211 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.212 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.212 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.212 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.212 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.212 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.212 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.212 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.212 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.212 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.212 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.212 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.212 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.212 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.212 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.212 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.213 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.213 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.213 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.213 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.213 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.213 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.213 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.213 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.213 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.213 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.213 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.213 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.213 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.213 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.213 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.213 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.214 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.214 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.214 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.214 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.214 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.214 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.214 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.215 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.215 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.215 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.215 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.215 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.215 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.215 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.215 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.216 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.216 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.216 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.216 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.216 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.216 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.216 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.216 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.216 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.216 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.216 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.216 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.216 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.216 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.218 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.218 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.218 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.218 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.218 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.218 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.218 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.218 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.218 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.218 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.218 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.218 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.218 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.218 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.218 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.219 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.219 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.219 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.219 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.219 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.219 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.219 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.219 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.219 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.219 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.219 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.220 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.220 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.220 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.220 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.220 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.220 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.220 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.220 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.220 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.221 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.221 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.221 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.221 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.221 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.221 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.221 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.221 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.221 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.221 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.221 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.221 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.221 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.221 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.221 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.222 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.222 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.222 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.222 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.222 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.222 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.222 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.222 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.222 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.222 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.222 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.222 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.222 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.224 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.224 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.224 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.224 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.224 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.224 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.224 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.224 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.224 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.224 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.224 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.224 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.224 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.224 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.224 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.225 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.225 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.225 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.225 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.225 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.225 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.225 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.225 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.225 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.225 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.225 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.225 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.225 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.225 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.225 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.226 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.226 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.226 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.226 INFO:teuthology.orchestra.run.smithi044.stdout:_____ ERROR at teardown of test_versioning_obj_create_overwrite_multipart ______ 2023-12-03T12:39:14.226 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.226 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.226 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.226 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.226 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.226 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.227 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.227 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.228 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.228 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.228 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.228 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.228 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.228 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.228 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.228 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.228 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.228 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.228 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.228 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.228 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.232 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.232 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.232 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.232 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.232 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.232 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.232 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.232 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.232 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.232 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.232 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.232 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.232 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.232 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.232 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.233 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.233 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.233 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.233 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.233 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.233 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.233 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.233 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.234 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.234 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.234 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.234 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.234 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.234 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.234 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.246 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.246 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.246 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.246 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.246 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.247 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.247 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.247 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.247 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.247 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.247 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.250 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.250 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.250 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.250 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.250 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout:_____________ ERROR at teardown of test_versioning_obj_list_marker _____________ 2023-12-03T12:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout:____________ ERROR at teardown of test_versioning_copy_obj_version _____________ 2023-12-03T12:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout:___________ ERROR at teardown of test_versioning_multi_object_delete ___________ 2023-12-03T12:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.303 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.303 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.303 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.311 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.311 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.311 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.311 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.311 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.311 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.311 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.311 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout:_____ ERROR at teardown of test_versioning_multi_object_delete_with_marker _____ 2023-12-03T12:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.331 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.331 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.331 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.331 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.331 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.331 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.331 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.331 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.332 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.332 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.332 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.332 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.332 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.332 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.332 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.332 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.332 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.332 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.332 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.332 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.332 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.332 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.332 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.333 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.333 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.333 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.333 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.333 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.333 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.333 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.333 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.333 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.333 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.333 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.333 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.333 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.333 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.333 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.334 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.334 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.334 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.334 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.334 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.334 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.334 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.334 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.334 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.334 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.334 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.334 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.334 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.334 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.335 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.335 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.335 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.335 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.335 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.335 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.335 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.335 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.335 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.335 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.335 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.335 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.335 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.336 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.336 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.336 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.336 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.336 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.336 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.336 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.336 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.336 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.336 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.336 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.336 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.336 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.337 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.337 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.337 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.337 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.337 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.337 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.337 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.337 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.337 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.337 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.337 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.337 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.337 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.337 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.337 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.337 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.338 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.338 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.338 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.338 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.338 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.338 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.338 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.338 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.338 INFO:teuthology.orchestra.run.smithi044.stdout:_ ERROR at teardown of test_versioning_multi_object_delete_with_marker_create __ 2023-12-03T12:39:14.338 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.338 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.338 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.338 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.339 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.339 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.339 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.339 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.339 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.339 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.339 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.339 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.339 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.339 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.339 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.339 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.340 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.340 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.340 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.340 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.340 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.340 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.340 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.340 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.341 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.341 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.341 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.341 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.341 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.341 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.341 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.341 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.341 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.341 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.341 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.341 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.341 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.341 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.341 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.342 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.342 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.342 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.342 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.342 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.342 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.342 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.342 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.342 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.342 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.342 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.342 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.342 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.342 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.343 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.343 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.343 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.343 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.343 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.343 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.343 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.343 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.343 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.343 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.343 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.343 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.343 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.343 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.344 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.344 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.344 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.344 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.344 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.344 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.344 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.344 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.344 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.344 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.345 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.345 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.345 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.345 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.345 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.345 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.345 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.345 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.345 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.345 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.345 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.345 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.345 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.345 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.345 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.345 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.346 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.346 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.346 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.346 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.346 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.346 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.346 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.346 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.346 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.346 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.346 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.346 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.346 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.346 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.347 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.347 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.347 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.347 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.347 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.347 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.347 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.347 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.347 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.347 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.347 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.347 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.347 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.347 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.347 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.347 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.348 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.348 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.348 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.348 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.348 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.348 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.348 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.348 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.348 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.348 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.348 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.348 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.348 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.348 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.349 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.349 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.349 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.349 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.349 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.349 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.349 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.349 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.349 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.349 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.349 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.349 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.349 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.349 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.349 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.349 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.350 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.350 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.350 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.350 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.350 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.350 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.350 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.350 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.350 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.350 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.350 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.350 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.350 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.351 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.351 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.351 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.352 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.352 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.352 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.352 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.352 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.352 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.352 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.352 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.352 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.352 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.352 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.353 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.353 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.353 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.353 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.353 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.353 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.353 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.353 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.353 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.353 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.353 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.353 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.353 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.353 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.354 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.354 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.354 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.354 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.354 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.354 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.354 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.354 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.355 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.355 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.355 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.355 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.355 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.355 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.356 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.356 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.356 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.356 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.356 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.356 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.357 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.357 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.357 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.357 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.357 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.357 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.357 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.358 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.358 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.358 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.358 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.358 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.358 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.358 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.358 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.358 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.359 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.359 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.359 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.359 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.359 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.359 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.359 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.359 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.359 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.359 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.359 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.359 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.359 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.359 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.360 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.360 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.360 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.360 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.360 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.360 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.360 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.360 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.360 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.360 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.360 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.360 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.361 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.361 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.361 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.361 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.361 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.361 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.361 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.361 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at teardown of test_versioned_object_acl ________________ 2023-12-03T12:39:14.361 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.361 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.361 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.362 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.362 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.362 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.362 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.362 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.362 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.362 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.362 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.362 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.362 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.362 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.362 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.362 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.362 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.363 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.363 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.363 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.363 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.363 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.363 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.363 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.363 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.363 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.363 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.363 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.364 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.364 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.364 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.364 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.364 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.364 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.364 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.364 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.364 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.365 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.365 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.365 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.365 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.365 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.365 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.365 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.365 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.365 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.365 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.365 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.365 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.365 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.366 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.366 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.366 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.366 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.366 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.366 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.366 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.366 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.366 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.366 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.367 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.367 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.367 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.367 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.367 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.367 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.367 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.367 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.367 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.367 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.367 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.368 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.368 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.368 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.368 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.368 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.368 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.368 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.368 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.368 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.368 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.368 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.368 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.368 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.369 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.369 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.369 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.369 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.369 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.369 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.369 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.369 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.369 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.369 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.369 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.369 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.369 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.369 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.369 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.370 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.370 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.370 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.370 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.370 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.370 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.370 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.370 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.370 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.370 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.370 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.370 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.370 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.370 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.370 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.371 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.371 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.371 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.371 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.371 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.371 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.371 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.371 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.371 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.371 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.371 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.371 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.371 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.371 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.372 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.372 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.372 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.372 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.372 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.372 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.372 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.372 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.372 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.372 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.372 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.372 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.372 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.374 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.374 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.375 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.375 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.375 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.375 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.375 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.375 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.375 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.375 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.375 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.375 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.375 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.375 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.375 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.375 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.375 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.376 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.376 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.376 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.376 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.376 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.376 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.376 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.376 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.376 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.376 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.376 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.376 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.376 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.377 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.377 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.377 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.377 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.377 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.377 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.377 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.377 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.377 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.377 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.377 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.377 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.377 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.377 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.378 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.378 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.378 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.378 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.378 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.378 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.378 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.378 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.378 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.378 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.378 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.378 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.378 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.378 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.379 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.379 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.379 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.379 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.379 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.379 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.379 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.379 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.379 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.379 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.379 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.379 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.379 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.379 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.379 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.379 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.379 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.380 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.380 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.380 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.380 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.380 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.380 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.380 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.380 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.380 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.380 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.380 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.380 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.380 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.380 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.381 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.381 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.381 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.381 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.381 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.381 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.381 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.381 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.381 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.381 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.381 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.381 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.381 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.381 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.381 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.382 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.382 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.382 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.382 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.382 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.382 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.382 INFO:teuthology.orchestra.run.smithi044.stdout:_____ ERROR at teardown of test_versioned_object_acl_no_version_specified ______ 2023-12-03T12:39:14.382 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.382 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.382 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.382 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.382 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.382 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.382 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.382 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.383 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.383 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.383 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.383 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.383 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.383 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.383 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.383 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.383 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.383 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.383 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.383 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.383 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.384 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.384 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.384 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.384 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.384 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.384 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.384 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.384 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.384 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.384 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.384 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.384 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.384 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.384 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.384 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.384 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.385 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.385 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.385 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.385 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.385 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.385 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.385 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.385 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.385 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.385 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.385 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.385 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.385 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.385 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.386 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.386 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.386 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.386 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.386 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.386 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.386 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.386 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.386 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.386 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.386 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.386 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.387 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.387 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.387 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.387 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.387 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.387 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.387 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.387 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.387 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.387 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.387 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.387 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.387 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.387 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.388 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.388 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.388 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.388 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.388 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.388 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.388 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.388 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.388 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.388 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.388 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.388 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.388 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.388 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.389 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.389 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.389 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.389 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.389 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.389 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.389 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.389 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.389 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.389 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.389 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.389 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.389 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.389 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.389 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.390 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.390 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.390 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.390 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.390 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.390 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.390 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.390 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.390 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.390 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.390 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.390 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.390 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.390 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.390 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.391 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.391 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.391 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.391 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.391 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.391 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.391 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.391 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.391 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.391 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.391 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.391 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.391 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.391 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.392 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.392 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.392 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.392 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.392 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.392 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.392 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.392 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.392 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.392 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.392 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.392 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.392 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.393 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.393 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.393 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.393 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.393 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.393 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.393 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.393 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.393 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.393 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.393 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.393 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.393 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.394 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.394 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.394 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.394 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.394 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.394 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.394 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.394 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.394 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.394 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.394 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.394 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.394 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.394 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.395 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.395 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.395 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.395 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.395 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.395 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.395 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.395 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.395 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.395 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.395 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.395 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.395 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.395 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.395 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.395 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.396 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.396 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.396 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.396 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.396 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.396 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.396 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.396 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.396 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.396 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.396 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.396 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.396 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.396 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.397 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.397 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.397 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.397 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.397 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.397 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.397 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.398 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.398 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.398 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.398 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.398 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.398 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.398 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.398 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.398 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.398 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.398 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.398 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.398 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.398 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.398 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.399 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.399 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.399 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.399 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.399 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.399 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.399 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.399 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.399 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.399 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.399 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.399 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.399 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.399 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.400 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.400 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.400 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.400 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.400 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.400 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.400 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.400 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.400 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.400 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.400 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.400 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.400 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.400 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.400 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.401 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.401 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.401 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.401 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.401 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.401 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.401 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.401 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.401 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.401 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.401 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.402 INFO:teuthology.orchestra.run.smithi044.stdout:___ ERROR at teardown of test_versioned_concurrent_object_create_and_remove ____ 2023-12-03T12:39:14.402 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.402 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.402 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.402 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.402 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.402 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.402 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.402 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.402 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.402 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.403 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.403 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.403 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.403 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.403 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.403 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.403 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.403 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.403 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.403 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.403 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.403 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.403 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.403 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.403 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.404 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.404 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.404 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.404 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.404 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.404 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.404 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.404 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.404 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.404 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.404 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.404 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.404 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.404 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.404 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.405 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.405 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.405 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.405 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.405 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.405 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.405 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.405 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.405 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.405 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.405 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.405 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.405 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.405 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.406 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.406 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.406 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.406 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.406 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.406 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.406 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.406 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.406 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.406 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.406 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.406 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.406 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.406 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.407 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.407 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.407 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.407 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.407 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.407 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.408 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.408 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.409 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.409 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.410 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.410 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.410 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.410 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.410 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.410 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.410 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.410 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.410 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.410 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.410 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.410 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.410 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.410 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.411 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.411 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.411 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.411 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.411 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.411 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.411 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.411 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.411 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.411 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.411 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.411 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.412 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.412 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.412 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.412 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.412 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.412 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.412 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.412 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.412 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.412 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.412 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.412 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.413 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.413 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.413 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.413 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.413 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.413 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.413 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.413 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.413 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.413 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.413 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.413 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.414 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.414 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.414 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.414 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.414 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.414 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.414 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.414 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.414 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.414 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.414 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.414 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.414 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.414 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.414 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.415 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.415 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.415 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.415 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.415 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.415 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.415 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.415 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.415 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.415 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.415 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.415 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.415 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.415 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.415 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.415 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.416 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.416 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.416 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.416 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.416 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.416 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.416 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.416 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.416 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.416 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.416 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.416 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.416 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.416 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.416 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.417 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.417 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.417 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.417 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.417 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.417 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.417 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.417 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.417 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.417 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.417 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.417 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.417 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.417 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.417 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.417 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.418 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.418 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.418 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.418 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.418 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.418 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.418 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.418 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.418 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.418 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.418 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.418 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.419 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.419 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.419 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.419 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.419 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.419 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.419 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.419 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.419 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.419 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.419 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.419 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.419 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.419 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.419 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.419 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.420 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.420 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.420 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.420 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.420 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.420 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.420 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.420 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.420 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.420 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.420 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.420 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.420 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.420 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.420 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.420 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.421 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.421 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.421 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.421 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.421 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.421 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.421 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.421 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.421 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.421 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.421 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.421 INFO:teuthology.orchestra.run.smithi044.stdout:___________________ ERROR at teardown of test_lifecycle_set ____________________ 2023-12-03T12:39:14.421 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.422 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.422 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.422 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.422 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.422 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.422 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.422 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.422 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.422 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.422 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.422 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.422 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.422 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.422 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.423 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.423 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.423 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.423 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.423 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.423 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.423 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.423 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.423 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.423 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.423 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.423 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.423 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.424 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.424 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.424 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.424 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.424 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.424 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.424 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.424 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.424 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.424 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.425 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.425 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.425 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.425 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.425 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.425 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.425 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.425 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.425 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.425 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.425 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.425 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.425 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.426 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.426 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.426 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.426 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.426 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.426 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.426 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.426 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.426 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.426 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.426 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.426 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.426 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.426 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.427 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.427 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.427 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.427 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.427 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.427 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.427 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.427 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.427 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.427 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.428 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.428 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.428 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.428 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.428 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.428 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.428 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.428 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.428 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.428 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.428 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.428 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.428 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.428 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.429 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.429 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.429 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.429 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.429 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.429 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.429 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.429 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.429 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.429 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.429 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.429 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.429 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.429 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.429 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.430 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.430 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.430 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.430 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.430 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.430 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.430 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.430 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.430 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.430 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.430 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.430 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.430 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.430 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.430 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.431 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.431 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.431 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.431 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.431 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.431 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.431 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.431 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.431 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.431 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.431 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.431 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.432 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.432 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.432 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.432 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.432 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.432 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.432 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.432 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.432 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.432 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.432 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.432 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.432 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.432 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.432 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.433 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.433 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.433 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.433 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.433 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.433 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.433 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.433 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.433 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.433 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.433 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.433 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.433 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.433 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.433 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.434 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.434 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.434 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.434 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.434 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.434 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.434 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.434 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.434 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.434 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.434 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.434 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.434 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.434 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.434 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.434 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.435 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.435 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.435 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.435 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.435 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.435 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.435 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.435 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.435 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.435 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.435 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.436 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.436 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.436 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.436 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.436 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.436 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.436 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.436 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.436 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.436 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.436 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.436 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.436 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.437 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.437 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.437 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.437 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.437 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.437 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.437 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.438 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.438 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.438 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.438 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.438 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.438 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.438 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.438 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.438 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.439 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.439 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.439 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.439 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.439 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.439 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.439 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.439 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.439 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.439 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.439 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.439 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.439 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.439 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.440 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.440 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.440 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.440 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.440 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.440 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.440 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.440 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.440 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.440 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.440 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.440 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.441 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.441 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.441 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.441 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.441 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.441 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.441 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.441 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.441 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.441 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.441 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.441 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.441 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.441 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.441 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.442 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.442 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.442 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.442 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.442 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.442 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.442 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.442 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.442 INFO:teuthology.orchestra.run.smithi044.stdout:___________________ ERROR at teardown of test_lifecycle_get ____________________ 2023-12-03T12:39:14.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.442 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.443 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.443 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.443 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.443 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.443 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.443 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.443 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.443 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.443 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.443 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.443 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.443 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.444 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.444 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.444 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.444 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.444 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.444 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.444 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.444 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.444 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.444 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.444 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.444 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.445 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.445 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.445 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.445 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.445 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.445 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.445 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.445 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.445 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.445 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.445 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.445 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.445 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.445 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.446 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.446 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.446 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.446 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.446 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.446 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.446 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.446 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.446 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.446 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.446 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.446 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.446 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.446 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.447 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.447 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.447 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.447 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.447 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.447 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.447 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.447 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.447 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.447 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.447 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.447 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.447 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.448 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.448 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.448 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.448 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.448 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.448 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.448 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.448 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.448 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.448 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.448 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.448 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.448 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.449 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.449 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.449 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.449 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.449 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.449 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.449 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.449 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.449 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.449 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.449 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.449 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.449 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.449 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.449 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.450 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.450 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.450 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.450 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.450 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.450 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.450 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.450 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.450 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.450 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.450 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.450 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.450 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.450 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.451 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.451 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.451 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.451 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.451 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.451 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.451 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.451 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.451 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.451 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.452 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.452 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.452 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.452 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.452 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.452 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.452 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.452 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.452 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.452 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.452 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.452 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.452 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.452 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.452 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.453 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.453 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.453 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.453 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.453 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.453 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.453 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.453 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.453 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.453 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.453 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.454 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.454 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.454 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.454 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.454 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.454 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.454 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.454 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.454 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.454 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.454 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.454 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.454 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.454 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.454 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.455 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.455 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.455 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.455 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.455 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.455 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.455 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.455 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.455 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.455 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.455 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.455 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.455 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.455 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.456 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.456 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.456 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.456 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.456 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.456 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.456 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.456 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.457 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.457 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.457 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.457 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.457 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.457 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.457 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.457 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.458 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.458 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.458 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.458 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.458 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.459 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.459 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.459 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.459 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.459 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.459 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.459 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.459 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.459 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.459 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.459 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.459 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.459 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.460 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.460 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.460 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.460 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.460 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.460 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.460 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.460 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.460 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.460 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.460 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.460 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.460 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.461 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.461 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.461 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.461 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.461 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.462 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.462 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.462 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.462 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.462 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.463 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.463 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.463 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.463 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.463 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.463 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.463 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.464 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.464 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.464 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.464 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at teardown of test_lifecycle_get_no_id _________________ 2023-12-03T12:39:14.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.464 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.465 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.465 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.465 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.465 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.465 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.465 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.465 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.465 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.465 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.466 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.466 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.466 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.466 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.466 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.466 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.466 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.466 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.466 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.466 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.466 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.467 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.467 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.467 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.467 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.467 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.467 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.467 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.467 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.467 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.467 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.467 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.468 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.468 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.468 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.468 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.468 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.468 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.468 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.468 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.468 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.468 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.468 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.468 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.468 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.469 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.469 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.469 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.469 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.469 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.469 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.469 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.469 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.469 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.469 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.469 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.469 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.469 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.470 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.470 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.470 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.470 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.470 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.470 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.470 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.470 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.470 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.471 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.471 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.471 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.471 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.471 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.471 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.471 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.471 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.471 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.471 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.471 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.471 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.471 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.471 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.471 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.472 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.472 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.472 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.472 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.472 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.472 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.472 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.472 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.472 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.472 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.472 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.472 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.472 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.472 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.472 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.473 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.473 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.473 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.473 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.473 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.473 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.473 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.473 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.473 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.473 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.473 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.473 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.473 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.473 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.473 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.474 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.474 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.474 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.474 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.474 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.474 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.474 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.474 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.474 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.474 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.474 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.474 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.474 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.475 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.475 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.475 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.475 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.475 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.475 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.475 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.475 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.475 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.475 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.475 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.475 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.475 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.475 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.475 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.475 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.476 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.476 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.476 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.476 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.476 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.476 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.476 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.476 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.476 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.476 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.476 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.476 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.476 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.476 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.477 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.477 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.477 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.477 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.477 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.477 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.477 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.477 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.477 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.477 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.478 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.478 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.478 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.478 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.478 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.478 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.478 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.478 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.478 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.478 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.478 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.478 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.478 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.478 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.478 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.479 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.479 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.479 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.479 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.479 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.479 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.479 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.479 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.479 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.479 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.479 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.479 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.479 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.479 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.479 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.480 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.480 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.480 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.480 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.480 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.480 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.480 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.480 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.480 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.480 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.480 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.480 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.480 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.480 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.480 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.480 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.481 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.481 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.481 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.481 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.481 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.481 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.481 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.481 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.481 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.481 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.481 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.481 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.481 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.481 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.482 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.482 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.482 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.482 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.482 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.482 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.482 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.482 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.482 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.482 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.482 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.482 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.482 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.482 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.483 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.483 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.483 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.483 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.483 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.483 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.483 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.483 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.483 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.483 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.483 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.483 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.483 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.483 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.484 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.484 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.484 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.484 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.484 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ ERROR at teardown of test_lifecycle_id_too_long ________________ 2023-12-03T12:39:14.484 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.484 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.484 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.484 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.484 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.484 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.484 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.484 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.484 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.484 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.484 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.484 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.485 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.485 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.485 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.485 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.485 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.485 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.485 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.485 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.485 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.485 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.485 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.485 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.485 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.486 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.486 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.486 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.486 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.486 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.486 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.486 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.486 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.486 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.486 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.486 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.486 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.486 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.487 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.487 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.487 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.487 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.487 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.487 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.487 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.487 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.487 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.487 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.487 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.487 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.487 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.487 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.488 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.488 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.488 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.488 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.488 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.488 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.488 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.488 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.488 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.488 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.488 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.488 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.488 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.488 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.488 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.488 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.489 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.489 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.489 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.489 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.489 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.489 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.489 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.489 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.489 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.489 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.489 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.489 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.489 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.489 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.489 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.490 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.490 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.490 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.490 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.490 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.490 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.490 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.490 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.490 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.490 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.490 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.490 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.490 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.490 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.490 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.491 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.491 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.491 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.491 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.491 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.491 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.491 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.491 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.491 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.491 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.491 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.491 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.491 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.491 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.491 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.491 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.492 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.492 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.492 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.492 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.492 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.492 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.492 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.492 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.492 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.493 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.493 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.493 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.493 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.493 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.493 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.493 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.493 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.493 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.493 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.493 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.493 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.493 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.493 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.494 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.494 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.494 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.494 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.494 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.494 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.494 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.494 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.494 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.494 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.494 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.494 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.494 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.494 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.494 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.494 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.495 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.495 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.495 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.495 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.495 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.495 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.495 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.495 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.495 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.495 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.495 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.495 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.495 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.495 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.495 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.496 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.496 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.496 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.496 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.496 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.496 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.496 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.496 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.496 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.496 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.496 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.497 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.497 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.497 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.497 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.497 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.497 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.497 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.497 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.497 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.497 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.497 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.497 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.497 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.497 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.498 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.498 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.498 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.498 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.498 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.498 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.498 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.498 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.498 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.498 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.498 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.498 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.498 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.498 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.498 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.499 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.499 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.499 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.499 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.499 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.499 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.499 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.499 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.499 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.499 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.499 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.499 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.499 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.499 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.499 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.500 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.500 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.500 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.500 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.500 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.500 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.500 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.500 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.500 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.500 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.500 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.500 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.500 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.500 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.501 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.501 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.501 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.501 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.501 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.501 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.501 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.501 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.501 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.501 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.501 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.501 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.501 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.501 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.502 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.502 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.502 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.502 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.502 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.502 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.502 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.502 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.502 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.502 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.502 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.502 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.502 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.502 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.502 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.503 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.503 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.503 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.503 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ ERROR at teardown of test_lifecycle_same_id __________________ 2023-12-03T12:39:14.503 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.503 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.503 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.503 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.503 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.503 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.504 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.504 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.504 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.504 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.504 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.504 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.504 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.504 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.504 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.504 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.504 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.504 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.504 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.504 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.505 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.505 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.505 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.505 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.505 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.505 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.505 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.505 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.505 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.505 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.505 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.505 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.505 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.505 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.505 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.505 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.506 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.506 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.506 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.506 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.506 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.506 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.506 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.506 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.506 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.506 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.506 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.506 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.510 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.510 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.511 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.511 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.511 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.511 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.511 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.511 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.511 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.511 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.511 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.511 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.511 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.511 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.511 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.511 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.512 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.512 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.512 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.512 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.512 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.512 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.512 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.512 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.512 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.513 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.513 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.513 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.513 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.513 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.513 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.513 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.513 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.513 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.513 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.513 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.514 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.514 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.514 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.514 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.514 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.514 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.514 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.514 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.514 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.514 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.514 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.514 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.514 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.515 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.515 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.515 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.515 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.515 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.515 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.515 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.515 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.515 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.515 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.515 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.515 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.515 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.515 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.515 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.516 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.516 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.516 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.516 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.516 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.516 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.516 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.516 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.516 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.517 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.517 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.517 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.517 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.517 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.517 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.517 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.517 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.517 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.517 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.517 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.517 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.517 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.517 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.518 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.518 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.518 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.518 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.518 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.518 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.518 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.518 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.518 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.518 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.519 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.519 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.519 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.519 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.519 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.519 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.519 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.519 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.519 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.519 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.519 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.519 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.519 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.519 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.519 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.520 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.520 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.520 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.520 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.520 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.520 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.520 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.520 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.520 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.521 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.521 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.521 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.521 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.521 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.521 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.521 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.521 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.521 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.521 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.521 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.522 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.522 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.522 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.522 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.522 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.522 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.522 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.522 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.522 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.522 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.522 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.522 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.522 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.522 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.522 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.523 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.523 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.523 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.523 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.523 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.523 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.523 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.523 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.523 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.523 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.523 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.523 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.523 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.523 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.524 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.524 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.524 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.524 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.524 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.524 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.524 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.524 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.524 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.524 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.524 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.524 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.524 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.525 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.525 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.525 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.525 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.525 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.525 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.525 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.525 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.525 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.525 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.526 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.526 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.526 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.526 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.526 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.526 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.526 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.526 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.526 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.526 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.526 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.526 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.526 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.526 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.527 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.527 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.527 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.527 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.527 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.527 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.527 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.527 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.527 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.527 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.527 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.527 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.527 INFO:teuthology.orchestra.run.smithi044.stdout:______________ ERROR at teardown of test_lifecycle_invalid_status ______________ 2023-12-03T12:39:14.527 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.528 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.528 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.528 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.528 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.528 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.528 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.528 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.528 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.528 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.528 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.528 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.528 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.529 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.529 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.529 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.529 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.529 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.529 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.529 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.529 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.529 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.529 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.529 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.529 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.529 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.529 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.529 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.530 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.530 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.530 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.530 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.530 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.530 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.530 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.530 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.530 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.530 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.530 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.530 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.530 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.531 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.531 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.531 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.531 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.531 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.531 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.531 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.531 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.531 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.531 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.532 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.532 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.532 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.532 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.532 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.532 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.532 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.532 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.532 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.532 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.532 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.532 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.532 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.533 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.533 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.533 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.533 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.533 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.533 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.533 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.533 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.533 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.533 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.533 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.534 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.534 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.534 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.534 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.534 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.534 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.534 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.534 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.534 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.534 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.534 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.534 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.534 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.534 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.534 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.534 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.535 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.535 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.535 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.535 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.535 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.535 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.535 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.535 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.535 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.535 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.535 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.535 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.535 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.535 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.535 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.535 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.536 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.536 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.536 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.536 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.536 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.536 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.536 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.536 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.537 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.537 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.537 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.537 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.537 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.537 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.537 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.537 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.537 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.537 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.537 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.537 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.537 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.537 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.538 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.538 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.538 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.538 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.538 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.538 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.538 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.538 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.538 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.538 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.538 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.539 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.539 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.539 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.539 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.539 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.539 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.539 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.539 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.539 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.539 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.539 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.539 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.539 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.539 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.540 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.540 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.540 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.540 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.540 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.540 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.540 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.540 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.541 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.541 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.541 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.541 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.541 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.541 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.541 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.541 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.541 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.541 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.541 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.541 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.541 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.541 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.541 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.542 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.542 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.542 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.542 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.542 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.542 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.542 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.542 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.542 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.542 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.542 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.542 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.542 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.542 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.543 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.543 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.543 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.543 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.543 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.543 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.543 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.543 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.543 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.543 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.543 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.543 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.543 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.544 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.544 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.544 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.544 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.544 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.544 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.544 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.544 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.544 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.544 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.544 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.544 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.545 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.545 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.545 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.545 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.545 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.545 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.545 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.545 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.545 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.545 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.545 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.545 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.545 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.545 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.545 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.545 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.545 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.546 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.546 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.546 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.546 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.546 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.546 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.546 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.546 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.546 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.546 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.546 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.546 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.546 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.546 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.546 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.547 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.547 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.547 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.547 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.547 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.547 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.547 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.547 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.547 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.547 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.547 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.547 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.547 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.547 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.547 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ ERROR at teardown of test_lifecycle_set_date _________________ 2023-12-03T12:39:14.548 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.548 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.548 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.548 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.548 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.548 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.548 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.548 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.548 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.548 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.548 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.548 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.548 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.548 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.549 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.549 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.549 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.549 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.549 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.549 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.549 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.549 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.549 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.549 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.549 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.549 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.549 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.549 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.549 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.550 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.550 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.550 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.550 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.550 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.550 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.550 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.550 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.550 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.551 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.551 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.551 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.551 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.551 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.551 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.551 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.551 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.551 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.551 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.551 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.551 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.552 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.552 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.552 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.552 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.552 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.552 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.552 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.552 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.552 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.552 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.552 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.552 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.552 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.552 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.553 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.553 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.553 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.553 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.553 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.553 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.553 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.553 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.553 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.553 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.553 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.554 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.554 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.554 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.554 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.554 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.554 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.554 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.554 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.554 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.554 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.554 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.554 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.554 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.555 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.555 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.555 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.555 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.555 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.555 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.555 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.555 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.555 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.555 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.555 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.555 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.555 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.555 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.555 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.555 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.556 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.556 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.556 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.556 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.556 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.556 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.556 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.556 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.556 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.557 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.557 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.557 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.557 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.557 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.557 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.557 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.557 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.557 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.557 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.557 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.557 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.557 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.557 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.557 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.557 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.557 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.558 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.558 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.558 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.558 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.558 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.558 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.558 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.558 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.558 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.558 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.559 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.559 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.559 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.559 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.559 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.559 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.559 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.559 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.559 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.559 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.559 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.559 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.559 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.560 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.560 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.560 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.560 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.560 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.560 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.560 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.560 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.560 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.560 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.560 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.560 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.560 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.560 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.560 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.561 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.561 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.561 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.561 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.561 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.561 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.561 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.561 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.561 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.561 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.561 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.561 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.561 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.562 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.562 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.562 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.562 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.562 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.562 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.563 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.563 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.563 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.563 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.563 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.563 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.563 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.563 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.563 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.563 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.563 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.563 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.563 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.563 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.564 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.564 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.564 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.564 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.564 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.564 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.564 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.564 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.564 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.564 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.564 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.564 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.564 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.564 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.565 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.565 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.565 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.565 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.565 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.565 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.565 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.565 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.565 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.565 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.565 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.565 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.565 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.566 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.566 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.566 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.566 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.566 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.566 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.566 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.566 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.566 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.566 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.566 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.566 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.566 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.567 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.567 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.567 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.567 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.567 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.567 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.567 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.567 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.567 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.567 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.567 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.567 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.567 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.568 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.568 INFO:teuthology.orchestra.run.smithi044.stdout:_____________ ERROR at teardown of test_lifecycle_set_invalid_date _____________ 2023-12-03T12:39:14.568 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.568 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.568 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.568 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.568 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.568 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.568 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.568 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.568 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.568 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.568 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.568 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.569 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.569 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.569 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.569 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.569 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.569 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.569 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.569 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.569 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.569 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.570 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.570 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.570 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.570 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.570 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.570 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.570 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.570 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.570 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.570 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.570 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.571 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.571 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.571 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.571 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.571 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.571 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.571 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.571 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.571 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.571 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.571 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.571 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.572 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.572 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.572 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.572 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.572 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.572 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.572 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.572 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.572 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.572 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.573 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.573 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.573 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.573 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.573 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.573 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.574 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.574 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.574 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.574 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.574 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.574 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.575 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.575 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.575 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.575 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.575 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.575 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.575 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.575 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.575 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.575 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.575 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.575 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.576 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.576 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.576 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.576 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.576 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.576 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.577 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.577 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.577 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.577 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.577 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.577 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.577 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.577 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.577 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.577 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.578 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.578 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.578 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.578 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.578 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.578 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.578 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.578 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.578 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.578 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.578 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.578 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.578 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.579 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.579 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.579 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.579 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.579 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.579 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.579 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.579 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.579 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.580 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.580 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.580 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.580 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.580 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.580 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.580 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.580 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.580 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.580 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.580 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.580 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.580 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.580 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.580 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.581 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.581 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.581 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.581 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.581 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.581 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.581 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.581 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.581 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.581 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.581 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.581 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.581 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.581 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.582 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.582 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.582 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.582 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.582 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.582 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.582 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.582 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.582 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.582 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.582 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.582 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.583 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.583 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.583 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.583 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.583 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.583 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.583 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.583 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.583 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.583 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.583 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.584 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.584 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.584 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.584 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.584 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.584 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.584 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.584 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.584 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.584 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.584 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.584 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.584 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.584 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.585 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.585 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.585 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.585 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.585 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.585 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.585 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.585 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.585 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.585 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.585 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.585 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.585 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.585 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.585 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.586 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.586 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.586 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.586 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.586 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.586 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.586 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.586 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.586 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.586 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.586 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.586 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.586 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.586 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.586 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.587 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.587 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.587 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.587 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.588 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.589 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.590 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.590 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.590 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.590 INFO:teuthology.orchestra.run.smithi044.stdout:______________ ERROR at teardown of test_lifecycle_set_noncurrent ______________ 2023-12-03T12:39:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.590 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.590 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.591 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.591 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.592 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.592 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.592 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.592 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.592 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.592 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.592 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.592 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.592 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.592 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.592 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.592 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.592 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.592 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.593 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.593 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.593 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.593 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.593 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.593 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.593 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.593 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.593 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.593 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.593 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.593 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.593 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.593 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.593 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.593 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.593 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.594 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.594 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.594 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.594 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.594 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.594 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.594 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.594 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.594 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.594 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.594 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.594 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.595 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.595 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.595 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.595 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.595 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.595 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.595 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.595 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.595 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.595 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.595 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.595 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.595 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.595 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.595 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.595 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.596 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.596 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.596 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.596 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.596 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.596 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.596 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.596 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.596 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.596 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.596 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.596 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.597 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.597 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.597 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.597 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.597 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.597 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.597 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.597 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.597 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.597 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.597 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.597 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.597 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.597 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.597 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.597 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.598 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.598 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.598 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.598 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.598 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.598 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.598 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.598 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.598 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.598 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.598 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.598 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.598 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.598 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.599 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.599 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.599 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.599 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.599 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.599 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.599 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.599 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.599 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.599 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.599 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.599 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.599 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.599 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.600 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.600 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.600 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.600 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.600 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.600 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.600 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.600 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.600 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.600 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.600 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.600 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.601 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.601 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.601 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.601 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.601 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.601 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.601 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.601 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.601 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.601 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.601 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.601 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.601 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.601 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.602 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.602 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.602 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.602 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.602 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.602 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.602 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.602 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.602 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.602 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.602 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.602 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.602 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.602 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.603 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.603 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.603 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.603 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.603 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.603 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.603 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.603 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.603 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.603 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.603 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.603 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.603 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.603 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.604 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.604 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.604 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.604 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.604 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.604 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.604 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.604 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.604 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.604 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.605 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.605 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.605 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.605 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.605 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.605 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.605 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.605 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.606 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.606 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.606 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.606 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.606 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.606 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.606 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.606 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.606 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.607 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.607 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.607 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.607 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.607 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.607 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.607 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.607 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.607 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.607 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.607 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.607 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.607 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.607 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.607 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.607 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.608 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.608 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.608 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.608 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.608 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.608 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.608 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.608 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.608 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.608 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.608 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.608 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.608 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.608 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.608 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.609 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.609 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.609 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.609 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.609 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.609 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.609 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.609 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.609 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.609 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.609 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.609 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.609 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.610 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.610 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.610 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.610 INFO:teuthology.orchestra.run.smithi044.stdout:_____________ ERROR at teardown of test_lifecycle_set_deletemarker _____________ 2023-12-03T12:39:14.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.610 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.610 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.610 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.610 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.610 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.610 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.611 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.611 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.611 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.611 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.611 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.611 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.611 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.611 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.611 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.611 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.611 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.612 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.612 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.612 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.612 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.612 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.612 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.612 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.612 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.612 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.612 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.612 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.612 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.613 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.613 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.613 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.613 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.613 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.613 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.613 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.613 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.613 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.613 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.613 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.613 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.614 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.614 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.614 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.614 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.614 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.614 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.614 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.614 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.614 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.614 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.614 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.614 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.614 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.614 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.615 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.615 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.615 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.615 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.615 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.615 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.615 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.615 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.615 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.615 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.615 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.616 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.616 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.616 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.616 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.616 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.616 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.616 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.616 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.616 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.616 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.616 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.616 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.617 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.617 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.617 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.617 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.617 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.617 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.617 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.617 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.617 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.617 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.617 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.617 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.617 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.617 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.617 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.617 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.618 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.618 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.618 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.618 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.618 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.618 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.618 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.618 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.618 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.618 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.618 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.618 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.618 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.618 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.619 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.619 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.619 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.619 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.619 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.619 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.619 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.619 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.619 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.619 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.619 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.619 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.619 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.619 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.619 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.619 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.620 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.620 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.620 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.620 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.620 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.620 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.620 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.620 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.620 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.620 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.620 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.620 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.620 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.621 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.621 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.621 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.621 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.621 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.621 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.621 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.621 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.621 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.621 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.621 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.621 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.622 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.622 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.622 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.622 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.622 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.622 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.622 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.622 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.622 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.622 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.623 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.623 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.623 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.623 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.623 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.623 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.623 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.623 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.623 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.623 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.623 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.623 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.623 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.623 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.623 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.624 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.624 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.624 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.624 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.624 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.624 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.624 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.624 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.624 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.624 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.624 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.624 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.624 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.624 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.625 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.625 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.625 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.625 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.625 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.626 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.626 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.626 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.626 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.626 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.626 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.626 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.626 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.627 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.627 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.627 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.627 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.627 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.627 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.627 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.627 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.627 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.627 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.627 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.627 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.627 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.627 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.627 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.628 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.628 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.628 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.628 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.628 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.628 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.628 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.628 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.628 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.628 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.628 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.628 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.629 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.629 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.629 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.629 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.629 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.629 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.629 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.629 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.629 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.629 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.629 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.629 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.629 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.629 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.629 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.630 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.630 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.630 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.630 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.630 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.630 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.630 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.630 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.630 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.630 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.630 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.630 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at teardown of test_lifecycle_set_filter ________________ 2023-12-03T12:39:14.630 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.631 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.631 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.631 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.631 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.631 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.631 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.631 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.631 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.631 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.631 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.631 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.631 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.631 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.632 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.632 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.632 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.632 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.632 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.632 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.632 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.632 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.632 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.632 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.632 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.632 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.632 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.633 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.633 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.633 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.633 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.633 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.633 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.633 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.633 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.633 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.633 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.633 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.633 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.633 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.633 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.633 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.634 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.634 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.634 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.634 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.634 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.634 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.634 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.634 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.634 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.634 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.634 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.634 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.634 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.634 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.635 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.635 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.635 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.635 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.635 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.635 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.635 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.635 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.635 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.635 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.635 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.635 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.635 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.636 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.636 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.636 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.636 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.636 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.636 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.636 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.636 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.636 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.636 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.637 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.637 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.637 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.637 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.637 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.637 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.637 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.637 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.637 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.637 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.637 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.637 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.637 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.637 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.637 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.638 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.638 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.638 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.638 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.638 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.638 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.638 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.638 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.638 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.638 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.638 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.638 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.638 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.638 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.638 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.639 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.639 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.639 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.639 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.639 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.639 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.639 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.639 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.640 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.640 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.640 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.640 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.640 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.640 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.640 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.640 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.640 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.640 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.640 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.640 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.640 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.641 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.641 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.641 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.641 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.641 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.641 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.641 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.641 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.641 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.641 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.641 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.641 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.641 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.641 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.642 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.642 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.642 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.642 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.642 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.642 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.642 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.642 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.642 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.642 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.642 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.643 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.643 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.643 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.643 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.643 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.643 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.643 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.643 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.643 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.644 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.644 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.644 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.644 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.644 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.644 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.644 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.644 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.644 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.644 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.644 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.644 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.644 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.644 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.645 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.645 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.645 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.645 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.645 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.645 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.645 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.645 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.646 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.646 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.646 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.646 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.646 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.646 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.646 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.646 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.647 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.647 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.647 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.647 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.650 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.650 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.651 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.651 INFO:teuthology.orchestra.run.smithi044.stdout:_____________ ERROR at teardown of test_lifecycle_set_empty_filter _____________ 2023-12-03T12:39:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.651 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.652 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.652 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.652 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.652 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.652 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.652 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.652 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.652 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.652 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.652 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.652 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.652 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.652 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.652 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.652 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.656 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.656 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.656 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.656 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.656 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.656 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.657 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.657 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.657 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.657 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.657 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.657 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.657 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.657 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.657 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.657 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.657 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.657 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.657 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.657 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.657 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.657 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.658 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.658 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.658 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.658 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.658 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.658 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.658 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.659 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.659 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.659 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.659 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.659 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.659 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.659 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.659 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.659 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.659 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.659 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.659 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.659 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.660 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.660 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.660 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.660 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.660 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.660 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.660 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.660 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.660 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.660 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.660 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.660 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.661 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.661 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.661 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.661 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.661 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.661 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.661 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.661 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.661 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.661 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.661 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.662 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.662 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.662 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.662 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.662 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.662 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.662 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.662 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.662 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.663 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.663 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.663 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.663 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.663 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.663 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.663 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.663 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.663 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.663 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.663 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.663 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.663 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.664 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.664 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.664 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.664 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.664 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.664 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.664 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.664 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.664 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.664 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.664 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.664 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.664 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.664 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.665 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.665 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.665 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.665 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.665 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.665 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.665 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.665 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.665 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.665 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.665 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.666 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.666 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.666 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.666 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.666 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.666 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.666 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.666 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.666 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.666 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.666 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.666 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.666 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.666 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.666 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.667 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.667 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.667 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.667 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.667 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.667 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.667 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.667 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.667 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.667 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.667 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.667 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.667 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.667 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.667 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.668 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.668 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.668 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.668 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.668 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.668 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.668 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.668 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.668 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.668 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.668 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.668 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.668 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.669 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.669 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.669 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.669 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.669 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.669 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.669 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.669 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.669 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.669 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.669 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.669 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.669 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.671 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.671 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.671 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.671 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.671 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.671 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.671 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.671 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.671 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.671 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.671 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.671 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.671 INFO:teuthology.orchestra.run.smithi044.stdout:______________ ERROR at teardown of test_lifecycle_set_multipart _______________ 2023-12-03T12:39:14.671 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.672 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.672 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.672 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.672 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.672 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.672 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.672 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.672 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.672 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.672 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.672 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.672 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.672 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.672 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.672 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.673 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.673 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.673 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.673 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.673 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.673 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.673 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.673 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.673 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.673 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.673 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.673 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.673 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.673 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.673 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.673 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.674 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.674 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.674 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.674 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.674 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.674 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.674 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.674 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.674 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.674 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.674 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.674 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.675 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.675 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.675 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.675 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.675 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.675 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.675 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.675 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.675 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.675 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.675 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.675 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.675 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.675 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.675 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.675 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.676 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.676 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.676 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.676 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.676 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.676 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.676 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.676 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.676 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.676 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.676 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.677 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.677 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.677 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.677 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.677 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.677 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.677 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.677 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.677 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.677 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.677 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.677 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.677 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.677 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.677 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.677 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.678 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.678 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.678 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.678 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.678 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.678 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.678 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.678 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.678 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.678 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.678 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.678 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.678 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.678 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.678 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.679 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.679 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.679 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.679 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.679 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.679 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.679 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.679 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.679 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.679 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.679 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.679 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.679 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.680 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.680 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.680 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.680 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.680 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.680 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.680 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.680 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.681 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.681 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.681 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.681 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.681 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.681 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.681 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.681 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.681 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.681 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.682 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.682 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.682 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.682 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.682 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.682 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.682 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.682 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.682 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.682 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.682 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.682 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.682 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.683 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.683 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.683 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.683 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.683 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.683 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.684 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.684 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.684 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.684 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.684 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.684 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.685 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.685 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.685 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.685 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.685 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.685 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.685 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.685 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.685 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.686 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.686 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.686 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.686 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.686 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.686 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.686 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.687 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.687 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.687 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.687 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.687 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.687 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.687 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.687 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.687 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.687 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.687 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.688 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.688 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.688 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.688 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.688 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.688 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.688 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.688 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.688 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.688 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.688 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.688 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.688 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.688 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.688 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.688 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.689 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.689 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.689 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.689 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.689 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.689 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.690 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.690 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.690 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.690 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.690 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.690 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.690 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.690 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.690 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.690 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.690 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.690 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.690 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.690 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.690 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.691 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.691 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.691 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.691 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.691 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.691 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.691 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.691 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.691 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.691 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.691 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.691 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.692 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.692 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.692 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.692 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.692 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.692 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.692 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.692 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.692 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.692 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.692 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.692 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.692 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.692 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.692 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.693 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.693 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.693 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.693 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.693 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.693 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.693 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.693 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.693 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.693 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.693 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.693 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.693 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.694 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.694 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.694 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.694 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.694 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.694 INFO:teuthology.orchestra.run.smithi044.stdout:_______ ERROR at teardown of test_lifecycle_transition_set_invalid_date ________ 2023-12-03T12:39:14.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.694 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.694 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.694 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.694 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.694 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.695 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.695 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.695 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.695 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.695 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.695 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.695 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.695 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.695 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.695 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.695 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.695 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.695 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.695 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.695 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.695 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.696 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.696 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.696 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.696 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.696 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.696 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.696 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.696 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.696 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.696 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.696 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.697 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.697 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.697 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.697 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.697 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.697 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.697 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.697 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.697 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.697 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.697 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.697 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.697 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.697 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.698 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.698 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.698 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.698 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.698 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.698 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.698 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.698 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.698 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.698 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.698 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.698 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.698 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.699 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.699 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.699 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.699 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.699 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.699 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.699 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.699 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.699 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.699 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.700 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.700 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.700 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.700 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.700 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.700 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.700 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.700 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.700 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.700 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.700 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.700 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.700 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.700 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.701 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.701 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.701 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.701 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.701 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.701 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.701 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.701 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.701 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.701 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.701 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.701 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.702 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.702 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.702 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.702 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.702 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.702 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.702 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.702 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.702 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.702 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.703 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.703 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.703 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.703 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.703 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.703 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.703 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.703 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.703 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.703 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.703 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.703 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.703 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.703 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.703 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.703 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.704 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.704 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.704 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.704 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.704 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.704 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.704 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.704 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.704 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.704 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.704 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.704 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.704 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.704 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.704 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.705 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.705 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.705 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.705 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.705 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.705 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.705 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.705 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.705 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.706 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.706 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.706 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.706 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.706 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.706 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.706 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.706 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.706 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.706 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.706 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.706 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.706 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.706 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.707 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.707 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.707 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.707 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.707 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.707 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.707 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.707 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.707 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.707 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.707 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.707 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.707 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.707 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.707 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.708 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.708 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.708 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.708 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.708 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.708 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.708 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.708 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.708 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.708 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.709 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.709 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.709 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.709 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.709 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.709 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.709 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.709 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.710 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.710 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.710 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.710 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.710 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.710 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.710 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.710 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.710 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.710 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.710 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.710 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.710 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.710 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.711 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.711 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.711 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.711 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.711 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.711 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.711 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.711 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.711 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.711 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.711 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.711 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.711 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.712 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.712 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.712 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.712 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.712 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.712 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.712 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.712 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.712 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.712 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.712 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.712 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.713 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.713 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.713 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.713 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.713 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.713 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.713 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.713 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.713 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.713 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.713 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.714 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.714 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.714 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.714 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.714 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.714 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.714 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.714 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ ERROR at teardown of test_encrypted_transfer_1b ________________ 2023-12-03T12:39:14.714 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.714 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.714 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.714 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.714 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.714 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.715 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.715 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.715 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.715 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.715 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.715 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.715 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.715 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.715 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.715 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.715 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.716 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.716 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.716 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.716 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.716 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.716 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.716 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.716 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.716 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.716 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.716 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.716 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.716 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.716 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.716 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.716 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.716 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.717 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.717 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.717 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.717 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.717 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.717 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.717 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.717 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.717 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.717 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.717 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.717 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.717 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.718 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.718 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.718 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.718 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.718 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.718 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.718 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.718 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.718 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.718 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.718 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.719 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.719 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.719 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.719 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.719 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.719 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.719 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.719 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.719 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.719 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.719 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.719 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.719 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.720 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.720 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.720 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.720 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.720 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.720 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.720 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.720 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.720 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.720 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.720 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.720 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.720 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.720 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.720 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.720 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.721 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.721 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.721 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.721 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.721 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.721 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.721 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.721 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.721 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.721 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.721 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.721 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.721 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.722 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.722 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.722 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.722 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.722 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.722 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.722 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.722 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.722 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.723 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.723 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.723 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.723 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.723 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.723 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.723 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.724 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.724 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.724 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.724 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.724 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.724 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.724 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.724 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.724 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.724 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.724 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.724 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.725 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.725 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.725 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.725 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.725 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.725 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.725 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.725 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.725 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.725 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.725 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.725 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.726 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.726 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.726 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.726 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.726 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.726 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.726 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.726 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.726 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.726 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.726 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.726 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.726 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.726 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.727 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.727 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.727 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.727 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.727 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.727 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.727 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.727 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.728 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.728 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.728 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.728 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.728 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.728 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.728 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.728 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.728 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.729 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.729 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.729 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.729 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.729 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.729 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.729 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.729 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.729 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.729 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.729 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.729 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.729 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.730 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.730 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.730 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.730 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.730 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.730 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.730 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.730 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.730 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.730 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.730 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.730 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.730 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.730 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.731 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.731 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.731 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.731 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.731 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.731 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.731 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.731 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.731 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.731 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.731 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.731 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.731 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.731 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.732 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.732 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.732 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.732 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.732 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.732 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.732 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.732 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.732 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.732 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.732 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.732 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.732 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.732 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.732 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.733 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.733 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.733 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.733 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.733 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.733 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.733 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.733 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.733 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.733 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.733 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.733 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.733 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.733 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.733 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.733 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.733 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.734 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.734 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.734 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.734 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.734 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.734 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.734 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.734 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.734 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.734 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.734 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.734 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.734 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.734 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.734 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.735 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.735 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.735 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.735 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.735 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.735 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.735 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.735 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ ERROR at teardown of test_encrypted_transfer_1kb _______________ 2023-12-03T12:39:14.735 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.735 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.735 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.735 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.735 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.735 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.736 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.736 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.736 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.736 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.736 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.736 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.736 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.736 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.736 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.736 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.736 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.736 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.736 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.736 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.736 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.736 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.736 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.737 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.737 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.737 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.737 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.737 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.737 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.737 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.737 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.737 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.737 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.737 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.737 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.737 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.738 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.738 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.738 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.738 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.738 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.738 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.738 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.738 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.738 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.738 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.738 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.738 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.739 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.739 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.739 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.739 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.739 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.739 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.739 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.739 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.739 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.739 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.739 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.739 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.739 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.739 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.740 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.740 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.740 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.740 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.740 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.740 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.740 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.740 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.740 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.740 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.740 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.740 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.740 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.741 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.741 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.741 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.741 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.741 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.741 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.741 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.741 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.741 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.741 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.741 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.741 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.741 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.741 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.741 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.742 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.742 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.742 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.742 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.742 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.742 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.742 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.742 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.742 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.742 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.742 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.742 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.742 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.742 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.743 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.743 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.743 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.743 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.743 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.743 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.743 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.743 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.743 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.743 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.743 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.743 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.743 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.743 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.743 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.743 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.743 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.744 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.744 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.744 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.744 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.744 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.744 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.744 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.744 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.744 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.744 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.744 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.744 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.744 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.744 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.744 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.745 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.745 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.745 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.745 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.745 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.745 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.745 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.745 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.745 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.745 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.745 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.745 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.745 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.745 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.745 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.745 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.746 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.746 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.746 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.746 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.746 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.746 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.746 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.746 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.746 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.746 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.746 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.746 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.746 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.746 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.747 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.747 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.747 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.747 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.747 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.747 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.747 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.747 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.747 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.747 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.747 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.747 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.747 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.747 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.747 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.747 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.748 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.748 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.748 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.748 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.748 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.748 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.748 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.748 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.748 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.748 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.748 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.748 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.748 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.748 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.748 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.748 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.748 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.749 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.749 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.749 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.749 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.749 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.749 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.749 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.749 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.749 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.749 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.749 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.749 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.749 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.750 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.750 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.750 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.750 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.750 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.750 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.751 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.751 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.751 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.751 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.751 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.751 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.751 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.751 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.751 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.751 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.751 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.751 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.752 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.752 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.752 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.752 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.752 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.752 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.752 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.752 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.752 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.752 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.752 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.752 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.752 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.752 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.752 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.753 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.753 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.753 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.753 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.753 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.753 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.753 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.753 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.753 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.753 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.753 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.753 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.753 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.753 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.753 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.753 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.754 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.754 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.754 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.754 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.754 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.754 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.754 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.754 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.754 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.754 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.754 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.754 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.754 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.754 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ ERROR at teardown of test_encrypted_transfer_1MB _______________ 2023-12-03T12:39:14.754 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.755 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.755 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.755 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.755 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.755 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.755 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.755 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.755 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.755 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.755 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.755 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.756 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.756 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.756 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.756 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.756 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.756 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.756 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.756 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.756 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.756 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.756 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.756 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.757 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.757 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.757 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.757 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.757 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.757 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.757 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.757 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.757 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.757 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.757 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.757 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.757 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.757 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.757 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.758 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.758 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.758 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.758 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.758 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.758 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.758 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.758 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.758 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.758 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.758 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.758 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.758 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.758 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.758 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.759 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.759 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.759 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.759 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.759 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.759 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.759 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.759 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.759 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.759 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.759 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.759 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.760 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.760 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.760 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.760 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.760 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.760 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.760 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.760 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.760 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.760 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.760 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.760 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.760 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.760 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.761 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.761 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.761 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.761 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.761 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.761 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.761 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.761 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.761 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.761 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.761 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.761 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.761 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.762 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.762 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.762 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.762 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.762 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.762 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.762 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.762 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.762 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.762 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.762 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.762 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.762 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.762 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.763 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.763 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.763 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.763 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.763 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.763 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.763 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.763 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.763 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.763 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.763 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.763 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.763 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.763 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.764 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.764 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.764 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.764 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.764 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.764 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.764 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.764 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.764 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.764 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.764 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.765 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.765 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.765 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.765 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.765 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.765 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.765 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.765 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.765 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.765 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.765 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.765 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.765 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.765 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.765 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.765 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.766 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.766 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.766 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.766 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.766 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.766 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.766 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.766 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.766 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.766 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.766 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.766 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.766 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.767 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.767 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.767 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.767 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.767 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.767 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.767 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.767 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.767 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.767 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.767 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.768 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.768 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.768 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.768 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.768 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.768 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.768 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.768 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.768 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.768 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.768 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.768 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.768 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.769 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.769 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.769 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.769 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.769 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.769 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.770 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.770 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.770 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.770 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.770 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.770 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.770 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.771 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.771 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.771 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.771 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.771 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.771 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.771 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.771 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.771 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.771 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.771 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.771 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.771 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.771 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.772 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.772 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.772 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.772 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.772 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.772 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.772 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.772 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.772 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.772 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.772 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.772 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.772 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.772 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.773 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.773 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.773 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.773 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.773 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.773 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.773 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.773 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.773 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.773 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.773 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.773 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.773 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.773 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.773 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.774 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.774 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.774 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.774 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.774 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.774 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.774 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.774 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.774 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.774 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ ERROR at teardown of test_encrypted_transfer_13b _______________ 2023-12-03T12:39:14.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.774 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.774 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.775 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.775 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.775 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.775 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.775 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.775 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.775 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.775 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.775 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.775 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.775 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.775 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.776 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.776 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.776 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.776 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.776 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.776 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.776 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.776 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.776 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.776 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.776 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.777 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.777 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.777 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.777 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.777 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.777 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.777 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.777 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.777 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.777 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.777 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.777 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.777 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.777 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.777 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.777 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.778 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.778 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.778 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.778 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.778 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.778 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.778 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.778 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.778 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.778 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.778 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.778 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.778 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.778 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.778 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.779 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.779 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.779 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.779 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.779 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.779 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.779 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.779 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.779 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.779 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.779 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.779 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.779 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.779 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.779 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.780 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.780 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.780 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.780 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.780 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.780 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.780 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.780 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.780 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.780 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.780 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.780 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.780 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.780 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.780 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.780 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.781 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.781 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.781 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.781 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.781 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.781 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.781 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.781 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.781 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.781 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.781 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.781 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.781 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.781 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.781 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.782 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.782 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.782 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.782 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.782 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.782 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.782 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.782 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.782 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.782 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.782 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.782 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.782 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.782 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.783 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.783 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.783 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.783 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.783 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.783 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.783 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.783 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.783 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.783 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.783 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.783 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.783 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.783 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.783 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.784 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.784 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.784 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.784 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.784 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.784 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.784 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.784 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.784 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.784 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.784 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.784 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.784 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.785 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.785 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.785 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.785 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.785 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.785 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.785 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.785 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.785 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.785 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.785 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.785 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.785 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.786 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.786 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.786 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.786 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.786 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.786 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.786 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.786 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.786 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.786 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.787 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.787 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.787 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.787 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.787 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.787 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.787 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.787 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.787 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.788 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.788 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.788 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.788 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.788 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.788 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.788 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.788 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.788 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.788 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.788 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.789 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.789 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.789 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.789 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.789 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.790 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.790 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.790 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.790 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.790 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.791 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.791 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.791 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.791 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.791 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.791 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.792 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.792 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.792 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.792 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.792 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.792 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.792 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.792 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.792 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.792 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.793 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.793 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.793 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.793 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.793 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.793 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.793 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.793 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.793 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.793 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.794 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.794 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.794 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.794 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.794 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.794 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.794 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.794 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.794 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.794 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.794 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.795 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.795 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.795 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.795 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.795 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.795 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.795 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.795 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.795 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.795 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.795 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.795 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.795 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.795 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.795 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.796 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.796 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.796 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.796 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.796 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.796 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.796 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.796 INFO:teuthology.orchestra.run.smithi044.stdout:____________ ERROR at teardown of test_encryption_sse_c_method_head ____________ 2023-12-03T12:39:14.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.796 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.796 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.796 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.797 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.797 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.797 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.797 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.797 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.797 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.797 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.797 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.797 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.797 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.797 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.797 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.797 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.797 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.797 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.797 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.798 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.798 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.798 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.798 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.798 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.798 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.798 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.798 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.798 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.798 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.798 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.798 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.798 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.798 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.799 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.799 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.799 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.799 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.799 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.799 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.799 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.799 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.799 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.799 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.799 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.799 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.800 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.800 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.800 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.800 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.800 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.800 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.800 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.800 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.800 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.800 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.800 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.800 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.800 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.801 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.801 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.801 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.801 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.801 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.801 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.801 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.801 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.801 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.801 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.801 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.801 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.801 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.801 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.802 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.802 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.802 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.802 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.802 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.802 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.802 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.802 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.802 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.802 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.802 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.802 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.802 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.802 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.803 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.803 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.803 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.803 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.803 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.803 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.803 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.803 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.803 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.803 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.803 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.803 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.803 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.803 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.803 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.804 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.804 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.804 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.804 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.804 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.804 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.804 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.804 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.804 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.804 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.804 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.804 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.804 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.804 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.804 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.805 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.805 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.805 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.805 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.805 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.805 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.805 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.805 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.805 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.805 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.805 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.805 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.805 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.805 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.805 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.805 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.806 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.806 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.806 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.806 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.806 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.806 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.806 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.806 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.806 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.806 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.807 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.807 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.807 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.807 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.807 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.807 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.807 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.807 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.807 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.807 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.807 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.807 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.807 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.807 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.808 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.808 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.808 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.808 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.808 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.808 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.808 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.808 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.808 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.808 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.808 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.808 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.808 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.808 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.808 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.809 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.809 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.809 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.809 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.809 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.809 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.809 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.809 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.809 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.809 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.809 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.809 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.809 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.809 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.809 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.809 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.810 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.810 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.810 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.810 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.810 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.810 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.810 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.810 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.810 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.810 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.810 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.810 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.810 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.810 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.810 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.811 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.811 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.811 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.811 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.811 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.811 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.811 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.811 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.811 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.811 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.811 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.812 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.812 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.812 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.812 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.812 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.812 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.812 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.812 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.812 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.812 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.812 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.812 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.812 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.812 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.812 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.812 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.813 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.813 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.813 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.813 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.813 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.813 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.813 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.813 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.813 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.813 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.813 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.813 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.813 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.813 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.813 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.814 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.814 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.814 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.814 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.814 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.814 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.814 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.814 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.814 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.814 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.814 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.815 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.815 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.815 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.815 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.815 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.815 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.815 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.815 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.815 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.815 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.815 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.815 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.815 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.816 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.816 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.816 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.816 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.816 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.816 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.816 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.816 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.816 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.816 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.816 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.816 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.816 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.816 INFO:teuthology.orchestra.run.smithi044.stdout:______________ ERROR at teardown of test_encryption_sse_c_present ______________ 2023-12-03T12:39:14.816 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.816 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.817 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.817 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.817 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.817 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.817 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.817 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.817 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.817 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.817 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.817 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.817 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.817 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.817 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.817 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.817 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.818 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.818 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.818 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.818 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.818 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.818 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.818 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.818 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.818 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.818 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.818 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.818 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.818 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.818 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.819 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.819 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.819 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.819 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.819 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.819 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.819 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.819 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.819 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.819 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.819 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.819 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.819 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.819 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.819 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.819 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.820 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.820 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.820 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.820 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.820 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.820 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.820 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.820 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.820 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.820 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.820 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.820 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.820 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.820 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.820 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.820 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.821 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.821 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.821 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.821 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.821 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.821 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.821 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.821 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.821 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.821 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.821 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.821 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.821 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.821 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.821 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.822 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.822 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.822 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.822 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.822 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.822 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.822 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.822 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.822 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.822 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.822 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.822 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.822 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.822 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.822 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.823 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.823 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.823 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.823 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.823 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.823 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.823 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.823 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.823 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.823 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.823 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.823 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.823 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.823 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.823 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.824 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.824 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.824 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.824 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.824 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.824 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.824 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.824 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.824 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.824 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.824 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.824 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.824 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.825 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.825 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.825 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.825 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.825 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.825 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.825 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.825 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.825 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.825 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.825 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.825 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.825 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.825 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.826 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.826 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.826 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.826 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.826 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.826 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.826 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.826 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.826 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.826 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.826 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.826 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.826 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout:_____________ ERROR at teardown of test_encryption_sse_c_other_key _____________ 2023-12-03T12:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.842 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.842 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.842 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.842 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.842 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.842 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.842 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.842 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.842 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.842 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.842 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.842 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.842 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.843 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.843 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.843 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.843 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.843 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.843 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.843 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout:____________ ERROR at teardown of test_encryption_sse_c_invalid_md5 ____________ 2023-12-03T12:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.875 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.875 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.875 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.875 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.875 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.875 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout:______________ ERROR at teardown of test_encryption_sse_c_no_md5 _______________ 2023-12-03T12:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.893 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.893 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.893 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.893 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.896 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.896 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.896 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.896 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.896 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout:______________ ERROR at teardown of test_encryption_sse_c_no_key _______________ 2023-12-03T12:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.914 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.914 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.914 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.914 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout:______________ ERROR at teardown of test_encryption_key_no_sse_c _______________ 2023-12-03T12:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.933 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.933 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.933 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.933 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.933 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.933 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.933 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.933 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.933 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.933 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.933 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.933 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.933 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.933 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.933 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.934 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.934 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.934 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.934 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.934 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.934 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.934 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.934 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.934 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.934 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.934 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.934 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.934 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.934 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.935 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.935 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.935 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.935 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.935 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.935 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.935 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.935 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.935 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.935 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.935 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.935 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.935 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.935 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.936 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.936 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.936 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.936 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.936 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.936 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.936 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.936 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.936 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.936 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.936 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.937 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.937 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.937 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.937 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.937 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.937 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.937 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.937 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.937 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.937 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.938 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.938 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.938 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.938 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.938 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.938 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.938 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.938 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.938 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.938 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.938 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.938 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.938 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.938 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.938 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.939 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.939 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.939 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.939 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.939 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.939 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.940 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.940 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.940 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.940 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.940 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.940 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.940 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.941 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.941 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.941 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.941 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.941 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.941 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.941 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.941 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.941 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.941 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.941 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.942 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.942 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.942 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.942 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.942 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.942 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.942 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.942 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.942 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.942 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.942 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.942 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.942 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.942 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.943 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.943 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.943 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.943 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.943 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.943 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.943 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.943 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.943 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.943 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.943 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.943 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.943 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.943 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.944 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.944 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.944 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.944 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.944 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.944 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.944 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.944 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.944 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.944 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.944 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.944 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.945 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.945 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.945 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.945 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.945 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.945 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.945 INFO:teuthology.orchestra.run.smithi044.stdout:_________ ERROR at teardown of test_encryption_sse_c_multipart_upload __________ 2023-12-03T12:39:14.945 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.945 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.945 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.945 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.945 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.945 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.945 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.945 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.946 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.946 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.946 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.946 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.946 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.946 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.946 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.946 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.946 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.946 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.946 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.946 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.946 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.946 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.947 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.947 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.947 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.947 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.947 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.947 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.947 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.947 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.947 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.947 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.947 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.947 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.948 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.948 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.948 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.948 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.948 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.948 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.948 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.948 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.948 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.948 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.948 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.948 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.948 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.949 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.949 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.949 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.949 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.949 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.949 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.949 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.949 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.949 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.949 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.949 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.950 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.950 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.950 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.950 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.950 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.950 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.950 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.950 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.950 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.950 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.950 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.950 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.951 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.951 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.951 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.951 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.951 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.951 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.951 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.951 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.951 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.951 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.951 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.951 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.952 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.952 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.952 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.952 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.952 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.952 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.952 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.952 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.952 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.952 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.952 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.952 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.952 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.952 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.953 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.953 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.953 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.953 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.953 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.953 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.953 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.953 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.953 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.953 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.953 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.953 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.953 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.953 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.954 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.954 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.954 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.954 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.954 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.954 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.954 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.954 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.954 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.954 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.954 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.954 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.954 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.954 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.954 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.955 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.955 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.955 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.955 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.955 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.955 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.955 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.955 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.955 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.955 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.955 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.955 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.956 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.956 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.956 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.956 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.956 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.956 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.956 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.956 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.956 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.956 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.956 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.956 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.956 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.956 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.956 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.957 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.957 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.957 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.957 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.957 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.957 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.957 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.957 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.957 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.957 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.957 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.957 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.957 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.957 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.958 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.958 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.958 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.958 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.958 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.958 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.958 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.958 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.958 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.958 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.958 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.958 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.958 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.958 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.958 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.959 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.959 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.959 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.959 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.959 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.959 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.959 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.959 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.959 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.959 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.959 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.959 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.959 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.959 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.959 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.960 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.960 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.960 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.960 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.960 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.960 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.960 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.960 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.960 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.960 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.960 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.960 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.960 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.960 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.961 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.961 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.961 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.961 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.961 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.961 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.961 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.961 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.961 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.961 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.961 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.961 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.961 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.961 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.961 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.962 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.962 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.962 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.962 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.962 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.962 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.962 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.962 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.962 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.962 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.962 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.962 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.962 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.962 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.962 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.963 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.963 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.963 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.963 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.963 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.963 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.963 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.963 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.963 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.963 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.963 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.963 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.963 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.963 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.963 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.964 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.964 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.964 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.964 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.964 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.964 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.964 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.964 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.964 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.964 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.964 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.964 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.964 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.965 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.965 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.965 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.965 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.965 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.965 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.965 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.965 INFO:teuthology.orchestra.run.smithi044.stdout:____ ERROR at teardown of test_encryption_sse_c_unaligned_multipart_upload _____ 2023-12-03T12:39:14.965 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.965 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.965 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.965 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.965 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.965 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.965 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.966 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.966 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.966 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.966 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.966 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.966 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.966 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.966 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.966 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.966 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.966 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.966 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.966 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.966 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.967 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.967 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.967 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.967 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.967 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.967 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.967 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.967 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.967 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.967 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.967 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.967 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.967 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.967 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.968 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.968 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.968 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.968 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.968 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.968 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.968 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.968 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.968 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.968 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.968 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.968 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.968 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.969 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.969 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.969 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.969 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.969 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.969 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.969 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.969 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.969 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.969 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.969 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.970 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.970 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.970 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.970 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.970 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.970 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.970 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.970 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.970 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.970 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.970 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.970 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.970 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.970 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.971 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.971 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.971 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.971 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.971 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.971 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.971 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.971 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.971 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.971 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.971 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.971 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.971 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.971 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.971 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.972 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.972 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.972 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.972 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.972 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.972 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.972 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.972 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.972 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.972 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.972 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.972 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.972 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.972 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.972 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.972 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.973 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.973 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.973 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.973 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.973 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.973 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.973 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.973 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.973 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.973 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.973 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.973 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.973 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.973 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.973 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.973 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.974 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.974 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.974 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.974 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.974 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.974 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.974 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.974 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.974 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.974 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.974 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.974 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.974 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.974 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.974 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.975 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.975 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.975 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.975 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.975 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.975 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.975 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.975 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.975 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.975 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.975 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.975 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.975 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.975 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.975 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.976 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.976 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.976 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.976 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.976 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.976 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.976 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.976 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.976 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.976 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.976 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.977 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.977 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.977 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.977 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.977 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.977 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.977 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.977 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.977 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.977 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.977 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.977 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.977 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.978 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.978 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.978 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.978 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.978 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.978 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.978 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.978 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.978 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.978 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.978 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.978 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.979 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.979 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.979 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.979 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.979 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.979 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.979 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.979 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.979 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.979 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.979 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.979 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.979 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.979 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.979 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.980 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.980 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.980 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.980 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.980 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.980 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.980 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.980 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.980 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.980 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.980 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.980 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:14.980 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:14.980 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:14.981 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:14.981 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:14.981 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:14.981 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:14.981 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:14.981 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:14.981 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:14.981 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:14.981 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.981 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.981 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.981 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.981 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.982 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.982 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.982 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.982 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.982 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.982 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.982 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.982 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.982 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.982 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.982 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.982 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.982 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.982 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.982 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.982 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.983 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.983 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:14.983 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.983 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.983 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.983 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.983 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.983 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.983 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.983 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.983 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.983 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.983 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.983 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:14.983 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:14.983 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:14.984 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:14.984 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:14.984 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.984 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.984 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:14.984 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:14.984 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:14.984 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:14.984 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:14.984 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.984 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:14.984 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:14.984 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.984 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:14.984 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:14.985 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:14.985 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:14.985 INFO:teuthology.orchestra.run.smithi044.stdout:______ ERROR at teardown of test_encryption_sse_c_multipart_bad_download _______ 2023-12-03T12:39:14.985 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.985 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.985 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.985 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.985 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.985 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.985 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.985 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.985 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.985 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.985 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.985 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.986 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.986 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.986 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.986 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.986 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:14.986 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.986 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.986 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.986 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:14.986 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.986 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:14.986 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:14.986 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.986 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.986 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:14.987 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:14.987 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.987 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:14.987 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:14.987 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:14.987 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:14.987 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:14.987 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.987 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:14.987 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.987 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:14.987 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:14.987 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:14.987 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:14.987 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:14.987 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:14.988 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:14.988 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:14.988 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.988 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.988 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:14.988 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:14.988 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:14.988 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:14.988 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.988 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:14.988 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:14.988 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:14.988 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:14.988 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.988 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.989 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:14.989 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:14.989 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:14.989 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:14.989 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.989 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:14.989 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:14.989 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:14.989 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.989 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:14.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.989 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:14.989 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:14.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.990 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:14.990 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:14.990 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:14.990 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:14.990 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:14.990 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:14.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.990 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:14.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.990 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.990 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.990 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:14.991 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.991 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:14.991 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.991 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:14.991 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:14.991 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:14.991 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:14.991 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:14.991 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:14.991 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:14.991 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:14.991 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:14.991 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:14.991 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:14.992 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:14.992 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:14.992 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.992 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:14.992 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:14.992 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:14.992 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:14.992 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:14.992 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:14.992 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:14.992 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:14.992 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:14.992 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:14.992 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:14.992 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.992 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:14.993 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:14.993 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:14.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:14.993 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:14.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:14.993 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:14.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:14.993 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:14.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:14.993 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:14.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:14.993 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:14.993 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:14.993 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:14.994 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:14.994 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:14.994 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:14.994 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.994 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:14.994 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:14.994 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:14.994 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:14.994 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:14.994 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:14.994 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:14.994 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:14.994 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:14.994 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:14.994 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.994 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.995 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:14.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.995 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:14.995 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:14.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.995 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:14.995 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:14.995 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:14.995 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:14.995 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:14.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.995 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:14.995 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:14.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.995 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:14.996 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:14.996 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:14.996 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.996 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:14.996 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:14.996 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:14.996 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:14.996 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:14.996 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.996 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:14.996 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:14.996 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:14.996 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:14.996 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:14.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.997 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:14.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.997 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:14.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.997 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:14.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.997 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:14.997 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:14.997 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:14.997 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:14.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:14.997 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:14.997 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:14.997 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:14.998 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:14.998 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:14.998 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:14.998 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:14.998 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:14.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:14.998 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:14.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:14.998 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:14.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:14.998 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:14.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:14.998 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:14.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:14.998 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:14.999 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:14.999 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:14.999 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:14.999 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:14.999 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:14.999 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:14.999 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:14.999 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:14.999 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:14.999 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:14.999 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:14.999 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:14.999 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:14.999 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.000 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.000 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.000 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.000 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.000 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.000 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.000 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.000 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.000 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.000 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.000 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.000 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.000 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.000 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.001 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.001 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.001 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.001 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.001 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.001 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.001 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.001 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.001 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.001 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.001 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.001 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.001 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.002 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.002 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.002 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.002 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.002 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.002 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.002 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.002 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.002 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.002 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.002 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.002 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.002 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.002 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.003 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.003 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.003 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.003 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.003 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.003 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.003 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.003 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.003 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.003 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.003 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.003 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.004 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.004 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.004 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.004 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.004 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.004 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.004 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.004 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.004 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.004 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.004 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.004 INFO:teuthology.orchestra.run.smithi044.stdout:_ ERROR at teardown of test_encryption_sse_c_post_object_authenticated_request _ 2023-12-03T12:39:15.004 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.005 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.005 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.005 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.005 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.005 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.005 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.005 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.005 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.005 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.005 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.005 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.005 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.006 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.006 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.006 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.006 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.006 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.006 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.006 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.006 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.006 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.006 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.006 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.006 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.007 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.007 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.007 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.007 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.007 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.007 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.007 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.008 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.008 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.008 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.008 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.008 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.008 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.009 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.009 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.009 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.009 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.009 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.010 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.010 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.010 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.010 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.010 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.010 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.010 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.010 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.010 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.011 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.011 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.011 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.011 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.011 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.011 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.011 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.012 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.012 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.012 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.012 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.012 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.012 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.012 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.012 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.012 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.012 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.012 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.012 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.013 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.013 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.013 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.013 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.013 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.013 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.013 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.013 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.013 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.013 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.013 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.013 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.013 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.013 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.013 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.013 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.014 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.014 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.014 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.014 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.014 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.014 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.014 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.014 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.014 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.014 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.014 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.014 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.014 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.014 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.015 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.015 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.015 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.015 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.015 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.015 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.015 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.015 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.015 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.015 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.015 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.015 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.016 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.016 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.016 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.016 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.016 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.016 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.016 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.016 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.016 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.016 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.016 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.016 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.016 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.016 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.016 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.017 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.017 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.017 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.017 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.017 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.017 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.017 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.017 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.017 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.017 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.017 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.017 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.017 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.017 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.017 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.018 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.018 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.018 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.018 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.018 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.018 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.018 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.018 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.018 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.018 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.018 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.018 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.018 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.018 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.018 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.019 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.019 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.019 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.019 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.019 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.019 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.019 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.019 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.019 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.019 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.019 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.019 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.019 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.019 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.019 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.020 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.020 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.020 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.020 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.020 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.020 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.020 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.020 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.020 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.020 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.020 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.021 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.021 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.021 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.021 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.021 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.021 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.021 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.021 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.021 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.021 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.021 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.021 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.021 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.021 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.021 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.022 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.022 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.022 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.022 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.022 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.022 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.022 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.022 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.022 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.022 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.022 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.022 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.022 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.022 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.022 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.023 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.023 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.023 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.023 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.023 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.023 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.023 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.023 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.023 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.023 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.023 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.023 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.024 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.024 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.024 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.024 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.024 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.024 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.024 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.024 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.024 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.024 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.024 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.024 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.024 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.024 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.025 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.025 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.025 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.025 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.025 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.025 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.025 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.025 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.025 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.025 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.025 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.025 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.025 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.025 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.025 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.025 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.026 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.026 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.026 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.026 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.026 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.026 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.026 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.026 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.026 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.026 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.026 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.026 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.026 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.027 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.027 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.027 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.027 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.027 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at teardown of test_sse_kms_method_head _________________ 2023-12-03T12:39:15.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.027 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.027 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.027 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.027 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.028 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.028 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.028 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.028 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.028 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.028 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.028 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.028 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.028 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.028 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.028 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.028 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.028 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.028 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.028 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.029 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.029 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.029 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.029 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.029 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.029 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.029 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.029 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.029 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.029 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.029 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.029 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.030 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.030 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.030 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.030 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.030 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.030 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.030 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.030 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.030 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.030 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.030 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.030 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.030 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.030 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.030 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.031 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.031 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.031 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.031 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.031 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.031 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.031 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.031 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.031 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.031 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.031 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.031 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.032 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.032 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.032 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.032 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.032 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.032 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.032 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.032 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.032 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.032 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.032 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.032 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.032 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.032 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.032 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.032 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.033 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.033 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.033 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.033 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.033 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.033 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.033 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.033 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.033 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.033 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.033 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.033 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.033 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.033 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.033 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.034 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.034 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.034 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.034 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.034 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.034 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.034 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.034 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.034 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.034 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.034 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.034 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.034 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.034 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.035 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.035 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.035 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.035 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.035 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.035 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.035 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.035 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.035 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.035 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.035 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.035 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.035 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.035 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.035 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.036 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.036 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.036 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.036 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.036 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.036 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.036 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.036 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.036 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.036 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.036 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.036 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.036 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.036 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.036 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.036 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.037 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.037 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.037 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.037 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.037 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.037 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.037 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.037 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.037 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.037 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.037 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.037 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.037 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.037 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.037 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.037 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.038 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.038 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.038 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.038 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.038 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.038 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.038 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.038 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.038 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.038 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.038 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.038 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.038 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.039 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.039 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.039 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.039 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.039 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.039 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.039 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.039 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.039 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.039 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.039 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.040 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.040 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.040 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.040 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.040 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.040 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.040 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.040 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.040 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.040 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.040 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.040 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.040 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.040 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.040 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.040 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.041 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.041 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.041 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.041 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.041 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.041 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.041 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.041 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.041 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.041 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.041 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.041 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.041 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.042 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.042 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.042 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.042 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.042 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.042 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.042 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.042 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.042 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.042 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.042 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.042 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.042 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.042 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.042 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.043 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.043 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.043 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.043 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.043 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.043 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.043 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.043 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.043 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.043 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.043 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.043 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.043 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.043 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.043 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.044 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.044 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.044 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.044 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.044 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.044 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.044 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.044 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.044 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.044 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.044 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.044 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.044 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.045 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.045 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.045 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.045 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.045 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.045 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.045 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.045 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.045 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.045 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.045 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.045 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.045 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.045 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.046 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.046 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.046 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.046 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.046 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.046 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.046 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.046 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.046 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.046 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.046 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.046 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.046 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.046 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ ERROR at teardown of test_sse_kms_present ___________________ 2023-12-03T12:39:15.046 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.047 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.047 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.047 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.047 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.047 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.047 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.047 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.047 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.047 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.047 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.048 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.048 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.048 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.048 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.048 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.048 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.048 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.048 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.048 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.048 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.048 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.049 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.049 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.049 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.049 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.049 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.049 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.049 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.049 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.049 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.049 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.049 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.049 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.049 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.049 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.049 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.049 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.050 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.050 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.050 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.050 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.050 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.050 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.050 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.050 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.050 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.050 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.050 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.050 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.050 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.050 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.051 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.051 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.051 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.051 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.051 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.051 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.051 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.051 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.051 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.051 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.051 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.051 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.051 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.051 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.052 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.052 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.052 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.052 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.052 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.052 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.052 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.052 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.052 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.052 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.052 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.052 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.052 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.052 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.052 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.052 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.053 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.053 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.053 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.053 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.053 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.053 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.053 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.053 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.053 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.053 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.053 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.053 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.053 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.053 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.053 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.053 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.054 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.054 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.054 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.054 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.054 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.054 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.054 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.054 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.054 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.054 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.054 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.054 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.054 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.054 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.055 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.055 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.055 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.055 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.055 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.055 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.055 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.055 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.055 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.055 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.055 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.055 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.055 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.055 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.056 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.056 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.056 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.056 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.056 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.056 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.056 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.056 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.056 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.056 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.056 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.056 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.056 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.056 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.056 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.057 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.057 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.057 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.057 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.057 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.057 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.057 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.057 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.057 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.057 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.057 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.057 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.057 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.057 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.057 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.058 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.058 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.058 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.058 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.058 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.058 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.058 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.058 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.058 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.058 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.058 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.058 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.059 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.059 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.059 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.059 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.059 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.059 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.059 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.059 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.059 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.059 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.059 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.059 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.060 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.060 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.060 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.060 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.060 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.060 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.060 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.060 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.060 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.060 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.060 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.060 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.060 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.060 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.060 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.060 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.061 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.061 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.061 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.061 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.061 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.061 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.061 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.061 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.061 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.061 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.061 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.061 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.061 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.062 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.062 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.062 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.062 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.062 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.062 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.062 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.062 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.062 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.062 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.062 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.062 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.063 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.063 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.063 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.063 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.063 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.063 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.063 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.063 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.063 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.063 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.063 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.063 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.063 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.063 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.063 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.064 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.064 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.064 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.064 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.064 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.064 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.064 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.064 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.064 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.064 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.064 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.064 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.064 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.064 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.064 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.065 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.065 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.065 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.065 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.065 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.065 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.065 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.065 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.065 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.065 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.065 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.065 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.065 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.065 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.065 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.066 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.066 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.066 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.066 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.066 INFO:teuthology.orchestra.run.smithi044.stdout:___________________ ERROR at teardown of test_sse_kms_no_key ___________________ 2023-12-03T12:39:15.066 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.066 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.066 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.066 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.066 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.066 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.066 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.066 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.066 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.066 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.067 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.067 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.067 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.067 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.067 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.067 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.067 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.067 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.067 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.067 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.067 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.067 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.067 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.067 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.067 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.068 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.068 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.068 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.068 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.068 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.068 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.068 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.068 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.068 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.068 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.068 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.069 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.069 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.069 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.069 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.069 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.069 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.069 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.069 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.069 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.069 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.069 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.070 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.070 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.070 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.070 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.070 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.070 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.070 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.070 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.070 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.070 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.070 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.070 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.070 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.070 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.070 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.071 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.071 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.071 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.071 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.071 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.071 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.071 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.071 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.071 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.071 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.071 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.071 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.071 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.072 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.072 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.072 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.072 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.072 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.072 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.072 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.072 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.072 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.072 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.072 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.072 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.072 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.072 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.072 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.073 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.073 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.073 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.073 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.073 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.073 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.073 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.073 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.073 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.073 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.073 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.073 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.073 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.073 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.073 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.074 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.074 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.074 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.074 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.074 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.074 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.074 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.074 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.074 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.074 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.074 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.074 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.074 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.074 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.075 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.075 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.075 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.075 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.075 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.075 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.075 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.075 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.075 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.075 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.075 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.075 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.075 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.075 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.075 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.075 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.076 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.076 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.076 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.076 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.076 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.076 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.076 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.076 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.076 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.076 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.076 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.076 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.077 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.077 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.077 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.077 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.077 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.077 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.077 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.077 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.077 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.077 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.077 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.077 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.077 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.077 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.077 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.077 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.078 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.078 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.078 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.078 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.078 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.078 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.078 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.078 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.078 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.078 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.079 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.079 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.079 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.079 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.079 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.079 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.079 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.079 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.079 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.079 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.079 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.079 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.079 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.079 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.080 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.080 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.080 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.080 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.080 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.080 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.080 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.080 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.080 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.080 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.080 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.080 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.080 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.080 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.080 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.081 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.081 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.081 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.081 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.081 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.081 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.081 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.081 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.081 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.081 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.081 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.081 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.081 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.081 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.082 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.082 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.082 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.082 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.082 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.082 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.082 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.082 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.082 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.082 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.082 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.082 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.083 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.083 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.083 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.083 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.083 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.083 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.083 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.083 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.083 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.083 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.083 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.083 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.083 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.083 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.083 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.084 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.084 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.084 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.084 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.084 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.084 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.084 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.084 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.084 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.084 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.084 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.084 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.084 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.084 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.084 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.085 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.085 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.085 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.085 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.085 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.085 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.085 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.085 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.085 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.085 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.085 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.085 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.085 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.085 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at teardown of test_sse_kms_not_declared ________________ 2023-12-03T12:39:15.086 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.086 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.086 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.086 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.086 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.086 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.086 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.086 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.086 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.086 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.086 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.086 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.086 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.087 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.087 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.087 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.087 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.087 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.087 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.087 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.087 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.087 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.087 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.087 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.087 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.087 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.088 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.088 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.088 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.088 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.088 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.088 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.088 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.088 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.088 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.088 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.088 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.088 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.088 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.088 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.088 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.089 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.089 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.089 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.089 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.089 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.089 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.089 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.089 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.089 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.089 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.089 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.089 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.089 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.090 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.090 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.090 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.090 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.090 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.090 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.090 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.090 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.090 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.090 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.090 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.090 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.091 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.091 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.091 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.091 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.091 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.091 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.091 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.091 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.091 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.091 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.091 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.091 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.091 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.092 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.092 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.092 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.092 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.092 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.092 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.092 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.092 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.092 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.092 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.092 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.092 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.092 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.092 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.092 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.093 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.093 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.093 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.093 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.093 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.093 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.093 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.093 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.093 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.093 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.093 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.093 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.093 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.093 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.093 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.093 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.094 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.094 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.094 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.094 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.094 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.094 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.094 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.094 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.094 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.094 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.094 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.094 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.094 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.094 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.094 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.095 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.095 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.095 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.095 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.095 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.095 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.095 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.095 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.095 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.095 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.095 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.095 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.095 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.095 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.095 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.097 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.097 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.097 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.097 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.097 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.097 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.097 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.097 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.097 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.097 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.097 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.098 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.098 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.098 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.098 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.098 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.098 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.098 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.098 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.098 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.098 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.098 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.098 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.098 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.098 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.099 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.099 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.099 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.099 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.099 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.099 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.099 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.099 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.099 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.099 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.099 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.099 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.099 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.099 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.099 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.100 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.100 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.100 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.100 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.100 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.100 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.100 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.100 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.100 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.100 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.100 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.100 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.100 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.100 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.100 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.101 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.101 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.101 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.101 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.101 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.101 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.101 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.101 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.101 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.101 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.101 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.102 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.102 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.102 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.102 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.102 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.102 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.102 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.102 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.102 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.102 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.102 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.102 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.102 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.102 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.104 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.104 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.104 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.104 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.104 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.104 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.104 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.104 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.104 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.104 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.104 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.104 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.104 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.104 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.105 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.105 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.105 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.105 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.105 INFO:teuthology.orchestra.run.smithi044.stdout:______________ ERROR at teardown of test_sse_kms_multipart_upload ______________ 2023-12-03T12:39:15.105 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.105 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.105 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.105 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.105 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.105 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.105 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.105 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.105 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.105 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.105 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.106 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.106 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.106 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.106 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.106 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.106 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.106 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.106 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.106 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.106 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.106 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.107 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.107 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.107 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.107 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.107 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.107 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.107 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.107 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.107 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.107 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.107 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.107 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.107 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.107 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.107 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.108 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.108 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.108 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.108 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.108 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.108 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.108 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.108 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.108 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.108 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.109 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.109 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.109 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.109 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.109 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.109 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.109 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.109 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.109 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.109 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.109 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.109 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.110 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.110 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.110 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.110 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.110 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.110 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.110 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.110 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.110 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.110 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.111 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.111 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.111 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.111 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.111 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.111 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.111 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.111 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.112 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.112 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.112 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.112 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.112 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.112 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.113 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.113 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.113 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.113 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.113 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.113 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.113 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.114 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.114 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.114 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.114 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.114 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.114 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.114 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.114 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.114 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.115 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.115 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.115 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.115 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.115 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.115 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.115 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.115 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.115 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.116 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.116 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.116 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.116 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.116 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.116 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.117 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.117 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.117 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.117 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.117 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.117 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.117 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.117 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.117 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.117 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.117 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.117 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.117 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.117 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.117 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.118 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.118 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.118 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.118 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.118 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.118 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.118 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.118 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.118 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.118 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.118 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.118 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.118 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.118 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.120 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.120 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.120 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.120 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.120 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.120 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.120 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.120 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.120 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.120 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.120 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.120 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.120 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.120 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.120 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.121 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.121 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.121 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.121 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.121 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.121 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.121 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.121 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.121 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.121 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.121 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.121 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.121 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.121 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.122 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.122 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.122 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.122 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.122 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.122 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.122 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.122 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.122 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.122 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.122 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.122 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.122 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.122 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.123 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.123 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.123 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.123 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.123 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.123 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.123 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.123 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.123 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.123 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.123 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.123 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.123 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.123 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.124 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.124 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.124 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.124 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.124 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.124 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.124 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.124 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.124 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.124 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.124 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.124 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.124 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.124 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.124 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.124 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.126 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.126 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.126 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.126 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.126 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.126 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.126 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.126 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.126 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.126 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.126 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.126 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.126 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.127 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.127 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.127 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.127 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.127 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.127 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.127 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.127 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.127 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.127 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.127 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.127 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.127 INFO:teuthology.orchestra.run.smithi044.stdout:_________ ERROR at teardown of test_sse_kms_multipart_invalid_chunks_1 _________ 2023-12-03T12:39:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.128 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.129 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.129 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.129 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.129 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.129 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.129 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.129 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.129 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.129 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.129 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.129 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.129 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.129 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.130 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.130 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.130 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.130 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.130 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.130 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.130 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.130 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.130 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.130 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.130 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.130 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.130 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.130 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.131 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.131 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.131 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.131 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.131 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.131 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.131 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.131 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.131 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.131 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.131 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.131 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.131 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.131 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.131 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.132 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.132 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.132 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.132 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.132 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.132 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.132 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.132 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.132 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.132 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.132 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.132 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.132 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.132 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.132 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.133 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.133 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.133 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.133 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.133 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.133 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.133 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.133 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.133 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.133 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.133 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.133 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.133 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.133 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.134 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.134 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.134 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.134 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.134 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.134 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.134 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.134 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.134 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.134 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.134 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.134 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.134 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.134 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.135 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.135 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.135 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.135 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.135 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.135 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.135 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.135 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.135 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.135 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.135 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.135 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.135 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.135 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.135 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.136 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.136 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.136 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.136 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.136 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.136 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.136 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.136 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.136 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.136 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.136 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.136 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.136 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.136 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.136 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.136 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.137 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.137 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.137 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.137 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.137 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.137 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.137 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.137 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.137 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.137 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.137 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.137 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.137 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.139 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.139 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.139 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.139 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.139 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.139 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.139 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.139 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.139 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.139 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.139 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.139 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.139 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.139 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.139 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.140 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.140 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.140 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.140 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.140 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.140 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.140 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.140 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.140 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.140 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.140 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.140 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.140 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.140 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.140 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.140 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.141 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.141 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.141 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.141 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.141 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.141 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.141 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.141 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.141 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.141 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.141 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.141 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.141 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.142 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.142 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.142 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.142 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.142 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.142 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.142 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.142 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.142 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.142 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.142 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.142 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.142 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.142 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.143 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.143 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.143 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.143 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.143 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.143 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.143 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.143 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.143 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.143 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.143 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.143 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.143 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.143 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.143 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.144 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.144 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.144 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.144 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.144 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.144 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.144 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.144 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.144 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.144 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.144 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.144 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.144 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.146 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.146 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.146 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.146 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.146 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.146 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.146 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.146 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.146 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.146 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.146 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.146 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.146 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.147 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.147 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.147 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.147 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.147 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.147 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.147 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.147 INFO:teuthology.orchestra.run.smithi044.stdout:_________ ERROR at teardown of test_sse_kms_multipart_invalid_chunks_2 _________ 2023-12-03T12:39:15.147 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.147 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.147 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.147 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.147 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.147 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.148 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.148 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.148 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.148 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.148 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.148 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.148 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.148 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.148 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.148 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.148 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.148 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.148 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.148 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.148 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.148 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.148 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.149 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.149 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.149 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.149 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.149 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.149 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.149 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.149 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.149 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.149 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.149 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.149 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.149 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.152 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.152 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.152 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.152 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.152 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.152 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.152 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.152 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.152 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.152 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.152 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.152 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.152 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.152 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.152 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.153 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.153 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.153 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.153 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.153 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.153 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.153 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.153 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.153 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.153 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.153 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.153 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.153 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.153 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.154 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.154 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.154 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.154 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.154 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.154 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.154 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.154 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.154 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.154 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.154 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.154 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.154 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.154 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.154 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.155 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.155 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.155 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.155 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.155 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.155 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.155 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.155 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.155 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.156 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.156 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.156 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.156 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.156 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.156 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.156 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.156 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.156 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.156 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.156 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.156 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.156 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.156 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.156 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.157 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.157 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.157 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.157 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.157 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.157 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.157 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.157 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.157 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.157 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.157 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.157 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.157 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.157 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.158 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.158 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.158 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.158 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.158 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.158 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.158 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.158 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.158 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.158 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.158 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.158 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.158 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.159 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.159 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.159 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.159 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.159 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.159 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.159 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.159 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.159 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.159 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.159 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.160 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.160 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.160 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.160 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.160 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.160 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.160 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.160 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.160 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.160 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.160 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.160 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.160 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.160 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.160 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.161 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.161 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.161 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.161 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.161 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.161 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.161 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.161 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.161 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.161 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.161 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.161 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.161 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.161 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.162 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.162 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.162 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.162 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.162 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.162 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.162 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.162 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.162 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.162 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.162 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.162 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.162 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.162 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.162 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.163 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.163 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.163 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.163 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.163 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.163 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.163 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.163 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.163 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.163 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.163 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.163 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.163 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.166 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.166 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.166 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.166 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.166 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.166 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.166 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.166 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.166 INFO:teuthology.orchestra.run.smithi044.stdout:_____ ERROR at teardown of test_sse_kms_post_object_authenticated_request ______ 2023-12-03T12:39:15.166 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.166 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.166 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.166 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.166 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.166 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.166 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.167 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.167 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.167 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.167 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.167 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.167 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.167 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.167 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.167 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.167 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.167 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.167 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.167 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.167 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.167 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.168 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.168 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.168 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.168 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.168 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.168 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.168 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.168 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.168 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.168 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.168 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.168 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.169 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.169 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.169 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.169 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.169 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.169 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.169 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.169 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.169 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.169 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.169 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.171 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.171 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.171 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.171 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.171 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.171 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.171 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.171 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.171 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.171 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.171 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.171 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.171 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.171 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.172 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.172 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.172 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.172 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.172 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.172 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.172 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.172 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.172 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.172 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.172 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.172 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.172 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.172 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.172 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.172 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.172 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.173 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.174 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.174 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.174 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.174 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.174 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.174 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.174 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.174 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.174 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.174 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.175 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.175 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.175 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.175 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.175 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.175 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.175 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.175 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.175 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.175 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.175 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.176 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.176 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.176 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.176 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.176 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.176 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.176 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.176 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.176 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.176 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.176 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.177 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.177 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.177 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.177 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.177 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.177 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.177 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.177 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.177 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.177 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.177 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.177 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.177 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.177 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.177 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.177 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.177 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.178 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.178 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.178 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.178 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.178 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.178 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.178 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.178 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.178 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.178 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.179 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.179 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.179 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.179 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.179 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.179 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.179 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.179 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.179 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.179 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.179 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.179 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.179 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.179 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.180 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.180 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.180 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.180 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.180 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.180 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.180 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.180 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.180 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.180 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.180 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.180 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.180 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.180 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.181 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.181 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.181 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.181 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.181 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.181 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.181 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.181 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.181 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.181 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.181 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.181 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.181 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.182 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.182 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.182 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.182 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.182 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.182 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.182 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.182 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.182 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.182 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.182 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.182 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.182 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.182 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.182 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.183 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.183 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.183 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.183 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.183 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.183 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.183 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.183 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.183 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.183 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.183 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.183 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.183 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.183 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.183 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.183 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.184 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.184 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.184 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.184 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.184 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.184 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.184 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.184 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.184 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.184 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.184 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.184 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.184 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.184 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.185 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.185 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.185 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.185 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.185 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.185 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.185 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.185 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.185 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.185 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.185 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.185 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.185 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at teardown of test_sse_kms_transfer_1b _________________ 2023-12-03T12:39:15.186 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.186 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.186 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.186 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.186 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.186 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.186 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.186 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.186 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.186 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.186 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.186 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.186 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.186 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.186 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.187 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.187 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.187 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.187 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.187 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.187 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.187 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.187 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.187 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.187 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.187 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.187 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.187 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.187 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.187 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.187 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.188 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.188 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.188 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.188 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.188 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.188 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.188 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.188 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.188 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.188 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.188 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.188 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.188 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.188 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.188 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.188 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.189 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.189 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.189 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.189 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.189 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.189 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.189 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.189 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.189 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.189 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.189 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.189 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.189 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.189 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.189 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.190 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.190 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.190 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.190 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.190 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.190 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.190 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.190 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.190 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.190 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.190 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.191 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.191 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.191 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.191 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.191 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.191 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.191 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.191 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.191 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.192 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.192 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.192 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.192 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.192 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.192 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.192 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.192 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.192 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.192 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.192 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.192 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.192 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.192 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.192 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.193 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.193 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.193 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.193 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.193 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.193 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.193 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.193 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.193 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.193 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.193 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.193 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.194 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.194 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.194 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.194 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.194 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.194 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.194 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.195 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.195 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.195 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.195 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.195 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.195 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.195 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.195 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.195 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.195 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.195 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.195 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.195 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.195 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.195 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.195 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.196 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.196 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.196 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.196 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.196 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.196 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.196 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.196 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.196 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.196 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.196 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.196 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.196 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.196 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.196 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.196 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.196 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.197 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.197 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.198 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.198 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.198 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.198 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.198 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.198 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.198 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.198 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.199 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.199 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.199 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.199 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.199 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.199 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.199 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.199 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.199 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.199 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.199 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.199 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.199 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.199 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.199 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.200 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.200 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.200 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.200 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.200 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.200 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.200 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.200 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.200 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.200 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.200 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.200 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.200 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.200 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.200 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.201 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.201 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.201 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.201 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.201 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.201 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.201 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.201 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.201 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.201 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.201 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.201 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.201 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.201 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.201 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.205 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.205 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.205 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.205 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.205 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.205 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.205 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at teardown of test_sse_kms_transfer_1kb ________________ 2023-12-03T12:39:15.205 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.205 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.205 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.205 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.205 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.205 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.205 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.206 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.206 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.206 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.206 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.206 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.206 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.206 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.206 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.206 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.206 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.206 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.206 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.206 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.206 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.206 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.207 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.207 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.207 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.207 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.210 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.210 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.210 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.210 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.210 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.210 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.210 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.210 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.210 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.210 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.210 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.211 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.211 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.211 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.211 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.211 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.211 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.211 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.211 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.211 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.211 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.212 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.212 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.212 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.212 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.212 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.212 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.212 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.212 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.212 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.212 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.212 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.213 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.213 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.213 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.213 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.213 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.213 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.213 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.213 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.213 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.213 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.213 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.213 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.214 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.214 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.214 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.214 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.214 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.214 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.214 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.214 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.214 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.214 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.215 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.215 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.215 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.215 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.215 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.215 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.215 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.215 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.215 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.215 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.215 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.216 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.216 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.216 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.216 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.216 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.216 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.216 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.216 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.216 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.216 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.216 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.216 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.216 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.217 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.217 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.217 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.217 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.217 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.217 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.217 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.217 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.217 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.217 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.217 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.217 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.217 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.217 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.218 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.218 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.218 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.218 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.218 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.218 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.218 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.218 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.218 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.218 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.218 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.218 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.218 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.218 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.219 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.219 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.219 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.219 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.219 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.219 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.219 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.219 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.219 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.219 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.219 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.219 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.219 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.219 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.219 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.219 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.220 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.220 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.220 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.220 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.220 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.220 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.220 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.220 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.221 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.221 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.221 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.221 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.221 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.221 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.221 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.221 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.221 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.221 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.221 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.221 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.221 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.221 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.222 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.222 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.222 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.222 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.222 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.222 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.222 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.222 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.222 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.223 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.223 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.223 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.223 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.223 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.223 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.223 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.223 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.223 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.223 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.223 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.223 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.223 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.223 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.223 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.223 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.224 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.224 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.224 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.224 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.224 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.224 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.224 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.224 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.224 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.224 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.224 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.224 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.224 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.224 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.224 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.224 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.225 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.225 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.225 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.225 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.225 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.225 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.226 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.226 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.226 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.226 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at teardown of test_sse_kms_transfer_1MB ________________ 2023-12-03T12:39:15.226 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.226 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.227 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.227 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.227 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.227 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.227 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.227 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.227 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.228 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.228 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.228 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.228 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.228 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.228 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.228 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.228 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.228 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.228 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.228 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.228 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.228 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.228 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.229 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.229 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.229 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.229 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.229 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.229 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.229 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.230 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.230 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.230 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.230 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.230 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.230 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.230 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.230 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.230 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.230 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.230 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.230 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.230 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.230 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.231 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.231 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.231 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.231 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.231 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.231 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.231 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.231 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.231 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.232 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.232 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.232 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.232 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.232 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.232 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.232 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.232 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.232 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.232 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.232 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.232 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.232 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.232 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.233 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.233 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.233 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.233 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.233 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.233 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.233 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.233 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.233 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.233 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.233 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.233 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.233 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.233 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.233 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.233 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.234 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.234 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.234 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.234 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.234 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.234 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.234 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.234 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.234 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.234 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.234 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.234 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.234 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.234 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.235 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.235 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.235 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.235 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.235 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.235 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.235 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.235 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.235 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.235 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.235 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.235 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.235 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.235 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.236 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.236 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.236 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.236 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.236 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.236 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.236 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.236 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.236 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.236 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.236 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.236 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.236 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.236 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.236 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.237 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.237 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.237 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.237 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.237 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.237 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.237 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.237 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.237 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.237 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.237 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.238 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.238 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.238 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.238 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.238 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.238 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.238 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.239 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.239 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.239 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.239 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.239 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.239 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.239 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.239 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.239 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.239 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.239 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.239 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.239 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.240 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.240 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.240 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.240 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.240 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.240 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.240 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.240 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.240 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.240 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.240 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.240 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.240 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.240 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.240 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.241 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.241 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.241 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.241 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.241 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.241 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.241 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.241 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.241 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.241 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.242 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.242 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.242 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.242 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.242 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.242 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.242 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.242 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.242 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.242 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.242 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.242 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.243 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.243 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.243 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.243 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.243 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.243 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.243 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.243 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.243 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.243 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.243 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.243 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.243 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.243 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.243 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.244 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.244 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.244 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.244 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.244 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.244 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.245 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.245 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.245 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.245 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.245 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.245 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.245 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.245 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.245 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.245 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.245 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.245 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.245 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.246 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.246 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.246 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.246 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.246 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.246 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.246 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.246 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.246 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.246 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.246 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.246 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.246 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.247 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.247 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.247 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.247 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.247 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.247 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.247 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.247 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.247 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.247 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.247 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.247 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.247 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.247 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.248 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.248 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.248 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.248 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.248 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.248 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.248 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.248 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.248 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.248 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.248 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.248 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.248 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.248 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.249 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.249 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.249 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.249 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.249 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.249 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.249 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at teardown of test_sse_kms_transfer_13b ________________ 2023-12-03T12:39:15.249 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.249 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.249 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.249 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.249 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.249 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.249 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.250 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.250 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.250 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.250 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.250 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.250 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.250 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.250 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.250 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.250 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.250 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.250 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.250 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.250 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.251 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.251 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.251 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.251 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.251 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.251 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.251 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.251 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.251 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.251 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.251 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.251 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.251 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.251 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.251 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.252 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.252 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.252 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.252 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.252 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.252 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.252 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.252 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.252 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.252 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.252 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.252 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.252 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.252 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.253 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.253 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.253 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.253 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.253 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.253 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.253 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.253 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.253 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.254 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.254 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.254 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.254 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.254 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.254 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.254 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.255 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.255 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.255 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.255 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.255 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.255 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.255 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.256 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.256 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.256 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.256 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.256 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.256 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.256 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.256 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.256 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.257 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.257 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.257 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.257 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.257 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.257 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.257 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.257 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.257 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.257 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.257 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.257 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.257 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.257 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.258 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.258 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.258 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.258 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.258 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.258 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.258 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.258 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.258 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.258 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.258 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.258 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.259 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.259 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.259 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.259 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.259 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.259 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.259 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.259 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.259 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.259 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.259 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.259 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.259 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.260 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.260 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.260 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.260 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.260 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.260 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.260 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.260 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.260 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.260 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.260 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.260 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.260 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.260 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.261 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.261 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.261 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.261 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.261 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.261 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.261 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.261 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.261 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.261 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.261 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.261 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.261 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.261 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.262 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.262 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.262 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.262 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.262 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.262 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.262 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.262 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.262 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.262 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.263 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.263 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.263 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.263 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.263 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.263 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.263 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.263 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.263 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.263 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.263 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.263 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.263 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.264 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.264 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.264 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.264 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.264 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.264 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.264 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.264 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.264 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.264 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.264 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.264 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.265 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.265 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.265 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.265 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.265 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.265 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.265 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.265 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.265 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.265 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.265 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.265 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.265 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.265 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.265 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.266 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.266 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.266 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.266 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.266 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.266 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.266 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.267 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.267 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.267 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.267 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.267 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.267 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.267 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.267 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.267 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.267 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.267 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.267 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.267 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.268 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.268 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.268 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.268 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.268 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.268 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.268 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.268 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.268 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.268 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.268 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.268 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.268 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.269 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.269 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.269 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.269 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.269 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.269 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.269 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.269 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.269 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.269 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.269 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.270 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.270 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.270 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.270 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.270 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.270 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.270 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.270 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.270 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.270 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.270 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.270 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.271 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.271 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.271 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.271 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.271 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.271 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.271 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.271 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.271 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.271 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at teardown of test_sse_kms_read_declare ________________ 2023-12-03T12:39:15.271 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.271 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.272 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.272 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.272 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.272 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.272 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.272 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.272 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.272 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.272 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.272 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.272 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.272 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.273 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.273 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.273 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.273 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.273 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.273 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.273 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.273 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.273 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.273 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.273 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.273 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.273 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.273 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.273 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.273 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.273 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.274 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.274 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.274 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.274 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.274 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.274 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.274 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.274 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.274 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.274 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.274 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.274 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.274 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.274 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.275 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.275 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.275 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.275 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.275 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.275 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.275 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.275 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.275 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.275 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.275 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.275 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.276 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.276 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.276 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.276 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.276 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.276 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.276 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.276 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.276 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.276 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.276 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.276 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.277 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.277 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.277 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.277 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.277 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.277 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.277 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.277 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.277 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.277 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.277 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.277 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.277 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.277 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.277 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.277 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.277 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.278 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.278 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.278 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.278 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.278 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.278 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.278 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.278 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.278 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.278 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.278 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.278 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.278 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.278 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.279 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.279 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.279 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.279 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.279 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.279 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.279 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.279 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.279 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.279 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.279 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.279 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.279 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.279 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.279 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.280 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.280 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.280 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.280 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.280 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.280 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.280 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.280 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.280 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.280 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.281 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.281 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.281 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.281 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.281 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.281 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.281 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.281 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.281 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.281 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.281 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.281 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.281 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.281 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.281 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.282 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.282 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.282 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.282 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.282 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.282 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.282 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.282 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.282 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.282 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.282 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.282 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.282 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.282 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.283 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.283 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.283 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.283 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.283 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.283 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.283 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.283 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.283 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.283 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.283 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.283 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.283 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.283 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.284 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.284 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.284 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.284 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.284 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.284 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.284 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.284 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.284 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.284 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.284 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.284 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.285 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.285 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.285 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.285 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.285 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.285 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.285 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.285 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.286 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.286 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.286 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.286 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.286 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.286 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.287 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.287 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.287 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.287 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.287 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.287 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.287 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.287 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.287 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.287 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.287 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.287 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.287 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.287 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.287 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.287 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.288 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.288 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.288 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.288 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.288 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.288 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.288 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.288 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.288 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.288 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.288 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.288 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.288 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.288 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.288 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.288 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.288 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.289 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.289 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.289 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.289 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.289 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.289 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.289 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.289 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.289 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.289 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.289 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.289 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.289 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.289 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.289 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.290 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.290 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.290 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.290 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.290 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.290 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.290 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.290 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.290 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.290 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.290 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.290 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.291 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.291 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.291 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.291 INFO:teuthology.orchestra.run.smithi044.stdout:___________________ ERROR at teardown of test_bucket_policy ____________________ 2023-12-03T12:39:15.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.291 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.291 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.291 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.291 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.291 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.291 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.291 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.292 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.292 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.292 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.292 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.292 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.292 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.292 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.292 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.292 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.292 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.292 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.292 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.292 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.292 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.292 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.293 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.293 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.293 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.293 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.293 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.293 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.293 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.293 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.293 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.293 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.293 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.293 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.293 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.293 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.293 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.293 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.294 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.294 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.294 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.294 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.294 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.294 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.294 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.294 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.294 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.294 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.294 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.294 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.294 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.294 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.295 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.295 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.295 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.295 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.295 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.295 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.295 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.295 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.295 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.295 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.295 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.295 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.296 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.296 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.296 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.296 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.296 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.296 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.296 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.296 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.296 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.296 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.297 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.297 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.297 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.297 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.297 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.297 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.297 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.297 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.297 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.297 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.297 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.297 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.297 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.297 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.297 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.298 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.298 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.298 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.298 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.298 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.298 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.298 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.298 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.298 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.298 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.298 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.298 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.298 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.298 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.298 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.299 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.299 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.299 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.299 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.299 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.299 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.299 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.299 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.300 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.300 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.300 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.300 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.300 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.300 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.300 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.300 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.300 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.300 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.300 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.300 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.301 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.301 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.301 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.301 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.301 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.301 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.301 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.301 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.301 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.301 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.301 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.302 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.302 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.302 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.302 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.302 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.302 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.302 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.302 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.302 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.302 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.303 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.303 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.303 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.303 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.303 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.303 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.303 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.303 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.303 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.303 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.303 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.303 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.304 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.304 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.304 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.304 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.304 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.304 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.304 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.304 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.304 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.304 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.304 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.304 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.305 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.305 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.305 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.305 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.305 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.305 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.305 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.305 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.306 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.306 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.306 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.306 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.306 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.306 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.306 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.306 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.306 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.306 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.306 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.306 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.307 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.307 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.307 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.307 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.307 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.307 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.307 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.307 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.307 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.307 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.307 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.307 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.307 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.307 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.308 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.308 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.308 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.308 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.308 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.308 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.308 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.308 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.308 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.308 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.308 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.308 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.308 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.308 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.308 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.308 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.309 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.309 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.309 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.309 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.309 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.309 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.309 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.309 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.309 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.309 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.309 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.309 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.309 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.309 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.310 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.310 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.310 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.310 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.310 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.310 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.310 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.310 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.310 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.310 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.310 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.310 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.311 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.311 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.311 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ ERROR at teardown of test_bucketv2_policy ___________________ 2023-12-03T12:39:15.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.311 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.311 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.311 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.311 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.311 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.311 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.311 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.311 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.312 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.312 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.312 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.312 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.312 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.312 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.312 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.312 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.312 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.312 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.312 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.312 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.312 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.312 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.313 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.313 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.313 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.313 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.313 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.313 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.313 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.313 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.314 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.314 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.314 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.314 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.314 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.314 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.314 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.314 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.314 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.314 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.314 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.314 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.314 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.314 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.315 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.315 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.315 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.315 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.315 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.315 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.315 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.315 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.315 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.315 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.315 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.315 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.315 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.315 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.316 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.316 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.316 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.316 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.316 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.316 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.316 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.316 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.316 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.316 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.316 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.316 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.317 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.317 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.317 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.317 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.317 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.317 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.317 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.317 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.317 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.317 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.318 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.318 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.318 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.318 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.318 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.318 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.318 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.318 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.318 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.318 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.318 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.318 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.318 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.318 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.318 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.319 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.319 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.319 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.319 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.319 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.319 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.319 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.319 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.319 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.319 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.319 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.319 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.319 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.320 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.320 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.320 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.320 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.320 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.320 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.320 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.320 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.320 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.321 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.321 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.321 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.321 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.321 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.321 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.321 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.321 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.321 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.321 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.321 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.321 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.321 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.321 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.322 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.322 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.322 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.322 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.322 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.322 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.322 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.322 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.322 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.322 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.322 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.322 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.323 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.323 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.323 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.323 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.323 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.323 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.323 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.323 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.323 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.323 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.323 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.323 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.324 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.324 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.324 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.324 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.324 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.324 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.324 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.324 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.324 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.324 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.325 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.325 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.325 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.325 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.325 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.325 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.325 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.325 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.325 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.325 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.325 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.325 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.325 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.326 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.326 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.326 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.326 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.326 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.326 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.326 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.327 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.327 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.327 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.327 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.327 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.327 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.327 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.327 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.327 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.327 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.327 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.327 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.327 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.327 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.327 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.328 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.328 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.328 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.328 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.328 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.328 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.328 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.328 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.328 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.328 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.328 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.328 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.328 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.329 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.329 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.329 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.329 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.329 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.329 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.329 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.329 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.329 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.329 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.329 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.329 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.329 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.329 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.329 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.330 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.330 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.330 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.330 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.330 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.330 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.330 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.330 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.330 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.331 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.331 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.331 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.331 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.331 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.331 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.331 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.331 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.331 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.331 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.332 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.332 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ ERROR at teardown of test_bucket_policy_acl __________________ 2023-12-03T12:39:15.332 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.332 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.332 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.332 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.332 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.332 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.332 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.332 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.332 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.332 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.332 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.333 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.333 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.333 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.333 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.333 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.333 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.333 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.333 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.333 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.333 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.333 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.333 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.333 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.333 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.334 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.334 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.334 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.334 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.334 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.334 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.334 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.334 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.334 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.334 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.334 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.335 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.335 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.335 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.335 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.335 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.335 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.335 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.335 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.335 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.335 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.335 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.337 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.337 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.337 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.337 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.337 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.337 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.337 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.337 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.338 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.338 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.338 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.338 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.338 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.338 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.339 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.339 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.339 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.339 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.339 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.339 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.339 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.340 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.340 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.340 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.340 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.340 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.340 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.340 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.340 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.340 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.340 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.340 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.340 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.340 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.340 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.341 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.341 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.341 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.341 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.341 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.341 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.342 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.342 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.342 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.342 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.342 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.342 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.342 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.342 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.342 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.342 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.342 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.342 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.343 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.343 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.343 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.343 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.343 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.343 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.343 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.343 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.343 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.343 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.343 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.343 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.343 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.343 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.343 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.343 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.344 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.344 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.344 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.344 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.344 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.344 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.344 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.344 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.344 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.344 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.344 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.344 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.344 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.344 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.344 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.345 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.345 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.345 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.345 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.345 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.345 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.345 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.345 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.345 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.345 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.345 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.345 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.346 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.346 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.346 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.346 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.346 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.346 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.346 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.346 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.346 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.346 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.346 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.346 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.346 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.346 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.346 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.347 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.347 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.347 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.347 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.347 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.347 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.347 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.347 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.347 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.347 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.347 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.347 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.347 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.347 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.348 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.348 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.348 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.348 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.348 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.348 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.348 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.348 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.348 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.348 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.348 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.348 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.349 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.349 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.349 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.349 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.349 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.349 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.349 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.349 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.349 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.349 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.349 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.349 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.349 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.349 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.349 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.350 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.350 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.350 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.350 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.350 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.350 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.350 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.350 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.350 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.350 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.350 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.350 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.350 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.350 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.351 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.351 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.351 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.354 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.354 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.354 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.354 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at teardown of test_bucketv2_policy_acl _________________ 2023-12-03T12:39:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.355 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.355 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.356 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.356 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.356 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.356 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.356 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.356 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.360 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.360 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.360 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.360 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.360 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.360 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.361 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.362 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.362 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.362 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.362 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.362 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.362 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.362 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.362 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.362 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.362 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.362 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.363 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.363 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.363 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.363 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.363 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.363 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.363 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.363 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.363 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.363 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.363 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.363 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.363 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.363 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.363 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.364 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.364 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.364 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.364 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.364 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.364 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.364 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.364 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.364 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.364 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.364 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.364 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.364 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.364 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.364 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.364 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.364 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.364 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.365 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.365 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.365 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.365 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.365 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.365 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.365 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.365 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.365 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.365 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.365 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.365 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.366 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.366 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.366 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.366 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.366 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.366 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.366 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.366 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.366 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.366 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.367 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.367 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.367 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.367 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.367 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.367 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.367 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.367 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.367 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.367 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.367 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.367 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.367 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.368 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.368 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.368 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.368 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.368 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.368 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.368 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.368 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.369 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.369 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.369 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.369 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.369 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.369 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.369 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.369 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.369 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.369 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.369 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.369 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.369 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.369 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.370 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.370 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.370 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.370 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.370 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.370 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.370 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.370 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.370 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.370 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.370 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.371 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.371 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.371 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.371 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.371 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.371 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.371 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.371 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.371 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.371 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.371 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.371 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.371 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.371 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.371 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.372 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.372 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.372 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.372 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.372 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.372 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.372 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.372 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.372 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.372 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.372 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.372 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.372 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.372 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.373 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.373 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.373 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.373 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.373 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.373 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.373 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.373 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.373 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.373 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.373 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.373 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.373 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.373 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.374 INFO:teuthology.orchestra.run.smithi044.stdout:____________ ERROR at teardown of test_bucket_policy_another_bucket ____________ 2023-12-03T12:39:15.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.374 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.374 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.374 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.374 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.374 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.374 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.374 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.374 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.374 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.374 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.375 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.375 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.375 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.375 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.375 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.375 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.375 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.375 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.375 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.375 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.375 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.375 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.375 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.375 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.375 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.375 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.375 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.376 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.376 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.376 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.376 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.376 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.376 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.376 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.376 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.376 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.376 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.376 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.376 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.376 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.376 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.376 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.377 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.377 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.377 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.377 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.377 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.377 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.377 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.377 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.377 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.377 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.377 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.377 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.377 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.377 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.377 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.378 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.378 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.378 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.378 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.378 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.378 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.378 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.378 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.378 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.378 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.378 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.378 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.378 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.378 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.378 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.379 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.379 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.379 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.379 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.379 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.379 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.379 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.379 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.379 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.379 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.379 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.379 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.379 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.379 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.379 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.380 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.380 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.380 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.380 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.380 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.380 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.380 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.380 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.380 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.380 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.380 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.380 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.380 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.380 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.380 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.380 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.381 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.381 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.381 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.381 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.381 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.381 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.381 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.381 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.381 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.382 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.382 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.382 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.382 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.382 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.382 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.382 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.382 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.382 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.382 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.382 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.382 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.382 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.382 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.383 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.383 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.383 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.383 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.383 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.383 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.383 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.383 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.383 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.383 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.383 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.383 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.383 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.383 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.383 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.384 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.384 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.384 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.384 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.384 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.384 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.384 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.384 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.384 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.384 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.384 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.384 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.384 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.384 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.384 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.384 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.385 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.385 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.385 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.385 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.385 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.385 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.385 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.385 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.385 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.385 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.385 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.385 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.385 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.386 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.386 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.386 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.386 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.386 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.386 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.386 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.386 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.386 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.386 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.386 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.386 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.386 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.386 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.386 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.387 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.387 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.387 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.387 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.387 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.387 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.387 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.387 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.387 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.387 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.387 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.387 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.387 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.387 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.387 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.387 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.388 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.388 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.388 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.388 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.388 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.388 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.388 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.388 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.388 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.388 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.388 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.388 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.388 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.388 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.388 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.388 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.388 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.389 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.389 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.389 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.389 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.389 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.389 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.389 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.389 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.389 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.389 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.389 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.389 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.389 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.389 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.389 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.390 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.390 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.390 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.390 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.390 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.390 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.390 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.390 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.390 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.390 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.390 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.390 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.390 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.391 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.391 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.391 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.391 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.391 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.391 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.391 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.391 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.391 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.391 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.391 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.391 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.392 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.392 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.392 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.392 INFO:teuthology.orchestra.run.smithi044.stdout:___________ ERROR at teardown of test_bucketv2_policy_another_bucket ___________ 2023-12-03T12:39:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.393 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.393 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.394 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.394 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.394 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.394 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.394 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.394 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.394 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.394 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.394 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.394 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.394 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.394 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.394 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.394 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.397 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.397 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.398 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.398 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.398 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.398 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.399 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.400 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.400 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.400 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.400 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.400 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.400 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.401 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.401 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.401 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.401 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.401 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.401 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.402 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.402 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.402 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.402 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.402 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.402 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.404 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.404 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.404 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.404 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.405 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.405 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.405 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.405 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.405 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.405 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.405 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.406 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.406 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.406 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.406 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.406 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.406 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.406 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.406 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.406 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.406 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.406 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.406 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.406 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.406 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.407 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.407 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.407 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.407 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.407 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.407 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.407 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.407 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.407 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.407 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.407 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.407 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.407 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.407 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.408 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.408 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.408 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.408 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.408 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.408 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.408 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.408 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.408 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.408 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.408 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.408 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.408 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.408 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.408 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.411 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.411 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.411 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.411 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.411 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.411 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.411 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.411 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.411 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.411 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.411 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.412 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.412 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ ERROR at teardown of test_get_obj_tagging ___________________ 2023-12-03T12:39:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.412 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.413 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.413 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.413 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.413 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.413 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.413 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.413 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.413 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.413 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.413 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.413 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.414 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.414 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.414 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.414 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.414 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.414 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.414 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.414 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.414 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.417 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.417 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.417 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.417 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.417 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.417 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.417 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.417 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.417 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.417 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.417 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.417 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.417 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.417 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.417 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.417 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.418 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.418 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.418 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.418 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.418 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.418 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.418 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.418 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.418 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.418 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.418 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.418 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.419 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.419 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.419 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.419 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.419 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.419 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.419 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.419 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.419 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.419 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.419 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.419 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.419 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.419 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.420 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.420 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.420 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.420 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.420 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.420 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.420 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.420 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.420 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.420 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.420 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.420 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.420 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.420 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.420 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.421 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.421 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.421 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.421 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.421 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.421 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.421 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.421 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.421 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.421 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.422 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.422 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.422 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.422 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.422 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.422 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.422 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.422 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.422 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.422 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.422 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.422 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.422 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.422 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.422 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.423 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.423 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.423 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.423 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.423 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.423 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.423 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.423 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.423 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.423 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.423 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.423 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.423 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.423 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.423 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.423 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.423 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.424 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.424 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.424 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.424 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.424 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.424 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.424 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.424 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.424 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.424 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.425 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.425 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.425 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.425 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.425 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.425 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.425 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.425 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.425 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.425 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.425 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.425 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.425 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.425 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.425 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.425 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.426 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.426 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.426 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.426 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.426 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.426 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.426 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.426 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.426 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.426 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.426 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.426 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.426 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.426 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.426 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.426 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.427 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.427 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.427 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.427 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.427 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.427 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.427 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.427 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.427 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.427 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.427 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.427 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.427 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.427 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.428 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.428 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.428 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.428 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.428 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.428 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.428 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.428 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.428 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.428 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.428 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.428 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.428 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.428 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.429 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.429 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.429 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.429 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.429 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.429 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.429 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.429 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.429 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.429 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.429 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.429 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.429 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.429 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.429 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.429 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.430 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.430 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.430 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.430 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.430 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.430 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.430 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.430 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.430 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.430 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.430 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.430 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.430 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.430 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.430 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.431 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.431 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.431 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.431 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.431 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.431 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.431 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.431 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.431 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at teardown of test_get_obj_head_tagging ________________ 2023-12-03T12:39:15.431 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.431 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.431 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.431 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.431 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.431 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.432 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.432 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.432 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.432 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.432 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.432 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.432 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.432 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.432 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.432 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.432 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.432 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.432 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.433 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.433 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.433 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.433 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.433 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.433 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.433 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.433 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.433 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.433 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.433 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.433 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.433 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.433 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.433 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.434 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.434 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.434 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.434 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.434 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.434 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.434 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.434 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.434 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.434 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.434 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.434 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.434 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.434 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.434 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.435 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.435 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.435 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.435 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.435 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.435 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.435 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.435 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.435 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.435 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.435 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.435 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.435 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.436 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.436 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.436 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.436 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.436 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.436 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.436 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.436 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.436 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.436 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.436 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.436 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.436 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.436 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.436 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.437 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.437 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.437 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.437 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.437 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.437 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.437 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.437 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.437 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.437 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.437 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.437 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.437 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.437 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.437 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.437 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.438 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.438 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.438 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.438 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.438 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.438 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.438 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.438 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.438 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.438 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.438 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.438 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.438 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.438 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.439 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.439 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.439 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.439 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.439 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.439 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.439 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.439 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.439 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.439 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.439 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.439 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.439 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.439 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.439 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.439 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.440 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.440 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.440 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.440 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.440 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.440 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.440 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.440 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.440 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.440 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.440 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.440 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.440 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.440 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.440 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.440 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.440 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.441 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.441 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.441 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.441 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.441 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.441 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.441 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.441 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.441 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.441 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.441 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.441 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.441 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.442 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.442 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.442 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.442 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.442 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.442 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.442 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.443 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.443 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.443 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.443 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.443 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.443 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.443 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.443 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.443 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.444 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.444 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.444 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.444 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.444 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.444 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.444 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.444 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.444 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.445 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.445 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.445 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.445 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.445 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.445 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.445 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.445 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.445 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.445 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.446 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.446 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.446 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.446 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.446 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.446 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.447 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.447 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.447 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.447 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.447 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.447 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.447 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.448 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.448 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.448 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.448 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.448 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.448 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.449 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.449 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.449 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.449 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.449 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.449 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.449 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.449 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.449 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.449 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.449 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.450 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.450 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.450 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.450 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.450 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.450 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.450 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.450 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.450 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.451 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.451 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.451 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.451 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.451 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.451 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.451 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.451 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.451 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.451 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.451 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.451 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.451 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.451 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.452 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.452 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.452 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.452 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.452 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.452 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.452 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.452 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.452 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.452 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.452 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.452 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.452 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.452 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.452 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.452 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.453 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.453 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.453 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.453 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.453 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.453 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.453 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.453 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.453 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.453 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.453 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.453 INFO:teuthology.orchestra.run.smithi044.stdout:____________________ ERROR at teardown of test_put_max_tags ____________________ 2023-12-03T12:39:15.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.454 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.454 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.454 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.454 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.454 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.454 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.454 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.454 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.454 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.454 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.454 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.454 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.454 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.455 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.455 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.455 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.455 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.455 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.455 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.455 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.455 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.455 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.455 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.455 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.456 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.456 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.456 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.456 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.456 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.456 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.456 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.456 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.456 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.456 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.456 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.456 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.456 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.456 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.456 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.457 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.457 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.457 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.457 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.457 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.457 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.457 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.457 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.457 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.457 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.457 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.457 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.457 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.457 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.457 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.457 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.458 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.458 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.458 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.458 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.458 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.458 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.458 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.458 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.458 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.458 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.458 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.459 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.459 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.459 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.459 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.459 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.459 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.459 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.459 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.459 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.459 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.459 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.459 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.459 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.459 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.459 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.459 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.459 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.460 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.460 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.460 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.460 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.460 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.460 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.460 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.460 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.460 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.460 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.460 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.460 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.460 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.460 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.460 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.460 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.461 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.461 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.461 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.461 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.461 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.461 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.461 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.461 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.461 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.461 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.461 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.461 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.461 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.462 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.462 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.462 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.462 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.462 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.462 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.462 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.462 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.462 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.462 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.462 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.462 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.462 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.462 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.462 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.462 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.463 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.463 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.463 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.463 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.463 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.463 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.463 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.463 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.463 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.463 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.463 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.463 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.463 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.464 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.464 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.464 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.464 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.464 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.464 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.464 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.464 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.464 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.464 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.464 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.464 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.465 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.465 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.465 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.465 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.465 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.465 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.465 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.465 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.465 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.465 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.465 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.465 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.466 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.466 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.466 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.466 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.466 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.466 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.466 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.466 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.466 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.466 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.466 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.466 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.467 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.467 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.467 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.467 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.467 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.467 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.467 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.467 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.467 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.467 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.467 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.467 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.467 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.467 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.467 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.467 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.468 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.468 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.468 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.468 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.468 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.468 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.468 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.468 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.468 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.468 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.468 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.468 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.468 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.468 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.469 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.469 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.469 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.469 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.469 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.469 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.469 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.469 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.469 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.469 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.469 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.469 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.470 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.470 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.470 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.470 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.470 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.470 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.470 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.470 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.470 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.470 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.471 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.471 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.471 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.471 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.471 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.471 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.471 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.471 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.471 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.471 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.471 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.471 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.471 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.471 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.472 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.472 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.472 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.472 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.472 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.472 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.472 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.472 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.472 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.472 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.472 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.472 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.472 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.472 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.472 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.473 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.473 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.473 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ ERROR at teardown of test_put_excess_tags ___________________ 2023-12-03T12:39:15.473 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.473 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.473 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.473 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.473 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.473 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.473 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.473 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.473 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.473 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.473 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.473 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.474 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.474 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.474 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.474 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.474 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.474 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.474 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.474 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.474 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.474 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.474 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.474 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.474 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.474 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.474 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.475 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.475 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.475 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.475 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.475 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.475 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.475 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.475 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.475 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.475 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.475 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.475 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.475 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.475 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.475 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.476 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.476 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.476 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.476 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.476 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.476 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.476 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.476 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.476 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.476 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.476 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.476 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.476 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.476 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.477 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.477 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.477 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.477 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.477 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.477 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.477 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.477 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.477 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.477 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.477 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.477 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.478 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.478 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.478 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.478 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.478 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.478 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.478 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.478 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.478 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.478 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.478 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.478 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.478 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.478 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.479 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.479 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.479 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.479 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.479 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.479 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.479 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.479 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.479 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.479 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.479 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.479 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.479 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.479 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.479 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.479 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.480 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.480 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.480 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.480 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.480 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.480 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.480 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.480 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.480 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.480 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.480 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.480 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.480 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.480 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.480 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.481 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.481 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.481 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.481 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.481 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.481 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.481 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.481 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.481 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.481 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.481 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.481 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.481 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.481 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.481 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.481 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.481 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.482 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.482 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.482 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.482 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.482 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.482 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.482 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.482 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.482 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.482 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.482 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.482 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.483 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.483 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.483 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.483 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.483 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.483 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.483 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.483 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.483 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.483 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.483 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.483 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.484 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.484 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.484 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.484 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.484 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.484 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.484 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.484 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.484 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.484 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.484 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.484 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.484 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.484 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.485 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.485 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.485 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.485 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.485 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.485 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.485 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.485 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.485 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.485 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.485 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.485 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.486 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.486 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.486 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.486 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.486 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.486 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.486 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.486 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.486 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.486 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.486 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.486 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.486 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.486 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.487 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.487 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.487 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.487 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.487 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.487 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.487 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.487 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.487 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.487 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.487 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.487 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.487 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.487 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.487 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.488 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.488 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.488 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.488 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.488 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.488 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.488 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.488 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.488 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.488 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.488 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.488 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.488 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.488 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.489 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.489 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.489 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.489 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.489 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.489 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.489 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.489 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.489 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.489 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.489 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.489 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.489 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.489 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.489 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.489 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.490 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.490 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.490 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.490 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.490 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.490 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.490 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.490 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.490 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.490 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.490 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.490 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.490 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.490 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.490 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.491 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.491 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.491 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.491 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.491 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.491 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.491 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.491 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.491 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.491 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.491 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.491 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.492 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.492 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.492 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.492 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.492 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.492 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at teardown of test_put_max_kvsize_tags _________________ 2023-12-03T12:39:15.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.492 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.492 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.492 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.492 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.492 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.493 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.493 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.493 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.493 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.493 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.493 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.493 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.493 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.493 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.493 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.493 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.493 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.493 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.494 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.494 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.494 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.494 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.494 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.494 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.494 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.494 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.494 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.494 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.494 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.494 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.494 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.494 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.495 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.495 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.495 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.495 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.495 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.495 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.495 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.495 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.495 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.495 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.495 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.495 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.495 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.495 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.495 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.495 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.496 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.496 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.496 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.496 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.496 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.496 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.496 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.496 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.496 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.496 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.496 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.496 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.496 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.497 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.497 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.497 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.497 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.497 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.497 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.497 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.497 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.497 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.497 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.497 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.497 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.497 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.497 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.497 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.497 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.497 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.498 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.498 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.498 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.498 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.498 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.498 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.498 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.498 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.498 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.498 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.498 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.498 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.498 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.498 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.498 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.498 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.499 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.499 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.499 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.499 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.499 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.499 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.499 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.499 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.499 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.499 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.499 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.499 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.499 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.499 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.500 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.500 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.500 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.500 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.500 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.500 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.500 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.500 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.500 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.500 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.500 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.500 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.500 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.501 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.501 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.501 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.501 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.501 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.501 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.501 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.501 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.501 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.501 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.501 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.501 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.501 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.502 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.502 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.502 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.502 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.502 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.502 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.502 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.502 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.502 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.502 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.502 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.502 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.502 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.502 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.503 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.503 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.503 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.503 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.503 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.503 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.503 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.503 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.503 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.503 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.503 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.503 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.503 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.503 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.504 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.504 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.504 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.504 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.504 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.504 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.504 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.504 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.504 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.504 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.504 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.504 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.504 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.504 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.504 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.504 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.505 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.505 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.505 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.505 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.505 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.505 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.505 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.505 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.505 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.505 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.505 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.505 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.505 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.505 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.505 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.505 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.506 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.506 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.506 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.506 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.506 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.506 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.506 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.506 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.506 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.506 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.506 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.506 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.506 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.506 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.506 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.506 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.507 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.507 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.507 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.507 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.507 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.507 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.507 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.507 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.507 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.507 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.507 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.507 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.507 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.507 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.508 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.508 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.508 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.508 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.508 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.508 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.508 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.508 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.508 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.508 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.508 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.508 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.508 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.508 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.508 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.509 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.509 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.509 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.509 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.509 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.509 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.509 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.509 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.509 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.509 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.509 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.509 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.509 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.509 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.509 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.509 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.510 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.510 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.510 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.510 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.510 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.510 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.510 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.510 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.510 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.510 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.510 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.510 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.510 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.510 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.511 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.511 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.511 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.511 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.511 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.511 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.511 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.511 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.511 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.511 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.511 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.512 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at teardown of test_put_excess_key_tags _________________ 2023-12-03T12:39:15.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.512 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.512 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.512 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.512 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.512 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.512 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.512 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.512 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.512 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.513 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.513 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.513 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.513 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.513 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.513 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.513 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.513 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.513 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.513 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.513 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.514 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.514 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.514 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.514 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.514 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.514 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.514 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.514 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.514 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.514 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.514 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.514 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.514 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.514 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.514 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.514 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.515 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.515 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.515 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.515 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.515 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.515 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.515 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.515 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.515 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.515 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.515 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.515 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.516 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.516 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.516 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.516 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.516 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.516 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.516 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.516 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.516 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.516 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.516 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.516 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.516 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.517 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.517 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.517 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.517 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.517 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.517 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.517 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.517 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.517 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.517 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.517 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.517 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.517 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.517 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.517 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.518 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.518 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.518 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.518 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.518 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.518 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.518 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.518 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.518 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.518 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.518 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.518 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.518 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.519 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.519 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.519 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.519 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.519 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.519 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.519 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.519 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.519 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.519 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.519 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.519 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.519 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.519 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.519 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.519 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.520 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.520 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.520 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.520 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.520 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.520 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.520 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.520 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.520 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.520 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.520 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.520 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.520 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.521 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.521 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.521 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.521 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.521 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.521 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.521 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.521 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.521 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.521 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.522 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.522 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.522 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.522 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.522 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.522 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.522 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.522 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.522 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.522 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.522 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.522 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.522 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.522 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.523 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.523 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.523 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.523 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.523 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.523 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.523 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.523 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.523 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.523 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.523 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.523 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.523 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.523 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.523 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.523 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.523 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.524 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.524 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.524 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.524 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.524 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.524 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.524 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.524 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.525 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.525 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.525 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.525 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.525 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.525 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.525 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.525 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.525 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.525 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.525 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.525 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.525 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.525 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.525 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.526 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.526 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.526 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.526 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.526 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.526 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.526 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.526 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.526 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.526 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.526 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.526 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.526 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.526 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.527 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.527 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.527 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.527 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.527 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.527 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.527 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.528 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.528 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.528 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.528 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.530 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.530 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.530 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.530 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.530 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.530 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.530 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.530 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.530 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.530 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.532 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.532 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.532 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.532 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.532 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.532 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at teardown of test_put_excess_val_tags _________________ 2023-12-03T12:39:15.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.532 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.532 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.532 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.533 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.534 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.534 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.534 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.534 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.534 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.534 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.534 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.534 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.534 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.534 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.534 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.534 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.534 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.534 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.537 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.538 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.538 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.538 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.538 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.538 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.538 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.538 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.538 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.538 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.538 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.539 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.540 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.540 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.540 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.540 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.540 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.541 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.541 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.541 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.541 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.541 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.541 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.541 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.541 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.541 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.541 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.541 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.541 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.541 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.541 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.542 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.542 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.542 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.542 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.542 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.542 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.542 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.542 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.542 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.542 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.542 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.542 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.542 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.542 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.544 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.544 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.544 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.545 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.545 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.545 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.545 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.545 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.545 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.545 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.545 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.545 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.545 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.545 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.545 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.545 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.545 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.545 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.546 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.546 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.546 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.546 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.546 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.546 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.546 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.546 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.546 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.546 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.546 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.546 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.546 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.546 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.547 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.547 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.547 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.547 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.547 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.547 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.547 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.547 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.547 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.547 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.547 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.547 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.547 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.547 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.547 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.548 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.548 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.548 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.548 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.548 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.548 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.548 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.548 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.548 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.548 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.548 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.548 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.552 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.552 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.552 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.552 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ ERROR at teardown of test_put_modify_tags ___________________ 2023-12-03T12:39:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.552 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.553 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.553 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.553 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.554 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.554 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.554 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.554 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.557 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.557 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.557 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.558 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.558 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.558 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.559 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.560 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.560 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.560 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.560 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.560 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.560 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.561 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.561 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.561 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.561 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.561 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.561 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.561 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.561 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.561 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.561 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.561 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.561 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.561 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.561 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.562 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.562 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.562 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.562 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.562 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.562 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.562 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.562 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.562 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.562 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.562 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.562 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.564 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.564 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.564 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.564 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.565 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.565 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.565 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.565 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.565 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.565 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.565 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.565 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.565 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.565 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.565 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.565 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.565 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.565 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.565 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.566 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.566 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.566 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.566 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.566 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.566 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.566 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.566 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.566 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.567 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.567 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.567 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.567 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.567 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.567 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.567 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.567 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.567 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.567 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.567 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.567 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.567 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.567 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.567 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.567 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.568 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.568 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.568 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.568 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.568 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.568 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.568 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.568 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.568 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.568 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.569 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.569 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.569 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.569 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.570 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.570 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.570 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.570 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.570 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.570 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.570 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.573 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.573 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.574 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.574 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ ERROR at teardown of test_put_delete_tags ___________________ 2023-12-03T12:39:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.574 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.575 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.575 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.575 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.575 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.576 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.579 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.579 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.579 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.579 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.579 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.580 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.581 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.581 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.581 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.582 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.582 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.582 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.582 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.582 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.582 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.582 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.582 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.582 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.582 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.582 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.582 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.582 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.582 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.583 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.583 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.583 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.583 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.583 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.583 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.583 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.583 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.583 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.583 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.583 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.583 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.583 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.584 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.585 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.585 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.586 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.586 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.586 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.586 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.586 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.586 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.586 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.586 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.586 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.587 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.587 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.587 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.587 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.587 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.587 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.587 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.587 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.587 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.587 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.587 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.587 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.587 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.587 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.587 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.587 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.588 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.588 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.588 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.588 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.588 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.588 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.588 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.588 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.588 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.588 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.588 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.588 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.588 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.588 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.588 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.588 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.589 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.589 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.589 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.589 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.589 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.589 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.589 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.593 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.593 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.593 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.593 INFO:teuthology.orchestra.run.smithi044.stdout:_________ ERROR at teardown of test_post_object_tags_anonymous_request _________ 2023-12-03T12:39:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.593 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.594 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.594 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.594 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.594 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.594 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.594 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.594 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.598 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.598 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.598 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.598 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.598 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.598 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.599 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.600 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.601 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.601 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.601 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.601 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.601 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.601 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.601 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.602 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.602 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.602 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.602 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.602 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.602 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.602 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.604 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.604 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.604 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.605 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.605 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.605 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.605 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.605 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.605 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.605 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.606 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.608 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.608 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.608 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.608 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.608 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.611 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.611 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.612 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.612 INFO:teuthology.orchestra.run.smithi044.stdout:_______ ERROR at teardown of test_post_object_tags_authenticated_request _______ 2023-12-03T12:39:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.612 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.613 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.613 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.613 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.614 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.614 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.617 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.617 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.617 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.617 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.617 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.617 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.617 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.617 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.617 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.617 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.617 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.619 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.619 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.619 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.620 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.620 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.620 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.620 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.620 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.620 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.620 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.620 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.621 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.621 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.621 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.621 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.621 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.621 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.621 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.621 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.621 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.621 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.621 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.621 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.621 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.621 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.621 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.622 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.623 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.624 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.624 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.624 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.624 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.624 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.624 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.624 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.624 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.624 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.624 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.624 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.625 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.625 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.625 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.625 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.625 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.625 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.625 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.625 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.625 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.625 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.626 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.626 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.626 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.626 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.626 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.626 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.626 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.626 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.627 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.627 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.627 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.627 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.627 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.627 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.627 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.630 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.630 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.630 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.631 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ ERROR at teardown of test_put_obj_with_tags __________________ 2023-12-03T12:39:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.631 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.632 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.632 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.632 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.632 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.632 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.632 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.632 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.632 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.632 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.632 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.632 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.632 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.632 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.632 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.632 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.632 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.636 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.636 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.636 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.636 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.636 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.636 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.636 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.636 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.636 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.636 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.638 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.638 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.638 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.638 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.639 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.639 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.639 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.639 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.639 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.639 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.639 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.639 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.639 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.640 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.640 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.640 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.640 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.640 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.640 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.640 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.642 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.642 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.642 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.643 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.643 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.643 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.643 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.643 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.643 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.643 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.643 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.644 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.644 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.644 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.644 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.644 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.644 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.644 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.644 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.644 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.644 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.644 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.644 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.644 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.644 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.644 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.645 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.645 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.645 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.645 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.645 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.645 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.645 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.645 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.645 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.646 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.646 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.646 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.646 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.646 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.646 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.646 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.646 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.650 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.650 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.650 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.650 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at teardown of test_get_tags_acl_public _________________ 2023-12-03T12:39:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.650 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.651 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.651 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.651 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.651 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.651 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.651 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.651 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.651 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.651 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.651 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.651 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.651 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.651 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.651 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.652 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.652 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.652 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.652 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.652 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.652 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.652 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.652 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.652 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.652 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.652 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.652 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.652 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.652 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.652 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.652 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.653 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.653 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.653 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.653 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.653 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.653 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.653 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.653 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.653 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.653 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.653 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.653 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.653 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.653 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.653 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.653 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.654 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.654 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.654 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.654 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.654 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.654 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.654 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.654 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.654 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.654 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.654 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.654 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.654 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.654 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.654 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.655 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.655 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.655 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.655 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.655 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.655 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.655 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.655 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.655 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.655 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.656 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.656 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.656 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.656 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.656 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.656 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.656 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.656 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.656 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.656 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.656 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.656 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.656 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.656 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.656 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.657 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.657 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.657 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.657 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.657 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.657 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.657 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.657 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.657 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.657 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.657 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.657 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.657 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.657 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.657 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.657 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.658 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.658 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.658 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.658 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.658 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.658 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.658 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.658 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.658 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.658 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.658 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.658 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.658 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.659 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.659 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.659 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.659 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.659 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.659 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.659 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.659 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.659 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.659 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.659 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.659 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.659 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.659 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.660 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.660 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.660 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.660 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.660 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.660 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.660 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.660 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.660 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.660 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.660 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.660 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.660 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.660 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.660 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.660 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.660 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.661 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.661 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.661 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.661 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.661 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.661 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.661 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.661 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.661 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.661 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.661 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.661 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.661 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.661 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.661 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.661 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.661 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.662 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.662 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.662 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.662 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.662 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.662 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.662 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.662 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.662 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.662 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.663 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.663 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.663 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.663 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.663 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.663 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.663 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.663 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.663 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.663 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.663 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.663 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.663 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.663 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.663 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.663 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.664 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.664 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.664 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.664 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.664 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.664 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.664 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.664 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.665 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.665 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.665 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.665 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.665 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.665 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.665 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.665 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.665 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.665 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.665 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.665 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.666 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.666 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.666 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.666 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.666 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.666 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.666 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.666 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.666 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.666 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.666 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.666 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.666 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.666 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.666 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.667 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.667 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.667 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.667 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.667 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.667 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.667 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.667 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.667 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.667 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.667 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.667 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.667 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.667 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.668 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.668 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.668 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.668 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.668 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.668 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.668 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.668 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.668 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.668 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.668 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.668 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.668 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.668 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.668 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.668 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.669 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.669 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at teardown of test_put_tags_acl_public _________________ 2023-12-03T12:39:15.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.669 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.669 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.669 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.669 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.669 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.669 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.669 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.669 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.669 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.669 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.670 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.670 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.670 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.670 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.670 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.670 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.670 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.670 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.670 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.670 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.670 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.670 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.670 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.671 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.671 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.671 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.671 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.671 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.671 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.671 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.671 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.671 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.671 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.671 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.671 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.671 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.671 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.672 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.672 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.672 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.672 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.672 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.672 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.672 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.672 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.672 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.672 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.672 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.672 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.672 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.672 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.672 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.673 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.673 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.673 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.673 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.673 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.673 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.673 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.673 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.673 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.673 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.673 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.673 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.673 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.674 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.674 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.674 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.674 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.674 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.674 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.674 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.674 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.674 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.674 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.675 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.675 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.675 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.675 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.675 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.675 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.675 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.675 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.675 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.675 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.675 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.675 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.675 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.675 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.675 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.676 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.676 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.676 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.676 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.676 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.676 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.676 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.676 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.676 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.676 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.676 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.676 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.676 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.677 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.677 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.677 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.677 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.677 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.677 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.677 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.677 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.677 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.677 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.677 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.677 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.677 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.677 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.677 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.678 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.678 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.678 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.678 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.678 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.678 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.678 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.678 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.678 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.678 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.678 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.678 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.678 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.678 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.679 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.679 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.679 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.679 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.679 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.679 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.679 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.679 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.679 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.679 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.679 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.679 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.679 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.679 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.679 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.680 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.680 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.680 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.680 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.680 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.680 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.680 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.680 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.680 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.680 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.680 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.680 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.680 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.680 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.680 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.681 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.681 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.681 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.681 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.681 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.681 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.681 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.681 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.681 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.681 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.682 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.682 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.682 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.682 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.682 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.682 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.682 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.682 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.682 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.682 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.682 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.682 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.682 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.682 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.682 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.682 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.682 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.683 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.683 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.683 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.683 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.683 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.683 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.683 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.683 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.683 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.683 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.683 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.683 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.683 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.683 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.684 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.684 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.684 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.684 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.684 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.684 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.684 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.685 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.685 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.685 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.685 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.685 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.685 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.685 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.685 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.685 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.685 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.685 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.685 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.685 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.685 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.685 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.685 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.686 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.686 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.686 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.686 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.686 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.686 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.686 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.686 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.686 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.686 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.686 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.686 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.686 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.686 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.686 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.686 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.687 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.687 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.687 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.687 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.687 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.687 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.687 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.687 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.687 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.687 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.687 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.687 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.687 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.687 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.688 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.688 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.688 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.688 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.688 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.688 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.688 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.688 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.688 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ ERROR at teardown of test_delete_tags_obj_public _______________ 2023-12-03T12:39:15.688 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.688 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.688 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.688 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.688 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.688 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.689 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.689 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.689 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.689 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.689 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.689 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.689 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.689 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.689 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.689 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.689 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.689 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.689 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.689 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.690 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.690 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.690 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.690 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.690 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.690 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.690 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.690 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.690 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.690 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.690 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.690 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.690 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.690 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.690 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.691 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.691 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.691 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.691 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.691 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.691 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.691 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.691 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.691 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.691 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.691 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.691 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.691 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.692 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.692 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.692 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.692 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.692 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.692 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.692 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.692 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.692 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.692 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.693 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.693 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.693 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.693 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.693 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.693 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.693 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.693 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.693 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.693 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.693 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.693 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.693 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.693 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.694 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.694 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.694 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.694 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.694 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.694 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.694 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.694 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.694 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.694 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.694 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.695 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.695 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.695 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.695 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.695 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.695 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.695 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.695 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.695 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.695 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.695 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.695 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.695 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.695 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.695 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.695 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.696 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.696 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.696 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.696 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.696 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.696 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.696 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.696 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.696 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.696 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.696 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.696 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.696 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.696 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.696 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.696 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.697 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.697 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.697 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.697 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.697 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.697 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.697 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.697 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.697 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.697 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.697 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.697 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.697 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.697 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.697 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.697 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.698 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.698 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.698 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.698 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.698 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.698 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.698 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.698 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.698 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.698 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.698 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.700 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.700 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.700 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.700 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.700 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.700 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.700 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.700 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.700 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.700 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.700 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.700 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.700 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.700 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.701 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.701 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.701 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.701 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.701 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.701 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.701 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.701 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.701 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.701 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.701 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.701 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.702 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.702 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.702 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.702 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.702 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.702 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.702 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.702 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.703 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.703 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.703 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.703 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.703 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.703 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.703 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.703 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.703 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.703 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.703 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.703 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.704 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.704 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.704 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.704 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.704 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.704 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.704 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.704 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.704 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.704 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.704 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.704 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.704 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.704 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.705 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.705 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.705 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.705 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.705 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.705 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.705 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.705 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.705 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.705 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.705 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.705 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.705 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.705 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.705 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.705 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.706 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.706 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.706 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.706 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.706 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.706 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.706 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.706 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.706 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.706 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.706 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.706 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.706 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.706 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.707 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.707 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.707 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.707 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.707 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.707 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.707 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.707 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.707 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.707 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.707 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.707 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.707 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.707 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.707 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.707 INFO:teuthology.orchestra.run.smithi044.stdout:_ ERROR at teardown of test_versioning_bucket_atomic_upload_return_version_id __ 2023-12-03T12:39:15.708 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.708 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.708 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.708 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.708 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.708 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.708 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.708 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.708 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.708 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.708 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.708 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.708 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.708 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.708 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.708 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.709 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.709 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.709 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.709 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.709 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.709 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.709 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.709 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.709 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.709 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.709 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.709 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.710 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.710 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.710 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.710 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.710 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.710 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.710 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.710 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.710 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.710 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.710 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.710 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.710 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.710 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.710 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.710 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.711 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.711 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.711 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.711 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.711 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.711 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.711 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.711 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.711 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.711 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.711 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.711 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.711 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.711 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.712 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.712 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.712 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.712 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.712 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.712 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.712 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.712 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.712 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.712 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.712 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.713 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.713 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.713 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.713 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.713 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.713 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.713 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.713 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.713 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.714 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.714 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.714 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.714 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.714 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.714 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.714 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.714 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.714 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.714 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.714 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.714 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.714 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.714 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.715 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.715 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.715 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.715 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.715 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.715 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.715 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.715 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.715 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.715 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.715 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.715 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.715 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.716 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.716 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.716 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.716 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.716 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.716 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.716 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.716 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.716 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.716 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.716 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.716 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.716 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.716 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.716 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.716 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.717 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.717 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.717 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.717 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.717 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.717 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.717 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.717 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.717 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.717 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.717 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.717 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.717 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.717 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.717 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.718 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.718 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.718 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.718 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.718 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.718 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.718 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.718 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.718 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.718 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.719 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.719 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.719 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.719 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.719 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.719 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.719 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.719 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.719 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.719 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.719 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.719 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.719 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.720 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.720 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.720 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.720 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.720 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.720 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.720 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.720 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.720 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.720 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.720 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.720 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.720 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.720 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.720 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.721 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.721 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.721 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.721 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.721 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.721 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.721 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.721 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.721 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.721 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.721 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.721 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.721 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.721 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.721 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.721 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.722 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.722 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.722 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.722 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.722 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.722 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.722 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.723 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.723 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.723 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.723 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.723 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.723 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.723 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.723 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.723 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.723 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.723 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.723 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.723 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.723 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.723 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.723 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.723 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.724 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.724 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.724 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.724 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.724 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.724 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.724 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.724 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.724 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.724 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.724 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.724 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.724 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.724 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.725 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.725 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.725 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.725 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.725 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.725 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.725 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.725 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.725 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.725 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.725 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.725 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.725 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.725 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.725 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.725 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.725 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.726 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.726 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.726 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.726 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.726 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.726 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.726 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.726 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.726 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.726 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.726 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.726 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.726 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.726 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.726 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.727 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.727 INFO:teuthology.orchestra.run.smithi044.stdout:_ ERROR at teardown of test_versioning_bucket_multipart_upload_return_version_id _ 2023-12-03T12:39:15.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.727 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.727 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.727 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.727 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.727 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.727 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.727 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.727 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.728 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.728 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.728 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.728 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.728 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.728 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.728 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.728 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.728 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.728 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.728 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.729 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.729 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.729 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.729 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.729 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.729 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.729 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.729 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.729 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.729 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.729 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.729 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.729 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.729 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.729 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.730 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.730 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.730 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.730 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.730 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.730 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.730 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.731 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.731 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.731 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.731 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.731 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.731 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.731 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.731 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.731 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.731 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.731 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.731 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.731 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.731 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.731 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.732 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.732 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.732 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.732 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.732 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.732 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.732 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.732 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.732 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.732 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.732 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.732 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.732 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.732 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.732 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.732 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.733 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.733 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.733 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.733 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.733 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.733 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.733 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.733 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.733 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.733 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.733 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.733 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.733 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.734 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.734 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.734 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.734 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.734 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.734 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.734 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.734 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.734 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.734 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.734 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.734 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.734 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.735 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.735 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.735 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.735 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.735 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.735 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.735 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.735 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.735 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.735 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.735 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.735 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.735 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.735 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.735 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.736 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.736 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.736 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.736 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.736 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.736 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.736 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.736 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.736 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.736 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.736 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.736 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.736 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.736 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.736 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.736 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.737 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.737 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.737 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.737 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.737 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.737 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.737 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.737 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.737 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.737 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.737 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.737 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.737 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.737 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.738 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.738 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.738 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.738 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.738 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.738 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.738 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.738 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.738 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.738 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.738 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.738 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.739 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.739 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.739 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.739 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.739 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.739 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.739 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.739 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.739 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.739 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.739 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.739 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.740 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.740 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.740 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.740 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.740 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.740 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.740 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.740 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.740 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.740 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.740 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.740 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.740 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.740 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.740 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.740 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.741 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.741 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.741 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.741 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.741 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.741 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.741 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.742 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.742 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.742 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.742 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.742 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.742 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.742 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.742 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.742 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.742 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.742 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.742 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.742 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.742 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.742 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.743 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.743 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.743 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.743 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.743 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.743 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.743 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.743 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.743 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.743 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.743 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.743 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.743 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.743 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.744 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.744 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.744 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.744 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.744 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.744 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.744 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.744 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.744 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.744 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.744 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.744 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.744 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.744 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.744 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.745 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.745 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.745 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.745 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.745 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.745 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.745 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.745 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.745 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.745 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.745 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.745 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.745 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.745 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.745 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.745 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.745 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.746 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.746 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.746 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.746 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.746 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.746 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.746 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.746 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.746 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.746 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.747 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.747 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.747 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.747 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.747 INFO:teuthology.orchestra.run.smithi044.stdout:_________ ERROR at teardown of test_bucket_policy_get_obj_existing_tag _________ 2023-12-03T12:39:15.747 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.747 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.747 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.747 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.747 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.747 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.747 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.747 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.747 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.748 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.748 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.748 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.748 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.748 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.748 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.748 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.748 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.748 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.748 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.748 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.748 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.748 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.748 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.748 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.749 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.749 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.749 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.749 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.749 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.749 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.749 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.749 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.749 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.749 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.749 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.749 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.749 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.749 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.749 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.749 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.750 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.750 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.750 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.750 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.750 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.750 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.750 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.750 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.750 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.750 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.750 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.750 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.750 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.750 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.751 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.751 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.751 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.751 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.751 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.751 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.751 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.751 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.751 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.751 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.751 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.751 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.751 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.752 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.752 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.752 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.752 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.752 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.752 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.752 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.752 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.752 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.752 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.752 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.752 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.752 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.752 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.752 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.752 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.752 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.753 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.753 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.753 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.753 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.753 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.753 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.753 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.753 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.753 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.753 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.753 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.753 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.753 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.753 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.753 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.754 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.754 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.754 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.754 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.754 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.754 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.754 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.754 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.754 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.754 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.754 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.754 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.754 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.754 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.754 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.754 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.755 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.755 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.755 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.755 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.755 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.755 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.755 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.755 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.755 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.755 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.755 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.755 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.755 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.755 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.756 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.756 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.756 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.756 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.756 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.756 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.756 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.756 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.756 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.756 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.756 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.756 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.756 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.756 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.756 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.757 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.757 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.757 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.757 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.757 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.757 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.757 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.757 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.757 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.757 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.757 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.757 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.758 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.758 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.758 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.758 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.758 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.758 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.758 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.758 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.758 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.758 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.758 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.758 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.758 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.758 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.758 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.759 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.759 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.759 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.759 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.759 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.759 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.759 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.759 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.759 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.759 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.759 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.760 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.760 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.760 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.760 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.760 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.760 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.760 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.760 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.760 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.760 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.760 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.760 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.760 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.760 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.760 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.760 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.761 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.761 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.761 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.761 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.761 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.761 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.761 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.761 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.761 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.761 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.761 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.761 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.761 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.761 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.761 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.762 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.762 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.762 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.762 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.762 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.762 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.762 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.762 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.762 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.762 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.762 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.762 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.763 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.763 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.763 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.763 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.763 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.763 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.763 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.763 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.763 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.763 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.763 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.763 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.763 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.763 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.763 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.763 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.764 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.764 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.764 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.764 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.764 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.764 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.764 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.764 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.764 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.764 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.764 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.764 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.764 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.764 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.764 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.765 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.765 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.765 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.765 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.765 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.765 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.765 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.765 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.765 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.765 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.765 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.765 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.765 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.765 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.765 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.766 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.766 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.766 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.766 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.766 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.766 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.766 INFO:teuthology.orchestra.run.smithi044.stdout:_____ ERROR at teardown of test_bucket_policy_get_obj_tagging_existing_tag _____ 2023-12-03T12:39:15.766 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.766 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.766 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.766 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.766 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.766 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.766 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.766 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.767 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.767 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.767 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.767 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.767 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.767 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.767 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.767 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.767 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.767 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.767 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.767 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.767 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.767 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.768 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.768 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.768 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.768 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.768 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.768 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.768 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.768 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.768 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.768 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.768 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.768 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.768 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.768 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.768 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.768 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.769 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.769 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.769 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.769 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.769 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.769 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.769 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.769 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.769 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.769 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.769 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.769 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.769 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.770 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.770 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.770 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.770 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.770 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.770 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.770 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.770 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.770 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.770 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.770 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.770 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.770 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.770 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.770 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.771 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.771 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.771 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.771 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.771 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.771 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.771 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.771 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.771 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.772 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.772 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.772 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.772 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.772 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.772 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.772 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.772 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.772 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.772 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.772 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.772 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.772 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.772 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.772 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.773 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.773 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.773 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.773 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.773 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.773 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.773 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.773 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.773 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.773 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.773 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.773 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.773 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.774 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.774 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.774 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.774 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.774 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.774 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.774 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.774 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.774 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.774 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.774 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.774 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.774 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.774 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.775 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.775 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.775 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.775 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.775 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.775 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.775 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.775 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.775 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.775 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.775 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.775 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.776 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.776 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.776 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.776 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.776 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.776 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.776 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.776 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.776 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.776 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.776 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.777 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.777 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.777 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.777 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.777 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.777 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.777 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.777 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.777 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.777 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.777 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.777 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.777 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.777 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.777 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.777 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.777 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.778 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.778 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.778 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.778 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.778 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.778 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.778 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.778 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.778 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.778 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.778 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.778 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.778 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.778 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.779 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.779 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.779 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.779 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.779 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.779 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.779 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.779 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.779 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.779 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.779 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.779 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.779 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.779 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.779 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.779 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.779 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.780 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.780 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.780 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.780 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.780 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.780 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.780 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.780 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.780 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.780 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.780 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.780 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.780 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.780 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.780 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.781 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.781 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.781 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.781 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.781 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.781 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.781 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.781 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.781 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.781 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.781 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.781 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.781 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.781 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.781 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.781 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.782 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.782 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.782 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.782 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.782 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.782 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.782 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.782 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.782 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.782 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.782 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.782 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.782 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.785 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.785 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.785 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.785 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.785 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.785 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.785 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.785 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.785 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.785 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.785 INFO:teuthology.orchestra.run.smithi044.stdout:_____ ERROR at teardown of test_bucket_policy_put_obj_tagging_existing_tag _____ 2023-12-03T12:39:15.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.786 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.786 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.786 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.786 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.786 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.786 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.786 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.786 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.786 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.786 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.787 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.787 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.787 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.787 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.787 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.787 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.787 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.787 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.787 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.787 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.787 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.787 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.787 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.787 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.787 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.788 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.788 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.788 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.788 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.788 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.788 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.788 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.788 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.788 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.788 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.788 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.788 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.788 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.788 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.788 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.788 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.788 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.789 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.789 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.789 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.789 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.789 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.789 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.789 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.789 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.789 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.789 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.789 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.789 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.789 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.789 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.789 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.790 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.790 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.790 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.790 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.790 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.790 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.790 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.790 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.790 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.790 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.790 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.790 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.790 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.790 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.791 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.791 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.791 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.791 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.791 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.791 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.791 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.791 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.791 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.791 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.791 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.791 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.791 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.791 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.791 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.791 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.792 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.792 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.792 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.792 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.792 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.792 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.792 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.792 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.792 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.792 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.792 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.792 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.792 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.793 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.793 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.793 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.793 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.793 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.793 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.793 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.793 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.793 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.793 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.793 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.793 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.793 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.793 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.793 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.793 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.793 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.794 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.794 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.794 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.794 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.794 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.794 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.794 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.794 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.794 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.794 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.794 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.794 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.794 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.794 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.794 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.795 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.795 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.795 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.795 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.795 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.795 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.797 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.797 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.797 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.797 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.797 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.798 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.798 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.798 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.798 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.798 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.798 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.798 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.798 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.798 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.798 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.798 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.798 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.798 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.798 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.798 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.799 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.799 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.799 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.799 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.799 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.799 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.799 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.799 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.799 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.799 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.799 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.799 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.799 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.799 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.799 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.799 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.800 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.800 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.800 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.800 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.800 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.800 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.800 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.800 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.800 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.800 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.800 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.800 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.800 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.800 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.800 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.800 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.801 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.801 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.801 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.801 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.801 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.801 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.801 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.801 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.801 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.801 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.801 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.801 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.801 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.802 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.802 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.802 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.802 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.802 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.802 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.802 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.802 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.802 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.802 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.802 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.802 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.802 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.802 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.802 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.803 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.803 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.803 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.803 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.803 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.803 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.803 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.803 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.803 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.803 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.803 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.803 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.803 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.803 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.803 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.804 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.804 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.804 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.804 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.804 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.804 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.804 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.804 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.804 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.804 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.804 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.804 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.804 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.804 INFO:teuthology.orchestra.run.smithi044.stdout:_________ ERROR at teardown of test_bucket_policy_put_obj_copy_source __________ 2023-12-03T12:39:15.804 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.805 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.805 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.805 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.805 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.805 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.805 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.805 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.805 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.805 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.805 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.806 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.806 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.806 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.806 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.806 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.806 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.806 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.806 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.806 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.806 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.806 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.806 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.806 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.806 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.806 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.807 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.807 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.807 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.807 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.807 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.807 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.807 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.807 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.807 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.807 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.807 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.807 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.807 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.807 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.807 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.808 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.808 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.808 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.808 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.808 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.808 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.808 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.808 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.808 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.808 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.808 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.808 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.808 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.808 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.808 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.808 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.809 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.809 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.809 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.809 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.809 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.809 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.809 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.809 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.809 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.809 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.809 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.809 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.809 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.809 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.809 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.809 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.809 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.810 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.810 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.810 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.810 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.810 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.810 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.810 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.810 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.810 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.810 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.810 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.810 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.811 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.811 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.811 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.811 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.811 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.811 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.811 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.811 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.811 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.811 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.811 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.811 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.811 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.811 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.812 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.812 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.812 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.812 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.812 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.812 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.812 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.812 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.812 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.812 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.812 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.812 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.812 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.812 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.813 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.813 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.813 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.813 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.813 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.813 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.813 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.813 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.813 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.813 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.813 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.813 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.813 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.813 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.813 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.814 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.814 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.814 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.814 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.814 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.814 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.814 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.814 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.814 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.814 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.814 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.814 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.814 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.815 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.815 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.815 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.815 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.815 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.815 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.815 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.815 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.815 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.815 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.815 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.816 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.816 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.816 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.816 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.816 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.816 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.816 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.816 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.816 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.816 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.816 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.816 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.816 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.816 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.817 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.817 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.817 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.817 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.817 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.817 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.817 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.817 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.817 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.817 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.817 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.817 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.817 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.817 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.818 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.818 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.818 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.818 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.818 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.818 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.818 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.818 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.818 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.818 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.819 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.819 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.819 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.819 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.819 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.819 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.819 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.819 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.819 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.819 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.819 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.819 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.819 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.819 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.820 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.820 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.820 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.820 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.820 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.820 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.820 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.820 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.820 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.820 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.820 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.820 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.820 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.820 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.821 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.821 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.821 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.821 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.821 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.821 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.821 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.821 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.821 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.821 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.821 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.821 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.821 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.822 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.822 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.822 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.822 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.822 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.822 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.822 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.822 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.822 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.822 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.822 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.822 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.822 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.822 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.822 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.823 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.823 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.823 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.823 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.823 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.823 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.823 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.823 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.823 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.823 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.823 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.823 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.823 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.823 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.823 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.823 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.824 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.824 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.824 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.824 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.824 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.824 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.824 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.824 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.824 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.824 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.824 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.824 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.824 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.824 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.825 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.825 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.825 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.825 INFO:teuthology.orchestra.run.smithi044.stdout:_______ ERROR at teardown of test_bucket_policy_put_obj_copy_source_meta _______ 2023-12-03T12:39:15.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.825 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.825 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.825 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.825 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.825 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.825 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.825 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.825 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.826 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.826 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.826 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.826 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.826 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.826 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.826 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.826 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.826 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.826 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.826 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.827 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.827 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.827 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.827 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.827 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.827 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.827 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.827 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.827 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.827 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.827 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.827 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.827 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.827 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.827 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.828 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.828 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.828 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.828 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.828 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.828 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.828 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.828 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.828 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.828 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.828 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.828 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.828 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.828 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.828 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.829 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.829 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.829 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.829 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.829 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.829 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.829 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.829 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.829 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.829 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.829 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.829 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.829 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.829 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.829 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.830 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.830 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.830 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.830 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.830 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.830 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.830 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.830 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.830 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.830 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.830 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.831 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.831 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.831 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.831 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.831 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.831 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.831 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.831 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.831 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.831 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.831 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.831 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.831 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.832 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.832 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.832 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.832 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.832 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.832 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.832 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.832 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.832 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.832 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.832 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.832 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.832 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.832 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.832 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.832 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.833 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.833 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.833 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.833 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.833 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.833 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.833 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.833 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.833 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.833 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.833 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.833 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.833 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.834 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.834 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.834 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.834 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.834 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.834 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.834 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.834 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.834 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.834 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.834 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.834 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.834 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.834 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.834 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.835 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.835 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.835 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.835 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.835 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.835 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.835 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.835 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.835 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.835 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.835 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.835 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.836 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.836 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.836 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.836 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.836 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.836 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.836 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.836 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.836 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.836 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.836 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.836 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.836 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.836 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.836 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.836 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.836 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.837 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.837 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.837 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.837 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.837 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.837 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.837 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.837 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.837 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.837 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.838 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.838 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.838 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.838 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.838 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.838 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.838 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.838 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.838 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.838 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.838 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.838 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.838 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.838 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.839 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.839 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.839 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.839 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.839 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.839 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.839 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.839 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.839 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.839 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.839 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.839 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.839 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.839 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.839 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.839 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.839 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.840 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.840 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.840 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.840 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.840 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.840 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.840 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.840 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.840 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.840 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.840 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.840 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.840 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.840 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.840 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.840 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.841 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.841 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.841 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.841 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.841 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.841 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.841 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.841 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.841 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.841 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.841 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.841 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.841 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.841 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.842 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.842 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.842 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.842 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.842 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.842 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.842 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.842 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.842 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.842 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.842 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.842 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.842 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.842 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.842 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.843 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.843 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.843 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.843 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.843 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.843 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.843 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.843 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.843 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.843 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.843 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.843 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.843 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.843 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.844 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.844 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.844 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.844 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.844 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.844 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.844 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.844 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.844 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.844 INFO:teuthology.orchestra.run.smithi044.stdout:_____________ ERROR at teardown of test_bucket_policy_put_obj_acl ______________ 2023-12-03T12:39:15.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.844 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.844 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.845 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.845 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.845 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.845 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.845 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.845 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.845 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.845 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.845 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.845 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.845 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.845 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.845 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.845 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.845 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.846 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.846 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.846 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.846 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.846 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.846 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.846 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.846 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.846 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.846 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.846 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.847 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.847 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.847 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.847 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.847 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.847 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.847 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.847 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.847 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.847 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.847 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.847 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.847 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.847 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.847 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.847 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.848 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.848 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.848 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.848 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.848 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.848 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.848 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.848 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.848 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.848 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.848 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.848 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.848 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.848 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.848 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.849 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.849 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.849 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.849 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.849 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.849 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.849 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.849 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.849 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.849 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.849 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.849 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.849 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.849 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.849 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.850 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.850 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.850 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.850 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.850 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.850 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.850 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.850 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.850 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.850 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.850 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.850 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.850 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.850 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.850 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.851 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.851 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.851 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.851 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.851 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.851 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.851 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.851 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.851 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.851 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.851 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.851 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.851 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.851 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.852 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.852 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.852 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.852 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.852 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.852 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.852 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.852 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.852 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.852 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.852 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.852 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.852 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.852 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.852 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.853 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.853 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.853 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.853 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.853 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.853 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.853 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.853 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.853 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.853 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.853 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.853 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.853 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.853 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.853 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.854 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.854 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.854 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.854 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.854 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.854 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.854 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.854 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.854 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.854 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.854 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.854 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.854 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.855 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.855 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.855 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.855 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.855 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.855 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.855 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.855 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.855 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.855 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.855 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.855 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.855 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.855 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.855 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.856 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.856 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.856 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.856 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.856 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.856 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.856 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.856 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.856 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.856 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.856 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.856 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.856 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.856 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.857 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.857 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.857 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.857 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.857 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.857 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.857 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.857 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.857 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.857 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.857 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.857 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.857 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.857 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.857 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.858 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.858 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.858 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.858 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.858 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.858 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.858 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.858 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.858 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.858 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.858 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.858 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.858 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.858 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.858 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.858 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.859 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.859 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.859 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.859 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.859 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.859 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.859 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.859 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.859 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.859 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.859 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.859 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.859 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.859 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.859 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.859 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.859 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.860 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.860 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.860 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.860 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.860 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.860 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.860 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.860 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.860 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.860 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.860 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.860 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.860 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.860 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.861 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.861 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.861 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.861 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.861 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.861 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.861 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.861 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.861 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.861 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.861 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.861 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.861 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.861 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.861 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.861 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.864 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.864 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.864 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.864 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.864 INFO:teuthology.orchestra.run.smithi044.stdout:____________ ERROR at teardown of test_bucket_policy_put_obj_grant _____________ 2023-12-03T12:39:15.864 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.864 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.864 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.864 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.864 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.864 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.864 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.864 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.864 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.864 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.864 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.865 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.865 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.865 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.865 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.865 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.865 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.865 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.865 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.865 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.865 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.865 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.865 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.865 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.865 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.865 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.866 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.866 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.866 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.866 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.866 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.866 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.866 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.866 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.866 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.866 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.866 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.866 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.866 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.867 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.867 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.867 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.867 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.867 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.867 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.867 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.867 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.867 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.867 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.867 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.867 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.867 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.867 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.868 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.868 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.868 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.868 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.868 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.868 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.868 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.868 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.868 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.868 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.868 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.868 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.868 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.868 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.869 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.869 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.869 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.869 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.869 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.869 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.869 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.869 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.869 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.869 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.869 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.870 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.870 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.870 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.870 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.870 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.870 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.870 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.870 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.870 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.870 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.870 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.870 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.870 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.870 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.871 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.871 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.871 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.871 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.871 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.871 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.871 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.871 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.871 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.871 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.871 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.871 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.871 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.871 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.871 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.872 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.872 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.872 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.872 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.872 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.872 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.872 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.872 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.872 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.872 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.872 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.872 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.872 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.872 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.872 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.873 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.873 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.873 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.873 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.873 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.873 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.873 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.873 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.873 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.873 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.873 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.873 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.873 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.873 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.873 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.873 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.874 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.874 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.874 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.874 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.874 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.874 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.874 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.874 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.874 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.874 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.874 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.874 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.874 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.875 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.875 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.875 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.875 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.875 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.875 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.875 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.875 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.875 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.875 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.875 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.875 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.875 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.876 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.876 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.876 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.876 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.876 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.876 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.876 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.876 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.876 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.876 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.877 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.877 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.877 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.877 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.877 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.877 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.877 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.877 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.877 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.877 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.877 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.877 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.877 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.878 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.878 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.878 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.878 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.878 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.878 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.878 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.878 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.878 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.878 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.878 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.878 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.878 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.878 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.878 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.879 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.879 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.879 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.879 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.879 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.879 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.879 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.879 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.879 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.879 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.879 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.879 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.879 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.879 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.879 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.880 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.880 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.880 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.880 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.880 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.880 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.880 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.880 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.880 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.880 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.880 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.880 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.880 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.880 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.881 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.881 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.881 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.881 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.881 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.881 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.881 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.881 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.881 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.881 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.881 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.881 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.881 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.881 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.881 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.882 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.882 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.882 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.882 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.882 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.882 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.882 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.882 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.882 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.882 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.882 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.882 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.883 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.883 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.883 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.883 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.883 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.883 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.883 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.883 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.883 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.883 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.883 INFO:teuthology.orchestra.run.smithi044.stdout:_____________ ERROR at teardown of test_put_obj_enc_conflict_c_s3 ______________ 2023-12-03T12:39:15.883 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.883 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.883 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.883 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.883 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.884 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.884 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.884 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.884 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.884 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.884 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.884 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.884 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.884 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.884 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.884 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.884 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.884 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.885 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.885 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.885 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.885 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.885 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.885 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.885 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.885 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.885 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.885 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.885 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.885 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.885 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.885 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.886 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.886 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.886 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.886 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.886 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.886 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.886 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.886 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.886 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.886 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.886 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.886 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.886 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.886 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.887 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.887 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.887 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.887 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.887 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.887 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.888 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.888 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.888 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.888 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.888 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.888 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.888 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.888 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.888 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.888 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.888 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.888 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.888 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.889 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.889 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.889 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.889 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.889 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.889 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.889 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.889 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.889 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.889 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.889 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.889 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.889 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.889 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.890 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.890 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.890 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.890 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.890 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.890 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.891 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.891 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.891 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.891 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.891 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.892 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.892 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.892 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.892 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.892 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.892 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.892 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.892 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.892 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.893 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.893 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.893 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.893 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.893 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.893 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.893 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.893 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.893 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.893 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.894 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.894 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.894 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.894 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.894 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.894 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.894 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.894 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.895 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.895 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.895 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.895 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.895 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.895 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.895 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.895 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.895 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.895 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.895 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.895 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.895 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.895 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.895 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.896 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.896 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.896 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.896 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.896 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.896 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.896 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.896 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.896 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.896 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.896 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.896 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.896 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.896 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.896 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.896 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.897 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.897 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.897 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.897 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.897 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.897 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.897 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.897 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.897 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.897 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.897 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.897 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.897 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.897 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.897 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.897 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.898 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.898 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.898 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.898 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.898 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.898 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.898 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.898 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.898 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.898 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.898 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.898 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.898 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.898 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.898 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.898 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.899 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.899 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.899 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.899 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.899 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.899 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.899 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.899 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.899 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.899 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.899 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.899 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.899 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.899 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.900 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.900 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.900 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.900 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.900 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.900 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.900 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.900 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.901 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.901 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.901 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.901 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.901 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.901 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.902 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.902 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.902 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.902 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.902 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.902 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.902 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.902 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.902 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.902 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.902 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.902 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.902 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.903 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.903 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.903 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.903 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.903 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.903 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.903 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.903 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.903 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.903 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.903 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.903 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.903 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.903 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.903 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.904 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.904 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.904 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.904 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.904 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.904 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.904 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.904 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.904 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.904 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.904 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.904 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.904 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.904 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.905 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.905 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.905 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.905 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.905 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.905 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.905 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.905 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.905 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.905 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.905 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.905 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.905 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.906 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.906 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.906 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.906 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.906 INFO:teuthology.orchestra.run.smithi044.stdout:_____________ ERROR at teardown of test_put_obj_enc_conflict_c_kms _____________ 2023-12-03T12:39:15.906 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.906 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.906 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.906 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.906 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.906 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.906 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.906 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.906 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.906 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.907 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.907 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.907 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.907 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.907 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.907 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.907 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.907 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.907 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.907 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.907 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.907 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.908 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.908 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.908 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.908 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.908 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.908 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.908 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.908 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.908 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.908 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.908 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.908 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.908 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.908 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.908 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.908 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.909 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.909 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.909 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.909 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.909 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.909 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.909 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.909 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.909 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.909 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.909 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.909 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.909 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.909 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.909 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.909 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.909 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.910 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.910 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.910 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.910 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.910 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.910 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.910 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.910 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.910 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.910 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.910 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.910 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.910 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.910 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.911 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.911 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.911 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.911 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.911 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.911 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.911 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.911 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.911 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.912 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.912 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.912 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.912 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.912 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.912 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.912 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.912 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.912 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.912 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.912 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.912 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.912 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.912 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.913 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.913 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.913 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.913 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.913 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.913 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.913 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.913 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.913 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.913 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.913 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.913 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.913 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.913 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.913 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.913 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.914 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.914 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.914 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.914 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.914 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.914 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.914 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.914 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.914 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.914 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.914 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.914 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.915 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.915 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.915 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.915 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.915 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.915 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.915 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.915 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.915 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.915 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.915 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.915 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.915 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.915 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.916 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.916 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.916 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.916 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.916 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.916 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.916 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.916 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.916 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.916 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.916 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.916 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.916 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.917 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.917 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.917 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.917 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.917 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.917 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.917 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.917 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.917 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.917 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.917 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.917 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.917 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.917 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.917 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.917 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.918 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.918 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.918 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.918 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.918 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.918 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.918 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.918 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.919 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.919 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.919 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.919 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.919 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.919 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.919 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.919 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.919 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.919 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.919 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.920 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.920 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.920 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.920 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.920 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.920 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.920 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.920 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.920 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.921 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.921 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.921 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.921 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.921 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.921 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.921 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.921 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.921 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.921 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.921 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.921 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.921 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.921 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.921 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.922 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.922 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.922 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.922 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.922 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.922 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.922 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.922 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.922 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.922 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.922 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.922 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.922 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.923 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.923 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.923 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.923 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.923 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.923 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.923 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.923 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.923 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.923 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.923 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.923 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.923 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.923 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.923 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.923 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.923 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.924 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.924 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.924 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.924 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.924 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.924 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.924 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.924 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.924 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.924 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.924 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.924 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.924 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.924 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.924 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.924 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.924 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.925 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.925 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.925 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.925 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.925 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.925 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.925 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.925 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.925 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.925 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.925 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.925 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.925 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.925 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.925 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.926 INFO:teuthology.orchestra.run.smithi044.stdout:____________ ERROR at teardown of test_put_obj_enc_conflict_s3_kms _____________ 2023-12-03T12:39:15.926 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.926 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.926 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.926 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.926 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.926 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.926 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.926 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.926 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.926 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.926 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.926 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.926 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.926 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.927 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.927 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.927 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.927 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.927 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.927 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.927 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.927 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.927 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.927 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.927 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.927 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.928 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.928 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.928 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.928 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.928 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.928 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.928 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.928 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.928 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.928 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.928 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.928 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.928 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.928 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.928 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.929 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.929 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.929 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.929 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.929 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.929 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.929 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.929 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.929 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.929 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.929 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.929 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.930 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.930 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.930 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.930 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.930 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.930 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.930 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.930 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.930 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.930 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.930 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.930 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.930 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.930 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.930 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.931 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.931 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.931 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.931 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.931 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.931 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.931 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.931 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.931 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.931 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.931 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.931 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.932 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.932 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.932 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.932 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.932 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.932 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.932 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.932 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.932 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.932 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.932 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.932 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.932 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.932 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.932 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.933 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.933 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.933 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.933 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.933 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.933 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.933 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.933 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.933 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.933 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.933 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.933 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.933 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.933 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.933 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.933 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.934 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.934 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.934 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.934 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.934 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.934 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.934 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.934 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.934 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.934 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.934 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.934 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.934 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.935 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.935 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.935 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.935 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.935 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.935 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.935 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.935 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.935 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.935 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.935 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.935 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.935 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.935 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.935 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.935 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.935 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.936 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.936 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.936 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.936 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.936 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.936 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.936 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.936 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.936 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.936 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.936 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.936 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.937 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.937 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.937 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.937 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.937 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.937 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.937 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.937 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.937 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.937 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.937 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.937 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.937 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.938 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.938 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.938 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.938 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.938 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.938 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.938 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.938 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.938 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.938 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.938 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.938 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.938 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.939 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.939 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.939 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.939 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.939 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.939 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.939 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.939 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.939 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.939 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.940 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.940 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.940 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.940 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.940 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.940 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.940 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.941 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.941 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.941 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.941 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.941 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.941 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.941 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.941 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.941 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.941 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.941 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.941 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.941 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.942 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.942 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.942 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.942 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.942 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.942 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.942 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.942 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.942 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.942 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.942 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.942 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.942 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.942 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.942 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.943 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.943 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.943 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.943 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.943 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.943 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.943 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.943 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.943 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.943 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.943 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.943 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.944 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.944 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.944 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.944 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.944 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.944 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.944 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.944 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.944 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.944 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.944 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.944 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.944 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.944 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.944 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.945 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.945 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.945 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.945 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.945 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.945 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.945 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.945 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.945 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.945 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.945 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.945 INFO:teuthology.orchestra.run.smithi044.stdout:__________ ERROR at teardown of test_put_obj_enc_conflict_bad_enc_kms __________ 2023-12-03T12:39:15.945 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.945 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.946 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.946 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.946 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.946 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.946 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.946 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.946 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.946 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.946 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.946 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.946 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.946 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.946 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.946 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.947 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.947 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.947 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.947 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.947 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.947 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.947 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.947 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.947 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.947 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.948 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.948 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.948 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.948 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.948 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.948 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.948 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.948 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.948 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.948 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.948 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.948 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.948 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.948 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.949 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.949 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.949 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.949 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.949 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.949 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.949 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.949 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.949 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.949 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.950 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.950 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.950 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.950 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.950 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.950 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.950 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.950 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.950 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.950 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.950 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.951 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.951 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.951 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.951 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.951 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.951 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.951 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.951 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.951 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.951 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.951 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.951 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.952 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.952 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.952 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.952 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.952 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.952 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.952 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.952 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.952 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.952 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.952 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.952 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.952 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.952 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.952 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.953 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.953 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.953 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.953 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.953 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.953 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.953 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.953 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.953 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.953 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.953 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.953 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.953 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.953 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.953 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.954 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.954 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.954 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.954 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.954 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.954 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.954 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.954 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.954 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.954 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.954 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.954 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.954 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.954 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.955 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.955 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.955 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.955 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.955 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.955 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.955 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.955 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.955 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.955 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.955 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.955 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.955 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.955 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.956 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.956 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.956 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.956 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.956 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.956 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.956 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.956 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.956 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.956 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.956 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.956 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.956 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.956 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.957 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.957 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.957 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.957 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.957 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.957 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.957 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.957 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.957 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.957 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.957 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.957 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.957 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.957 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.957 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.958 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.958 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.958 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.958 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.958 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.958 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.958 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.958 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.958 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.958 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.958 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.958 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.958 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.958 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.959 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.959 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.959 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.959 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.959 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.959 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.959 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.959 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.959 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.959 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.959 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.959 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.959 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.959 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.959 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.960 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.960 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.960 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.960 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.960 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.960 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.960 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.960 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.960 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.960 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.960 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.960 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.960 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.960 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.961 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.961 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.961 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.961 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.961 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.961 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.961 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.961 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.961 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.961 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.961 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.961 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.961 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.961 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.961 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.962 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.962 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.962 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.962 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.962 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.962 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.962 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.962 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.962 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.962 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.962 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.962 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.962 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.962 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.963 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.963 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.963 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.963 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.963 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.963 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.963 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.963 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.963 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.963 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.963 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.963 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.963 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.963 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.964 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.964 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.964 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.964 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.964 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.964 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.964 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.964 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.964 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.964 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.964 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.964 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.964 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.964 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.964 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.965 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.965 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.965 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.965 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.965 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.965 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.965 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.965 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.965 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.965 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.965 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.965 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.965 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.965 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.966 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.966 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.966 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.966 INFO:teuthology.orchestra.run.smithi044.stdout:__________ ERROR at teardown of test_bucket_policy_put_obj_kms_noenc ___________ 2023-12-03T12:39:15.966 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.966 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.966 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.966 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.966 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.966 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.966 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.966 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.966 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.966 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.967 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.967 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.967 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.967 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.967 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.967 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.967 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.967 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.967 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.967 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.967 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.967 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.967 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.967 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.967 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.968 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.968 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.968 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.968 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.968 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.968 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.968 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.968 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.968 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.968 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.968 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.968 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.968 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.968 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.968 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.969 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.969 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.969 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.969 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.969 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.969 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.969 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.969 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.969 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.969 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.969 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.969 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.970 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.970 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.970 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.970 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.970 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.970 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.970 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.970 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.970 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.970 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.970 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.970 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.970 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.971 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.971 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.971 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.971 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.971 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.971 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.971 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.971 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.971 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.971 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.971 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.971 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.971 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.971 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.972 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.972 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.972 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.972 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.972 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.972 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.972 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.972 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.972 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.972 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.972 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.972 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.972 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.972 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.972 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.973 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.973 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.973 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.973 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.973 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.973 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.973 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.973 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.973 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.973 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.973 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.973 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.973 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.973 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.973 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.974 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.974 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.974 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.974 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.974 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.974 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.974 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.974 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.974 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.974 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.974 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.974 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.974 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.974 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.975 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.975 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.975 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.975 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.975 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.975 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.975 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.975 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.975 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.975 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.975 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.975 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.976 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.976 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.976 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.976 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.976 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.976 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.976 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.976 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.976 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.976 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.976 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.976 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.976 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.977 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.977 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.977 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.977 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.977 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.977 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.977 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.977 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.977 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.977 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.977 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.978 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.978 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.978 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.978 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.978 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.978 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.978 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.978 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.978 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.978 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.978 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.978 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.978 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.979 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.979 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.979 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.979 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.979 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.979 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.979 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.979 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.979 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.979 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.979 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.979 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.979 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.979 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.980 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.980 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.980 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.980 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:15.980 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:15.980 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:15.980 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:15.980 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:15.980 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:15.980 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:15.980 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:15.980 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:15.980 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:15.980 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:15.980 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:15.981 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:15.981 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:15.981 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:15.981 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:15.981 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:15.981 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:15.981 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:15.981 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:15.981 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:15.981 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:15.981 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:15.981 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:15.981 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:15.981 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:15.982 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:15.982 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:15.982 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:15.982 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:15.982 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:15.982 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:15.982 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:15.982 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:15.982 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:15.982 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:15.982 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.982 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.982 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.982 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.982 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.983 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.983 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.983 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.983 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.983 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.983 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.983 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.983 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.983 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.983 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.983 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.983 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.983 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.983 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.983 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.983 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.984 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.984 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:15.984 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.984 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.984 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.984 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.984 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.984 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.984 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.984 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.984 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.984 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.984 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.984 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:15.984 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:15.985 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:15.985 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:15.985 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:15.985 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.985 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.985 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:15.985 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:15.985 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:15.985 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:15.985 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:15.985 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.985 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:15.985 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:15.985 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.985 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:15.986 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:15.986 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:15.986 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.986 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:15.986 INFO:teuthology.orchestra.run.smithi044.stdout:____________ ERROR at teardown of test_bucket_policy_put_obj_kms_s3 ____________ 2023-12-03T12:39:15.986 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.986 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.986 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.986 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.986 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.986 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.986 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.987 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.987 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.987 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.987 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.987 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.987 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.987 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.987 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.987 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.987 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:15.987 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.987 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.987 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.987 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:15.987 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.988 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:15.988 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:15.988 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.988 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.988 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:15.988 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:15.988 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.988 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:15.988 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:15.988 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:15.988 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:15.988 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:15.988 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.988 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:15.988 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.989 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:15.989 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:15.989 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:15.989 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:15.989 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:15.989 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:15.989 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:15.989 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:15.989 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.989 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:15.989 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:15.989 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:15.989 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:15.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.989 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:15.990 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:15.990 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:15.990 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:15.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.990 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.990 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:15.990 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:15.990 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:15.990 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:15.990 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.990 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:15.990 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:15.991 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:15.991 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.991 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:15.991 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.991 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:15.991 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:15.991 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.991 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:15.991 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:15.991 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:15.991 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:15.991 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:15.991 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:15.991 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:15.992 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.992 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.992 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.992 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.992 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:15.992 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.992 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:15.992 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.992 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:15.992 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:15.992 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:15.992 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:15.992 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:15.992 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:15.993 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:15.993 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:15.993 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:15.993 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:15.993 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:15.993 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:15.993 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:15.993 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.993 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:15.993 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:15.993 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:15.993 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:15.993 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:15.993 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:15.994 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:15.994 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:15.994 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:15.994 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:15.994 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:15.994 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.994 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.994 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:15.994 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.994 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:15.994 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:15.994 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:15.995 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:15.995 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:15.995 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:15.995 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:15.995 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:15.995 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:15.995 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:15.995 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:15.995 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:15.995 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:15.995 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:15.995 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:15.995 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:15.995 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:15.995 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.996 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:15.996 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:15.996 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:15.996 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:15.996 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:15.996 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:15.996 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:15.996 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:15.996 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:15.996 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:15.996 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.996 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:15.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.996 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:15.996 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:15.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.997 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:15.997 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:15.997 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:15.997 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:15.997 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:15.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.997 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:15.997 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:15.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.997 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:15.997 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:15.997 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:15.997 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.997 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:15.998 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:15.998 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:15.998 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:15.998 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:15.998 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.998 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.998 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:15.998 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:15.998 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:15.998 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:15.998 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:15.998 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:15.998 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.998 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:15.999 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.999 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:15.999 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.999 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:15.999 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:15.999 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:15.999 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:15.999 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:15.999 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:15.999 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:15.999 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:15.999 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:15.999 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:15.999 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:15.999 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.000 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.000 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.000 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.000 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.000 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.000 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.000 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.000 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.000 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.000 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.000 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.000 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.000 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.001 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.001 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.001 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.001 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.001 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.001 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.001 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.001 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.001 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.001 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.001 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.001 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.001 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.001 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.002 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.002 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.002 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.002 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.002 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.002 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.002 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.002 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.002 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.002 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.002 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.002 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.003 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.003 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.003 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.003 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.003 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.003 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.003 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.003 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.003 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.003 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.003 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.003 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.003 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.003 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.003 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.003 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.004 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.004 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.004 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.004 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.004 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.004 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.004 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.004 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.004 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.004 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.004 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.004 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.004 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.004 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.005 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.005 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.005 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.005 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.005 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.005 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.005 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.006 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.006 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.006 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.006 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.006 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.006 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.006 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.006 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.006 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.006 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.006 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.006 INFO:teuthology.orchestra.run.smithi044.stdout:_______ ERROR at teardown of test_bucket_policy_get_obj_acl_existing_tag _______ 2023-12-03T12:39:16.006 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.007 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.007 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.007 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.007 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.007 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.007 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.007 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.007 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.008 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.008 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.008 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.008 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.008 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.008 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.009 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.009 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.009 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.009 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.009 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.009 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.010 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.010 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.010 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.010 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.010 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.010 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.010 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.010 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.010 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.011 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.011 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.011 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.011 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.011 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.011 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.011 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.011 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.011 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.012 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.012 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.012 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.012 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.012 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.012 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.012 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.012 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.013 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.013 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.013 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.013 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.013 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.013 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.013 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.013 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.013 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.013 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.013 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.013 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.013 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.013 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.013 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.014 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.014 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.014 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.014 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.014 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.014 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.014 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.014 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.014 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.014 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.014 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.014 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.015 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.015 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.015 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.015 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.015 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.015 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.015 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.015 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.015 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.015 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.016 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.016 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.016 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.016 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.016 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.016 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.016 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.016 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.016 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.016 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.016 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.016 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.017 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.017 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.017 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.017 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.017 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.017 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.017 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.017 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.017 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.017 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.017 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.017 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.017 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.017 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.018 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.018 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.018 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.018 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.018 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.018 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.018 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.018 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.018 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.018 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.018 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.018 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.018 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.018 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.019 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.019 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.019 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.019 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.019 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.019 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.019 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.019 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.019 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.019 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.019 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.020 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.020 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.020 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.020 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.020 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.020 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.020 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.020 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.020 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.021 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.021 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.021 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.021 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.021 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.021 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.021 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.021 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.021 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.021 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.021 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.021 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.021 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.021 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.022 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.022 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.022 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.022 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.022 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.022 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.022 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.022 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.022 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.022 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.022 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.022 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.022 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.022 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.023 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.023 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.023 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.023 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.023 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.023 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.023 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.023 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.023 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.023 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.023 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.023 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.023 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.023 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.024 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.024 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.024 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.024 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.024 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.024 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.024 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.024 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.024 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.024 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.024 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.024 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.024 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.024 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.025 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.025 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.025 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.025 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.025 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.025 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.025 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.025 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.025 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.025 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.025 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.025 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.025 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.026 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.026 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.026 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.026 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.026 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.026 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.026 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.026 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.026 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.026 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.026 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.026 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.026 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.026 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.026 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.027 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.027 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.027 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.027 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.027 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.027 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.027 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.027 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.027 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.027 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.027 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.027 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.027 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.027 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.028 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.028 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.028 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.028 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.028 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.028 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.028 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.028 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.028 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.028 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.028 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.028 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.028 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.028 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.028 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.029 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.029 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.029 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.029 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.029 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.029 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.029 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.029 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.029 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.029 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.029 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.029 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.030 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.030 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.030 INFO:teuthology.orchestra.run.smithi044.stdout:______________ ERROR at teardown of test_object_lock_put_obj_lock ______________ 2023-12-03T12:39:16.030 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.030 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.030 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.030 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.030 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.030 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.030 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.030 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.030 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.030 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.030 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.030 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.031 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.031 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.031 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.031 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.031 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.031 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.031 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.031 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.031 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.031 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.031 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.032 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.032 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.032 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.032 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.032 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.032 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.032 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.032 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.032 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.032 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.032 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.032 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.032 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.032 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.032 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.032 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.033 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.033 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.033 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.033 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.033 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.033 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.033 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.033 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.033 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.033 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.033 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.033 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.033 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.033 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.033 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.033 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.034 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.034 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.034 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.034 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.034 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.034 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.034 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.034 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.034 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.034 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.034 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.034 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.034 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.035 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.035 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.035 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.035 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.035 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.035 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.035 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.035 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.035 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.035 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.035 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.035 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.036 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.036 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.036 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.036 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.036 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.036 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.036 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.036 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.036 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.036 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.036 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.036 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.036 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.036 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.036 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.036 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.036 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.037 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.037 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.037 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.037 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.037 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.037 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.037 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.037 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.037 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.037 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.037 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.037 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.037 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.037 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.037 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.038 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.038 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.038 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.038 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.038 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.038 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.038 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.038 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.038 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.038 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.038 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.038 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.038 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.038 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.038 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.039 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.039 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.039 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.039 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.039 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.039 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.039 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.039 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.039 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.039 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.039 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.039 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.039 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.040 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.040 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.040 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.040 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.040 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.040 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.040 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.040 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.040 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.040 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.040 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.040 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.040 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.040 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.040 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.041 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.041 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.041 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.041 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.041 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.041 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.041 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.041 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.041 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.041 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.041 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.041 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.041 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.041 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.041 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.042 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.042 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.042 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.042 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.042 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.042 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.042 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.042 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.042 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.042 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.042 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.042 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.042 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.042 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.043 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.043 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.043 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.043 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.043 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.043 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.043 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.043 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.043 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.043 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.043 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.043 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.044 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.044 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.044 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.044 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.044 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.044 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.044 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.045 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.045 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.045 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.045 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.045 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.045 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.045 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.045 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.045 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.045 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.045 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.045 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.045 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.045 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.045 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.045 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.046 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.046 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.046 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.046 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.046 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.046 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.046 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.046 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.046 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.046 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.046 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.046 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.046 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.047 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.047 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.047 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.047 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.047 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.047 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.047 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.047 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.047 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.047 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.047 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.047 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.047 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.047 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.048 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.048 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.048 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.048 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.048 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.048 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.048 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.048 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.048 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.048 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.048 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.048 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.048 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.049 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.049 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.049 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.049 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.049 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.049 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.049 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.049 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.049 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.049 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.049 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.049 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.049 INFO:teuthology.orchestra.run.smithi044.stdout:______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_bucket _______ 2023-12-03T12:39:16.049 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.049 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.049 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.050 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.050 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.050 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.050 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.050 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.050 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.050 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.050 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.050 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.050 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.050 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.050 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.051 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.051 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.051 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.051 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.051 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.051 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.051 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.051 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.051 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.051 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.051 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.051 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.051 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.052 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.052 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.052 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.052 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.052 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.052 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.052 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.052 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.052 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.052 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.052 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.052 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.052 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.052 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.052 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.052 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.053 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.053 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.053 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.053 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.053 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.053 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.053 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.053 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.053 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.053 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.053 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.053 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.053 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.053 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.053 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.053 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.054 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.054 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.054 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.054 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.054 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.054 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.054 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.054 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.054 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.054 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.054 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.054 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.054 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.054 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.055 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.055 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.055 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.055 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.055 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.055 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.055 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.055 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.055 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.055 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.055 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.055 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.055 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.055 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.055 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.055 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.056 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.056 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.056 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.056 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.056 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.056 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.056 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.056 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.056 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.056 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.056 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.056 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.056 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.056 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.056 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.056 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.057 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.057 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.057 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.057 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.057 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.057 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.057 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.057 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.057 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.057 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.057 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.057 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.057 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.057 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.057 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.058 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.058 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.058 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.058 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.058 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.058 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.058 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.058 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.058 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.058 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.058 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.058 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.058 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.058 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.059 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.059 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.059 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.059 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.059 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.059 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.059 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.059 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.059 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.059 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.059 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.059 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.059 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.059 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.059 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.060 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.060 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.060 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.060 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.060 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.060 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.060 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.060 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.060 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.060 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.060 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.060 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.060 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.060 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.061 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.061 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.061 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.061 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.061 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.061 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.061 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.061 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.061 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.061 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.061 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.061 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.061 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.061 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.061 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.062 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.062 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.062 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.062 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.062 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.062 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.062 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.062 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.062 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.062 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.062 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.063 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.063 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.063 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.063 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.063 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.063 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.063 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.063 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.063 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.063 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.063 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.063 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.063 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.063 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.063 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.064 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.064 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.064 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.064 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.064 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.064 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.064 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.064 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.064 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.064 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.064 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.064 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.064 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.064 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.064 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.064 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.065 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.065 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.065 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.065 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.065 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.065 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.065 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.065 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.065 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.065 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.065 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.065 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.065 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.065 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.065 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.065 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.066 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.066 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.066 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.066 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.066 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.066 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.066 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.066 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.066 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.066 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.066 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.066 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.066 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.066 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.066 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.067 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.067 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.067 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.067 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.067 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.067 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.067 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.067 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.067 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.067 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.067 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.067 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.067 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.067 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.067 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.067 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.068 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.068 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.068 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.068 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.068 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.068 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.068 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.068 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.068 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.068 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.068 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.068 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.068 INFO:teuthology.orchestra.run.smithi044.stdout:____ ERROR at teardown of test_object_lock_put_obj_lock_with_days_and_years ____ 2023-12-03T12:39:16.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.068 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.069 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.069 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.069 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.069 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.069 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.069 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.069 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.069 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.069 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.069 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.069 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.069 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.070 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.070 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.070 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.070 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.070 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.070 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.070 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.070 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.070 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.070 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.070 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.070 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.070 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.070 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.071 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.071 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.071 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.071 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.071 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.071 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.071 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.071 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.071 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.071 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.071 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.071 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.071 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.071 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.071 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.071 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.071 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.072 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.072 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.072 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.072 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.072 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.072 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.072 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.072 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.072 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.072 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.072 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.072 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.072 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.072 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.072 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.072 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.073 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.073 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.073 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.073 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.073 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.073 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.073 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.073 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.073 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.073 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.073 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.073 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.073 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.073 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.073 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.073 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.074 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.074 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.074 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.074 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.074 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.074 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.074 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.074 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.074 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.074 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.074 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.074 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.074 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.074 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.074 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.075 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.075 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.075 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.075 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.075 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.075 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.075 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.075 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.075 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.075 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.075 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.075 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.075 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.075 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.075 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.075 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.076 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.076 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.076 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.076 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.076 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.076 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.076 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.076 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.076 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.076 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.076 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.076 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.076 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.076 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.076 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.077 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.077 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.077 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.077 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.077 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.077 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.077 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.077 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.077 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.077 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.077 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.077 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.077 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.077 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.077 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.077 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.078 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.078 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.078 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.078 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.078 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.078 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.078 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.078 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.078 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.078 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.078 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.079 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.079 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.079 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.079 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.079 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.079 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.079 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.079 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.079 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.079 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.079 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.079 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.079 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.079 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.079 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.079 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.079 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.080 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.080 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.080 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.080 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.080 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.080 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.080 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.080 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.080 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.080 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.081 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.081 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.081 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.081 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.081 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.081 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.081 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.081 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.081 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.081 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.081 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.081 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.081 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.081 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.081 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.082 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.082 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.082 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.082 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.082 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.082 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.082 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.082 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.082 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.082 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.082 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.082 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.082 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.082 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.082 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.082 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.083 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.083 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.083 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.083 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.083 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.083 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.083 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.083 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.083 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.083 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.083 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.083 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.083 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.083 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.084 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.084 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.084 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.084 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.084 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.084 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.084 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.084 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.084 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.084 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.084 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.084 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.084 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.084 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.084 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.084 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.084 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.085 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.085 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.085 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.085 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.085 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.085 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.085 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.085 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.085 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.085 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.085 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.085 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.085 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.085 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.085 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.086 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.086 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.086 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.086 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.086 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.086 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.086 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.086 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.086 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.086 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.086 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.086 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.086 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.086 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.086 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.086 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.087 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.087 INFO:teuthology.orchestra.run.smithi044.stdout:_______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_days ________ 2023-12-03T12:39:16.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.087 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.087 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.087 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.087 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.087 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.087 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.087 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.087 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.087 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.088 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.088 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.088 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.088 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.088 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.088 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.088 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.088 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.088 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.088 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.088 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.088 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.088 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.089 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.089 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.089 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.089 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.089 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.089 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.089 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.089 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.089 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.089 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.089 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.089 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.089 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.089 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.090 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.090 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.090 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.090 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.090 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.090 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.090 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.090 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.090 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.090 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.090 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.090 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.091 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.091 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.091 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.091 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.091 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.091 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.091 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.091 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.091 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.091 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.091 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.091 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.091 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.091 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.091 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.092 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.092 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.092 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.092 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.092 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.092 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.092 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.092 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.092 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.092 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.092 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.092 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.092 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.092 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.093 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.093 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.093 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.093 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.093 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.093 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.093 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.093 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.093 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.093 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.093 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.093 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.093 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.093 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.093 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.094 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.094 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.094 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.094 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.094 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.094 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.094 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.094 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.094 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.094 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.094 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.094 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.094 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.095 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.095 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.095 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.095 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.095 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.095 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.095 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.095 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.095 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.095 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.095 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.095 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.095 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.095 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.096 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.096 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.096 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.096 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.096 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.096 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.096 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.096 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.096 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.096 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.096 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.097 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.097 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.097 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.097 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.097 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.097 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.097 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.097 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.097 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.097 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.097 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.097 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.097 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.098 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.098 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.098 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.098 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.098 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.098 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.098 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.098 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.098 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.098 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.098 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.098 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.098 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.098 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.098 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.099 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.099 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.099 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.099 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.099 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.099 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.099 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.099 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.099 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.099 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.099 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.099 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.099 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.100 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.100 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.100 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.100 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.100 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.100 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.100 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.100 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.100 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.100 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.100 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.100 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.100 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.100 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.100 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.100 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.101 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.101 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.101 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.101 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.101 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.101 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.101 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.101 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.101 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.101 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.101 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.101 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.101 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.101 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.101 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.102 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.102 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.102 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.102 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.102 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.102 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.102 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.102 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.102 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.102 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.102 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.102 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.102 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.103 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.103 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.103 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.103 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.103 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.103 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.103 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.103 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.103 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.103 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.103 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.103 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.103 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.103 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.103 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.103 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.103 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.104 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.104 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.104 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.104 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.104 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.104 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.104 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.104 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.104 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.104 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.104 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.104 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.104 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.104 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.104 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.104 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.105 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.105 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.105 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.105 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.105 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.105 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.105 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.105 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.105 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.105 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.105 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.105 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.105 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.105 INFO:teuthology.orchestra.run.smithi044.stdout:_______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_years _______ 2023-12-03T12:39:16.105 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.105 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.106 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.106 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.106 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.106 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.106 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.106 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.106 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.106 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.106 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.106 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.107 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.107 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.107 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.107 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.107 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.107 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.107 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.107 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.107 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.107 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.107 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.107 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.107 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.107 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.107 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.108 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.108 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.108 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.108 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.108 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.108 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.108 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.108 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.108 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.108 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.108 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.108 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.108 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.108 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.109 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.109 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.109 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.109 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.109 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.109 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.109 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.109 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.109 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.109 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.109 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.109 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.109 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.109 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.109 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.110 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.110 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.110 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.110 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.110 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.110 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.110 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.110 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.110 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.110 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.110 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.110 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.110 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.110 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.110 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.110 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.111 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.111 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.111 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.111 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.111 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.111 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.111 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.111 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.111 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.111 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.111 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.111 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.111 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.111 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.112 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.112 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.112 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.112 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.112 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.112 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.112 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.112 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.112 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.112 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.112 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.113 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.113 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.113 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.113 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.113 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.113 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.113 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.113 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.113 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.113 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.113 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.113 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.113 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.113 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.113 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.114 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.114 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.114 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.114 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.114 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.114 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.114 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.114 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.114 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.114 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.114 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.115 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.115 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.115 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.115 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.115 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.115 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.115 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.115 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.115 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.115 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.115 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.115 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.116 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.116 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.116 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.116 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.116 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.116 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.116 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.116 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.116 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.116 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.116 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.116 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.116 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.116 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.116 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.116 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.117 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.117 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.117 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.117 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.117 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.117 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.117 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.117 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.117 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.117 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.117 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.117 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.117 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.117 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.117 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.117 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.118 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.118 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.118 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.118 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.118 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.118 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.118 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.118 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.118 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.118 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.118 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.118 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.118 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.118 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.118 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.119 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.119 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.119 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.119 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.119 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.119 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.119 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.119 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.119 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.119 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.119 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.119 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.119 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.119 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.120 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.120 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.120 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.120 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.120 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.120 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.120 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.120 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.120 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.120 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.120 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.121 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.121 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.121 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.121 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.121 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.121 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.121 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.121 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.121 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.121 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.122 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.122 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.122 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.122 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.122 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.122 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.122 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.122 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.122 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.123 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.123 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.123 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.123 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.123 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.123 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.123 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.123 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.123 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.123 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.123 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.123 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.123 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.123 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.123 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.123 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.124 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.124 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.124 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.124 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.124 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.124 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.124 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.124 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.124 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.124 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.124 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.125 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.125 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.125 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.125 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.125 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.125 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.126 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.126 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.126 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.126 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.126 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.126 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.126 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.127 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.127 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.127 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.127 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.127 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.127 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.127 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.127 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.127 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.127 INFO:teuthology.orchestra.run.smithi044.stdout:_______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_mode ________ 2023-12-03T12:39:16.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.127 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.128 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.128 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.128 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.128 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.128 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.128 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.129 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.129 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.129 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.129 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.129 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.129 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.129 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.129 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.130 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.130 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.130 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.130 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.130 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.130 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.130 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.130 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.130 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.130 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.130 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.130 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.130 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.130 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.130 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.131 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.131 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.131 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.131 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.131 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.131 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.131 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.131 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.131 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.131 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.131 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.131 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.131 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.131 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.132 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.132 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.132 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.132 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.132 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.132 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.132 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.132 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.132 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.132 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.132 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.132 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.132 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.133 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.133 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.133 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.133 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.133 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.133 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.133 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.133 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.133 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.133 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.133 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.133 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.133 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.133 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.133 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.134 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.134 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.134 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.134 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.134 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.134 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.134 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.134 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.134 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.134 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.134 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.135 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.135 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.135 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.135 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.135 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.135 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.135 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.135 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.135 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.135 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.135 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.135 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.135 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.136 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.136 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.136 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.136 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.136 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.136 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.136 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.136 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.136 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.136 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.136 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.136 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.136 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.136 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.136 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.137 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.137 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.137 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.137 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.137 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.137 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.137 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.137 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.137 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.137 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.137 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.137 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.137 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.137 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.138 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.138 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.138 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.138 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.138 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.138 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.138 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.138 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.138 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.138 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.138 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.138 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.139 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.139 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.139 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.139 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.139 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.139 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.139 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.139 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.139 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.139 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.139 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.139 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.139 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.139 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.139 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.140 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.140 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.140 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.140 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.140 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.140 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.140 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.140 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.140 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.140 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.140 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.140 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.140 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.140 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.141 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.141 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.141 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.141 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.141 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.141 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.141 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.141 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.141 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.141 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.141 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.142 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.142 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.142 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.142 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.142 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.142 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.142 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.142 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.142 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.142 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.142 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.142 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.142 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.142 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.143 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.143 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.143 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.143 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.143 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.143 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.143 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.143 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.143 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.143 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.143 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.143 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.143 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.143 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.143 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.144 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.144 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.144 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.144 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.144 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.144 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.144 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.144 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.144 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.144 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.144 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.144 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.144 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.145 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.145 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.145 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.145 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.145 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.145 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.145 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.145 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.145 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.145 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.145 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.145 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.146 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.146 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.146 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.146 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.146 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.146 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.146 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.146 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.146 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.146 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.146 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.146 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.146 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.146 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.147 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.147 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.147 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.147 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.147 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.147 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.147 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.147 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.147 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.147 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.147 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.147 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.147 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.148 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.148 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.148 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.148 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.148 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.148 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.148 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.148 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.148 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.148 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.148 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.148 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.148 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.148 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.148 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.148 INFO:teuthology.orchestra.run.smithi044.stdout:______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_status _______ 2023-12-03T12:39:16.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.149 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.149 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.149 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.149 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.149 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.149 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.149 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.149 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.149 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.149 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.149 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.150 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.150 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.150 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.150 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.150 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.150 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.150 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.150 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.150 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.150 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.150 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.151 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.151 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.151 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.151 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.151 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.151 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.151 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.151 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.151 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.151 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.151 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.151 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.152 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.152 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.152 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.152 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.152 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.152 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.152 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.152 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.152 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.152 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.152 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.152 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.152 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.152 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.152 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.153 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.153 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.153 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.153 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.153 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.153 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.153 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.153 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.153 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.153 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.153 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.153 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.153 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.153 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.153 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.154 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.154 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.154 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.154 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.154 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.154 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.154 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.154 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.154 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.154 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.154 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.154 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.154 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.154 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.155 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.155 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.155 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.155 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.155 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.155 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.155 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.155 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.155 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.155 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.155 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.155 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.155 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.155 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.155 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.155 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.156 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.156 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.156 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.156 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.156 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.156 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.156 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.156 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.156 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.156 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.156 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.156 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.156 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.156 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.156 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.157 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.157 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.157 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.157 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.157 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.157 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.157 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.157 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.157 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.157 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.157 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.157 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.157 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.157 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.157 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.158 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.158 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.158 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.158 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.158 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.158 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.158 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.158 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.158 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.158 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.158 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.158 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.158 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.158 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.159 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.159 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.159 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.159 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.159 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.159 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.159 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.159 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.159 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.159 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.159 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.159 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.160 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.160 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.160 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.160 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.160 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.160 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.160 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.160 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.160 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.160 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.160 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.160 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.160 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.160 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.160 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.160 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.161 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.161 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.161 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.161 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.161 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.161 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.161 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.161 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.161 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.161 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.161 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.161 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.161 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.161 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.162 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.162 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.162 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.162 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.162 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.162 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.162 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.162 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.162 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.162 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.162 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.162 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.162 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.162 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.163 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.163 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.163 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.163 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.163 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.163 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.163 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.163 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.163 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.163 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.163 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.163 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.163 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.163 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.163 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.164 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.164 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.164 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.164 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.164 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.164 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.164 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.164 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.164 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.164 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.164 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.164 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.164 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.164 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.164 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.164 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.165 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.165 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.165 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.165 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.165 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.165 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.165 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.165 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.165 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.165 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.165 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.165 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.165 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.165 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.165 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.166 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.166 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.166 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.166 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.166 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.166 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.166 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.166 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.166 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.166 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.166 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.166 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.166 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.166 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.166 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.167 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.167 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.167 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.167 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.167 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.167 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.167 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.167 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.167 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.167 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.167 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.167 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.167 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.167 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.167 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.168 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.168 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.168 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.168 INFO:teuthology.orchestra.run.smithi044.stdout:___________ ERROR at teardown of test_object_lock_suspend_versioning ___________ 2023-12-03T12:39:16.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.168 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.168 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.168 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.168 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.168 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.168 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.168 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.168 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.169 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.169 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.169 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.169 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.169 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.169 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.169 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.169 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.169 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.169 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.169 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.169 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.170 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.170 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.170 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.170 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.170 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.170 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.170 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.170 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.170 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.170 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.170 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.170 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.171 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.171 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.171 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.171 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.171 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.171 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.171 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.171 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.171 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.171 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.171 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.171 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.171 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.172 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.172 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.172 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.172 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.172 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.172 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.172 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.172 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.172 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.172 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.172 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.172 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.172 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.172 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.172 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.173 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.173 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.173 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.173 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.173 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.173 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.173 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.173 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.173 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.173 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.173 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.173 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.173 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.173 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.173 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.174 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.174 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.174 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.174 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.174 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.174 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.174 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.174 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.174 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.174 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.174 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.174 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.174 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.174 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.174 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.175 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.175 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.175 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.175 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.175 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.175 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.175 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.175 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.175 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.175 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.175 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.175 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.175 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.175 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.175 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.176 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.176 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.176 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.176 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.176 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.176 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.176 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.177 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.177 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.177 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.177 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.177 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.177 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.177 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.177 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.177 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.177 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.177 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.177 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.177 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.177 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.177 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.178 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.178 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.178 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.178 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.178 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.178 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.178 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.178 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.178 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.178 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.179 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.179 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.179 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.179 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.179 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.179 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.179 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.179 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.179 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.179 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.179 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.179 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.179 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.180 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.180 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.180 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.180 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.180 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.180 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.180 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.180 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.180 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.180 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.180 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.181 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.181 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.181 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.181 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.181 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.181 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.181 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.181 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.181 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.181 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.181 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.181 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.181 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.182 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.182 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.182 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.182 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.182 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.182 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.182 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.182 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.182 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.182 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.182 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.182 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.182 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.183 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.183 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.183 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.183 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.183 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.183 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.183 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.183 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.183 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.183 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.183 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.183 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.183 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.183 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.183 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.184 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.184 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.184 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.187 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.187 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.187 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.187 INFO:teuthology.orchestra.run.smithi044.stdout:______________ ERROR at teardown of test_object_lock_get_obj_lock ______________ 2023-12-03T12:39:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.187 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.188 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.189 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.189 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.189 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.189 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.189 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.189 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.192 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.192 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.193 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.193 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.193 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.194 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.195 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.195 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.195 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.195 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.195 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.196 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.196 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.196 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.196 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.196 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.196 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.196 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.197 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.197 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.197 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.197 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.197 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.197 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.199 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.199 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.199 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.199 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.200 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.200 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.200 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.200 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.200 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.200 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.200 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.200 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.200 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.200 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.200 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.200 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.201 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.201 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.201 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.201 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.201 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.201 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.201 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.201 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.202 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.202 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.202 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.202 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.202 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.202 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.202 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.202 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.202 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.202 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.202 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.202 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.202 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.202 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.203 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.203 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.203 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.203 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.203 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.206 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.206 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.206 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.207 INFO:teuthology.orchestra.run.smithi044.stdout:______ ERROR at teardown of test_object_lock_get_obj_lock_invalid_bucket _______ 2023-12-03T12:39:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.207 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.208 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.208 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.208 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.208 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.208 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.208 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.208 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.212 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.212 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.212 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.212 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.212 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.212 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.213 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.214 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.215 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.216 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.216 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.216 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.216 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.216 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.216 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.216 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.216 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.216 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.216 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.216 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.216 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.216 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.216 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.216 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.218 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.218 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.219 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.219 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.219 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.219 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.219 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.219 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.219 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.220 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.220 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.220 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.221 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.221 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.221 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.221 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.221 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.221 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.221 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.221 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.221 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.221 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.222 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.222 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.222 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.222 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.222 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.222 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.222 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.222 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.222 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.222 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.222 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.222 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.222 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.223 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.223 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.223 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.226 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.226 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.226 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.226 INFO:teuthology.orchestra.run.smithi044.stdout:___________ ERROR at teardown of test_object_lock_put_obj_retention ____________ 2023-12-03T12:39:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.226 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.227 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.227 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.227 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.228 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.228 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.228 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.228 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.228 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.228 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.228 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.228 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.228 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.228 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.231 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.231 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.231 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.231 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.231 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.232 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.232 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.232 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.232 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.232 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.233 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.234 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.234 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.234 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.234 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.234 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.234 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.234 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.234 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.234 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.236 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.237 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.237 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.237 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.237 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.237 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.237 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.238 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.238 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.238 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.238 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.238 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.238 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.238 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.238 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.238 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.238 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.238 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.238 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.238 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.238 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.238 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.239 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.239 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.239 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.239 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.239 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.239 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.239 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.239 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.239 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.243 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.243 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.243 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.243 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.243 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.243 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.244 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.244 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.244 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.244 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.244 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.244 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.244 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.244 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.244 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.244 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.245 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.245 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.245 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.245 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.245 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.245 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.245 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.245 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.245 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.245 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.245 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.245 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.245 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.245 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.246 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.246 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.246 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.246 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.246 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.246 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.246 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.246 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.246 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.246 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.246 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.246 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.246 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.247 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.247 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.247 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.247 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.251 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.251 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.251 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.251 INFO:teuthology.orchestra.run.smithi044.stdout:____ ERROR at teardown of test_object_lock_put_obj_retention_invalid_bucket ____ 2023-12-03T12:39:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.251 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.252 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.253 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.253 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.253 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.253 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.253 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.253 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.253 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.253 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.253 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.253 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.253 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.253 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.255 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.255 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.255 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.255 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.255 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.255 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.255 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.255 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.255 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.255 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.255 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.255 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.257 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.257 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.257 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.257 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.257 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.258 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.259 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.260 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.260 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.260 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.260 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.260 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.260 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.260 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.261 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.261 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.261 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.261 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.261 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.261 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.261 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.262 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.262 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.262 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.262 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.264 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.264 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.264 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.264 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.264 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.265 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.265 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.265 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.265 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.265 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.265 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.265 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.266 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.266 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.266 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.266 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.266 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.266 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.266 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.268 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.268 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.268 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.268 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.268 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.271 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.271 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.271 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.272 INFO:teuthology.orchestra.run.smithi044.stdout:_____ ERROR at teardown of test_object_lock_put_obj_retention_invalid_mode _____ 2023-12-03T12:39:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.272 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.273 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.273 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.273 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.273 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.273 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.273 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.273 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.277 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.277 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.277 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.277 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.277 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.277 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.279 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.279 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.279 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.279 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.280 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.280 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.281 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.281 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.281 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.281 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.281 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.281 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.281 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.281 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.281 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.281 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.281 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.281 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.281 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.281 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.281 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.283 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.284 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.284 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.284 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.284 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.284 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.284 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.284 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.284 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.285 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.285 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.286 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.286 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.286 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.286 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.286 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.286 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.287 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.287 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.287 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.287 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.287 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.287 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.287 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.290 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.290 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.291 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.291 INFO:teuthology.orchestra.run.smithi044.stdout:___________ ERROR at teardown of test_object_lock_get_obj_retention ____________ 2023-12-03T12:39:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.291 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.292 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.292 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.292 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.292 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.292 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.292 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.292 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.292 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.292 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.292 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.292 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.292 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.292 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.292 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.293 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.293 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.293 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.293 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.293 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.293 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.293 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.293 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.293 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.293 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.293 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.293 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.293 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.293 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.293 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.294 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.294 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.294 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.294 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.294 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.294 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.294 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.294 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.294 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.294 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.294 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.294 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.294 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.294 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.295 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.295 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.295 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.295 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.295 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.295 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.295 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.295 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.295 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.295 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.295 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.295 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.295 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.296 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.296 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.296 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.296 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.296 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.296 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.296 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.296 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.296 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.296 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.296 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.297 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.297 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.297 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.297 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.297 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.297 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.297 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.297 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.297 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.297 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.297 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.297 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.297 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.297 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.297 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.298 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.298 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.298 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.298 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.298 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.298 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.298 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.298 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.298 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.298 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.298 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.298 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.298 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.298 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.298 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.299 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.299 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.299 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.299 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.299 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.299 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.299 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.299 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.299 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.300 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.300 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.300 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.300 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.300 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.300 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.300 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.300 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.300 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.300 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.300 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.300 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.300 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.300 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.300 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.301 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.301 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.301 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.301 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.301 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.301 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.301 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.301 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.301 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.301 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.301 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.302 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.302 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.302 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.302 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.302 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.302 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.302 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.302 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.302 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.302 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.302 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.303 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.303 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.303 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.303 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.303 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.303 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.303 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.303 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.303 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.303 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.304 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.304 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.304 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.304 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.304 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.304 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.304 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.304 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.304 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.304 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.304 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.304 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.304 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.304 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.304 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.304 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.304 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.305 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.305 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.305 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.305 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.305 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.305 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.305 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.305 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.306 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.306 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.306 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.306 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.306 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.306 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.306 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.306 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.306 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.306 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.306 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.306 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.306 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.307 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.307 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.307 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.307 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.307 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.307 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.307 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.307 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.307 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.307 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.307 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.307 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.307 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.307 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.307 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.307 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.307 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.310 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.310 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.310 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.310 INFO:teuthology.orchestra.run.smithi044.stdout:_______ ERROR at teardown of test_object_lock_get_obj_retention_iso8601 ________ 2023-12-03T12:39:16.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.310 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.310 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.310 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.310 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.310 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.310 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.311 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.311 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.311 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.311 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.311 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.311 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.311 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.311 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.311 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.311 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.311 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.311 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.312 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.312 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.312 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.312 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.312 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.312 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.312 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.312 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.312 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.312 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.312 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.312 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.312 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.312 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.312 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.313 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.313 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.313 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.313 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.313 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.313 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.313 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.313 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.313 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.313 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.313 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.313 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.313 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.313 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.313 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.314 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.314 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.314 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.314 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.314 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.314 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.314 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.314 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.314 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.314 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.314 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.314 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.314 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.314 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.314 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.315 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.315 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.315 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.315 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.315 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.315 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.315 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.315 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.315 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.316 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.316 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.316 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.316 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.316 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.316 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.316 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.316 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.316 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.316 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.316 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.316 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.316 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.317 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.317 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.317 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.317 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.317 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.317 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.317 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.317 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.317 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.317 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.317 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.317 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.317 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.317 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.317 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.318 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.318 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.318 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.318 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.318 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.318 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.318 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.318 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.318 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.318 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.318 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.318 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.318 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.318 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.318 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.319 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.319 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.319 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.319 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.319 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.319 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.319 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.319 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.319 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.319 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.319 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.319 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.319 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.319 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.319 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.320 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.320 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.320 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.320 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.320 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.320 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.320 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.320 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.320 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.320 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.320 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.320 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.320 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.321 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.321 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.321 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.321 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.321 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.321 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.321 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.321 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.321 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.321 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.321 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.321 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.321 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.322 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.322 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.322 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.322 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.322 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.322 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.322 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.322 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.322 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.323 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.323 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.323 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.323 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.323 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.323 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.323 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.324 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.324 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.324 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.324 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.324 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.324 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.324 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.324 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.324 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.324 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.324 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.324 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.324 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.324 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.324 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.324 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.325 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.325 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.325 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.325 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.325 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.325 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.325 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.325 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.325 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.325 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.325 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.325 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.325 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.325 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.325 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.325 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.326 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.326 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.326 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.326 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.326 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.326 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.326 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.326 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.326 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.326 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.326 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.327 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.327 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.327 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.327 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.327 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.327 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.327 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.327 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.327 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.327 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.327 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.327 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.327 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.327 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.327 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.328 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.328 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.328 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.328 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.328 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.328 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.328 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.328 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.328 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.328 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.328 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.328 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.328 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.328 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.328 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.329 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.329 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.329 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.329 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.329 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.329 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.329 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.329 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.329 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.329 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.329 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.329 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.329 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.329 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.330 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.330 INFO:teuthology.orchestra.run.smithi044.stdout:____ ERROR at teardown of test_object_lock_get_obj_retention_invalid_bucket ____ 2023-12-03T12:39:16.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.330 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.330 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.330 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.330 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.330 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.330 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.330 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.330 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.331 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.331 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.331 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.331 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.331 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.331 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.331 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.331 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.331 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.331 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.331 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.332 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.332 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.332 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.332 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.332 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.332 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.332 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.332 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.332 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.332 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.332 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.332 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.332 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.332 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.332 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.333 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.333 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.333 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.333 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.333 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.333 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.333 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.333 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.333 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.333 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.333 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.333 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.333 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.333 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.333 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.334 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.334 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.334 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.334 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.334 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.334 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.334 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.334 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.334 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.334 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.334 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.334 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.334 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.334 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.334 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.335 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.335 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.335 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.335 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.335 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.335 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.335 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.335 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.335 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.335 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.335 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.335 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.335 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.336 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.336 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.336 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.336 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.336 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.336 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.336 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.336 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.336 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.336 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.336 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.336 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.336 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.336 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.337 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.337 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.337 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.337 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.337 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.337 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.337 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.337 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.337 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.337 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.337 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.337 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.337 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.337 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.337 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.337 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.338 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.338 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.338 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.338 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.338 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.338 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.338 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.338 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.338 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.338 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.338 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.338 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.338 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.338 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.339 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.339 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.339 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.339 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.339 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.339 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.339 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.339 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.339 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.339 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.339 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.339 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.339 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.339 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.339 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.339 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.340 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.340 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.340 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.340 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.340 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.340 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.340 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.340 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.340 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.340 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.340 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.341 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.341 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.341 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.341 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.341 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.341 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.341 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.341 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.341 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.341 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.341 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.341 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.342 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.342 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.342 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.342 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.342 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.342 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.342 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.342 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.342 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.342 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.342 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.342 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.342 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.342 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.343 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.343 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.343 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.343 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.343 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.343 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.343 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.343 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.343 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.343 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.344 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.344 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.344 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.344 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.344 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.344 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.344 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.344 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.344 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.344 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.344 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.344 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.344 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.344 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.345 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.345 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.345 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.345 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.345 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.345 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.345 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.345 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.345 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.345 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.345 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.345 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.346 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.346 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.346 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.346 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.346 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.346 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.347 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.347 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.347 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.347 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.347 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.347 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.348 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.348 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.348 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.348 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.348 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.348 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.348 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.348 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.348 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.349 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.349 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.349 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.349 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.349 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.349 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.349 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.349 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.349 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.349 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.349 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.349 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.349 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.349 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.350 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.350 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.350 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.350 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.350 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.350 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.350 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.350 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.350 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.350 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.350 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.350 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.350 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.351 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.351 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.351 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.351 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.351 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.351 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.351 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.351 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.351 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.351 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.351 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.351 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.352 INFO:teuthology.orchestra.run.smithi044.stdout:______ ERROR at teardown of test_object_lock_put_obj_retention_versionid _______ 2023-12-03T12:39:16.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.352 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.352 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.352 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.352 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.352 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.352 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.352 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.352 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.352 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.353 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.353 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.353 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.353 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.353 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.353 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.353 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.353 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.353 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.353 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.353 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.354 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.354 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.354 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.354 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.354 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.354 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.354 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.354 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.354 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.354 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.354 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.354 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.354 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.354 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.355 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.355 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.355 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.355 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.355 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.355 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.355 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.355 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.355 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.355 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.355 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.355 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.355 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.355 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.355 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.356 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.356 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.356 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.356 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.356 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.356 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.356 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.356 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.356 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.356 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.356 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.356 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.356 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.356 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.357 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.357 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.357 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.357 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.357 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.357 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.357 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.357 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.357 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.357 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.357 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.357 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.358 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.358 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.358 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.358 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.358 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.358 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.358 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.358 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.358 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.358 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.358 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.358 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.358 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.358 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.359 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.359 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.359 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.359 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.359 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.359 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.359 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.359 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.359 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.359 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.359 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.359 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.359 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.360 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.360 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.360 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.360 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.360 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.360 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.360 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.360 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.360 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.360 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.360 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.360 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.360 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.360 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.360 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.360 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.361 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.361 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.361 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.361 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.361 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.361 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.361 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.361 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.361 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.361 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.361 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.362 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.362 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.362 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.362 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.362 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.362 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.362 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.362 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.362 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.362 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.362 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.362 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.362 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.362 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.363 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.363 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.363 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.363 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.363 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.363 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.363 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.363 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.363 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.363 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.363 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.363 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.363 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.363 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.363 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.364 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.364 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.364 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.364 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.364 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.364 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.364 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.364 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.364 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.364 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.364 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.364 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.364 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.364 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.364 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.364 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.365 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.365 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.365 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.365 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.365 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.365 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.365 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.365 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.365 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.365 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.365 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.365 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.365 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.365 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.365 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.365 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.366 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.366 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.366 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.366 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.366 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.366 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.366 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.366 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.366 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.366 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.366 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.366 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.366 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.366 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.366 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.367 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.367 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.367 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.367 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.367 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.367 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.367 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.367 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.367 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.367 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.367 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.367 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.367 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.368 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.368 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.368 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.368 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.368 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.368 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.368 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.368 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.368 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.368 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.368 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.368 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.368 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.368 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.368 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.368 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.369 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.369 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.369 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.369 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.369 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.369 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.369 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.369 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.369 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.369 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.369 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.369 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.369 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.370 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.370 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.370 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.370 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.370 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.370 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.370 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.370 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.370 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.370 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.370 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.370 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.370 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.370 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.371 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.371 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.371 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.371 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.371 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.371 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.371 INFO:teuthology.orchestra.run.smithi044.stdout:_ ERROR at teardown of test_object_lock_put_obj_retention_override_default_retention _ 2023-12-03T12:39:16.371 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.371 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.371 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.371 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.371 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.371 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.371 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.371 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.372 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.372 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.372 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.372 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.372 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.372 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.372 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.372 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.372 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.372 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.372 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.372 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.372 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.373 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.373 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.373 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.373 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.373 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.373 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.373 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.373 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.373 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.373 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.373 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.373 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.374 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.374 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.374 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.374 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.374 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.374 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.374 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.374 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.374 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.374 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.374 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.374 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.374 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.375 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.375 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.375 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.375 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.375 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.375 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.375 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.375 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.375 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.375 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.375 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.375 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.375 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.375 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.375 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.375 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.375 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.376 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.376 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.376 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.376 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.376 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.376 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.376 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.376 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.376 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.376 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.377 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.377 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.377 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.377 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.377 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.377 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.377 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.377 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.377 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.377 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.377 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.377 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.377 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.377 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.377 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.378 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.378 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.378 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.378 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.378 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.378 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.378 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.378 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.378 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.378 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.378 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.378 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.378 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.378 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.379 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.379 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.379 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.379 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.379 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.379 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.379 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.379 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.379 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.379 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.379 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.379 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.379 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.379 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.379 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.379 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.380 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.380 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.380 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.380 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.380 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.380 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.380 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.380 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.380 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.380 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.380 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.380 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.380 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.380 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.380 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.381 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.381 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.381 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.381 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.381 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.381 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.381 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.381 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.381 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.381 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.381 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.381 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.381 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.381 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.382 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.382 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.382 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.382 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.382 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.382 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.382 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.382 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.382 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.382 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.382 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.382 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.382 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.382 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.382 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.383 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.383 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.383 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.383 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.383 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.383 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.383 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.383 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.383 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.383 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.383 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.384 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.384 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.384 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.384 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.384 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.384 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.384 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.384 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.384 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.384 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.384 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.384 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.384 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.384 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.384 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.384 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.385 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.385 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.385 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.385 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.385 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.385 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.385 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.385 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.385 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.385 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.385 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.385 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.385 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.385 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.385 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.385 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.385 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.386 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.386 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.386 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.386 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.386 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.386 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.386 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.386 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.386 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.386 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.386 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.386 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.386 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.386 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.387 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.387 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.387 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.387 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.387 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.387 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.387 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.387 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.387 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.387 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.387 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.387 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.387 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.387 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.388 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.389 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.390 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.390 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.390 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.390 INFO:teuthology.orchestra.run.smithi044.stdout:___ ERROR at teardown of test_object_lock_put_obj_retention_increase_period ____ 2023-12-03T12:39:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.390 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.390 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.391 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.391 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.392 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.392 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.392 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.392 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.392 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.392 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.394 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.395 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.395 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.395 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.395 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.395 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.396 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.396 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.396 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.396 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.396 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.396 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.396 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.396 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.396 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.396 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.396 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.396 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.396 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.396 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.396 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.396 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.396 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.397 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.397 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.397 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.397 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.397 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.397 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.397 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.397 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.397 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.397 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.397 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.397 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.397 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.397 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.397 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.397 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.398 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.398 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.398 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.398 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.398 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.398 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.398 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.398 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.398 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.398 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.398 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.398 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.398 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.398 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.398 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.399 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.399 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.399 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.399 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.399 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.399 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.399 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.399 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.399 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.399 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.399 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.399 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.399 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.399 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.399 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.399 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.399 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.400 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.400 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.400 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.400 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.400 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.400 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.400 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.400 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.400 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.400 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.400 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.400 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.400 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.400 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.400 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.401 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.401 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.401 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.401 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.401 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.401 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.401 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.401 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.401 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.401 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.401 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.401 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.401 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.401 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.401 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.402 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.402 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.402 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.402 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.402 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.402 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.402 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.402 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.402 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.402 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.402 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.402 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.402 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.403 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.403 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.403 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.403 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.403 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.403 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.403 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.403 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.403 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.403 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.403 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.403 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.403 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.403 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.403 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.404 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.404 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.404 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.404 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.404 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.404 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.404 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.404 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.404 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.404 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.404 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.404 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.404 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.404 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.404 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.404 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.405 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.405 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.405 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.405 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.405 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.405 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.405 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.405 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.405 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.405 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.405 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.405 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.405 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.405 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.406 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.406 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.406 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.406 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.406 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.406 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.406 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.406 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.406 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.406 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.406 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.406 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.406 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.406 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.406 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.406 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.407 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.407 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.407 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.407 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.407 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.407 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.407 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.407 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.407 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.407 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.407 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.407 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.407 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.407 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.407 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.408 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.408 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.408 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.408 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.408 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.408 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.408 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.408 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.408 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.408 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.408 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.408 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.408 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.408 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.408 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.408 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.409 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.409 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.409 INFO:teuthology.orchestra.run.smithi044.stdout:____ ERROR at teardown of test_object_lock_put_obj_retention_shorten_period ____ 2023-12-03T12:39:16.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.409 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.409 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.409 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.409 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.409 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.409 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.409 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.409 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.409 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.410 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.410 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.410 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.410 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.410 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.410 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.410 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.410 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.410 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.410 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.410 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.410 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.410 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.410 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.411 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.411 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.411 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.411 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.411 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.411 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.411 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.411 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.411 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.411 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.411 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.412 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.412 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.412 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.412 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.412 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.412 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.412 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.412 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.440 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.440 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.440 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.440 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.440 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.440 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.440 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.441 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.441 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.441 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.441 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.441 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.441 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.441 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.441 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.441 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.441 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.441 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.441 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.441 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.441 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.442 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.442 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.442 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.442 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.442 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.442 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.442 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.442 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.442 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.443 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.443 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.443 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.443 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.443 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.443 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.443 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.443 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.443 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.443 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.443 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.443 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.443 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.443 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.444 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.444 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.444 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.444 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.444 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.444 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.444 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.444 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.444 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.444 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.444 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.445 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.445 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.445 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.445 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.445 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.445 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.445 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.445 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.445 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.445 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.445 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.445 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.445 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.445 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.445 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.446 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.446 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.446 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.446 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.446 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.446 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.446 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.446 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.446 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.446 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.446 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.446 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.446 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.446 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.447 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.447 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.447 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.447 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.447 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.447 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.447 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.447 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.447 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.447 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.447 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.447 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.447 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.448 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.448 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.448 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.448 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.448 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.448 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.448 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.448 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.448 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.448 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.448 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.448 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.448 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.448 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.449 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.449 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.449 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.449 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.449 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.449 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.449 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.449 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.449 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.449 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.449 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.449 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.449 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.449 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.449 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.450 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.450 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.450 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.450 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.450 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.450 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.450 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.450 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.450 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.450 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.450 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.450 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.450 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.450 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.450 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.451 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.451 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.451 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.451 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.451 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.451 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.451 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.452 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.452 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.452 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.452 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.452 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.452 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.452 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.452 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.452 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.452 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.452 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.452 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.452 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.453 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.453 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.453 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.453 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.453 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.453 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.453 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.453 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.453 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.453 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.453 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.453 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.454 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.454 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.454 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.454 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.454 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.454 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.454 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.454 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.454 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.454 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.454 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.455 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.455 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.455 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.455 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.455 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.455 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.455 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.455 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.455 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.455 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.455 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.455 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.455 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.455 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.456 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.456 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.456 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.456 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.456 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.456 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.456 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.456 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.456 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.456 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.456 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.456 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.457 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.457 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.457 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.457 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.457 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.457 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.457 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.457 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.457 INFO:teuthology.orchestra.run.smithi044.stdout:_ ERROR at teardown of test_object_lock_put_obj_retention_shorten_period_bypass _ 2023-12-03T12:39:16.457 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.457 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.457 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.457 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.457 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.458 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.458 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.458 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.458 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.458 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.458 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.458 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.458 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.458 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.458 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.458 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.459 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.459 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.459 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.459 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.459 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.459 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.459 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.459 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.459 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.459 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.459 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.459 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.459 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.459 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.459 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.460 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.460 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.460 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.460 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.460 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.460 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.460 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.460 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.460 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.460 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.460 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.460 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.460 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.460 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.460 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.460 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.461 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.461 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.461 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.461 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.461 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.461 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.461 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.461 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.461 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.461 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.461 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.461 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.462 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.462 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.462 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.462 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.462 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.462 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.462 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.462 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.462 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.462 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.462 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.462 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.463 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.463 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.463 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.463 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.463 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.463 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.463 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.463 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.463 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.463 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.464 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.464 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.464 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.464 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.464 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.464 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.464 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.464 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.464 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.464 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.464 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.464 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.464 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.465 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.465 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.465 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.465 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.465 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.465 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.465 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.465 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.465 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.465 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.465 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.465 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.465 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.465 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.466 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.466 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.466 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.466 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.466 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.466 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.466 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.466 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.466 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.466 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.466 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.466 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.466 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.466 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.467 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.467 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.467 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.467 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.467 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.467 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.467 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.467 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.467 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.467 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.467 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.467 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.467 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.467 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.468 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.468 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.468 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.468 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.468 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.468 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.468 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.468 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.468 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.468 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.468 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.468 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.469 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.469 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.469 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.469 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.469 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.469 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.469 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.469 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.469 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.469 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.470 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.470 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.470 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.470 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.470 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.470 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.470 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.470 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.470 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.470 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.470 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.470 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.471 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.471 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.471 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.471 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.471 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.471 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.471 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.471 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.471 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.471 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.471 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.471 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.471 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.472 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.472 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.472 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.472 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.472 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.472 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.472 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.472 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.472 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.472 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.472 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.472 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.472 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.472 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.472 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.473 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.473 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.473 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.473 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.473 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.473 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.473 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.473 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.473 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.473 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.473 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.473 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.473 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.473 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.473 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.473 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.474 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.474 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.474 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.474 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.474 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.474 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.474 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.474 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.474 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.474 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.474 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.474 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.474 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.474 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.474 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.475 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.475 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.475 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.475 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.475 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.475 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.475 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.475 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.475 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.475 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.475 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.475 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.475 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.475 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.475 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.475 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.476 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.476 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.476 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.476 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.476 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.476 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.476 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.476 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.476 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.477 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.477 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.477 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.477 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.477 INFO:teuthology.orchestra.run.smithi044.stdout:______ ERROR at teardown of test_object_lock_delete_object_with_retention ______ 2023-12-03T12:39:16.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.477 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.477 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.477 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.477 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.477 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.478 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.478 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.478 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.478 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.478 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.478 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.478 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.478 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.478 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.478 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.478 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.478 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.478 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.478 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.479 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.479 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.479 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.479 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.479 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.479 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.479 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.479 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.479 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.479 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.479 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.479 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.479 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.480 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.480 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.480 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.480 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.480 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.480 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.480 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.480 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.480 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.480 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.480 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.480 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.480 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.480 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.480 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.481 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.481 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.481 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.481 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.481 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.481 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.481 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.481 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.481 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.481 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.481 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.481 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.482 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.482 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.482 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.482 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.482 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.482 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.482 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.482 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.482 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.482 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.482 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.482 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.482 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.482 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.483 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.483 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.483 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.483 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.483 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.483 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.483 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.483 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.483 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.483 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.483 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.484 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.484 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.484 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.484 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.484 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.484 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.484 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.484 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.484 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.484 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.484 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.484 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.484 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.484 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.484 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.484 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.484 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.485 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.485 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.485 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.485 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.485 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.485 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.485 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.485 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.485 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.485 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.485 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.485 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.485 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.485 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.485 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.486 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.486 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.486 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.486 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.486 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.486 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.486 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.486 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.486 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.486 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.486 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.486 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.486 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.486 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.487 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.487 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.487 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.487 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.487 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.487 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.487 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.487 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.487 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.487 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.487 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.487 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.487 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.487 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.487 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.487 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.487 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.488 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.488 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.488 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.488 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.488 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.488 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.488 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.488 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.488 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.488 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.488 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.488 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.488 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.488 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.489 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.489 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.489 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.489 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.489 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.489 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.489 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.489 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.489 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.489 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.489 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.489 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.489 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.489 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.490 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.490 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.490 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.490 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.490 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.490 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.490 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.490 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.490 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.490 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.490 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.490 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.490 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.491 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.491 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.491 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.491 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.491 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.491 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.491 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.491 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.491 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.491 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.491 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.491 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.491 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.491 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.491 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.492 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.492 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.492 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.492 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.492 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.492 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.492 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.493 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.493 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.493 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.493 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.493 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.493 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.493 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.493 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.493 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.493 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.493 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.493 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.493 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.494 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.494 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.494 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.494 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.494 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.494 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.494 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.494 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.494 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.494 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.494 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.494 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.494 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.495 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.495 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.495 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.495 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.495 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.495 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.495 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.495 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.495 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.495 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.495 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.495 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.495 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.495 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.495 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.496 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.496 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.496 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.496 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.496 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.496 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.496 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.496 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.496 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.496 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.496 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.496 INFO:teuthology.orchestra.run.smithi044.stdout:_ ERROR at teardown of test_object_lock_delete_object_with_retention_and_marker _ 2023-12-03T12:39:16.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.497 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.497 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.497 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.497 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.497 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.497 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.497 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.497 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.497 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.497 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.497 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.497 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.497 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.497 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.497 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.497 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.498 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.498 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.498 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.498 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.498 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.498 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.498 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.498 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.498 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.498 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.498 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.498 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.498 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.498 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.498 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.498 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.499 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.499 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.499 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.499 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.499 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.499 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.499 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.499 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.499 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.499 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.499 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.499 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.499 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.499 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.499 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.499 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.500 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.500 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.500 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.500 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.500 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.500 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.500 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.500 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.500 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.500 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.501 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.501 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.501 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.501 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.501 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.501 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.501 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.501 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.501 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.501 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.501 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.501 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.501 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.501 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.502 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.502 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.502 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.502 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.502 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.502 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.502 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.502 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.502 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.502 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.502 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.502 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.502 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.502 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.503 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.503 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.503 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.503 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.503 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.503 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.503 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.503 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.503 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.503 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.503 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.503 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.503 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.503 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.504 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.504 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.504 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.504 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.504 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.504 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.504 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.504 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.504 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.504 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.504 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.504 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.504 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.504 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.504 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.505 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.505 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.505 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.505 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.505 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.505 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.505 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.505 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.505 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.505 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.505 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.505 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.505 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.505 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.505 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.505 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.506 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.506 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.506 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.506 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.506 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.506 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.506 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.506 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.506 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.506 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.506 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.506 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.506 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.506 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.506 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.507 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.507 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.507 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.507 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.507 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.507 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.507 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.507 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.507 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.507 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.507 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.507 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.507 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.507 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.508 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.508 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.508 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.508 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.508 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.508 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.508 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.508 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.508 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.508 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.508 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.508 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.508 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.508 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.508 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.508 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.508 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.509 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.509 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.509 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.509 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.509 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.509 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.509 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.509 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.509 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.509 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.509 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.509 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.509 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.509 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.509 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.509 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.510 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.510 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.510 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.510 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.510 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.510 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.510 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.510 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.510 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.510 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.510 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.510 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.510 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.511 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.511 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.511 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.511 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.511 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.511 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.511 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.511 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.511 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.511 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.511 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.511 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.512 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.512 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.512 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.512 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.512 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.512 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.512 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.512 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.512 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.512 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.512 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.512 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.512 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.513 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.513 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.513 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.513 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.513 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.513 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.513 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.513 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.513 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.513 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.513 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.513 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.513 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.513 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.513 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.514 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.514 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.514 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.514 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.514 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.514 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.514 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.514 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.514 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.514 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.514 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.514 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.514 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.514 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.515 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.515 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.515 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.515 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.515 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.515 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.515 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.515 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.515 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.515 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.515 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.515 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.515 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.516 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.516 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.516 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.516 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.516 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.516 INFO:teuthology.orchestra.run.smithi044.stdout:___ ERROR at teardown of test_object_lock_multi_delete_object_with_retention ___ 2023-12-03T12:39:16.516 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.516 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.516 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.516 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.516 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.516 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.516 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.517 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.517 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.517 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.517 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.517 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.517 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.517 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.517 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.517 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.517 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.517 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.517 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.517 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.517 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.517 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.518 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.518 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.518 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.518 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.518 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.518 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.518 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.518 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.518 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.518 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.518 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.518 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.518 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.519 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.519 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.519 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.519 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.519 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.519 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.519 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.519 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.519 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.519 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.519 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.519 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.519 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.519 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.519 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.520 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.520 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.520 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.520 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.520 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.520 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.520 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.520 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.520 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.520 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.520 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.520 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.520 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.521 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.521 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.521 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.521 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.521 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.521 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.521 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.521 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.521 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.521 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.521 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.521 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.521 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.521 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.522 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.522 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.522 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.522 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.522 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.522 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.522 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.522 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.522 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.522 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.522 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.522 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.522 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.522 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.522 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.523 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.523 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.523 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.523 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.523 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.523 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.523 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.523 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.523 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.523 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.523 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.523 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.523 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.524 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.524 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.524 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.524 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.524 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.524 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.524 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.524 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.524 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.524 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.524 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.524 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.524 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.524 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.524 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.525 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.525 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.525 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.525 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.525 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.525 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.525 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.525 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.525 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.525 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.525 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.525 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.525 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.525 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.525 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.525 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.525 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.526 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.526 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.526 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.526 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.526 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.526 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.526 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.526 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.526 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.526 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.526 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.526 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.526 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.526 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.526 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.527 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.527 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.527 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.527 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.527 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.527 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.527 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.527 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.527 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.527 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.527 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.527 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.527 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.527 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.527 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.528 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.528 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.528 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.528 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.528 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.528 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.528 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.528 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.528 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.528 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.528 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.528 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.528 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.528 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.528 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.528 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.529 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.529 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.529 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.529 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.529 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.529 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.529 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.529 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.529 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.529 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.529 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.529 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.529 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.529 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.529 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.529 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.529 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.530 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.530 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.530 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.530 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.530 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.530 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.530 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.530 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.530 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.530 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.530 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.530 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.530 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.530 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.531 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.531 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.531 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.531 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.531 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.531 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.531 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.531 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.531 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.531 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.531 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.531 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.531 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.531 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.532 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.532 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.532 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.532 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.532 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.532 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.532 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.532 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.532 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.532 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.532 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.532 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.532 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.532 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.533 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.533 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.533 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.533 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.533 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.533 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.533 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.533 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.533 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.533 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.533 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.533 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.533 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.533 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.534 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.534 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.534 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.534 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.534 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.534 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.534 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.534 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.534 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.534 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.534 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.534 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.534 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.534 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.535 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.535 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.535 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.535 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.535 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.535 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.535 INFO:teuthology.orchestra.run.smithi044.stdout:_____________ ERROR at teardown of test_object_lock_put_legal_hold _____________ 2023-12-03T12:39:16.535 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.535 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.535 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.535 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.535 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.535 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.535 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.536 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.536 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.536 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.536 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.536 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.536 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.536 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.536 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.536 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.536 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.536 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.536 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.536 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.536 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.537 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.537 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.537 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.537 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.537 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.537 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.537 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.537 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.537 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.537 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.537 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.537 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.537 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.537 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.537 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.537 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.537 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.538 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.538 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.538 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.538 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.538 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.538 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.538 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.538 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.538 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.538 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.538 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.538 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.538 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.538 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.539 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.539 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.539 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.539 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.539 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.539 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.539 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.539 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.539 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.539 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.539 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.539 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.539 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.539 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.539 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.539 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.540 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.540 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.540 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.540 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.540 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.540 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.540 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.540 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.540 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.540 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.540 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.541 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.541 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.541 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.541 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.541 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.541 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.541 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.541 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.541 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.541 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.541 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.541 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.541 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.541 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.541 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.541 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.542 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.542 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.542 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.542 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.542 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.542 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.542 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.542 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.542 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.542 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.542 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.542 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.543 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.543 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.543 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.543 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.543 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.543 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.543 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.543 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.543 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.543 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.543 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.543 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.543 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.543 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.543 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.543 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.544 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.544 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.544 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.544 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.544 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.544 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.544 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.544 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.544 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.544 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.544 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.544 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.544 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.545 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.545 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.545 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.545 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.545 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.545 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.545 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.545 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.545 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.545 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.545 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.545 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.545 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.545 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.545 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.546 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.546 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.546 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.546 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.546 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.546 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.546 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.546 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.546 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.546 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.546 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.546 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.547 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.547 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.547 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.547 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.547 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.547 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.547 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.547 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.547 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.547 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.547 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.547 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.547 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.547 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.547 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.547 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.548 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.548 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.548 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.548 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.548 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.548 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.548 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.548 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.548 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.548 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.548 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.548 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.548 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.548 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.548 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.549 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.549 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.549 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.549 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.549 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.549 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.549 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.549 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.550 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.550 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.550 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.550 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.550 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.550 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.550 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.550 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.550 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.550 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.550 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.550 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.550 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.550 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.550 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.551 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.551 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.551 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.551 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.551 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.551 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.551 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.551 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.551 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.551 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.551 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.551 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.551 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.551 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.552 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.552 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.552 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.552 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.552 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.552 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.552 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.552 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.552 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.552 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.552 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.552 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.552 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.552 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.552 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.552 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.553 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.553 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.553 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.553 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.553 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.553 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.553 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.553 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.553 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.553 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.553 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.553 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.553 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.554 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.554 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.554 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.554 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.554 INFO:teuthology.orchestra.run.smithi044.stdout:_____ ERROR at teardown of test_object_lock_put_legal_hold_invalid_bucket ______ 2023-12-03T12:39:16.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.554 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.554 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.554 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.555 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.555 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.555 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.555 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.555 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.555 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.555 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.555 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.555 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.555 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.555 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.555 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.555 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.555 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.555 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.556 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.556 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.556 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.556 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.556 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.556 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.556 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.556 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.556 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.556 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.556 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.556 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.556 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.556 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.556 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.556 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.557 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.557 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.557 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.557 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.557 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.557 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.557 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.557 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.557 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.557 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.557 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.557 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.557 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.558 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.558 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.558 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.558 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.558 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.558 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.558 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.558 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.558 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.558 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.558 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.558 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.559 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.559 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.559 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.559 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.559 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.559 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.559 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.559 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.559 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.559 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.559 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.559 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.560 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.560 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.560 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.560 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.560 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.560 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.560 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.560 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.560 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.560 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.560 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.560 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.560 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.560 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.561 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.561 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.561 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.561 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.561 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.561 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.561 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.561 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.561 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.561 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.561 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.561 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.561 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.561 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.562 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.562 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.562 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.562 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.562 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.562 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.562 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.562 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.562 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.562 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.563 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.563 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.563 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.563 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.563 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.563 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.563 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.563 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.563 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.563 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.563 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.563 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.563 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.563 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.563 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.563 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.564 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.564 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.564 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.564 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.564 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.564 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.564 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.564 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.564 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.564 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.564 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.564 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.564 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.564 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.564 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.564 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.565 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.565 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.565 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.565 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.565 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.565 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.565 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.565 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.565 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.565 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.565 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.565 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.565 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.565 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.565 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.565 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.566 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.566 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.566 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.566 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.566 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.566 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.566 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.566 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.566 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.566 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.566 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.567 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.567 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.567 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.567 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.567 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.567 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.567 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.567 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.567 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.567 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.567 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.567 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.567 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.567 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.567 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.568 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.568 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.568 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.568 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.568 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.568 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.568 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.568 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.568 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.568 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.568 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.568 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.568 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.568 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.568 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.568 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.569 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.569 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.569 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.569 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.569 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.569 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.569 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.569 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.569 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.569 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.569 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.569 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.569 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.569 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.569 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.570 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.570 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.570 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.570 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.570 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.570 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.570 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.570 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.570 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.570 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.570 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.570 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.570 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.570 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.571 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.571 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.571 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.571 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.571 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.571 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.571 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.571 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.571 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.571 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.571 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.571 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.571 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.572 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.572 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.572 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.572 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.572 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.572 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.572 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.572 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.572 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.572 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.572 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.572 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.572 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.572 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.572 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.572 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.573 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.573 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.573 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.573 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.573 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.573 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.573 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.573 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.573 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.573 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.573 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.573 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.573 INFO:teuthology.orchestra.run.smithi044.stdout:_____ ERROR at teardown of test_object_lock_put_legal_hold_invalid_status ______ 2023-12-03T12:39:16.573 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.573 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.573 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.574 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.574 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.574 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.574 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.574 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.574 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.574 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.574 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.574 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.574 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.574 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.575 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.575 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.575 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.575 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.575 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.575 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.575 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.575 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.575 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.575 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.575 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.575 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.575 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.575 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.575 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.576 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.576 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.576 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.576 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.576 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.576 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.576 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.576 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.576 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.576 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.576 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.576 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.576 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.576 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.577 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.577 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.577 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.577 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.577 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.577 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.577 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.577 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.577 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.577 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.577 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.577 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.578 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.578 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.578 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.578 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.578 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.578 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.578 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.578 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.578 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.578 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.578 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.578 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.579 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.579 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.579 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.579 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.579 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.579 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.579 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.579 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.579 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.579 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.579 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.579 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.579 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.579 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.580 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.580 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.580 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.580 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.580 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.580 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.580 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.580 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.580 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.580 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.580 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.580 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.580 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.580 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.580 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.581 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.581 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.581 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.581 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.581 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.581 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.581 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.581 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.581 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.581 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.581 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.581 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.581 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.582 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.582 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.582 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.582 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.582 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.582 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.582 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.582 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.582 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.582 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.582 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.582 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.582 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.583 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.583 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.583 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.583 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.583 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.583 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.583 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.583 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.583 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.583 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.583 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.583 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.583 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.584 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.584 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.584 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.584 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.584 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.584 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.584 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.584 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.584 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.584 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.584 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.584 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.584 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.584 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.584 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.585 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.585 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.585 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.585 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.585 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.585 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.585 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.585 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.585 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.585 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.585 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.585 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.585 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.585 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.585 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.585 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.586 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.586 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.586 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.586 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.586 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.586 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.586 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.586 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.586 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.586 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.586 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.586 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.587 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.587 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.587 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.587 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.587 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.587 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.587 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.587 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.587 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.587 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.587 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.587 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.587 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.587 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.587 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.587 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.588 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.588 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.588 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.588 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.588 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.588 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.588 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.588 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.588 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.588 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.588 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.588 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.588 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.588 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.588 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.588 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.589 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.589 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.589 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.589 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.589 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.589 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.589 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.589 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.589 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.589 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.589 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.589 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.589 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.589 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.590 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.590 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.590 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.590 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.590 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.590 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.590 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.590 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.590 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.590 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.590 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.590 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.590 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.590 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.591 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.591 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.591 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.591 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.591 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.591 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.591 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.591 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.591 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.591 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.591 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.591 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.591 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.591 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.592 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.592 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.592 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.592 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.592 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.592 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.592 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.592 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.592 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.592 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.592 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.592 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.592 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.592 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.593 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.593 INFO:teuthology.orchestra.run.smithi044.stdout:_____________ ERROR at teardown of test_object_lock_get_legal_hold _____________ 2023-12-03T12:39:16.593 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.593 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.593 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.593 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.593 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.593 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.593 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.593 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.593 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.593 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.593 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.593 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.593 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.594 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.594 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.594 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.594 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.594 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.594 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.594 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.594 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.594 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.594 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.594 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.595 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.595 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.595 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.595 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.595 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.595 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.595 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.595 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.595 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.595 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.595 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.595 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.595 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.595 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.595 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.595 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.596 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.596 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.596 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.596 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.596 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.596 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.596 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.596 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.596 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.596 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.596 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.596 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.596 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.597 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.597 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.597 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.597 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.597 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.597 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.597 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.597 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.597 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.597 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.597 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.597 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.598 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.598 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.598 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.598 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.598 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.598 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.598 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.598 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.598 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.598 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.598 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.598 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.598 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.598 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.598 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.598 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.599 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.599 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.599 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.599 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.599 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.599 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.599 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.599 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.599 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.599 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.599 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.599 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.599 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.599 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.599 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.599 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.599 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.600 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.600 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.600 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.600 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.600 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.600 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.600 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.600 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.600 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.600 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.600 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.600 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.600 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.601 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.601 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.601 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.601 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.601 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.601 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.601 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.601 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.601 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.601 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.601 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.601 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.601 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.601 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.601 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.602 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.602 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.602 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.602 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.602 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.602 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.602 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.602 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.602 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.602 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.602 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.602 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.602 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.602 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.603 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.603 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.603 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.603 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.603 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.603 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.603 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.603 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.603 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.603 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.603 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.603 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.603 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.603 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.603 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.604 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.604 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.604 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.604 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.604 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.604 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.604 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.604 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.604 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.604 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.604 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.604 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.604 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.605 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.605 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.605 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.605 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.605 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.605 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.605 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.605 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.605 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.605 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.606 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.606 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.606 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.606 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.606 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.606 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.606 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.606 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.606 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.606 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.607 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.607 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.607 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.607 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.607 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.607 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.607 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.607 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.608 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.608 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.608 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.608 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.608 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.608 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.608 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.608 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.608 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.608 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.608 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.608 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.609 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.609 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.609 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.609 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.609 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.609 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.609 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.609 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.609 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.609 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.609 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.609 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.609 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.609 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.609 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.610 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.610 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.610 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.610 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.610 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.610 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.610 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.610 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.610 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.610 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.610 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.610 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.610 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.611 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.611 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.611 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.611 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.611 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.611 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.611 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.611 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.611 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.611 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.611 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.611 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.611 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.611 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.612 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.612 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.612 INFO:teuthology.orchestra.run.smithi044.stdout:_____ ERROR at teardown of test_object_lock_get_legal_hold_invalid_bucket ______ 2023-12-03T12:39:16.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.612 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.612 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.612 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.612 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.612 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.612 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.612 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.613 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.613 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.613 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.613 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.613 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.613 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.613 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.613 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.613 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.613 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.613 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.613 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.613 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.613 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.614 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.614 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.614 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.614 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.614 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.614 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.614 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.614 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.614 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.614 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.614 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.614 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.614 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.614 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.614 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.615 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.615 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.615 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.615 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.615 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.615 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.615 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.615 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.615 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.615 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.615 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.616 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.616 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.616 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.616 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.616 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.616 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.616 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.616 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.616 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.616 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.616 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.617 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.617 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.617 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.617 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.617 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.617 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.617 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.617 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.617 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.617 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.617 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.617 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.618 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.618 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.618 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.618 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.618 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.618 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.618 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.618 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.618 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.618 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.618 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.618 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.618 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.618 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.619 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.619 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.619 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.619 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.619 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.619 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.619 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.619 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.619 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.619 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.619 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.619 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.619 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.619 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.619 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.619 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.620 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.620 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.620 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.620 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.620 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.620 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.620 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.620 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.621 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.621 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.621 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.621 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.621 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.621 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.621 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.621 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.621 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.621 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.621 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.621 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.621 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.621 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.622 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.622 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.622 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.622 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.622 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.622 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.622 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.622 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.622 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.622 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.622 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.623 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.623 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.623 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.623 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.623 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.623 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.623 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.623 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.623 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.623 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.623 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.623 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.623 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.623 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.623 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.623 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.624 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.624 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.624 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.624 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.624 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.624 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.624 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.624 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.624 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.624 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.625 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.625 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.625 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.625 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.625 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.625 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.625 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.625 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.625 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.625 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.625 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.625 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.625 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.625 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.625 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.626 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.626 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.626 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.626 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.626 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.626 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.626 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.627 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.627 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.627 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.627 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.627 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.627 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.627 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.627 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.627 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.627 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.627 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.627 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.627 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.627 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.628 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.628 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.628 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.628 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.628 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.628 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.628 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.628 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.628 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.628 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.628 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.628 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.628 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.628 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.629 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.629 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.629 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.629 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.629 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.629 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.629 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.629 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.629 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.629 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.629 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.629 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.629 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.629 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.629 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.629 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.630 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.630 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.630 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.630 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.630 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.630 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.630 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.630 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.630 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.630 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.630 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.630 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.630 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.630 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.630 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.631 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.631 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.631 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.631 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.631 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.631 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.631 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.631 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.631 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.631 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.631 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.631 INFO:teuthology.orchestra.run.smithi044.stdout:____ ERROR at teardown of test_object_lock_delete_object_with_legal_hold_on ____ 2023-12-03T12:39:16.631 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.632 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.632 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.632 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.632 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.632 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.632 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.632 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.632 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.632 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.632 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.632 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.632 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.632 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.632 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.632 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.633 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.633 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.633 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.633 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.633 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.633 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.633 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.633 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.633 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.633 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.633 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.633 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.633 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.633 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.634 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.634 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.634 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.634 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.634 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.634 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.634 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.634 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.634 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.634 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.634 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.634 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.634 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.634 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.634 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.635 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.635 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.635 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.635 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.635 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.635 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.635 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.635 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.635 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.635 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.635 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.635 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.635 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.635 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.636 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.636 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.636 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.636 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.636 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.636 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.636 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.636 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.636 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.636 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.636 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.636 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.636 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.637 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.637 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.637 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.637 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.637 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.637 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.637 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.637 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.637 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.637 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.637 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.637 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.637 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.637 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.637 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.637 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.638 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.638 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.638 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.638 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.638 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.638 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.638 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.638 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.638 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.638 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.638 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.638 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.638 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.638 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.638 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.639 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.639 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.639 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.639 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.639 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.639 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.639 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.639 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.639 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.640 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.640 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.640 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.640 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.640 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.640 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.640 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.640 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.640 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.640 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.640 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.640 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.640 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.640 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.640 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.641 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.641 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.641 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.641 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.641 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.643 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.643 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.643 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.643 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.643 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.643 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.643 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.643 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.643 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.644 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.644 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.644 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.644 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.644 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.644 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.644 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.644 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.644 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.644 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.644 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.644 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.644 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.644 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.644 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.644 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.644 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.645 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.645 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.645 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.645 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.645 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.645 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.646 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.646 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.646 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.646 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.646 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.646 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.646 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.647 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.647 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.647 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.647 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.647 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.647 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.649 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.649 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.649 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.649 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.649 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.649 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.649 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.649 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.649 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.649 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.649 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.649 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.650 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.650 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.650 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.650 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.650 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.650 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.650 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.650 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.650 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.650 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.650 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.650 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.650 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.651 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.651 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.651 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.651 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.651 INFO:teuthology.orchestra.run.smithi044.stdout:___ ERROR at teardown of test_object_lock_delete_object_with_legal_hold_off ____ 2023-12-03T12:39:16.651 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.651 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.651 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.651 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.651 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.651 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.651 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.651 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.651 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.651 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.652 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.652 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.652 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.652 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.652 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.652 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.652 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.652 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.652 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.652 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.652 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.652 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.652 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.653 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.653 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.653 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.653 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.653 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.653 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.653 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.653 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.653 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.653 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.653 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.653 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.653 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.653 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.653 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.653 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.654 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.654 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.654 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.654 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.654 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.654 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.654 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.654 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.654 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.654 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.654 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.654 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.654 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.654 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.654 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.655 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.655 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.655 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.655 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.655 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.655 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.655 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.655 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.655 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.655 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.655 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.656 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.656 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.656 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.656 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.656 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.656 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.656 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.656 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.656 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.656 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.656 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.656 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.657 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.657 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.657 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.657 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.657 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.657 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.657 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.657 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.657 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.657 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.657 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.657 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.657 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.657 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.658 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.658 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.658 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.658 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.658 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.658 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.658 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.658 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.658 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.658 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.658 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.658 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.658 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.658 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.658 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.659 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.659 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.659 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.659 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.659 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.659 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.659 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.659 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.659 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.659 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.659 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.659 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.659 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.659 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.660 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.660 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.660 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.660 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.660 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.660 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.660 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.660 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.660 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.660 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.660 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.660 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.660 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.661 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.661 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.661 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.661 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.661 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.661 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.661 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.661 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.661 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.661 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.661 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.661 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.661 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.661 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.661 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.662 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.662 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.662 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.662 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.662 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.662 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.662 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.662 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.662 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.662 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.662 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.662 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.663 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.663 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.663 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.663 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.663 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.663 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.663 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.663 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.663 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.663 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.663 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.664 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.664 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.664 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.664 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.664 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.664 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.664 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.664 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.664 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.664 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.664 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.664 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.664 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.664 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.664 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.665 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.665 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.665 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.665 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.665 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.665 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.665 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.665 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.666 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.666 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.666 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.666 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.666 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.666 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.666 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.666 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.666 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.666 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.666 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.666 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.666 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.666 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.666 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.667 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.667 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.667 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.667 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.667 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.667 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.667 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.667 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.667 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.667 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.667 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.667 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.667 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.667 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.668 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.668 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.668 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.668 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.668 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.668 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.668 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.668 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.668 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.668 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.668 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.668 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.668 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.668 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.668 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.668 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.669 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.669 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.669 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.669 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.669 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.669 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.669 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.669 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.669 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.669 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.669 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.669 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.669 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.669 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.670 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.670 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.670 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.670 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.670 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.670 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.670 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.670 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.670 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.670 INFO:teuthology.orchestra.run.smithi044.stdout:____________ ERROR at teardown of test_object_lock_get_obj_metadata ____________ 2023-12-03T12:39:16.670 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.670 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.670 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.670 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.671 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.671 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.671 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.671 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.671 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.671 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.671 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.671 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.671 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.671 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.671 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.671 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.671 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.671 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.672 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.672 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.672 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.672 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.672 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.672 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.672 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.672 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.672 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.672 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.672 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.672 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.672 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.672 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.672 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.673 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.673 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.673 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.673 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.673 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.673 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.673 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.673 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.673 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.673 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.673 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.673 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.673 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.674 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.674 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.674 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.674 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.674 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.674 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.674 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.674 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.675 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.675 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.675 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.675 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.675 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.675 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.675 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.675 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.675 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.675 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.675 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.675 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.675 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.675 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.676 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.676 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.676 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.676 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.676 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.676 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.676 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.676 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.676 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.677 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.677 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.677 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.677 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.677 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.677 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.677 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.677 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.677 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.677 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.677 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.677 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.677 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.677 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.678 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.678 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.678 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.678 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.678 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.678 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.678 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.678 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.678 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.678 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.678 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.678 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.678 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.678 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.678 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.679 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.679 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.679 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.679 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.679 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.679 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.679 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.679 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.679 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.679 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.679 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.679 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.679 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.679 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.679 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.680 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.680 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.680 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.680 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.680 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.680 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.680 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.680 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.680 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.681 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.681 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.681 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.681 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.681 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.681 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.681 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.681 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.681 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.681 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.681 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.681 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.682 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.682 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.682 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.682 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.682 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.682 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.682 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.682 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.682 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.682 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.682 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.682 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.683 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.683 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.683 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.683 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.683 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.683 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.683 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.683 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.683 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.683 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.683 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.683 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.683 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.683 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.683 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.683 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.684 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.684 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.684 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.684 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.684 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.684 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.684 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.684 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.684 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.684 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.684 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.684 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.684 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.684 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.684 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.685 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.685 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.685 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.685 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.685 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.685 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.685 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.685 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.685 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.685 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.685 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.685 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.685 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.685 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.685 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.685 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.685 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.686 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.686 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.686 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.686 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.686 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.686 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.687 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.687 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.687 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.687 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.687 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.687 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.687 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.687 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.687 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.687 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.687 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.687 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.688 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.688 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.688 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.688 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.688 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.688 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.688 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.688 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.688 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.688 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.688 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.688 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.688 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.688 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.689 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.689 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.689 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.689 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.689 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.689 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.689 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.689 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.689 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.689 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.689 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.689 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.689 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.689 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.689 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.690 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.690 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.690 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.690 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.690 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.690 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.690 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.690 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.690 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.690 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.690 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.690 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.690 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.690 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.691 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.691 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.691 INFO:teuthology.orchestra.run.smithi044.stdout:_____________ ERROR at teardown of test_object_lock_uploading_obj ______________ 2023-12-03T12:39:16.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.691 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.691 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.691 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.691 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.691 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.691 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.692 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.692 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.692 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.692 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.692 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.692 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.692 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.692 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.692 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.692 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.692 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.693 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.693 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.693 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.693 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.693 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.693 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.693 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.693 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.693 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.693 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.693 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.693 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.694 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.694 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.694 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.694 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.694 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.694 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.694 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.694 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.694 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.694 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.694 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.694 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.694 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.695 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.695 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.695 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.695 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.695 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.695 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.695 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.695 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.695 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.695 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.695 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.695 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.695 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.695 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.695 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.695 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.696 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.696 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.696 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.696 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.696 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.696 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.696 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.696 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.696 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.696 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.697 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.697 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.697 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.697 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.697 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.697 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.697 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.697 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.697 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.697 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.697 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.697 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.697 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.698 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.698 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.698 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.698 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.698 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.698 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.698 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.698 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.698 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.698 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.698 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.698 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.698 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.698 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.699 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.699 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.699 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.699 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.699 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.699 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.699 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.699 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.699 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.699 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.699 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.699 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.700 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.700 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.700 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.700 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.700 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.700 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.700 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.700 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.700 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.700 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.700 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.700 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.700 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.700 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.701 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.701 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.701 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.701 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.701 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.701 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.701 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.701 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.701 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.701 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.701 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.701 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.702 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.702 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.702 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.702 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.702 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.702 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.702 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.702 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.702 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.702 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.702 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.702 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.702 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.702 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.703 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.703 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.703 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.703 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.703 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.703 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.703 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.703 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.703 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.703 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.703 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.703 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.703 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.704 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.704 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.704 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.704 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.704 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.704 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.704 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.704 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.704 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.704 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.704 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.704 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.704 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.704 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.704 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.705 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.705 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.705 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.705 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.705 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.705 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.705 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.705 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.706 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.706 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.706 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.706 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.706 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.706 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.706 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.706 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.706 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.706 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.706 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.706 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.706 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.706 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.707 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.707 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.707 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.707 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.707 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.707 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.707 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.707 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.707 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.707 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.707 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.707 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.707 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.707 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.707 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.708 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.708 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.708 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.708 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.708 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.708 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.708 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.708 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.708 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.708 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.708 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.708 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.708 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.708 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.708 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.709 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.709 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.709 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.709 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.709 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.709 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.709 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.709 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.709 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.709 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.709 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.709 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.709 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.709 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.709 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.710 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.710 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.710 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.710 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.710 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.710 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.710 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.710 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.710 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.710 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.710 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.710 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.710 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.711 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.711 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.711 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.711 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.711 INFO:teuthology.orchestra.run.smithi044.stdout:_ ERROR at teardown of test_object_lock_changing_mode_from_governance_with_bypass _ 2023-12-03T12:39:16.711 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.711 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.711 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.711 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.711 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.711 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.711 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.711 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.711 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.712 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.712 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.712 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.712 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.712 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.712 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.712 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.712 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.712 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.712 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.712 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.713 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.713 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.713 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.713 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.713 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.713 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.713 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.713 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.713 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.713 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.713 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.714 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.714 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.714 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.714 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.714 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.714 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.714 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.714 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.714 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.714 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.714 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.714 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.714 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.714 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.715 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.715 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.715 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.715 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.715 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.715 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.715 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.715 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.715 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.715 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.716 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.716 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.716 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.716 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.716 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.716 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.716 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.716 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.716 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.716 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.716 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.717 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.717 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.717 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.717 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.717 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.717 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.717 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.717 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.717 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.717 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.718 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.718 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.718 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.718 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.718 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.718 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.718 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.718 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.718 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.718 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.718 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.718 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.718 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.719 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.719 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.719 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.719 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.719 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.719 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.719 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.719 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.719 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.719 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.719 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.719 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.719 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.719 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.720 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.720 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.720 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.720 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.720 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.720 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.720 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.720 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.720 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.720 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.720 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.720 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.720 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.720 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.721 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.721 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.721 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.721 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.721 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.721 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.721 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.721 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.721 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.721 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.721 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.721 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.721 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.721 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.722 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.722 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.722 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.722 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.722 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.722 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.722 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.722 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.722 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.722 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.722 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.722 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.722 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.722 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.722 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.723 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.723 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.723 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.723 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.723 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.723 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.723 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.723 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.723 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.723 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.723 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.723 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.723 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.723 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.723 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.724 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.724 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.724 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.724 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.724 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.724 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.724 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.725 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.725 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.725 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.725 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.725 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.725 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.725 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.725 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.725 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.725 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.725 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.725 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.725 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.725 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.726 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.726 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.726 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.726 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.726 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.726 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.726 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.726 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.726 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.726 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.726 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.726 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.726 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.726 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.727 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.727 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.727 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.727 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.727 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.727 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.727 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.728 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.728 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.728 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.728 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.728 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.728 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.728 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.728 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.728 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.728 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.728 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.728 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.729 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.729 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.729 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.729 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.729 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.729 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.729 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.729 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.729 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.729 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.729 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.729 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.729 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.729 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.730 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.730 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.730 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.730 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.730 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.730 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.730 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.730 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.730 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.730 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.730 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.730 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.730 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.730 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.730 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.731 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.731 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.731 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.731 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.731 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.731 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.731 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.731 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.731 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.731 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.731 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.731 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.731 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.731 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.732 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.732 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.732 INFO:teuthology.orchestra.run.smithi044.stdout:_ ERROR at teardown of test_object_lock_changing_mode_from_governance_without_bypass _ 2023-12-03T12:39:16.732 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.732 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.732 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.732 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.732 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.732 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.732 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.732 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.732 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.732 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.732 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.732 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.733 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.733 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.733 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.733 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.733 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.733 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.733 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.733 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.733 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.733 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.733 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.733 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.733 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.733 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.734 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.734 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.734 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.734 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.734 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.734 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.734 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.734 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.734 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.734 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.734 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.734 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.734 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.735 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.735 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.735 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.735 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.735 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.735 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.735 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.735 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.735 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.735 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.735 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.735 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.735 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.735 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.736 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.736 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.736 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.736 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.736 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.736 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.736 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.736 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.736 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.736 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.736 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.736 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.736 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.737 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.737 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.737 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.737 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.737 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.737 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.737 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.737 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.737 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.737 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.737 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.738 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.738 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.738 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.738 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.738 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.738 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.738 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.738 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.738 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.738 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.738 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.739 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.739 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.739 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.739 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.739 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.739 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.739 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.739 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.739 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.739 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.739 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.739 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.739 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.740 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.740 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.740 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.740 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.740 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.740 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.740 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.740 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.740 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.740 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.740 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.740 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.740 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.741 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.741 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.741 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.741 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.741 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.741 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.741 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.741 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.741 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.741 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.742 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.742 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.742 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.742 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.742 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.742 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.742 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.742 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.742 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.742 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.742 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.742 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.742 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.742 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.742 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.743 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.743 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.743 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.743 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.743 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.743 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.743 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.743 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.743 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.743 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.743 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.743 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.743 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.743 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.744 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.744 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.744 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.744 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.744 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.744 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.744 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.744 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.744 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.744 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.744 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.744 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.745 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.745 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.745 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.745 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.745 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.745 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.745 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.745 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.745 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.745 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.745 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.745 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.746 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.746 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.746 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.746 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.746 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.746 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.746 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.746 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.746 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.746 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.746 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.746 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.746 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.746 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.747 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.747 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.747 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.747 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.747 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.747 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.747 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.747 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.748 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.748 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.748 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.748 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.748 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.748 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.748 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.748 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.748 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.748 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.748 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.748 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.748 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.749 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.749 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.749 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.749 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.749 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.749 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.749 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.749 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.749 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.749 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.749 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.749 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.749 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.750 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.750 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.750 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.750 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.750 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.750 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.750 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.750 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.750 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.750 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.750 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.750 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.750 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.751 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.751 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.751 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.751 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.751 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.751 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.751 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.751 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.751 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.751 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.751 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.751 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.751 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.752 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.752 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.752 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.752 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.752 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.752 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.752 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.752 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.752 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.752 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.752 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.752 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.752 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.752 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.752 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.753 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.753 INFO:teuthology.orchestra.run.smithi044.stdout:_____ ERROR at teardown of test_object_lock_changing_mode_from_compliance ______ 2023-12-03T12:39:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.753 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.754 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.754 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.754 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.754 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.754 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.754 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.754 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.754 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.754 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.754 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.754 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.754 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.754 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.754 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.754 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.758 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.758 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.758 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.758 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.758 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.758 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.758 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.758 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.758 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.758 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.758 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.758 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.758 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.760 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.760 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.761 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.761 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.761 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.761 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.761 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.761 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.761 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.761 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.761 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.761 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.761 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.761 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.762 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.762 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.762 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.762 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.762 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.762 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.762 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.762 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.762 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.762 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.762 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.762 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.762 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.762 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.763 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.763 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.763 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.765 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.765 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.765 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.765 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.765 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.765 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.765 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.765 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.765 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.765 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.765 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.765 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.766 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.766 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.766 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.766 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.766 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.766 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.766 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.766 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.766 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.766 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.766 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.766 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.766 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.766 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.766 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.766 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.767 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.767 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.767 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.767 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.767 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.767 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.767 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.767 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.767 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.767 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.767 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.767 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.767 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.767 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.767 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.767 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.768 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.768 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.768 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.768 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.768 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.768 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.768 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.768 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.768 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.768 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.768 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.768 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.768 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.768 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.768 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.768 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.769 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.769 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.769 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.769 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.769 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.769 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.769 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.769 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.769 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.769 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.769 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.769 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.769 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.769 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.770 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.770 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.770 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.770 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.770 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.770 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.770 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.770 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.770 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.770 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.770 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.770 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.770 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.770 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.770 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.771 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.771 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.771 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.771 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.771 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.771 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.771 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.771 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.771 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.771 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.771 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.771 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.771 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.772 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.772 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.772 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.772 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.772 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.772 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.772 INFO:teuthology.orchestra.run.smithi044.stdout:______________ ERROR at teardown of test_copy_object_ifmatch_good ______________ 2023-12-03T12:39:16.772 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.772 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.772 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.772 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.772 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.772 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.773 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.773 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.773 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.773 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.773 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.773 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.773 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.773 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.773 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.773 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.773 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.773 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.773 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.773 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.773 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.774 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.774 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.774 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.774 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.774 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.774 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.774 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.774 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.774 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.774 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.775 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.775 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.775 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.775 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.775 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.775 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.775 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.775 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.775 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.775 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.775 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.775 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.775 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.776 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.776 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.776 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.776 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.776 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.776 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.776 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.776 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.776 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.776 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.776 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.776 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.776 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.777 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.777 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.777 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.777 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.777 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.777 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.777 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.777 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.777 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.777 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.777 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.777 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.777 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.777 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.777 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.778 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.778 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.778 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.778 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.778 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.778 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.778 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.778 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.778 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.778 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.778 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.778 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.778 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.778 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.778 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.778 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.779 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.779 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.779 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.779 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.779 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.779 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.779 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.779 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.779 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.779 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.779 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.779 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.779 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.779 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.779 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.779 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.780 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.780 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.780 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.780 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.780 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.780 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.780 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.780 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.780 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.780 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.780 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.780 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.780 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.780 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.781 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.781 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.781 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.781 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.781 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.781 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.781 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.781 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.781 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.781 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.781 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.781 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.782 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.782 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.782 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.782 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.782 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.782 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.782 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.782 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.782 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.782 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.782 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.782 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.782 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.782 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.782 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.783 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.783 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.783 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.783 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.783 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.783 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.783 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.783 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.783 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.783 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.783 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.784 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.784 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.784 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.784 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.784 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.784 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.784 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.784 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.784 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.784 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.784 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.784 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.784 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.785 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.785 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.785 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.785 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.785 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.785 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.785 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.785 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.786 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.786 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.786 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.786 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.786 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.786 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.786 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.786 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.786 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.786 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.786 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.786 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.786 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.787 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.787 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.787 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.787 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.787 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.787 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.787 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.787 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.787 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.787 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.787 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.787 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.787 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.787 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.787 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.788 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.788 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.788 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.788 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.788 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.788 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.788 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.788 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.789 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.789 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.789 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.789 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.789 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.789 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.789 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.789 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.789 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.789 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.789 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.789 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.789 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.790 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.790 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.790 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.790 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.790 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.790 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.790 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.790 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.790 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.790 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.790 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.791 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.791 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.791 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.791 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.791 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.791 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.791 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.791 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.791 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.791 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.792 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.792 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.792 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.792 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.792 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.792 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.792 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.792 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.792 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.793 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.793 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.793 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.793 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.793 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.793 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.793 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.793 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.793 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.793 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.793 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.793 INFO:teuthology.orchestra.run.smithi044.stdout:___________ ERROR at teardown of test_copy_object_ifnonematch_failed ___________ 2023-12-03T12:39:16.793 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.793 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.793 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.793 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.794 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.794 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.794 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.794 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.794 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.794 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.794 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.794 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.794 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.794 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.794 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.794 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.794 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.794 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.795 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.795 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.795 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.795 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.795 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.795 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.795 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.795 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.795 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.795 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.795 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.795 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.795 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.796 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.796 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.796 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.796 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.796 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.796 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.796 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.796 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.796 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.796 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.796 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.796 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.796 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.797 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.797 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.797 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.797 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.797 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.797 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.797 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.797 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.797 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.797 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.797 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.797 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.797 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.798 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.798 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.798 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.798 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.798 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.798 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.798 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.798 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.798 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.798 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.798 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.798 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.798 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.798 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.799 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.799 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.799 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.799 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.799 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.799 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.799 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.799 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.799 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.799 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.799 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.799 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.799 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.800 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.800 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.800 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.800 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.800 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.800 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.800 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.800 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.800 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.800 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.800 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.800 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.800 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.800 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.800 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.800 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.801 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.801 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.801 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.801 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.801 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.801 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.801 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.801 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.801 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.801 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.801 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.801 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.801 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.802 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.802 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.802 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.802 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.802 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.802 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.802 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.802 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.802 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.802 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.802 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.802 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.802 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.802 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.802 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.803 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.803 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.803 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.803 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.803 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.803 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.803 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.803 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.803 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.803 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.803 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.803 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.803 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.804 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.804 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.804 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.804 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.804 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.804 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.804 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.804 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.804 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.804 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.804 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.804 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.804 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.804 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.804 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.805 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.805 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.805 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.805 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.805 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.805 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.805 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.805 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.805 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.805 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.805 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.805 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.806 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.806 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.806 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.806 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.806 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.806 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.806 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.806 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.806 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.806 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.806 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.806 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.806 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.806 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.807 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.807 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.807 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.807 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.807 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.807 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.807 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.807 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.807 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.807 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.807 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.807 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.807 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.807 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.807 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.807 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.808 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.808 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.808 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.808 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.808 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.808 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.808 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.809 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.809 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.809 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.809 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.809 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.809 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.809 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.809 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.809 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.810 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.810 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.810 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.810 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.810 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.810 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.810 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.810 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.810 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.810 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.810 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.810 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.810 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.811 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.811 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.811 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.811 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.811 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.811 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.811 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.811 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.811 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.811 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.811 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.811 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.811 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.811 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.811 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.812 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.812 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.812 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.812 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.812 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.812 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.812 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.812 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.812 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.812 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.812 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.812 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.812 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.812 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.813 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.813 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.813 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.813 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.813 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.813 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.813 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.813 INFO:teuthology.orchestra.run.smithi044.stdout:______________ ERROR at teardown of test_get_bucket_policy_status ______________ 2023-12-03T12:39:16.813 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.813 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.813 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.813 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.813 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.813 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.813 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.813 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.813 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.814 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.814 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.814 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.814 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.814 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.814 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.814 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.814 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.814 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.814 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.814 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.814 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.814 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.814 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.814 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.815 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.815 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.815 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.815 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.815 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.815 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.815 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.815 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.815 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.815 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.815 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.815 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.816 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.816 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.816 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.816 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.816 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.816 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.816 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.816 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.816 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.816 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.816 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.816 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.817 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.817 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.817 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.817 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.817 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.817 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.817 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.817 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.817 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.817 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.817 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.817 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.817 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.817 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.817 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.818 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.818 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.818 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.818 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.818 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.818 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.818 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.818 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.818 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.818 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.818 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.818 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.818 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.819 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.819 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.819 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.819 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.819 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.819 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.819 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.819 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.819 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.819 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.819 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.819 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.819 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.819 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.819 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.820 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.820 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.820 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.820 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.820 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.820 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.820 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.820 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.820 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.820 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.820 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.820 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.820 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.820 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.820 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.820 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.821 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.821 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.821 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.821 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.821 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.821 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.821 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.821 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.821 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.821 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.821 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.821 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.822 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.822 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.822 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.822 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.822 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.822 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.822 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.822 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.822 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.822 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.822 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.822 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.822 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.822 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.823 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.823 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.823 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.823 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.823 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.823 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.823 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.823 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.823 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.823 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.823 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.823 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.823 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.823 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.823 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.824 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.824 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.824 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.824 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.824 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.824 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.824 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.824 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.824 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.824 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.824 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.824 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.824 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.824 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.824 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.824 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.825 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.825 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.825 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.825 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.825 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.825 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.825 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.825 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.825 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.825 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.825 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.826 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.826 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.826 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.826 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.826 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.826 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.826 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.826 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.826 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.826 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.827 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.827 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.827 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.827 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.827 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.827 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.827 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.827 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.827 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.827 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.827 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.827 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.827 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.828 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.828 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.828 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.828 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.828 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.828 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.828 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.828 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.828 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.828 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.828 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.829 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.829 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.829 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.829 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.829 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.829 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.829 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.829 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.829 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.829 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.829 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.829 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.829 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.829 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.829 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.830 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.830 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.830 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.830 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.830 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.830 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.830 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.830 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.830 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.830 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.830 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.830 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.830 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.831 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.831 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.831 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.831 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.831 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.831 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.831 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.831 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.831 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.831 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.831 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.831 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.831 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.831 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.832 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.832 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.832 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.832 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.832 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.832 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.832 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.832 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.832 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.832 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.832 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.832 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.832 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.832 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.833 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.833 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.833 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.833 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.833 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.833 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.833 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.833 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.833 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.833 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.833 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.834 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.834 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.834 INFO:teuthology.orchestra.run.smithi044.stdout:________ ERROR at teardown of test_get_public_acl_bucket_policy_status _________ 2023-12-03T12:39:16.834 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.834 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.834 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.834 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.834 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.834 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.834 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.834 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.834 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.834 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.834 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.835 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.835 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.835 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.835 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.835 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.835 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.835 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.835 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.835 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.835 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.835 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.835 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.836 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.836 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.836 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.836 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.836 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.836 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.836 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.836 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.836 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.836 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.836 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.836 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.836 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.836 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.837 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.837 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.837 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.837 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.837 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.837 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.837 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.837 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.837 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.837 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.837 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.837 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.837 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.838 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.838 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.838 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.838 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.838 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.838 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.838 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.838 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.838 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.838 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.838 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.838 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.838 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.838 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.839 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.839 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.839 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.839 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.839 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.839 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.839 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.839 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.839 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.839 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.839 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.839 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.840 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.840 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.840 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.840 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.840 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.840 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.840 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.840 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.840 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.840 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.840 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.840 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.840 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.840 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.840 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.840 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.841 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.841 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.841 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.841 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.841 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.841 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.841 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.841 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.841 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.841 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.841 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.841 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.841 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.841 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.842 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.842 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.842 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.842 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.842 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.842 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.842 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.842 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.843 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.843 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.843 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.843 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.843 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.843 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.843 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.843 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.843 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.843 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.843 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.843 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.843 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.843 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.844 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.844 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.844 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.844 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.844 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.844 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.844 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.844 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.844 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.844 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.845 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.845 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.845 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.845 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.845 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.845 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.845 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.845 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.845 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.845 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.845 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.845 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.846 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.846 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.846 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.846 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.846 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.846 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.846 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.846 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.846 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.846 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.846 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.846 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.847 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.847 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.847 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.847 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.847 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.847 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.847 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.847 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.847 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.847 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.847 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.847 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.847 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.847 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.848 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.848 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.848 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.848 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.848 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.848 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.848 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.848 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.849 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.849 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.849 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.849 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.849 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.849 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.849 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.849 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.849 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.849 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.849 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.849 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.850 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.850 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.850 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.850 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.850 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.850 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.850 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.850 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.850 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.850 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.850 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.850 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.850 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.850 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.851 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.851 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.851 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.851 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.851 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.851 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.851 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.851 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.851 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.851 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.851 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.851 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.851 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.851 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.851 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.852 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.852 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.852 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.852 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.852 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.852 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.852 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.852 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.852 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.852 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.852 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.852 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.852 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.852 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.854 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.854 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.854 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.854 INFO:teuthology.orchestra.run.smithi044.stdout:______ ERROR at teardown of test_get_authpublic_acl_bucket_policy_status _______ 2023-12-03T12:39:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.854 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.855 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.855 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.855 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.855 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.855 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.855 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.855 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.855 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.855 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.855 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.855 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.855 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.855 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.855 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.855 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.855 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.856 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.856 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.856 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.856 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.856 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.856 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.856 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.856 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.856 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.856 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.856 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.856 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.856 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.856 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.856 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.857 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.857 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.857 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.857 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.857 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.857 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.857 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.857 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.857 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.857 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.857 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.857 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.858 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.858 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.858 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.858 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.858 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.858 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.858 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.858 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.858 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.858 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.858 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.858 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.858 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.858 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.859 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.859 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.859 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.859 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.859 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.859 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.859 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.859 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.859 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.859 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.859 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.859 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.860 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.860 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.860 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.860 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.860 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.860 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.860 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.860 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.860 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.860 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.860 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.860 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.860 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.860 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.861 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.861 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.861 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.861 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.861 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.861 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.861 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.861 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.861 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.861 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.861 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.861 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.861 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.861 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.861 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.862 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.862 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.862 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.862 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.862 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.862 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.862 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.862 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.862 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.862 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.862 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.862 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.862 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.862 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.863 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.863 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.863 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.863 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.863 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.863 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.863 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.863 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.863 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.863 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.863 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.863 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.863 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.863 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.864 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.864 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.864 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.864 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.864 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.864 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.864 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.864 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.864 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.864 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.864 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.864 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.864 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.864 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.864 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.864 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.865 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.865 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.865 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.865 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.865 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.865 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.865 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.865 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.865 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.865 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.865 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.865 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.865 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.865 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.865 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.866 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.866 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.866 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.866 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.866 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.866 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.866 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.866 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.866 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.866 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.866 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.866 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.866 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.866 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.867 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.867 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.867 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.867 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.867 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.867 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.867 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.867 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.867 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.867 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.868 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.868 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.868 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.868 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.868 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.868 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.868 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.868 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.868 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.868 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.868 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.868 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.868 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.868 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.868 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.868 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.868 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.869 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.869 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.869 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.869 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.869 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.869 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.869 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.869 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.869 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.869 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.869 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.869 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.869 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.869 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.869 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.870 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.870 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.870 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.870 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.870 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.870 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.870 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.870 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.871 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.871 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.871 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.871 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.871 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.871 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.871 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.871 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.871 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.871 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.871 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.871 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.871 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.871 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.871 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.872 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.872 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.872 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.872 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.872 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.872 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.872 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.872 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.872 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.872 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.872 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.872 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.872 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.872 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.873 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.873 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.873 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.873 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.873 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.873 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.873 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.873 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.873 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.873 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.873 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.873 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.873 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.873 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.874 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.874 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.874 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.874 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.874 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.874 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.874 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.874 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.874 INFO:teuthology.orchestra.run.smithi044.stdout:_____ ERROR at teardown of test_get_publicpolicy_acl_bucket_policy_status ______ 2023-12-03T12:39:16.874 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.875 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.875 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.875 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.875 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.875 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.875 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.875 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.875 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.875 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.875 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.875 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.875 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.876 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.876 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.876 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.876 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.876 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.876 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.876 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.876 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.876 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.876 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.876 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.877 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.877 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.877 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.877 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.877 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.877 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.877 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.877 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.877 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.877 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.877 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.877 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.877 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.877 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.878 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.878 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.878 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.878 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.878 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.878 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.878 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.878 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.878 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.878 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.878 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.878 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.878 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.878 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.879 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.879 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.879 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.879 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.879 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.879 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.879 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.879 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.879 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.879 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.879 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.879 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.879 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.879 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.879 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.879 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.880 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.880 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.880 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.880 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.880 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.880 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.880 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.880 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.880 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.880 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.880 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.881 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.881 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.881 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.881 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.881 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.881 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.881 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.881 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.881 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.881 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.881 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.881 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.881 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.882 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.882 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.882 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.882 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.882 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.882 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.882 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.882 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.882 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.882 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.882 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.882 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.882 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.883 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.883 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.883 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.883 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.883 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.883 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.883 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.883 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.883 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.883 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.883 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.883 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.884 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.884 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.884 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.884 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.884 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.884 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.884 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.884 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.884 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.884 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.884 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.884 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.884 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.884 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.885 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.885 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.885 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.885 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.885 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.885 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.885 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.885 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.885 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.885 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.885 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.885 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.885 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.885 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.885 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.885 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.886 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.886 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.886 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.886 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.886 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.886 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.886 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.886 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.886 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.886 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.886 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.886 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.886 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.886 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.886 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.887 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.887 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.887 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.887 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.887 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.887 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.887 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.887 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.887 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.888 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.888 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.888 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.888 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.888 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.888 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.888 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.888 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.888 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.888 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.888 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.888 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.888 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.889 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.889 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.889 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.889 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.889 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.889 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.889 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.889 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.889 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.889 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.889 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.889 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.889 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.889 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.890 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.890 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.890 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.890 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.890 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.890 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.890 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.890 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.890 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.890 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.890 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.890 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.890 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.890 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.890 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.891 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.891 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.891 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.891 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.891 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.891 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.891 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.891 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.891 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.891 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.891 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.891 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.891 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.891 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.892 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.892 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.892 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.892 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.892 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.892 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.892 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.892 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.892 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.892 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.892 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.892 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.892 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.893 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.893 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.893 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.893 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.893 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.893 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.893 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.893 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.893 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.893 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.893 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.893 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.893 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.893 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.893 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.893 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.894 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.894 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.894 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.894 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.894 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.894 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.894 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.894 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.894 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.894 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.894 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.894 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.895 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.895 INFO:teuthology.orchestra.run.smithi044.stdout:____ ERROR at teardown of test_get_nonpublicpolicy_acl_bucket_policy_status ____ 2023-12-03T12:39:16.895 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.895 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.895 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.895 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.895 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.895 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.895 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.895 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.895 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.895 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.895 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.896 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.896 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.896 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.896 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.896 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.896 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.896 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.896 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.896 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.896 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.896 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.896 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.896 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.896 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.896 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.896 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.896 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.897 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.897 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.897 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.897 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.897 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.897 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.897 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.897 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.897 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.897 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.897 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.897 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.897 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.897 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.897 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.898 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.898 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.898 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.898 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.898 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.898 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.898 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.898 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.898 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.898 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.898 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.898 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.898 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.898 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.899 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.899 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.899 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.899 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.899 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.899 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.899 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.899 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.899 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.899 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.899 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.899 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.899 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.900 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.900 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.900 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.900 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.900 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.900 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.900 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.900 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.900 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.900 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.900 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.900 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.900 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.900 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.900 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.901 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.901 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.901 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.901 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.901 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.901 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.901 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.901 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.901 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.901 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.901 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.901 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.901 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.901 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.901 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.902 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.902 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.902 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.902 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.902 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.902 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.902 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.902 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.902 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.902 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.902 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.902 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.902 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.903 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.903 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.903 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.903 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.903 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.903 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.903 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.903 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.903 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.903 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.903 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.903 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.903 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.903 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.903 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.903 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.903 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.904 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.904 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.904 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.904 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.904 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.904 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.904 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.904 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.904 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.904 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.904 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.904 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.904 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.904 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.904 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.904 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.904 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.905 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.905 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.905 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.905 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.905 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.905 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.905 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.905 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.905 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.905 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.905 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.905 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.905 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.906 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.906 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.906 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.906 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.906 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.906 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.906 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.906 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.906 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.906 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.906 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.906 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.906 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.906 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.906 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.907 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.907 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.907 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.907 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.907 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.907 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.907 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.907 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.907 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.908 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.908 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.908 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.908 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.908 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.908 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.908 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.908 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.908 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.909 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.909 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.909 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.909 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.909 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.909 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.909 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.909 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.909 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.909 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.909 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.909 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.909 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.909 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.910 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.910 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.910 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.910 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.910 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.910 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.910 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.910 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.910 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.910 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.910 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.910 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.911 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.911 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.911 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.911 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.911 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.911 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.912 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.912 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.912 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.912 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.912 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.913 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.913 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.913 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.913 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.913 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.913 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.913 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.913 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.913 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.913 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.914 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.914 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.914 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.914 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.914 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.914 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.915 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.915 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.915 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.915 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.915 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.915 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.915 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.915 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.915 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.915 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.915 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.915 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.915 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.915 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.915 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.916 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.916 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.916 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.916 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.916 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.916 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.916 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.916 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.916 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.916 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.916 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.917 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.917 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.917 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.917 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.917 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.917 INFO:teuthology.orchestra.run.smithi044.stdout:___ ERROR at teardown of test_get_nonpublicpolicy_deny_bucket_policy_status ____ 2023-12-03T12:39:16.917 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.917 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.917 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.917 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.917 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.917 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.917 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.917 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.917 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.917 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.918 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.918 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.918 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.918 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.918 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.918 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.918 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.918 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.918 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.918 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.918 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.919 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.919 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.919 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.919 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.919 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.919 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.919 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.919 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.919 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.919 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.919 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.919 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.919 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.919 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.919 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.920 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.920 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.920 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.920 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.920 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.920 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.920 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.920 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.920 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.920 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.920 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.920 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.920 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.920 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.920 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.920 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.920 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.921 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.921 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.921 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.921 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.921 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.921 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.921 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.921 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.921 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.921 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.921 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.921 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.922 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.922 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.922 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.922 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.922 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.922 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.922 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.922 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.922 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.922 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.922 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.922 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.922 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.923 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.923 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.923 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.923 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.923 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.923 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.923 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.923 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.923 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.923 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.923 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.923 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.923 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.923 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.923 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.924 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.924 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.924 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.924 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.924 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.924 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.924 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.924 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.924 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.924 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.924 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.924 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.924 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.924 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.924 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.924 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.925 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.925 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.925 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.925 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.925 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.925 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.925 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.925 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.925 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.925 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.925 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.925 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.925 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.925 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.925 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.926 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.926 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.926 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.926 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.926 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.926 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.926 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.926 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.926 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.926 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.926 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.926 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.926 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.926 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.926 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.927 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.927 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.927 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.927 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.927 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.927 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.927 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.927 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.927 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.927 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.927 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.927 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.927 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.928 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.928 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.928 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.928 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.928 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.928 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.928 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.928 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.928 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.928 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.928 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.928 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.928 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.928 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.928 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.929 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.929 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.929 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.929 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.929 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.929 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.929 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.930 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.930 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.930 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.930 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.930 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.930 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.930 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.930 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.930 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.930 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.930 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.930 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.930 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.930 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.930 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.931 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.931 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.931 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.931 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.931 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.931 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.931 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.931 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.931 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.931 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.931 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.931 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.931 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.932 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.932 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.932 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.932 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.932 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.932 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.932 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.932 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.932 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.932 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.932 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.932 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.932 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.932 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.932 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.932 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.933 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.933 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.933 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.933 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.933 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.933 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.933 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.933 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.933 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.933 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.933 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.934 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.934 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.934 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.934 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.934 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.934 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.934 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.934 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.934 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.934 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.934 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.934 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.934 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.934 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.934 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.935 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.935 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.935 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.935 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.935 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.935 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.935 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.935 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.935 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.935 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.935 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.935 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.935 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.935 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.935 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.935 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.936 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.936 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.936 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.936 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.936 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.936 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.936 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.936 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.936 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.936 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.936 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.936 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.936 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.936 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.937 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.937 INFO:teuthology.orchestra.run.smithi044.stdout:______________ ERROR at teardown of test_get_default_public_block ______________ 2023-12-03T12:39:16.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.937 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.937 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.937 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.937 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.937 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.937 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.937 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.937 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.938 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.938 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.938 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.938 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.938 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.938 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.938 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.938 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.938 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.938 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.938 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.938 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.938 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.938 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.938 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.938 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.939 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.939 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.939 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.939 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.939 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.939 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.939 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.939 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.939 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.939 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.939 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.939 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.939 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.939 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.939 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.939 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.940 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.940 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.940 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.940 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.940 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.940 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.940 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.940 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.940 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.940 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.940 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.940 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.940 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.940 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.940 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.941 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.941 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.941 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.941 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.941 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.941 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.941 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.941 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.941 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.941 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.941 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.941 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.942 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.942 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.942 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.942 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.942 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.942 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.942 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.942 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.942 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.942 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.942 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.942 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.942 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.942 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.942 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.943 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.943 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.943 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.943 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.943 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.943 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.943 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.943 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.943 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.943 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.943 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.943 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.943 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.943 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.943 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.943 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.943 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.944 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.944 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.944 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.944 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.944 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.944 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.944 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.944 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.944 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.944 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.944 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.944 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.945 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.945 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.945 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.945 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.945 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.945 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.945 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.945 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.945 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.945 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.945 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.945 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.945 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.946 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.946 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.946 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.946 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.946 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.946 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.946 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.946 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.946 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.946 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.946 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.946 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.947 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.947 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.947 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.947 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.947 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.947 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.947 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.947 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.947 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.947 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.947 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.948 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.948 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.948 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.948 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.948 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.948 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.948 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.948 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.948 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.948 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.948 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.948 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.948 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.949 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.949 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.949 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.949 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.949 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.949 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.949 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.949 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.949 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.950 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.950 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.950 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.950 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.950 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.950 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.950 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.950 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.950 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.950 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.950 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.951 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.951 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.951 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.951 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.951 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.951 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.951 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.951 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.952 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.952 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.952 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.952 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.952 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.952 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.952 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.952 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.952 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.952 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.952 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.952 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.952 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.952 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.952 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.953 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.953 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.953 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.953 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.953 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.953 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.953 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.953 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.953 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.953 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.953 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.953 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.953 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.953 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.953 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.954 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.954 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.954 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.954 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.954 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.954 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.954 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.954 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.954 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.954 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.954 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.954 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.954 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.955 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.955 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.955 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.955 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.955 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.955 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.955 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.955 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.955 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.955 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.955 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.955 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.955 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.955 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.955 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.956 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.956 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.956 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.956 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.956 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.956 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.956 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.956 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.956 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.956 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.956 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.956 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ ERROR at teardown of test_put_public_block __________________ 2023-12-03T12:39:16.957 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.957 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.957 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.957 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.957 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.957 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.957 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.957 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.957 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.957 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.957 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.957 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.958 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.958 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.958 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.958 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.958 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.958 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.958 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.958 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.958 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.958 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.958 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.958 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.958 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.958 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.959 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.959 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.959 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.959 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.959 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.959 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.959 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.959 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.959 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.959 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.959 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.959 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.959 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.960 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.960 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.960 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.960 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.960 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.960 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.960 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.960 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.960 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.960 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.960 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.960 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.961 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.961 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.961 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.961 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.961 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.961 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.961 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.961 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.961 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.961 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.961 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.961 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.961 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.962 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.962 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.962 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.962 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.962 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.962 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.962 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.962 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.962 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.962 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.962 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.962 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.962 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.962 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.962 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.963 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.963 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.963 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.963 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.963 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.963 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.963 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.963 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.963 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.963 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.963 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.963 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.963 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.963 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.963 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.964 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.964 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.964 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.964 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.964 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.964 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.964 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.964 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.964 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.964 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.964 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.964 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.964 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.964 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.965 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.965 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.965 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.965 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.965 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.965 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.965 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.965 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.965 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.965 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.965 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.965 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.965 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.965 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.965 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.965 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.966 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.966 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.966 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.966 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.966 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.966 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.966 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.966 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.966 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.966 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.966 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.966 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.966 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.966 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.967 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.967 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.967 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.967 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.967 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.967 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.967 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.967 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.967 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.967 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.967 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.967 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.967 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.967 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.968 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.968 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.968 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.968 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.968 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.968 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.968 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.968 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.968 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.968 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.968 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.968 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.968 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.968 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.969 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.969 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.969 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.969 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.969 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.969 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.969 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.969 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.969 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.969 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.969 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.969 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.970 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.970 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.970 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.970 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.970 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.970 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.970 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.970 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.970 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.970 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.970 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.970 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.971 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.971 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.971 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.971 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.971 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.971 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.971 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.971 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.971 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.971 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.971 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.971 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.971 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.972 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.972 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.972 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.972 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.972 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.972 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.972 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.972 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.972 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.972 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.972 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.972 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.972 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.972 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.972 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.972 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.973 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.973 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.973 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.973 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.973 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.973 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.973 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.973 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.973 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.973 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.973 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.973 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.973 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.973 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.973 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.974 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.974 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.974 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.974 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.974 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.974 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.974 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.974 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.974 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.974 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.974 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.974 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.975 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.975 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.975 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.975 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.975 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.975 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.975 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.975 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.975 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.975 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.975 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.975 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.975 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.975 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.975 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.975 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.976 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.976 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.976 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.976 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.976 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.976 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.976 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.976 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.976 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.976 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.976 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.976 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.976 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.977 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.977 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.977 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.977 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.977 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.977 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.977 INFO:teuthology.orchestra.run.smithi044.stdout:____________ ERROR at teardown of test_block_public_put_bucket_acls ____________ 2023-12-03T12:39:16.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.977 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.977 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.977 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.977 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.977 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.978 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.978 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.978 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.978 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.978 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.978 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.978 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.978 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.978 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.978 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.978 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.978 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.978 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.978 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.979 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.979 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.979 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.979 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.979 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.979 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.979 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.979 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.979 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.979 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.979 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.979 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.979 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.979 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.979 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.979 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.979 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.980 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.980 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.980 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.980 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.980 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.980 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.980 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.980 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.980 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:16.980 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:16.980 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:16.980 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:16.980 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.980 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:16.980 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:16.980 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:16.981 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:16.981 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.981 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.981 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:16.981 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:16.981 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:16.981 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:16.981 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.981 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.981 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:16.981 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:16.981 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:16.981 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.982 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:16.982 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.982 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:16.982 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:16.982 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.982 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:16.982 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:16.982 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:16.982 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:16.982 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:16.982 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:16.982 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.982 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:16.982 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.983 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.983 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.983 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.983 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.983 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.983 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.983 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.983 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.983 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.983 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.983 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.983 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.983 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.983 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.983 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.984 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.984 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.984 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.984 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.984 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.984 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.984 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.984 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:16.984 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.984 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.984 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.984 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.984 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.984 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.984 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.985 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.985 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.985 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.985 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:16.985 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:16.985 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:16.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:16.985 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:16.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:16.985 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:16.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:16.985 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:16.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:16.986 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:16.986 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:16.986 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:16.986 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:16.986 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:16.986 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:16.986 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:16.986 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:16.986 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.986 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:16.986 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:16.986 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:16.986 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:16.986 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:16.986 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:16.986 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:16.987 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:16.987 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:16.987 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:16.987 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.987 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.987 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.987 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.987 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.987 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.987 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.987 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.987 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.987 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.987 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.987 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.987 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.988 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.988 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.988 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.988 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.988 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:16.988 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.988 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.988 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.988 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:16.988 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:16.988 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:16.988 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:16.988 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:16.988 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.988 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.989 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:16.989 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:16.989 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:16.989 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.989 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:16.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.989 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:16.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.989 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:16.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.989 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:16.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.989 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:16.989 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:16.990 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:16.990 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:16.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.990 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:16.990 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.990 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:16.990 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:16.990 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:16.990 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:16.990 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:16.990 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:16.990 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:16.990 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:16.990 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:16.991 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:16.991 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:16.991 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:16.991 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:16.991 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:16.991 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:16.991 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:16.991 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:16.991 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:16.991 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:16.991 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:16.991 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:16.991 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:16.991 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:16.991 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:16.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:16.992 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:16.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:16.992 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:16.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:16.992 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:16.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:16.992 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:16.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:16.992 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:16.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:16.992 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:16.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:16.992 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:16.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:16.993 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:16.993 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.993 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.993 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.993 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:16.993 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.993 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:16.993 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.993 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:16.993 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:16.993 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:16.993 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:16.993 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:16.994 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:16.994 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.994 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:16.994 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:16.994 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:16.994 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:16.994 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:16.994 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:16.994 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.994 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:16.994 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:16.994 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:16.994 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:16.994 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:16.995 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:16.995 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:16.995 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:16.995 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:16.995 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:16.995 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:16.995 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.995 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:16.995 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:16.995 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:16.995 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:16.995 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:16.995 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.996 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:16.996 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:16.996 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:16.996 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:16.996 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:16.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.996 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:16.996 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:16.996 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.996 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:16.996 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:16.996 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:16.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.996 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:16.996 INFO:teuthology.orchestra.run.smithi044.stdout:__________ ERROR at teardown of test_block_public_object_canned_acls ___________ 2023-12-03T12:39:16.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.997 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:16.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.997 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:16.997 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:16.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.997 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:16.997 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:16.997 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:16.997 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:16.997 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:16.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.997 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:16.997 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:16.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.997 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:16.998 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:16.998 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:16.998 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:16.998 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:16.998 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:16.998 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:16.998 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:16.998 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.998 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:16.998 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:16.998 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.998 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:16.999 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:16.999 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:16.999 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:16.999 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:16.999 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:16.999 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:16.999 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:16.999 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:16.999 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:16.999 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:16.999 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:16.999 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:16.999 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:16.999 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:16.999 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:16.999 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.000 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.000 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.000 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.000 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.000 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.000 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.000 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.000 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.000 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.000 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.000 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.000 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.000 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.000 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.000 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.000 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.001 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.001 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.001 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.001 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.001 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.001 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.001 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.001 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.001 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.001 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.001 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.001 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.001 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.001 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.001 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.002 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.002 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.002 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.002 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.002 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.002 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.002 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.002 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.002 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.002 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.002 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.003 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.003 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.003 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.003 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.003 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.003 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.003 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.003 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.003 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.003 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.003 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.003 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.003 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.003 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.003 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.003 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.004 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.004 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.004 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.004 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.004 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.004 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.004 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.004 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.004 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.004 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.004 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.004 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.004 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.004 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.004 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.005 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.005 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.005 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.005 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.005 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.005 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.005 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.005 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.005 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.005 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.006 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.006 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.006 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.006 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.006 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.006 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.006 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.006 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.006 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.006 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.006 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.006 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.007 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.007 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.007 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.007 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.007 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.007 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.007 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.007 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.007 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.007 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.007 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.007 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.008 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.008 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.008 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.008 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.008 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.008 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.008 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.008 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.008 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.008 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.008 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.008 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.008 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.008 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.009 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.009 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:17.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.009 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:17.009 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:17.009 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:17.009 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:17.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.009 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:17.009 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.009 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:17.009 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.009 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.009 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.010 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.010 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.010 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.010 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.010 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.010 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.010 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.010 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.011 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.011 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.011 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.011 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.011 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.011 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.011 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.011 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.011 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.011 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.011 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.011 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.011 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.011 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.012 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.012 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.012 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.012 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.012 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.012 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.012 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.012 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.012 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.012 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.012 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.012 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.012 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.012 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.012 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.012 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.013 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.013 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.013 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.013 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.013 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.013 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.013 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.013 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.013 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.013 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.013 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.013 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.013 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.013 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.014 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.014 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.014 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.014 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.014 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.014 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.014 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.014 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.014 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.014 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.014 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.014 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.014 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.014 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.015 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.015 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.015 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.015 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.015 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.015 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.015 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.015 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.015 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.015 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.015 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.015 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.016 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.016 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.016 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.016 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at teardown of test_block_public_policy _________________ 2023-12-03T12:39:17.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.016 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.016 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.016 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.016 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.017 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.017 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.017 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.017 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.017 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.017 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.017 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.017 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.017 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.017 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.017 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.017 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.017 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.017 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.018 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.018 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.018 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.018 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.018 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.018 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.018 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.018 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.018 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.018 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.018 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.018 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.018 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.018 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.018 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.019 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.019 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.019 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.019 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.019 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.019 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.019 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.019 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.019 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.019 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.019 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.019 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.019 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.019 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.019 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.019 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.020 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.020 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.020 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.020 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.020 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.020 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.020 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.020 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.021 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.021 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.021 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.021 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.021 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.021 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.021 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.021 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.021 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.021 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.021 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.021 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.021 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.021 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.021 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.022 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.022 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.022 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.022 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.022 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.022 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.022 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.022 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.022 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.022 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.023 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.023 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.023 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.023 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.023 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.023 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.023 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.024 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.024 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.024 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.024 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.024 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.024 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.024 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.024 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.025 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.025 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.025 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.025 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.025 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.025 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.025 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.025 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.025 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.025 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.025 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.025 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.026 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.026 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.026 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.026 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.026 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.026 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.026 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.027 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.027 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.027 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.027 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.027 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.027 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.027 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.027 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.027 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.027 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.027 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.027 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.027 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.027 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.027 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.028 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.028 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.028 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.028 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.028 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.028 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.028 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.028 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.028 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.028 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.028 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.028 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.028 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.028 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.028 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.029 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.029 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.029 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.029 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.029 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.029 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.029 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.029 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.029 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.029 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.029 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.029 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.029 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.030 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.030 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.030 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.030 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.030 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.030 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.030 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.030 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.030 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.031 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.031 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.031 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.031 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.031 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.031 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.031 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.031 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.031 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:17.031 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.031 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:17.031 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:17.032 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:17.032 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:17.032 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.032 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:17.032 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.032 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:17.032 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.032 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.032 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.032 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.032 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.032 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.032 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.032 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.032 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.033 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.033 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.033 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.033 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.033 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.033 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.033 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.033 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.033 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.033 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.033 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.033 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.033 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.033 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.033 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.033 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.034 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.034 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.034 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.034 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.034 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.034 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.034 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.034 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.034 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.034 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.034 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.034 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.034 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.034 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.035 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.035 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.035 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.035 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.035 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.035 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.035 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.035 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.035 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.035 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.035 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.035 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.035 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.036 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.036 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.036 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.036 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.036 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.036 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.036 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.036 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.036 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.036 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.036 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.036 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.036 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.036 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.036 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.036 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.037 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.037 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.037 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.037 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.037 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.037 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.037 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.037 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.037 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.037 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.037 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.037 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.037 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.037 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.037 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.037 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.037 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.038 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.038 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.038 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.038 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.038 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.038 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.038 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.038 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ ERROR at teardown of test_ignore_public_acls _________________ 2023-12-03T12:39:17.038 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.038 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.038 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.038 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.038 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.038 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.038 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.039 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.039 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.039 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.039 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.039 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.039 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.039 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.039 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.039 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.039 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.039 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.039 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.039 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.039 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.040 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.040 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.040 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.040 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.040 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.040 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.040 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.040 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.040 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.040 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.040 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.040 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.040 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.040 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.040 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.040 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.040 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.041 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.041 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.041 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.041 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.041 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.041 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.041 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.041 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.041 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.041 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.041 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.041 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.041 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.041 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.042 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.042 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.042 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.042 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.042 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.042 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.042 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.042 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.042 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.042 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.042 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.042 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.042 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.042 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.042 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.043 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.043 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.043 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.043 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.043 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.043 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.043 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.043 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.043 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.043 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.043 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.043 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.043 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.043 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.044 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.045 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.045 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.045 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.045 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.045 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.045 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.045 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.045 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.045 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.045 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.045 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.045 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.046 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.046 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.046 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.046 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.046 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.046 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.046 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.046 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.046 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.046 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.046 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.047 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.047 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.047 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.047 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.047 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.047 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.047 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.047 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.047 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.047 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.047 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.047 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.047 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.047 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.047 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.047 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.047 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.048 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.048 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.048 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.048 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.048 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.048 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.048 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.048 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.048 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.048 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.049 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.050 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.050 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.050 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.050 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.050 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.050 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.050 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.050 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.050 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:17.050 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.050 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:17.050 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:17.050 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:17.051 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:17.051 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.051 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:17.051 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.051 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:17.051 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.051 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.051 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.051 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.051 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.051 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.051 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.051 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.051 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.051 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.052 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.052 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.052 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.052 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.052 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.052 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.052 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.052 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.052 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.052 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.052 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.052 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.052 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.052 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.052 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.052 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.053 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.053 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.053 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.053 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.053 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.053 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.053 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.053 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.053 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.053 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.053 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.053 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.053 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.053 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.053 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.054 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.054 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.054 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.054 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.054 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.054 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.054 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.054 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.054 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.054 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.054 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.054 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.054 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.057 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.057 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.057 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.057 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.057 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.057 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.057 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.057 INFO:teuthology.orchestra.run.smithi044.stdout:______ ERROR at teardown of test_multipart_upload_on_a_bucket_with_policy ______ 2023-12-03T12:39:17.057 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.057 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.057 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.057 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.057 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.057 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.057 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.058 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.058 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.058 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.058 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.058 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.058 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.058 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.058 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.058 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.058 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.059 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.059 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.059 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.059 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.059 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.059 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.059 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.059 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.059 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.059 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.059 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.059 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.059 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.059 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.060 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.060 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.060 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.060 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.060 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.060 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.060 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.060 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.060 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.060 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.060 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.060 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.060 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.060 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.061 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.061 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.061 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.061 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.061 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.061 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.061 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.061 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.061 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.061 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.061 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.061 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.061 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.061 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.061 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.062 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.062 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.062 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.062 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.062 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.062 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.062 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.062 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.062 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.062 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.062 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.062 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.063 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.063 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.063 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.063 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.063 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.063 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.063 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.063 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.063 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.063 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.063 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.063 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.063 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.063 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.063 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.063 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.064 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.065 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.065 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.065 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.065 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.065 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.065 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.065 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.065 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.065 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.065 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.065 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.065 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.066 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.066 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.066 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.066 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.066 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.066 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.066 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.066 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.066 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.066 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.066 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.066 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.066 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.066 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.067 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.067 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.067 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.067 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.067 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.067 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.067 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.067 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.067 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.067 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.067 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.067 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.067 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.067 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.067 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.067 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.069 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.069 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.069 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.069 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.069 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.069 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.069 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.069 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.069 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.069 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:17.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.069 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:17.070 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:17.070 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:17.070 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:17.070 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.070 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:17.070 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.070 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:17.070 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.070 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.070 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.070 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.070 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.070 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.070 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.070 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.071 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.071 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.071 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.071 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.071 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.071 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.071 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.071 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.071 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.071 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.071 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.071 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.071 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.071 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.071 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.072 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.072 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.072 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.072 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.072 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.072 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.072 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.073 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.073 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.073 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.073 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.073 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.073 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.073 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.073 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.073 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.073 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.073 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.073 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.073 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.073 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.075 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.075 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.075 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.075 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.075 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.075 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.075 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.075 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.075 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.075 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.075 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.075 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.075 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.076 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.076 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.076 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.076 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.076 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.076 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.076 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.076 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.076 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.076 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.076 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.076 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.076 INFO:teuthology.orchestra.run.smithi044.stdout:_____________ ERROR at teardown of test_put_bucket_encryption_kms ______________ 2023-12-03T12:39:17.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.077 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.077 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.077 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.077 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.077 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.077 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.077 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.077 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.077 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.077 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.077 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.077 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.077 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.078 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.078 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.078 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.078 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.078 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.078 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.078 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.078 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.078 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.078 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.078 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.080 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.080 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.080 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.080 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.080 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.080 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.080 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.080 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.080 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.080 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.081 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.081 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.081 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.081 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.081 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.081 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.081 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.081 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.081 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.081 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.081 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.081 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.082 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.082 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.082 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.082 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.082 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.082 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.082 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.082 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.082 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.082 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.083 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.083 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.083 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.083 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.083 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.083 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.083 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.083 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.083 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.083 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.083 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.083 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.083 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.083 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.083 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.083 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.084 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.084 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.084 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.084 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.084 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.084 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.084 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.084 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.084 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.084 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.084 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.084 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.084 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.084 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.084 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.085 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.085 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.085 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.085 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.085 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.085 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.085 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.085 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.085 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.085 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.085 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.085 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.085 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.085 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.085 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.086 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.086 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.086 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.086 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.086 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.086 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.086 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.086 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.086 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.086 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.086 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.086 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.086 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.086 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.086 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.086 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.087 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.087 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.087 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.087 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.087 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.087 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.087 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.087 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.087 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.087 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.087 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.088 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.088 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.088 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.088 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.088 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.088 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.088 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.088 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.088 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.088 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.088 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.088 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.088 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.089 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.089 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.089 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.089 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:17.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.089 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:17.089 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:17.089 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:17.089 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:17.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.090 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:17.090 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.090 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:17.090 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.090 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.090 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.090 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.090 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.090 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.090 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.090 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.090 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.090 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.090 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.091 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.091 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.091 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.091 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.091 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.091 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.091 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.092 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.092 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.092 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.092 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.092 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.092 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.092 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.093 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.093 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.093 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.093 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.093 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.093 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.093 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.093 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.093 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.093 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.093 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.093 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.093 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.093 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.093 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.094 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.094 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.094 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.094 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.094 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.094 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.094 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.094 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.094 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.094 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.094 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.094 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.094 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.095 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.095 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.095 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.095 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.095 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.095 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.095 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.095 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.095 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.095 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.095 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.095 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.095 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.095 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.095 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.096 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.096 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.096 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.096 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.096 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.096 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.096 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.096 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.096 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.096 INFO:teuthology.orchestra.run.smithi044.stdout:_____________ ERROR at teardown of test_get_bucket_encryption_kms ______________ 2023-12-03T12:39:17.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.096 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.096 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.097 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.098 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.098 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.098 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.098 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.098 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.098 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.098 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.098 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.098 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.098 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.098 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.098 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.098 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.098 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.100 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.100 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.100 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.100 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.100 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.100 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.100 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.100 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.100 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.100 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.100 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.100 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.100 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.100 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.100 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.101 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.101 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.101 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.101 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.101 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.101 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.101 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.102 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.102 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.102 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.102 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.102 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.102 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.102 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.102 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.102 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.102 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.102 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.102 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.102 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.102 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.103 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.103 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.103 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.103 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.103 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.103 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.103 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.103 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.103 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.103 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.103 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.103 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.103 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.103 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.104 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.104 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.104 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.104 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.104 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.104 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.104 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.104 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.104 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.104 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.104 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.104 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.104 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.104 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.105 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.105 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.105 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.105 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.105 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.105 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.105 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.105 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.105 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.105 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.105 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.105 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.105 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.105 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.105 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.106 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.106 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.106 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.106 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.106 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.106 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.106 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.106 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.106 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.106 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.106 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.106 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.106 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.106 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.106 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.107 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.107 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.107 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.107 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.107 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.107 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.107 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.107 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.107 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.107 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.107 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.107 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.107 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.107 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.108 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.108 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.108 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.108 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.108 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.108 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.108 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.108 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.108 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.108 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.108 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.108 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.109 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.109 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.109 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.109 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.109 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.109 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.109 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.109 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.109 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.109 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:17.109 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.109 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:17.109 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:17.109 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:17.109 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:17.109 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.110 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:17.110 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.110 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:17.110 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.110 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.110 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.110 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.110 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.110 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.110 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.110 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.110 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.110 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.110 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.111 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.111 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.111 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.111 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.111 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.111 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.111 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.112 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.112 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.112 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.112 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.112 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.112 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.112 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.112 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.112 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.112 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.112 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.112 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.112 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.112 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.112 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.113 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.113 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.113 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.113 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.113 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.113 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.113 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.113 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.113 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.113 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.113 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.113 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.113 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.114 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.114 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.114 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.114 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.114 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.114 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.114 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.114 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.114 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.114 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.114 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.114 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.114 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.114 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.115 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.115 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.115 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.115 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.115 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.115 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.115 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.115 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.115 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.115 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.115 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.115 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.115 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.115 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.116 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.116 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.116 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.116 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.116 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.116 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.116 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.116 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.116 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.116 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.116 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.116 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.116 INFO:teuthology.orchestra.run.smithi044.stdout:____________ ERROR at teardown of test_delete_bucket_encryption_kms ____________ 2023-12-03T12:39:17.116 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.117 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.117 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.117 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.117 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.117 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.117 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.117 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.117 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.117 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.117 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.117 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.117 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.118 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.118 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.118 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.118 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.118 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.118 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.118 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.118 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.118 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.118 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.118 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.118 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.118 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.118 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.119 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.119 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.119 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.119 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.119 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.119 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.119 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.119 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.119 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.119 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.119 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.119 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.119 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.119 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.121 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.121 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.121 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.121 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.121 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.121 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.121 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.121 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.121 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.121 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.121 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.121 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.122 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.122 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.122 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.122 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.122 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.122 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.122 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.122 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.122 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.122 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.122 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.122 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.122 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.124 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.124 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.124 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.124 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.124 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.124 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.124 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.124 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.124 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.124 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.124 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.124 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.124 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.124 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.124 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.125 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.125 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.125 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.125 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.125 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.125 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.125 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.125 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.125 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.125 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.125 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.125 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.125 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.125 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.125 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.126 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.126 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.126 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.126 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.126 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.126 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.126 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.126 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.126 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.126 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.126 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.126 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.126 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.126 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.127 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.127 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.127 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.127 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.127 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.127 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.127 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.127 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.127 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.127 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.128 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.128 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.128 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.128 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.128 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.128 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.128 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.128 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.128 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.128 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.128 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.129 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.129 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.129 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.129 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.129 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.129 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.129 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:17.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.129 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:17.129 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:17.129 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:17.130 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:17.130 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.130 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.130 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.130 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.130 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.131 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.131 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.131 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.131 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.131 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.131 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.131 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.131 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.132 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.132 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.132 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.132 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.132 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.132 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.132 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.132 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.132 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.132 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.132 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.132 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.132 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.132 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.133 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.133 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.133 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.133 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.133 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.133 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.133 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.133 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.133 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.133 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.133 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.133 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.133 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.133 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.133 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.133 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.133 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.134 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.134 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.134 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.134 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.134 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.134 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.134 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.134 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.135 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.135 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.135 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.135 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.135 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.135 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.135 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.135 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.135 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.135 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.135 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.135 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.135 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.136 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.136 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.136 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.136 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.136 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.136 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.136 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.136 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.136 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.136 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.136 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.136 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.136 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.136 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.136 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.137 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.137 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.137 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.137 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.137 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.137 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.137 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.138 INFO:teuthology.orchestra.run.smithi044.stdout:_ ERROR at teardown of test_sse_kms_default_post_object_authenticated_request __ 2023-12-03T12:39:17.138 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.138 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.138 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.138 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.139 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.139 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.139 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.139 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.139 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.139 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.140 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.140 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.140 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.140 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.140 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.140 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.140 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.140 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.140 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.140 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.140 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.140 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.140 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.140 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.141 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.141 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.141 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.142 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.142 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.142 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.142 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.142 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.142 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.142 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.142 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.142 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.142 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.142 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.142 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.142 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.142 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.143 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.143 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.143 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.143 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.143 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.143 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.143 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.143 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.143 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.143 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.143 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.143 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.143 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.143 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.143 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.143 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.144 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.144 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.144 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.144 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.144 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.144 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.144 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.144 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.144 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.144 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.144 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.144 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.144 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.145 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.145 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.145 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.145 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.145 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.145 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.145 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.145 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.145 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.145 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.145 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.146 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.146 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.146 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.146 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.146 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.146 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.146 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.146 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.146 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.146 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.146 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.146 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.146 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.147 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.147 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.147 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.147 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.147 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.147 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.147 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.147 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.147 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.147 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.147 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.147 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.147 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.147 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.148 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.148 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.148 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.148 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.148 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.148 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.148 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.148 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.148 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.148 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.148 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.148 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.148 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.148 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.148 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.148 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.149 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.149 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.149 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.149 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.149 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.149 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.149 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.149 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.149 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.149 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.149 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.149 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.149 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.149 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.150 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.150 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.150 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.150 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.150 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.150 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.150 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.150 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.151 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.151 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.151 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.151 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.151 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.151 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.151 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.151 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.151 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.151 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.151 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.151 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.151 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.151 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.151 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.152 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.152 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.152 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.152 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.152 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.152 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.152 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.152 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.152 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.152 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:17.152 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.152 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:17.152 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:17.152 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:17.153 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:17.153 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.153 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:17.153 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.153 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:17.153 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.153 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.153 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.153 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.153 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.153 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.154 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.154 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.154 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.154 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.154 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.154 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.154 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.154 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.154 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.154 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.154 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.154 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.154 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.155 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.155 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.155 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.155 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.155 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.155 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.155 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.155 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.156 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.156 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.156 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.156 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.156 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.156 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.156 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.156 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.156 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.156 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.156 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.156 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.156 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.156 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.156 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.157 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.157 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.157 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.157 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.157 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.157 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.157 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.157 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.157 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.157 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.157 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.157 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.157 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.157 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.158 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.158 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.158 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.158 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.158 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.158 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.158 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.158 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.158 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.158 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.158 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.158 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.158 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.158 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.158 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.159 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.159 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.159 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.159 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.159 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.159 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.159 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.159 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.159 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.159 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.159 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.159 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ ERROR at teardown of test_get_object_torrent _________________ 2023-12-03T12:39:17.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.160 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.160 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.160 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.160 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.160 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.160 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.160 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.160 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.160 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.160 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.160 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.160 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.160 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.160 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.160 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.161 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.161 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.161 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.161 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.161 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.161 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.161 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.161 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.161 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.161 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.161 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.161 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.161 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.162 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.162 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.162 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.162 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.162 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.162 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.162 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.162 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.162 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.162 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.162 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.162 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.162 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.163 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.163 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.163 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.163 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.163 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.163 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.163 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.163 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.163 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.163 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.163 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.163 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.164 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.164 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.164 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.164 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.164 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.164 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.164 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.164 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.164 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.164 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.164 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.164 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.164 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.164 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.164 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.165 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.165 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.165 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.165 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.165 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.165 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.165 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.165 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.165 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.166 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.166 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.166 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.166 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.166 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.166 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.166 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.166 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.166 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.166 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.166 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.166 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.166 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.167 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.167 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.167 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.167 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.167 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.167 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.167 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.167 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.167 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.167 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.167 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.167 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.167 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.167 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.167 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.167 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.168 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.168 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.168 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.168 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.168 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.168 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.168 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.168 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.168 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.168 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.168 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.168 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.168 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.168 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.168 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.169 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.169 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.169 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.169 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.169 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.169 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.169 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.169 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.169 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.169 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.169 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.169 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.169 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.169 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.169 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.170 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.170 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.170 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.170 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.170 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.170 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.170 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.170 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.170 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.170 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.170 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.171 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.171 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.171 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.171 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.171 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.171 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.171 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.171 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.171 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.171 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.171 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.171 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.171 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.171 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.172 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.172 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.172 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.172 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.172 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.172 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.172 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.172 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.172 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.172 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.172 INFO:teuthology.orchestra.run.smithi044.stdout:configfile = 2023-12-03T12:39:17.172 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.172 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:39:17.172 INFO:teuthology.orchestra.run.smithi044.stdout: def setup_teardown(configfile): 2023-12-03T12:39:17.172 INFO:teuthology.orchestra.run.smithi044.stdout: yield 2023-12-03T12:39:17.172 INFO:teuthology.orchestra.run.smithi044.stdout:> teardown() 2023-12-03T12:39:17.173 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.173 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:39:17.173 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.173 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:39:17.173 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.173 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.173 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.173 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.173 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.173 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.173 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.173 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.174 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.174 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.174 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.174 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.174 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.174 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.174 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.175 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.175 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.175 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.175 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.175 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.175 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.175 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.176 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.176 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.176 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.176 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.176 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.176 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.176 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.176 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.176 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.176 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.176 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.177 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.177 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.177 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.177 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.177 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.177 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.177 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.177 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.177 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.177 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.177 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.177 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.177 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.177 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.177 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.178 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.178 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.178 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.178 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.178 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.178 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.178 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.178 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.178 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.178 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.178 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.178 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.179 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.179 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.179 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.179 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.179 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.179 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.179 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.179 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.179 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.179 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.179 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.179 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ ERROR at setup of test_generate_where_clause _________________ 2023-12-03T12:39:17.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.180 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.180 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.180 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.180 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.180 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.180 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.180 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.180 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.180 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.180 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.180 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.181 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.181 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.181 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.181 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.181 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.181 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.181 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.181 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.181 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.181 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.181 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.181 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.182 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.182 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.182 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.182 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.182 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.182 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.182 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.182 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.182 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.182 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.182 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.182 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.182 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.182 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.182 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.182 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.183 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.183 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.183 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.183 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.183 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.183 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.183 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.183 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.183 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.183 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.183 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.183 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.183 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.183 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.183 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.184 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.184 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.184 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.184 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.184 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.184 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.184 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.184 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.184 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.184 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.184 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.184 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.184 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.184 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.184 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.184 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.185 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.185 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.185 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.185 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.185 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.185 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.185 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.185 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.185 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.185 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.185 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.186 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.186 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.186 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.186 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.186 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.186 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.186 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.186 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.186 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.186 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.186 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.186 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.186 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.186 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.187 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.187 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.187 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.187 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.187 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.187 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.187 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.187 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.187 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.187 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.187 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.187 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.187 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.187 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.187 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.187 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.188 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.188 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.188 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.188 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.188 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.188 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.188 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.188 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.189 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.189 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.189 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.189 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.189 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.189 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.189 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.189 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.189 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.189 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.189 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.189 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.189 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.189 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.189 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.189 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.190 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.190 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.190 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.190 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.190 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.190 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.190 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.190 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.190 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.190 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.190 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.191 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.191 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.191 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.191 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.191 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.191 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.191 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.191 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.191 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.191 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.191 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.192 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.192 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.192 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.192 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.192 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.192 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.192 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.192 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.192 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.192 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.192 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.192 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.192 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.192 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.192 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.192 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.193 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.193 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.193 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.193 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.193 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.193 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.193 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.193 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.194 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.194 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.194 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.194 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.194 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.194 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.194 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.194 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.195 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.195 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.195 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.195 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.195 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.195 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.195 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.195 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.195 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.195 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.195 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.195 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.195 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.195 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.196 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.196 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.196 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.196 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.196 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.196 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.196 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.196 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.196 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.196 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.196 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.196 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.196 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.196 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.196 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.196 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.196 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.197 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.197 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.197 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.197 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.197 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.197 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.197 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.197 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.197 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.197 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.197 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.197 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.197 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.197 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.197 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.197 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.198 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.198 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.198 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.198 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.198 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.198 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.198 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.198 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.198 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.198 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.198 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.198 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.199 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.199 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ ERROR at setup of test_generate_projection __________________ 2023-12-03T12:39:17.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.199 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.199 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.199 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.199 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.199 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.199 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.199 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.199 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.200 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.200 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.200 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.200 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.200 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.200 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.200 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.200 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.200 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.200 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.200 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.200 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.200 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.201 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.201 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.201 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.201 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.201 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.201 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.201 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.201 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.201 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.201 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.201 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.201 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.201 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.201 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.202 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.202 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.202 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.202 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.202 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.202 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.202 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.202 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.202 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.202 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.202 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.202 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.202 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.202 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.202 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.203 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.203 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.203 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.203 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.203 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.203 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.203 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.203 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.203 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.203 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.203 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.203 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.203 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.204 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.204 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.204 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.204 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.204 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.204 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.205 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.205 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.205 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.205 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.205 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.205 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.205 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.205 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.205 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.205 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.205 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.205 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.205 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.205 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.206 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.206 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.206 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.206 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.206 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.206 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.206 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.206 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.206 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.206 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.206 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.206 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.206 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.206 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.207 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.207 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.207 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.207 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.207 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.207 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.207 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.207 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.207 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.207 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.207 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.207 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.207 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.207 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.207 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.207 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.208 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.208 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.208 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.208 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.208 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.208 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.208 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.208 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.208 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.208 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.208 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.208 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.208 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.208 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.209 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.209 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.209 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.209 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.209 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.209 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.209 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.209 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.209 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.209 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.209 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.209 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.209 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.210 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.210 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.210 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.210 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.210 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.210 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.210 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.210 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.210 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.210 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.210 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.210 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.211 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.211 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.211 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.211 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.211 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.211 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.211 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.211 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.211 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.211 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.211 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.212 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.212 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.212 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.212 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.212 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.212 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.212 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.212 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.212 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.212 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.212 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.212 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.212 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.212 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.213 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.213 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.213 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.213 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.213 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.213 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.213 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.214 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.214 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.214 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.214 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.214 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.214 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.214 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.215 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.215 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.215 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.215 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.215 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.215 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.215 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.215 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.215 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.215 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.216 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.216 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.216 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.216 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.216 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.216 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.216 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.216 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.216 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.216 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.216 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.216 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.216 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.216 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.216 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.217 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.217 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.217 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.217 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.217 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.217 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.217 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.217 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.217 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.217 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.217 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.217 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.217 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.218 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.218 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.218 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.218 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.218 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.218 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.218 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.218 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.218 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.218 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.218 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.218 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.218 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.219 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.219 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.219 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.219 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.219 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.219 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.219 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.219 INFO:teuthology.orchestra.run.smithi044.stdout:____________________ ERROR at setup of test_count_operation ____________________ 2023-12-03T12:39:17.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.219 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.219 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.219 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.220 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.220 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.220 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.220 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.220 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.220 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.220 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.220 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.220 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.220 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.220 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.220 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.220 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.220 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.221 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.221 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.221 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.221 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.221 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.221 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.221 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.221 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.221 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.221 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.221 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.221 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.221 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.221 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.222 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.222 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.222 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.222 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.222 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.222 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.222 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.222 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.222 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.222 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.222 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.222 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.222 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.222 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.223 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.223 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.223 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.223 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.223 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.223 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.223 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.223 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.223 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.223 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.223 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.223 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.223 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.223 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.223 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.224 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.224 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.224 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.224 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.224 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.224 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.224 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.224 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.224 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.224 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.224 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.224 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.224 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.224 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.224 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.224 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.225 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.225 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.225 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.225 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.225 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.225 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.225 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.225 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.225 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.225 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.225 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.225 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.225 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.226 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.226 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.226 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.226 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.226 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.226 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.226 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.226 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.226 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.226 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.226 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.226 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.226 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.226 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.227 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.227 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.227 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.227 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.227 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.227 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.227 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.227 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.227 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.227 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.227 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.227 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.227 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.227 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.228 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.228 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.228 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.228 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.228 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.228 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.228 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.228 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.228 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.228 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.228 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.228 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.228 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.228 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.229 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.229 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.229 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.229 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.229 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.229 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.229 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.229 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.229 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.229 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.229 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.229 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.229 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.229 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.229 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.230 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.230 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.230 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.230 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.230 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.230 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.230 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.230 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.230 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.231 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.231 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.231 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.231 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.231 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.231 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.231 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.231 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.231 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.231 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.231 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.231 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.232 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.232 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.232 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.232 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.232 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.232 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.232 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.232 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.232 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.233 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.233 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.233 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.233 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.233 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.233 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.233 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.233 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.233 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.233 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.233 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.233 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.233 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.233 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.234 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.234 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.234 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.234 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.234 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.234 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.234 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.234 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.234 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.234 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.234 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.234 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.234 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.234 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.235 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.235 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.235 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.235 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.235 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.235 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.235 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.235 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.235 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.235 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.235 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.235 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.235 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.235 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.236 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.236 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.236 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.236 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.236 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.236 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.236 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.236 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.236 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.236 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.236 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.236 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.236 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.237 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.237 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.237 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.237 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.237 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.237 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.237 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.237 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.237 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.237 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.237 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.237 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.237 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.237 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.238 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.238 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.238 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.238 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.238 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.238 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.238 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.238 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.238 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.238 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.238 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.238 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.238 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.238 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.238 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.239 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.239 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.239 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.239 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.239 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.239 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.239 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.239 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.239 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.239 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.239 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.239 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.239 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.239 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.240 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.240 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.240 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ ERROR at setup of test_count_json_operation __________________ 2023-12-03T12:39:17.240 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.240 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.240 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.240 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.240 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.240 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.240 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.240 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.240 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.240 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.240 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.240 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.241 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.241 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.241 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.241 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.241 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.241 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.241 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.241 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.241 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.241 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.241 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.242 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.242 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.242 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.242 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.242 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.242 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.242 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.242 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.242 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.242 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.242 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.242 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.243 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.243 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.243 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.243 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.243 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.243 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.243 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.243 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.243 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.243 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.243 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.243 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.243 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.243 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.243 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.244 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.244 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.244 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.244 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.244 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.244 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.244 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.244 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.244 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.244 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.244 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.244 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.244 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.244 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.244 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.245 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.245 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.245 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.245 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.245 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.245 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.245 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.245 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.245 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.245 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.245 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.245 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.245 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.245 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.245 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.246 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.246 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.246 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.246 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.246 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.246 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.246 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.246 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.246 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.246 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.246 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.246 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.246 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.246 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.247 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.247 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.247 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.247 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.247 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.247 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.248 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.248 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.248 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.248 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.248 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.248 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.248 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.248 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.248 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.248 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.248 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.248 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.248 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.248 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.249 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.249 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.249 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.249 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.249 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.249 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.249 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.249 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.249 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.249 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.249 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.249 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.249 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.249 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.250 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.250 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.250 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.250 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.250 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.251 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.251 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.251 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.251 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.251 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.251 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.252 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.252 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.252 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.252 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.252 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.252 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.252 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.253 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.253 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.253 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.253 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.253 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.253 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.253 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.253 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.253 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.253 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.253 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.253 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.253 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.253 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.254 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.254 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.254 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.254 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.254 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.255 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.255 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.255 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.255 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.255 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.255 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.255 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.255 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.255 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.255 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.255 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.255 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.255 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.255 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.256 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.256 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.256 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.256 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.256 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.256 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.256 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.256 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.256 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.256 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.256 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.256 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.256 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.256 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.256 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.257 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.257 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.257 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.257 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.257 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.257 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.257 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.257 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.257 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.257 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.257 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.257 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.257 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.257 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.257 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.258 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.258 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.258 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.258 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.258 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.258 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.258 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.258 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.258 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.258 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.258 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.258 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.258 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.258 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.259 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.259 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.259 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.259 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.259 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.259 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.259 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.259 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.259 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.259 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.259 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.259 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.259 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.259 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.260 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.260 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.260 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.260 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.260 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.260 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.260 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.260 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.260 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.260 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.260 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.260 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.260 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.260 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.261 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.261 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.261 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.261 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.261 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.261 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.261 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.261 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.261 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.261 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.261 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.261 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.261 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.261 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.262 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.262 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.262 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.262 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.262 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.262 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.262 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.262 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.262 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.262 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.263 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.263 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.263 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.263 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.263 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at setup of test_json_column_sum_min_max ________________ 2023-12-03T12:39:17.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.263 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.263 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.263 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.263 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.263 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.264 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.264 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.264 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.264 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.264 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.264 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.264 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.264 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.264 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.264 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.265 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.265 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.265 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.265 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.265 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.265 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.265 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.265 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.265 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.265 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.265 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.265 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.265 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.265 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.266 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.266 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.266 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.266 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.266 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.266 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.266 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.266 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.266 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.266 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.266 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.266 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.266 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.266 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.266 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.267 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.267 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.267 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.267 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.267 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.267 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.267 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.267 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.267 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.267 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.267 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.267 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.267 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.267 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.268 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.268 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.268 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.268 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.268 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.268 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.268 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.268 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.268 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.268 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.268 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.268 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.268 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.268 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.268 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.269 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.269 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.269 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.269 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.269 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.269 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.269 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.269 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.269 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.269 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.269 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.269 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.270 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.270 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.270 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.270 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.270 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.270 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.270 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.270 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.270 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.270 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.270 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.270 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.270 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.271 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.271 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.271 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.271 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.271 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.271 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.271 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.271 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.271 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.271 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.271 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.271 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.271 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.271 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.271 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.272 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.272 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.272 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.272 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.272 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.272 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.272 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.272 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.272 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.272 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.272 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.272 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.272 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.272 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.272 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.273 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.273 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.273 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.273 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.273 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.273 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.273 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.273 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.273 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.273 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.274 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.274 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.274 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.274 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.274 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.274 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.274 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.275 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.275 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.275 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.275 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.275 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.275 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.276 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.276 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.276 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.276 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.276 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.276 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.276 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.276 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.276 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.276 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.276 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.276 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.277 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.277 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.277 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.277 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.277 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.277 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.277 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.277 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.277 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.277 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.277 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.277 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.277 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.277 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.277 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.278 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.278 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.278 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.278 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.278 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.278 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.278 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.278 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.278 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.278 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.278 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.278 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.279 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.279 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.279 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.279 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.279 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.279 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.279 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.279 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.279 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.279 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.279 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.279 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.279 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.279 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.280 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.280 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.280 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.280 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.280 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.280 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.280 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.280 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.280 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.280 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.280 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.281 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.281 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.281 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.281 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.281 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.281 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.281 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.281 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.281 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.281 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.281 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.281 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.281 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.281 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.282 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.282 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.282 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.282 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.282 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.282 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.282 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.282 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.282 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.282 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.282 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.282 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.282 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.282 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.283 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.283 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.283 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.283 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.283 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.283 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.283 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.283 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.283 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.283 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.283 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.283 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.283 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.283 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.283 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.284 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.284 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.284 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.284 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.284 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.284 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.284 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at setup of test_json_nullif_expressions ________________ 2023-12-03T12:39:17.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.284 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.284 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.284 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.284 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.284 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.285 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.285 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.285 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.285 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.285 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.285 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.285 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.285 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.285 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.285 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.285 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.285 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.285 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.286 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.286 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.286 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.286 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.286 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.286 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.286 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.286 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.286 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.286 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.286 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.286 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.286 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.289 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.289 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.289 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.289 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.290 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.290 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.291 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.292 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.292 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.292 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.292 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.292 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.292 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.293 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.293 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.293 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.293 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.293 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.293 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.293 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.294 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.294 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.294 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.294 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.294 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.296 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.296 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.296 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.296 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.297 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.297 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.297 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.297 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.297 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.297 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.297 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.297 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.298 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.298 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.298 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.298 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.298 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.298 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.298 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.298 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.298 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.298 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.298 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.298 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.298 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.298 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.298 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.299 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.299 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.299 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.299 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.299 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.299 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.299 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.300 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.300 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.300 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.302 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.302 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.302 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.302 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.302 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.302 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.302 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.302 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.302 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.302 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.302 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.302 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.302 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.303 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.303 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.303 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.303 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.303 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.303 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.303 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.303 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.303 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.303 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.303 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.303 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.304 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.304 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ ERROR at setup of test_column_sum_min_max ___________________ 2023-12-03T12:39:17.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.304 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.304 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.304 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.304 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.304 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.304 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.304 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.304 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.305 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.305 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.305 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.305 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.305 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.305 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.305 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.305 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.305 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.305 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.305 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.306 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.306 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.306 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.306 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.306 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.306 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.306 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.306 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.306 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.306 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.306 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.306 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.306 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.307 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.307 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.307 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.307 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.307 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.307 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.307 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.307 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.307 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.307 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.307 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.307 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.307 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.307 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.307 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.308 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.308 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.308 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.308 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.308 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.308 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.308 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.308 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.308 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.308 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.308 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.308 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.308 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.308 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.308 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.309 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.309 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.309 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.309 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.309 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.309 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.309 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.309 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.309 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.309 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.309 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.310 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.310 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.310 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.310 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.310 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.310 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.310 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.310 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.310 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.310 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.310 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.311 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.311 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.311 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.311 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.311 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.311 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.311 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.311 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.311 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.311 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.311 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.311 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.311 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.311 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.312 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.312 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.312 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.312 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.312 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.312 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.312 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.312 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.312 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.312 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.312 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.312 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.312 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.312 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.312 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.313 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.313 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.313 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.313 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.313 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.313 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.313 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.313 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.313 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.314 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.314 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.314 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.314 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.314 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.314 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.314 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.314 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.314 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.314 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.314 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.314 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.314 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.315 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.315 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.315 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.315 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.315 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.315 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.315 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.315 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.315 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.315 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.315 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.316 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.316 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.316 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.316 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.316 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.316 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.316 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.316 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.316 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.316 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.316 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.316 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.317 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.317 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.317 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.317 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.317 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.317 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.317 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.317 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.317 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.317 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.318 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.318 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.318 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.318 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.318 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.318 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.318 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.318 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.318 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.318 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.318 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.318 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.318 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.319 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.319 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.319 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.319 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.319 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.319 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.319 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.319 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.319 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.319 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.319 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.319 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.319 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.319 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.319 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.320 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.320 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.320 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.320 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.320 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.320 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.320 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.320 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.320 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.320 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.320 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.320 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.321 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.321 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.321 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.321 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.321 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.321 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.321 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.321 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.321 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.321 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.321 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.321 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.321 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.321 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.322 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.322 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.322 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.322 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.322 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.322 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.322 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.322 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.322 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.322 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.322 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.322 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.322 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.323 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.323 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.323 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.323 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.323 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.323 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.323 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.323 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.323 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.323 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.323 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.323 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.324 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.324 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.324 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.324 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.324 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.324 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ ERROR at setup of test_nullif_expressions ___________________ 2023-12-03T12:39:17.324 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.324 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.324 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.324 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.324 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.324 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.324 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.324 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.324 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.325 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.325 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.325 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.325 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.325 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.325 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.325 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.325 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.325 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.325 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.325 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.325 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.325 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.325 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.325 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.325 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.326 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.326 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.326 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.326 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.326 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.326 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.326 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.326 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.326 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.326 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.326 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.326 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.327 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.327 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.327 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.327 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.327 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.327 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.327 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.327 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.327 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.327 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.327 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.327 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.327 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.327 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.327 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.328 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.328 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.328 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.328 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.328 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.328 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.328 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.328 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.328 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.328 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.328 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.328 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.329 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.329 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.329 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.329 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.329 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.329 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.329 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.329 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.329 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.329 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.329 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.329 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.330 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.330 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.330 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.330 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.330 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.330 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.330 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.330 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.330 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.330 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.330 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.331 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.331 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.331 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.331 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.331 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.331 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.331 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.331 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.331 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.331 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.331 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.331 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.332 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.332 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.332 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.332 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.332 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.332 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.332 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.332 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.332 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.332 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.332 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.332 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.332 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.332 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.332 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.332 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.333 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.333 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.333 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.333 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.333 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.333 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.333 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.333 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.333 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.334 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.334 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.334 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.334 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.334 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.334 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.334 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.334 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.334 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.334 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.334 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.334 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.334 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.335 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.335 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.335 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.335 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.335 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.335 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.335 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.335 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.335 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.335 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.335 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.335 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.335 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.335 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.336 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.336 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.336 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.336 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.336 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.336 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.336 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.336 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.336 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.336 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.336 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.336 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.336 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.337 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.337 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.337 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.337 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.337 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.337 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.337 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.337 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.337 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.337 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.337 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.337 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.337 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.337 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.337 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.338 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.338 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.338 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.338 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.338 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.338 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.338 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.338 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.338 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.338 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.338 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.338 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.339 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.339 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.339 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.339 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.339 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.339 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.339 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.339 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.339 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.339 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.339 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.339 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.339 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.339 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.339 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.340 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.340 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.340 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.340 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.340 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.340 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.340 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.340 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.341 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.341 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.341 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.341 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.341 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.341 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.341 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.341 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.341 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.341 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.341 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.341 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.341 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.341 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.341 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.342 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.342 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.342 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.342 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.342 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.342 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.342 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.342 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.342 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.342 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.342 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.342 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.342 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.343 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.343 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.343 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.343 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.343 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.343 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.343 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.343 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.343 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.343 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.343 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.343 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.343 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.343 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.343 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.343 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.344 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.344 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.344 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.344 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.344 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.344 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.344 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.344 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at setup of test_nulliftrue_expressions _________________ 2023-12-03T12:39:17.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.344 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.344 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.344 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.344 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.345 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.345 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.345 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.345 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.345 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.345 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.345 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.345 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.345 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.345 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.345 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.345 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.345 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.345 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.345 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.345 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.346 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.346 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.346 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.346 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.346 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.346 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.346 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.346 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.346 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.346 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.346 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.346 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.346 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.347 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.347 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.347 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.347 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.347 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.347 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.347 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.347 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.347 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.347 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.347 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.347 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.347 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.348 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.348 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.348 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.348 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.348 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.348 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.348 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.348 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.348 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.348 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.348 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.349 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.349 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.349 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.349 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.349 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.349 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.349 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.349 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.349 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.349 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.349 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.349 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.349 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.349 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.349 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.349 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.350 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.350 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.350 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.350 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.350 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.351 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.352 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.352 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.352 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.352 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.353 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.353 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.353 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.353 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.353 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.353 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.353 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.353 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.354 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.354 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.354 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.354 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.354 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.354 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.354 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.354 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.354 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.354 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.354 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.354 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.354 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.354 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.355 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.355 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.355 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.356 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.356 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.356 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.356 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.356 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.356 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.357 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.357 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.357 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.357 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.357 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.358 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.358 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.358 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.358 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.358 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.358 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.359 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.359 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.359 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.359 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.359 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.359 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.359 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.360 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.360 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.360 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.360 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.360 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.360 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.360 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.360 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.361 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.361 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.361 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.361 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.361 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.361 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.361 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.362 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.362 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.362 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.362 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.362 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.362 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.363 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.363 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.363 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.363 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.363 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.363 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.363 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.363 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.363 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.363 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.363 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.363 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.363 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.363 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.363 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.363 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.364 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.364 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.364 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.364 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.364 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.364 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.364 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.364 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.364 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.364 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.364 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.364 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.364 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.364 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.365 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.365 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.365 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.365 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.365 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.365 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.365 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.365 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.365 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.365 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.365 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.365 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.365 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.365 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.366 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.366 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.366 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.366 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.366 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.366 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.366 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.366 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.366 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.366 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.366 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.366 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.367 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at setup of test_is_not_null_expressions ________________ 2023-12-03T12:39:17.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.367 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.367 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.367 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.367 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.367 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.367 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.367 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.367 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.367 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.368 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.368 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.368 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.368 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.368 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.368 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.368 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.368 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.368 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.368 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.368 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.368 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.368 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.369 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.369 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.369 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.369 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.369 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.369 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.369 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.369 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.369 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.369 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.369 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.369 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.369 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.370 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.370 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.370 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.370 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.370 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.370 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.370 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.370 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.370 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.370 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.370 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.370 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.370 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.370 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.371 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.371 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.371 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.371 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.371 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.371 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.371 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.371 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.371 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.371 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.371 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.371 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.371 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.371 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.371 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.372 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.372 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.372 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.372 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.372 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.372 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.372 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.372 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.372 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.372 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.373 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.373 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.373 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.373 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.373 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.373 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.373 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.373 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.373 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.373 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.373 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.373 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.373 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.373 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.373 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.374 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.374 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.374 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.374 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.374 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.374 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.374 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.374 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.374 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.374 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.374 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.374 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.374 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.375 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.375 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.375 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.375 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.375 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.375 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.375 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.375 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.375 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.375 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.375 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.375 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.375 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.375 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.376 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.376 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.376 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.376 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.376 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.376 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.376 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.376 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.376 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.376 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.376 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.377 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.377 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.377 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.377 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.377 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.377 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.377 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.377 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.377 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.377 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.377 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.377 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.377 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.378 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.378 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.378 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.378 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.378 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.378 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.378 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.378 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.378 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.378 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.378 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.378 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.378 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.378 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.379 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.379 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.379 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.379 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.379 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.379 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.379 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.379 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.379 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.379 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.379 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.379 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.379 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.379 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.379 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.380 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.380 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.380 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.380 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.380 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.380 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.380 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.380 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.380 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.380 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.380 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.380 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.380 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.380 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.380 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.381 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.381 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.381 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.381 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.381 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.381 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.381 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.382 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.382 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.382 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.382 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.382 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.382 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.382 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.382 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.382 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.382 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.382 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.382 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.382 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.382 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.383 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.383 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.383 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.383 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.383 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.383 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.383 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.383 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.383 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.383 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.383 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.383 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.383 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.384 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.384 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.384 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.384 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.384 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.384 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.384 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.384 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.384 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.384 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.384 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.384 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.384 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.384 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.384 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.384 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.385 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.385 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.385 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.385 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.385 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.385 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.385 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.385 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.385 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.385 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.385 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.385 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.385 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.385 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.386 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.386 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.386 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.386 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.386 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.386 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.386 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.386 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.386 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.386 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.386 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.386 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at setup of test_lowerupper_expressions _________________ 2023-12-03T12:39:17.386 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.386 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.387 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.387 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.387 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.387 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.387 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.387 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.387 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.387 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.387 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.387 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.387 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.387 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.387 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.387 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.387 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.387 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.388 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.388 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.388 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.388 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.388 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.388 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.388 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.388 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.388 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.388 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.388 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.388 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.388 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.388 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.388 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.388 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.389 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.389 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.389 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.389 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.389 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.389 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.389 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.389 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.389 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.389 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.389 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.389 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.389 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.389 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.390 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.390 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.390 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.390 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.390 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.390 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.390 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.390 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.390 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.390 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.390 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.390 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.390 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.390 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.391 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.391 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.391 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.391 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.391 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.391 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.391 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.391 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.391 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.391 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.391 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.392 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.392 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.392 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.392 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.392 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.392 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.392 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.392 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.392 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.392 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.392 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.392 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.393 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.393 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.393 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.393 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.393 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.393 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.393 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.393 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.393 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.393 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.393 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.393 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.393 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.393 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.394 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.394 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.394 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.394 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.394 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.394 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.394 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.394 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.394 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.394 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.394 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.394 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.394 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.394 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.394 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.395 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.395 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.395 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.395 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.395 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.395 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.395 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.395 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.395 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.395 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.395 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.395 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.395 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.395 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.395 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.396 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.396 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.396 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.396 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.396 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.396 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.396 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.396 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.396 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.396 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.396 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.396 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.396 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.396 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.396 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.396 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.397 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.397 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.397 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.397 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.397 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.397 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.397 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.397 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.397 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.397 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.397 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.397 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.397 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.397 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.397 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.398 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.398 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.398 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.398 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.398 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.398 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.398 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.398 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.398 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.398 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.398 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.398 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.398 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.398 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.398 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.399 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.399 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.399 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.399 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.399 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.399 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.399 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.399 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.399 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.399 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.399 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.399 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.399 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.399 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.399 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.400 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.400 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.400 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.400 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.400 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.400 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.400 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.400 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.400 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.400 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.400 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.400 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.400 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.400 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.401 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.401 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.401 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.401 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.401 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.401 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.401 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.401 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.401 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.401 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.401 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.401 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.401 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.401 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.402 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.402 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.402 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.402 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.402 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.402 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.402 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.402 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.402 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.402 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.402 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.402 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.402 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.402 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.402 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.403 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.403 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.403 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.403 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.403 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.403 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.403 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.403 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.403 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.403 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.403 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.403 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.403 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.403 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.403 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.404 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.404 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.404 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.404 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.404 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.404 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.404 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.404 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.404 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.404 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.404 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.404 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.404 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.404 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.404 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.405 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.405 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.405 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.405 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.405 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.405 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.405 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.405 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.405 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.405 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.405 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.406 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.406 INFO:teuthology.orchestra.run.smithi044.stdout:____________________ ERROR at setup of test_in_expressions _____________________ 2023-12-03T12:39:17.406 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.406 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.406 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.406 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.406 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.406 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.406 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.406 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.406 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.406 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.406 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.406 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.407 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.407 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.407 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.407 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.407 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.407 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.407 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.407 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.407 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.407 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.407 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.407 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.407 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.407 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.407 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.407 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.408 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.408 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.408 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.408 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.408 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.408 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.408 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.408 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.408 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.408 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.408 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.408 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.408 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.408 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.409 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.409 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.409 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.409 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.409 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.409 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.409 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.409 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.409 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.409 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.409 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.409 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.409 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.409 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.410 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.410 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.410 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.410 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.410 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.410 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.410 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.410 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.410 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.410 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.410 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.410 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.410 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.411 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.411 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.411 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.411 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.411 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.411 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.411 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.411 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.411 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.411 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.412 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.412 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.412 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.412 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.412 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.412 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.412 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.412 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.412 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.412 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.412 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.412 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.412 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.412 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.413 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.413 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.413 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.413 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.413 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.413 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.413 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.413 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.413 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.413 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.413 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.413 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.413 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.413 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.414 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.414 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.414 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.414 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.414 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.414 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.414 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.414 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.414 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.414 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.414 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.414 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.414 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.414 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.415 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.415 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.415 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.415 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.415 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.415 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.415 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.415 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.415 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.415 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.415 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.415 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.415 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.415 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.415 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.416 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.416 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.416 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.416 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.416 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.416 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.416 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.416 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.416 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.416 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.416 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.416 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.416 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.416 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.417 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.417 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.417 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.417 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.417 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.417 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.417 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.417 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.417 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.417 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.417 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.417 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.417 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.417 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.417 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.418 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.418 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.418 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.418 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.418 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.418 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.418 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.418 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.418 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.419 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.419 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.419 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.419 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.419 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.419 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.419 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.419 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.419 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.419 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.419 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.419 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.419 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.419 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.419 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.419 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.420 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.420 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.420 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.420 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.420 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.420 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.420 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.420 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.420 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.420 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.420 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.420 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.420 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.420 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.420 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.421 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.421 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.421 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.421 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.421 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.421 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.421 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.421 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.421 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.422 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.422 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.422 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.422 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.422 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.422 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.422 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.422 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.422 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.422 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.422 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.422 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.422 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.422 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.422 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.423 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.423 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.423 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.423 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.423 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.423 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.423 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.423 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.423 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.423 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.424 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.424 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.424 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.424 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.424 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.424 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.424 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.424 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.424 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.424 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.424 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.424 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.425 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.425 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.425 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.425 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.425 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.425 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.425 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.425 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.425 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.425 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.425 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.425 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ ERROR at setup of test_true_false_in_expressions _______________ 2023-12-03T12:39:17.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.426 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.426 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.426 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.426 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.426 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.426 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.426 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.426 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.426 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.426 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.426 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.426 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.426 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.426 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.426 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.426 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.427 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.427 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.427 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.427 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.427 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.427 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.427 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.427 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.427 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.427 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.427 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.427 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.427 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.427 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.428 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.428 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.428 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.428 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.428 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.428 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.428 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.428 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.428 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.428 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.428 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.428 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.428 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.428 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.429 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.429 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.429 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.429 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.429 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.429 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.429 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.429 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.429 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.429 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.429 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.429 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.429 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.429 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.429 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.430 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.430 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.430 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.430 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.430 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.430 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.430 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.430 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.430 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.430 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.430 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.430 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.430 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.430 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.431 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.431 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.431 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.431 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.431 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.431 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.431 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.431 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.431 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.431 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.431 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.431 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.431 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.431 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.431 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.432 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.432 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.432 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.432 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.432 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.432 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.432 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.432 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.432 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.432 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.432 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.432 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.432 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.432 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.432 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.433 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.433 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.433 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.433 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.433 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.433 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.433 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.433 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.433 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.433 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.433 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.433 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.433 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.433 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.434 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.434 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.434 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.434 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.434 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.434 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.434 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.434 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.434 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.434 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.434 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.434 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.434 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.435 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.435 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.435 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.435 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.435 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.435 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.435 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.435 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.435 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.435 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.435 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.435 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.436 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.436 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.436 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.436 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.436 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.436 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.436 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.436 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.436 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.436 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.436 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.436 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.436 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.437 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.437 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.437 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.437 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.437 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.437 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.437 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.437 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.437 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.437 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.437 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.437 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.437 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.437 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.437 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.437 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.438 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.438 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.438 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.438 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.438 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.438 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.438 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.438 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.438 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.438 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.438 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.438 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.439 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.439 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.439 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.439 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.439 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.439 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.439 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.439 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.439 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.439 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.439 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.439 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.439 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.439 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.439 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.439 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.440 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.440 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.440 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.440 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.440 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.440 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.440 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.440 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.440 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.440 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.440 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.440 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.440 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.440 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.440 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.441 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.441 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.441 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.441 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.441 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.441 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.441 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.441 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.441 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.441 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.441 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.441 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.441 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.441 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.442 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.442 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.442 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.442 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.442 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.442 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.442 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.442 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.442 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.442 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.442 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.442 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.442 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.443 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.443 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.443 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.443 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.443 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.443 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.443 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.443 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.443 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.443 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.443 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.443 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.443 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.443 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.444 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.444 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.444 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.444 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.444 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.444 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.444 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.444 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.444 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.444 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.444 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.444 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.444 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.444 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.445 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.445 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.445 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.445 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.445 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.445 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.445 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.445 INFO:teuthology.orchestra.run.smithi044.stdout:___________________ ERROR at setup of test_like_expressions ____________________ 2023-12-03T12:39:17.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.445 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.445 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.445 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.446 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.446 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.446 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.446 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.446 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.446 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.446 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.446 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.446 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.446 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.446 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.446 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.446 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.446 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.447 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.447 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.447 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.447 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.447 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.447 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.447 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.447 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.447 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.448 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.448 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.448 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.448 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.448 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.448 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.448 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.448 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.448 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.448 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.448 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.448 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.448 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.448 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.449 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.449 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.449 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.449 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.449 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.449 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.449 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.449 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.449 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.449 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.449 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.449 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.450 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.450 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.450 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.450 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.450 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.450 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.450 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.450 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.450 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.450 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.450 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.450 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.450 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.450 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.450 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.451 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.451 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.451 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.451 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.451 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.451 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.451 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.451 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.451 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.451 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.451 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.451 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.452 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.452 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.452 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.452 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.452 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.452 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.452 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.452 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.452 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.452 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.452 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.452 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.452 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.452 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.453 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.453 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.453 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.453 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.453 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.453 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.453 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.453 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.453 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.453 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.453 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.453 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.453 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.453 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.453 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.454 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.454 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.454 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.454 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.454 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.454 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.454 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.454 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.454 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.454 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.454 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.454 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.454 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.454 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.454 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.455 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.455 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.455 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.455 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.455 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.455 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.455 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.455 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.455 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.455 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.455 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.455 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.455 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.455 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.455 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.455 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.456 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.456 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.456 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.456 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.456 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.456 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.456 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.456 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.456 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.456 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.456 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.456 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.456 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.456 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.456 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.457 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.457 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.457 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.457 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.457 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.457 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.457 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.457 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.457 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.457 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.457 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.457 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.457 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.457 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.457 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.457 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.458 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.458 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.458 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.458 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.458 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.458 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.458 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.458 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.458 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.458 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.459 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.459 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.459 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.459 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.459 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.459 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.459 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.459 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.459 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.459 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.459 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.459 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.459 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.459 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.459 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.459 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.460 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.460 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.460 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.460 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.460 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.460 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.460 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.461 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.461 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.461 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.461 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.461 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.461 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.461 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.461 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.461 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.461 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.462 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.462 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.462 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.462 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.462 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.462 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.462 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.462 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.462 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.462 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.462 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.462 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.464 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.464 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.464 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.464 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.464 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.464 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.465 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.465 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.465 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.465 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.465 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.465 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.465 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.465 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.467 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.467 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.467 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.467 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.467 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.467 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.467 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.468 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.468 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.468 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.468 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ ERROR at setup of test_truefalselike_expressions _______________ 2023-12-03T12:39:17.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.468 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.468 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.468 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.468 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.468 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.468 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.468 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.469 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.469 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.470 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.470 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.470 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.471 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.471 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.471 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.471 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.471 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.471 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.471 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.471 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.471 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.471 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.471 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.471 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.471 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.471 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.471 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.471 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.472 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.472 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.472 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.472 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.472 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.472 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.472 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.472 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.472 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.472 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.472 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.473 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.473 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.473 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.473 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.473 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.473 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.473 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.473 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.473 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.473 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.473 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.473 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.473 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.473 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.473 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.473 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.474 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.474 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.474 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.474 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.474 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.474 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.474 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.474 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.474 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.474 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.474 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.474 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.474 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.475 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.475 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.475 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.475 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.475 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.475 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.475 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.475 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.475 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.475 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.475 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.475 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.475 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.476 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.476 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.476 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.476 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.476 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.476 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.476 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.476 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.476 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.476 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.476 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.476 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.477 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.477 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.477 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.477 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.477 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.477 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.477 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.477 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.477 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.477 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.477 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.477 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.477 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.477 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.477 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.477 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.478 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.478 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.478 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.478 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.478 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.478 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.478 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.478 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.478 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.478 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.478 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.479 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.479 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.479 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.479 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.479 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.479 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.479 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.479 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.479 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.479 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.479 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.479 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.479 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.479 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.480 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.480 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.480 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.480 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.480 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.480 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.480 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.480 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.480 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.480 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.480 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.480 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.480 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.480 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.480 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.481 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.481 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.481 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.481 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.481 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.481 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.481 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.481 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.481 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.481 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.481 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.482 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.482 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.482 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.482 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.482 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.482 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.482 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.482 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.482 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.482 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.482 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.482 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.482 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.482 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.482 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.483 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.483 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.483 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.483 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.483 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.483 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.483 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.483 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.483 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.483 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.483 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.483 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.483 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.483 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.483 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.484 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.484 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.484 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.484 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.484 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.484 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.484 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.484 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.484 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.484 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.484 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.484 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.484 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.484 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.484 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.485 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.485 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.485 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.485 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.485 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.485 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.485 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.485 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.485 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.485 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.485 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.485 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.485 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.485 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.485 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.486 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.486 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.486 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.486 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.486 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.486 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.486 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.486 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.486 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.486 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.486 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.486 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.486 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.487 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.487 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.487 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.487 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.487 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.487 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.487 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.487 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.487 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.487 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.487 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.487 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.487 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.487 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.487 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.488 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.488 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.488 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.488 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ ERROR at setup of test_complex_expressions __________________ 2023-12-03T12:39:17.488 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.488 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.488 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.488 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.488 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.488 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.488 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.488 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.488 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.488 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.488 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.489 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.489 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.489 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.489 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.489 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.489 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.489 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.489 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.489 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.489 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.489 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.489 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.489 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.490 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.490 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.491 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.491 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.491 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.491 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.491 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.491 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.491 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.491 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.491 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.491 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.491 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.491 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.491 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.491 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.491 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.492 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.492 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.492 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.492 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.492 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.492 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.492 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.492 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.492 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.492 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.492 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.492 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.493 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.493 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.493 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.493 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.493 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.493 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.493 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.493 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.493 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.493 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.493 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.494 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.494 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.494 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.494 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.494 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.494 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.494 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.494 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.494 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.494 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.494 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.494 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.494 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.494 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.495 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.495 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.495 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.495 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.495 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.495 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.495 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.495 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.495 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.495 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.495 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.495 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.495 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.495 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.495 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.496 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.496 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.496 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.496 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.496 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.496 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.496 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.496 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.497 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.497 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.497 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.497 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.497 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.497 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.497 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.497 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.497 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.497 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.497 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.497 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.497 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.497 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.497 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.498 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.498 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.498 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.498 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.498 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.498 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.498 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.498 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.498 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.498 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.498 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.498 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.498 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.499 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.499 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.499 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.499 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.499 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.499 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.499 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.499 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.499 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.499 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.499 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.499 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.499 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.499 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.499 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.500 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.500 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.500 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.500 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.500 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.500 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.500 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.500 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.500 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.500 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.501 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.501 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.501 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.501 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.501 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.501 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.501 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.501 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.501 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.501 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.501 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.501 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.501 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.501 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.502 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.502 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.502 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.502 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.502 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.502 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.502 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.502 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.502 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.502 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.502 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.502 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.502 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.502 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.503 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.503 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.503 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.503 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.503 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.503 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.503 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.503 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.503 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.503 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.503 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.503 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.503 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.503 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.503 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.504 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.504 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.504 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.504 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.504 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.504 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.504 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.504 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.504 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.504 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.504 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.504 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.504 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.504 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.504 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.504 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.505 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.505 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.505 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.505 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.505 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.505 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.505 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.505 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.505 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.505 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.505 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.505 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.505 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.505 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.505 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.505 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.505 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.506 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.506 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.506 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.506 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.506 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.506 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.506 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.506 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.506 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.506 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.506 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.506 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.507 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.507 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.507 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.507 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.507 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.507 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.507 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.507 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.507 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.507 INFO:teuthology.orchestra.run.smithi044.stdout:_________________________ ERROR at setup of test_alias _________________________ 2023-12-03T12:39:17.507 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.507 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.507 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.507 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.508 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.508 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.508 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.508 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.508 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.508 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.508 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.508 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.508 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.508 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.508 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.508 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.508 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.508 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.508 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.508 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.509 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.509 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.509 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.509 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.509 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.509 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.509 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.509 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.509 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.509 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.509 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.509 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.509 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.509 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.510 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.510 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.510 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.510 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.510 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.510 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.510 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.510 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.510 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.510 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.510 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.510 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.511 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.511 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.511 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.511 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.511 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.511 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.511 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.511 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.511 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.511 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.511 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.511 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.511 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.511 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.512 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.512 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.512 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.512 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.512 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.512 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.512 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.512 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.512 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.512 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.512 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.512 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.512 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.513 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.513 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.513 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.513 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.513 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.513 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.513 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.513 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.513 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.513 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.513 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.513 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.514 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.514 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.514 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.514 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.514 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.514 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.514 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.514 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.514 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.514 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.514 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.514 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.514 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.514 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.515 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.515 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.515 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.515 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.515 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.515 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.515 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.515 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.515 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.515 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.515 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.516 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.516 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.516 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.516 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.516 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.516 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.516 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.516 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.516 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.517 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.517 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.517 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.517 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.517 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.517 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.517 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.517 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.517 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.517 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.517 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.517 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.517 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.517 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.517 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.517 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.518 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.518 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.518 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.518 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.518 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.518 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.518 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.518 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.519 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.519 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.519 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.519 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.519 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.519 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.519 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.519 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.519 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.519 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.519 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.519 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.519 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.519 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.519 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.519 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.520 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.520 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.520 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.520 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.520 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.520 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.520 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.520 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.520 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.520 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.520 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.521 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.521 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.521 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.521 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.521 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.521 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.521 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.522 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.522 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.522 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.522 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.522 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.522 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.522 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.522 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.522 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.522 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.522 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.522 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.522 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.522 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.523 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.523 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.523 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.523 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.523 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.523 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.523 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.523 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.523 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.523 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.523 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.523 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.523 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.523 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.523 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.524 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.524 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.524 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.524 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.524 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.524 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.524 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.524 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.524 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.524 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.524 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.524 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.524 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.524 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.525 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.525 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.525 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.525 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.525 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.525 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.525 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.525 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.525 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.525 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.525 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.525 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.525 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.525 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.525 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.526 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.526 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.526 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.526 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.526 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.526 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.526 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.526 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.526 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.526 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.526 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.526 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.526 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.526 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.526 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.527 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.527 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.527 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.527 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ ERROR at setup of test_alias_cyclic_refernce _________________ 2023-12-03T12:39:17.527 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.527 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.527 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.527 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.527 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.527 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.527 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.527 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.527 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.527 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.527 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.528 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.528 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.528 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.528 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.528 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.528 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.528 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.528 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.528 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.528 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.528 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.528 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.528 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.528 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.528 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.529 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.529 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.529 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.529 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.529 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.529 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.529 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.529 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.529 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.529 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.529 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.529 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.529 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.529 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.529 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.530 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.530 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.530 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.530 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.530 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.530 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.530 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.530 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.530 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.530 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.530 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.530 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.530 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.530 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.531 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.531 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.531 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.531 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.531 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.531 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.531 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.531 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.531 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.531 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.531 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.531 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.532 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.532 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.532 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.532 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.532 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.532 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.532 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.532 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.532 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.532 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.532 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.533 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.533 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.533 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.533 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.533 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.533 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.533 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.533 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.533 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.533 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.533 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.533 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.533 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.533 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.534 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.534 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.534 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.534 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.534 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.534 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.534 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.534 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.534 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.534 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.534 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.534 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.534 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.535 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.535 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.535 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.535 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.535 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.535 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.535 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.535 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.535 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.536 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.536 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.536 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.536 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.536 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.536 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.536 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.536 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.537 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.537 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.537 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.537 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.537 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.537 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.537 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.537 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.537 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.537 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.537 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.537 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.537 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.537 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.537 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.537 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.538 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.538 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.538 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.538 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.538 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.538 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.538 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.538 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.538 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.538 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.539 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.539 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.539 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.539 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.539 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.539 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.539 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.539 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.539 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.539 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.539 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.539 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.539 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.539 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.539 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.540 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.540 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.540 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.540 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.540 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.540 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.540 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.540 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.540 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.540 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.540 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.540 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.540 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.540 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.541 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.541 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.541 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.541 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.541 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.541 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.541 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.541 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.541 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.541 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.541 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.541 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.541 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.541 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.542 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.542 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.542 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.542 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.542 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.542 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.542 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.542 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.542 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.542 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.542 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.542 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.542 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.543 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.543 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.543 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.543 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.543 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.543 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.543 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.543 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.543 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.543 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.543 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.543 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.543 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.543 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.544 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.544 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.544 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.544 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.544 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.544 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.544 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.544 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.544 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.544 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.544 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.544 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.544 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.544 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.544 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.545 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.545 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.545 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.545 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.545 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.545 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.545 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.545 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.545 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.545 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.545 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.545 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.545 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.545 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.545 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.545 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.546 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.546 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.546 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.546 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.546 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.546 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.546 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.546 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.546 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.546 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.546 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.546 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.546 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.547 INFO:teuthology.orchestra.run.smithi044.stdout:_______________________ ERROR at setup of test_datetime ________________________ 2023-12-03T12:39:17.547 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.547 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.547 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.547 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.547 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.547 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.547 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.547 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.547 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.547 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.547 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.547 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.548 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.548 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.548 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.548 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.548 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.548 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.548 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.548 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.548 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.548 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.548 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.548 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.548 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.549 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.549 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.549 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.549 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.549 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.549 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.549 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.549 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.549 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.549 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.549 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.549 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.549 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.549 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.549 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.549 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.550 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.550 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.550 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.550 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.550 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.550 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.550 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.550 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.550 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.550 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.550 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.550 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.550 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.550 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.551 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.551 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.551 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.551 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.551 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.551 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.551 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.551 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.551 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.551 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.551 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.551 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.552 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.552 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.552 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.552 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.552 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.552 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.552 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.552 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.552 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.552 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.552 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.552 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.552 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.552 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.552 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.553 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.553 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.553 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.553 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.553 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.553 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.553 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.553 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.553 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.553 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.553 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.553 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.553 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.553 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.554 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.554 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.554 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.554 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.554 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.554 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.554 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.554 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.554 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.554 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.554 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.554 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.554 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.554 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.555 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.555 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.555 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.555 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.555 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.555 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.555 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.555 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.555 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.556 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.556 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.556 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.556 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.556 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.556 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.556 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.556 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.556 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.556 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.556 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.557 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.557 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.557 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.557 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.557 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.557 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.557 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.557 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.557 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.557 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.557 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.557 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.557 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.557 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.557 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.558 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.558 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.558 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.558 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.558 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.558 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.558 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.558 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.558 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.558 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.559 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.559 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.559 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.559 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.559 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.559 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.559 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.559 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.559 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.559 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.559 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.559 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.560 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.560 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.560 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.560 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.560 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.560 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.560 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.560 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.560 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.560 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.560 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.560 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.560 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.560 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.561 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.561 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.561 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.561 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.561 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.561 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.561 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.561 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.561 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.561 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.561 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.561 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.561 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.561 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.562 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.562 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.562 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.562 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.562 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.562 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.562 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.562 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.562 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.563 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.563 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.563 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.563 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.563 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.563 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.563 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.563 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.563 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.563 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.563 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.563 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.563 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.563 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.563 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.563 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.564 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.564 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.564 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.564 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.564 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.564 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.564 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.564 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.564 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.564 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.564 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.564 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.564 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.564 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.564 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.564 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.565 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.565 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.565 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.565 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.565 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.565 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.565 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.565 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.565 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.565 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.565 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.565 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.565 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.565 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.565 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.565 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.566 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.566 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.566 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.566 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ ERROR at setup of test_true_false_datetime __________________ 2023-12-03T12:39:17.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.566 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.566 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.566 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.566 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.566 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.566 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.567 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.567 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.567 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.567 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.567 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.567 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.567 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.567 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.567 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.567 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.567 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.567 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.567 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.568 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.568 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.568 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.568 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.568 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.568 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.568 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.568 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.568 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.568 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.568 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.568 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.568 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.568 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.568 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.569 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.569 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.569 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.569 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.569 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.569 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.569 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.569 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.569 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.569 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.569 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.569 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.569 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.569 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.570 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.570 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.570 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.570 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.570 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.570 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.570 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.570 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.570 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.570 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.570 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.570 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.570 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.570 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.571 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.571 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.571 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.571 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.571 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.571 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.571 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.571 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.571 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.571 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.572 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.572 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.572 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.572 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.572 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.572 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.572 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.572 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.572 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.572 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.572 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.572 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.572 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.572 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.572 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.572 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.573 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.573 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.573 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.573 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.573 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.573 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.573 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.573 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.573 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.573 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.573 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.573 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.573 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.573 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.574 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.574 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.574 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.574 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.574 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.574 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.574 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.574 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.575 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.575 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.575 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.575 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.575 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.575 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.575 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.576 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.576 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.576 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.576 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.576 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.576 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.576 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.576 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.576 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.576 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.576 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.576 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.576 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.576 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.577 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.577 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.577 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.577 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.577 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.577 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.577 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.577 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.577 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.577 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.578 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.578 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.578 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.578 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.578 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.578 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.578 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.578 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.578 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.578 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.578 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.578 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.579 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.579 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.579 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.579 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.579 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.579 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.579 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.579 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.579 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.579 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.579 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.579 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.579 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.579 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.580 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.580 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.580 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.580 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.580 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.580 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.580 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.580 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.580 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.580 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.580 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.580 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.580 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.580 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.581 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.581 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.581 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.581 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.581 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.581 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.581 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.581 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.581 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.581 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.581 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.581 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.581 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.581 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.582 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.582 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.582 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.582 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.582 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.582 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.582 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.582 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.582 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.582 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.582 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.582 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.582 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.583 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.583 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.583 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.586 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.586 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.586 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.586 INFO:teuthology.orchestra.run.smithi044.stdout:______________________ ERROR at setup of test_csv_parser _______________________ 2023-12-03T12:39:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.586 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.587 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.587 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.588 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.588 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.588 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.588 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.588 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.591 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.591 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.591 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.592 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.592 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.592 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.593 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.594 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.594 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.594 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.594 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.594 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.594 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.594 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.594 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.594 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.594 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.594 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.594 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.595 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.595 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.595 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.595 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.595 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.595 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.595 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.595 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.595 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.596 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.596 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.596 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.598 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.598 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.598 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.598 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.598 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.599 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.599 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.599 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.599 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.599 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.599 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.599 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.599 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.599 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.599 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.599 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.599 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.599 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.599 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.599 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.599 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.600 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.600 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.600 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.600 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.600 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.600 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.600 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.600 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.600 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.601 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.601 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.601 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.601 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.601 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.601 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.601 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.601 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.601 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.601 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.601 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.601 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.601 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.601 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.604 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.604 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.604 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.604 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.604 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.604 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.604 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.604 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.604 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.604 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.604 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.604 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.604 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.604 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.604 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.604 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.604 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.605 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.605 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.605 INFO:teuthology.orchestra.run.smithi044.stdout:____________________ ERROR at setup of test_csv_definition _____________________ 2023-12-03T12:39:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.605 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.606 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.607 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.607 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.607 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.607 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.610 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.610 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.611 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.611 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.611 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.612 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.613 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.614 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.614 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.614 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.614 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.614 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.614 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.614 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.614 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.614 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.614 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.614 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.614 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.614 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.614 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.615 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.615 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.615 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.615 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.617 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.617 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.617 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.617 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.617 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.618 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.618 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.618 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.618 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.618 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.618 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.618 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.618 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.618 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.618 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.618 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.618 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.619 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.619 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.619 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.619 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.619 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.619 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.619 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.619 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.619 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.619 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.619 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.619 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.619 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.619 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.619 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.620 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.620 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.620 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.620 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.620 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.620 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.621 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.621 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.621 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.621 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.624 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.624 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.625 INFO:teuthology.orchestra.run.smithi044.stdout:___________________ ERROR at setup of test_schema_definition ___________________ 2023-12-03T12:39:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.625 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.626 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.626 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.626 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.626 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.626 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.626 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.626 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.626 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.626 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.626 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.626 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.626 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.626 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.630 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.630 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.630 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.630 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.630 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.630 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.631 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.632 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.632 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.632 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.633 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.633 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.634 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.634 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.634 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.634 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.634 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.634 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.634 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.636 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.636 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.636 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.637 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.637 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.637 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.637 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.637 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.637 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.637 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.638 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.638 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.638 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.638 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.638 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.638 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.638 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.638 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.638 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.638 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.638 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.638 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.638 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.638 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.638 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.640 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.640 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.640 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.640 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.643 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.643 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.643 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.643 INFO:teuthology.orchestra.run.smithi044.stdout:______________ ERROR at setup of test_when_then_else_expressions _______________ 2023-12-03T12:39:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.644 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.645 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.645 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.645 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.645 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.645 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.649 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.649 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.649 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.649 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.649 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.649 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.650 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.651 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.651 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.651 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.651 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.652 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.652 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.652 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.652 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.652 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.652 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.652 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.653 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.653 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.653 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.653 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.653 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.653 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.653 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.655 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.655 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.655 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.656 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.656 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.656 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.656 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.656 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.656 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.656 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.657 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.657 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.657 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.657 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.657 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.657 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.657 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.657 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.657 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.657 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.657 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.657 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.657 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.657 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.657 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.657 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.657 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.658 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.658 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.658 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.658 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.658 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.658 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.658 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.658 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.658 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.658 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.658 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.658 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.658 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.658 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.658 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.659 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.659 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.659 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.659 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.659 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.659 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.659 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.659 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.659 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.659 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.659 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.659 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.659 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.659 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.659 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.660 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.660 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.660 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.660 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.660 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.660 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.660 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.660 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.660 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.660 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.660 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.660 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.660 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.660 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.660 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.662 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.662 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.662 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.662 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ ERROR at setup of test_coalesce_expressions __________________ 2023-12-03T12:39:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.663 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.664 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.664 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.664 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.664 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.664 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.667 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.667 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.667 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.668 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.668 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.668 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.669 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.670 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.671 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.671 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.671 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.671 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.671 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.671 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.671 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.671 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.671 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.671 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.671 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.671 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.672 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.672 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.672 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.674 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.674 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.674 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.674 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.674 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.675 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.675 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.675 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.675 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.675 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.675 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.675 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.675 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.675 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.676 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.676 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.676 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.676 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.676 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.676 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.676 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.677 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.677 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.677 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.677 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.677 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.677 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.677 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.677 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.677 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.677 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.677 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.677 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.677 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.677 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.678 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.678 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.681 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.681 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.681 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.681 INFO:teuthology.orchestra.run.smithi044.stdout:___________________ ERROR at setup of test_cast_expressions ____________________ 2023-12-03T12:39:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.681 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.682 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.682 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.682 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.682 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.683 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.683 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.683 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.686 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.686 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.687 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.687 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.687 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.688 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.689 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.690 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.690 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.690 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.690 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.690 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.690 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.690 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.690 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.690 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.690 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.690 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.690 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.690 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.690 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.691 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.691 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.691 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.691 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.693 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.693 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.693 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.693 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.693 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.694 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.694 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.694 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.694 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.694 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.694 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.694 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.694 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.694 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.694 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.694 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.694 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.694 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.694 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.694 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.695 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.695 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.695 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.695 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.695 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.695 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.695 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.695 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.695 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.695 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.695 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.695 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.695 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.695 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.695 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.695 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.696 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.696 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.696 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.696 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.696 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.696 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.696 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.696 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.696 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.696 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.696 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.696 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.696 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.697 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.697 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.697 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.697 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.697 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.697 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.697 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.697 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.697 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.697 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.697 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.697 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.698 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.698 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.698 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.698 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.698 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.698 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.698 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.698 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.698 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.698 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.698 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.698 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.698 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.698 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.698 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.699 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.699 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.699 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.699 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.699 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.699 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.699 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.699 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.699 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.699 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.699 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.699 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.699 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.700 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.700 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.700 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.700 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.700 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.700 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.700 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.700 INFO:teuthology.orchestra.run.smithi044.stdout:________________________ ERROR at setup of test_version ________________________ 2023-12-03T12:39:17.700 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.700 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.700 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.700 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.700 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.700 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.700 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.701 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.701 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.701 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.701 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.701 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.701 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.701 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.701 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.701 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.701 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.701 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.701 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.702 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.702 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.702 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.702 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.702 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.702 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.702 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.702 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.702 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.702 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.702 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.702 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.702 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.702 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.703 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.703 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.703 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.703 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.703 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.703 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.703 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.703 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.703 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.703 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.703 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.703 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.703 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.703 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.703 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.703 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.703 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.704 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.704 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.704 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.704 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.704 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.704 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.704 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.704 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.704 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.704 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.704 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.704 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.704 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.704 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.704 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.705 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.705 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.705 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.705 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.705 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.705 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.705 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.705 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.705 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.705 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.705 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.705 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.705 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.705 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.705 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.706 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.706 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.706 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.706 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.706 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.706 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.706 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.706 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.706 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.706 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.706 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.706 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.706 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.706 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.706 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.706 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.707 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.707 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.707 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.707 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.707 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.707 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.707 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.707 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.707 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.707 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.707 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.707 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.707 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.707 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.707 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.707 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.707 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.708 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.708 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.708 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.708 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.708 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.708 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.708 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.708 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.709 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.709 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.709 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.709 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.709 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.709 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.709 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.709 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.709 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.709 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.709 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.710 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.710 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.710 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.710 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.710 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.710 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.710 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.710 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.710 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.710 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.710 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.710 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.710 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.711 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.711 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.711 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.711 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.711 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.711 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.711 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.711 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.711 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.711 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.711 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.711 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.711 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.711 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.711 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.712 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.712 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.712 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.712 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.712 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.712 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.712 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.712 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.712 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.712 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.712 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.713 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.713 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.713 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.713 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.713 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.713 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.713 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.713 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.713 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.713 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.713 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.713 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.713 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.713 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.713 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.713 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.713 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.714 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.714 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.714 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.714 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.714 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.714 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.714 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.714 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.714 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.714 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.714 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.714 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.714 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.714 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.715 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.715 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.715 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.715 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.715 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.715 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.715 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.715 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.715 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.715 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.715 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.715 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.715 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.716 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.716 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.716 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.716 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.716 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.716 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.716 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.716 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.716 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.716 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.716 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.716 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.716 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.716 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.716 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.716 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.716 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.717 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.717 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.717 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.717 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.717 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.717 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.717 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.717 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.717 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.717 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.717 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.717 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.717 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.718 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.718 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.718 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.718 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.718 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.718 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.718 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.718 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.718 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.718 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.718 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.719 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.719 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.719 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.719 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.719 INFO:teuthology.orchestra.run.smithi044.stdout:___________________ ERROR at setup of test_trim_expressions ____________________ 2023-12-03T12:39:17.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.719 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.719 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.719 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.719 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.719 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.720 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.720 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.720 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.720 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.720 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.720 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.720 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.720 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.720 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.720 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.720 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.720 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.720 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.720 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.720 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.721 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.721 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.721 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.721 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.721 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.721 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.721 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.721 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.721 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.721 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.721 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.722 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.722 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.722 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.722 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.722 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.722 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.722 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.722 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.722 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.722 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.722 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.722 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.722 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.723 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.723 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.723 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.723 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.723 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.723 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.723 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.723 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.723 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.723 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.723 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.723 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.723 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.723 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.723 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.723 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.724 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.724 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.724 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.724 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.724 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.724 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.724 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.724 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.724 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.724 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.724 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.724 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.725 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.725 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.725 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.725 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.725 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.725 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.725 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.725 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.725 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.725 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.725 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.725 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.725 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.725 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.725 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.725 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.725 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.726 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.726 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.726 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.726 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.726 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.726 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.726 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.726 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.726 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.726 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.726 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.726 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.726 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.726 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.726 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.727 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.727 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.727 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.727 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.727 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.727 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.727 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.727 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.728 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.728 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.728 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.728 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.728 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.728 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.728 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.728 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.728 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.728 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.728 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.728 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.729 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.729 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.729 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.729 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.729 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.729 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.729 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.729 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.729 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.729 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.729 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.729 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.729 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.729 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.729 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.729 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.730 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.730 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.730 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.730 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.730 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.730 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.730 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.730 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.730 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.730 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.730 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.730 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.730 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.730 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.730 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.731 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.731 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.731 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.731 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.731 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.731 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.731 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.731 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.731 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.731 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.731 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.731 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.731 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.732 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.732 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.732 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.732 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.732 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.732 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.732 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.732 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.732 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.732 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.732 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.733 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.733 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.733 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.733 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.733 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.733 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.733 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.733 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.733 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.733 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.733 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.733 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.733 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.733 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.733 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.733 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.734 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.734 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.734 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.734 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.734 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.734 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.734 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.734 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.734 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.734 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.734 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.734 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.734 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.734 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.735 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.735 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.735 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.735 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.735 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.735 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.735 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.735 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.735 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.735 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.735 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.735 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.735 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.735 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.735 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.735 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.736 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.736 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.736 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.736 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.736 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.736 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.736 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.736 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.736 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.736 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.736 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.736 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.736 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.736 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.736 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.736 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.737 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.737 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.737 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.737 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.737 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.737 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.737 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.737 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.737 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.737 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.737 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.737 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.738 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.738 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.738 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.738 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.738 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.738 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.738 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.738 INFO:teuthology.orchestra.run.smithi044.stdout:______________ ERROR at setup of test_truefalse_trim_expressions _______________ 2023-12-03T12:39:17.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.738 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.738 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.738 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.738 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.739 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.739 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.739 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.739 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.739 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.739 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.739 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.739 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.739 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.739 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.739 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.739 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.739 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.740 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.740 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.740 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.740 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.740 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.740 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.740 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.740 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.740 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.740 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.740 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.740 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.740 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.740 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.740 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.740 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.740 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.741 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.741 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.741 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.741 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.741 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.741 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.741 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.741 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.741 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.741 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.741 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.741 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.741 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.741 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.741 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.742 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.742 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.742 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.742 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.742 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.742 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.742 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.742 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.742 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.742 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.742 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.742 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.742 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.742 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.742 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.743 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.743 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.743 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.743 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.743 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.743 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.743 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.743 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.743 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.743 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.743 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.743 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.743 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.743 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.744 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.744 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.744 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.744 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.744 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.744 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.744 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.744 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.744 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.744 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.744 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.744 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.744 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.744 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.744 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.744 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.745 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.745 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.745 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.745 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.745 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.745 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.745 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.745 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.745 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.745 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.745 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.745 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.745 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.745 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.745 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.746 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.746 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.746 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.746 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.746 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.746 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.746 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.746 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.746 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.746 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.746 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.746 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.746 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.746 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.746 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.747 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.747 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.747 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.747 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.747 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.747 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.747 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.747 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.747 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.747 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.747 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.748 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.748 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.748 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.748 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.748 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.748 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.748 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.748 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.748 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.748 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.748 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.748 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.748 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.748 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.748 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.749 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.749 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.749 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.749 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.749 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.749 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.749 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.749 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.749 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.749 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.749 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.749 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.749 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.749 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.749 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.749 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.750 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.750 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.750 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.750 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.750 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.750 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.750 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.750 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.750 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.750 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.750 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.750 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.750 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.750 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.751 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.751 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.751 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.751 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.751 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.751 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.751 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.751 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.751 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.751 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.751 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.751 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.751 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.751 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.751 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.752 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.752 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.752 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.752 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.752 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.752 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.752 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.752 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.752 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.752 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.752 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.752 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.752 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.752 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.752 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.752 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.753 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.753 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.753 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.753 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.753 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.753 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.753 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.753 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.753 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.753 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.753 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.753 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.753 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.753 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.753 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.754 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.754 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.754 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.754 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.754 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.754 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.754 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.754 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.754 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.754 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.754 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.754 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.754 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.754 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.755 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.755 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.755 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.755 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.755 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.755 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.755 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.755 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.755 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.755 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.755 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.755 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.755 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.755 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.756 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.756 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.756 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.756 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.756 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.756 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.756 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.756 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.756 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.756 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.756 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.756 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.756 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.756 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.756 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.757 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.757 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ ERROR at setup of test_escape_expressions ___________________ 2023-12-03T12:39:17.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.757 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.757 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.757 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.757 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.757 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.757 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.757 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.757 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.757 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.758 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.758 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.758 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.758 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.758 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.758 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.758 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.758 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.758 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.758 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.758 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.758 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.758 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.758 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.758 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.759 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.759 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.759 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.759 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.759 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.759 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.759 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.759 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.759 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.759 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.759 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.759 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.760 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.760 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.760 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.760 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.760 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.760 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.760 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.760 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.760 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.760 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.760 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.760 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.760 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.760 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.760 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.760 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.761 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.761 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.761 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.761 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.761 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.761 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.761 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.761 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.761 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.761 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.761 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.761 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.761 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.761 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.761 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.761 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.761 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.762 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.762 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.762 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.762 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.762 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.762 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.762 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.762 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.762 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.762 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.762 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.762 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.762 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.762 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.763 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.763 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.763 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.763 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.763 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.763 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.763 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.763 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.763 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.763 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.763 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.763 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.763 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.763 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.763 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.763 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.764 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.764 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.764 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.764 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.764 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.764 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.764 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.764 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.764 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.764 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.764 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.764 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.764 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.764 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.764 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.765 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.765 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.765 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.765 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.765 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.765 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.765 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.766 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.766 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.766 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.766 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.766 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.766 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.766 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.766 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.766 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.766 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.766 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.766 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.766 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.767 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.767 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.767 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.767 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.767 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.767 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.767 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.767 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.767 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.767 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.767 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.767 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.768 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.768 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.768 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.768 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.768 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.768 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.768 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.768 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.768 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.768 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.768 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.768 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.768 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.768 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.768 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.769 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.769 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.769 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.769 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.769 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.769 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.769 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.769 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.769 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.769 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.769 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.769 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.770 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.770 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.770 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.770 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.770 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.770 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.770 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.771 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.771 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.771 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.771 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.771 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.771 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.771 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.771 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.771 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.771 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.771 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.771 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.771 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.771 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.772 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.772 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.772 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.772 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.772 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.772 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.772 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.772 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.772 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.772 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.772 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.772 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.772 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.772 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.772 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.772 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.772 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.773 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.773 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.773 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.773 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.773 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.773 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.773 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.773 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.773 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.773 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.773 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.773 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.773 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.773 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.773 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.773 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.773 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.774 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.774 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.774 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.774 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.774 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.774 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.774 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.774 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.774 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.774 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.774 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.774 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.775 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.775 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.775 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.775 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.775 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.775 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.775 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.775 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.775 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.775 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.775 INFO:teuthology.orchestra.run.smithi044.stdout:________________ ERROR at setup of test_case_value_expressions _________________ 2023-12-03T12:39:17.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.775 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.776 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.776 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.776 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.776 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.776 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.776 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.776 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.776 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.776 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.777 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.777 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.777 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.777 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.777 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.777 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.777 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.777 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.777 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.777 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.777 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.777 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.778 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.778 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.778 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.778 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.778 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.778 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.778 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.778 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.778 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.778 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.778 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.778 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.778 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.778 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.779 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.779 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.779 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.779 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.779 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.779 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.779 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.779 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.779 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.779 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.779 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.779 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.779 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.779 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.779 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.779 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.779 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.779 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.780 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.780 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.780 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.780 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.780 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.780 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.780 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.780 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.780 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.780 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.780 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.780 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.780 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.780 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.781 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.781 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.781 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.781 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.781 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.781 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.781 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.781 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.781 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.781 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.781 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.781 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.781 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.781 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.781 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.782 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.782 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.782 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.782 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.782 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.782 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.782 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.782 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.782 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.782 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.782 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.782 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.782 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.782 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.783 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.783 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.783 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.783 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.783 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.783 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.783 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.783 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.783 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.783 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.783 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.783 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.783 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.783 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.783 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.784 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.784 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.784 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.784 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.784 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.784 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.784 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.784 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.784 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.784 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.785 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.785 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.785 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.785 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.785 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.785 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.785 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.785 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.785 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.785 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.785 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.785 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.785 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.785 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.786 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.786 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.786 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.786 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.786 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.786 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.786 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.786 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.786 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.786 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.786 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.786 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.787 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.787 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.787 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.787 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.787 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.787 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.787 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.787 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.787 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.787 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.787 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.787 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.787 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.788 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.788 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.788 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.788 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.788 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.788 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.788 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.788 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.788 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.788 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.788 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.788 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.788 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.788 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.788 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.789 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.789 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.789 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.789 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.789 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.789 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.789 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.789 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.790 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.790 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.790 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.790 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.790 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.790 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.790 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.790 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.790 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.790 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.790 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.790 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.790 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.790 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.791 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.791 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.791 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.791 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.791 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.791 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.791 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.791 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.791 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.791 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.791 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.791 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.791 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.791 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.791 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.792 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.792 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.792 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.792 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.792 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.792 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.792 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.792 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.792 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.792 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.792 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.792 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.792 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.792 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.792 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.792 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.793 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.793 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.793 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.793 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.793 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.793 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.793 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.793 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.793 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.793 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.793 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.793 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.793 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.793 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.793 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.793 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.794 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.794 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.794 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.794 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.794 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.794 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.794 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.794 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.794 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.794 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.794 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.794 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.794 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.794 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.794 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ ERROR at setup of test_bool_cast_expressions _________________ 2023-12-03T12:39:17.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.795 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.795 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.795 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.795 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.795 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.795 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.795 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.795 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.795 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.795 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.796 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.796 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.796 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.796 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.796 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.796 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.796 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.796 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.796 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.796 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.796 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.797 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.797 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.797 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.797 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.797 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.797 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.797 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.797 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.797 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.797 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.797 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.797 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.797 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.797 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.797 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.797 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.797 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.798 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.798 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.798 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.798 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.798 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.798 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.798 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.798 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.798 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.798 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.798 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.798 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.799 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.799 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.799 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.799 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.799 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.799 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.799 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.799 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.799 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.799 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.799 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.799 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.800 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.800 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.800 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.800 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.800 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.800 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.800 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.800 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.800 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.800 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.800 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.800 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.800 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.800 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.801 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.801 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.801 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.801 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.801 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.801 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.801 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.801 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.801 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.801 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.801 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.801 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.801 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.801 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.802 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.802 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.802 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.802 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.802 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.802 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.802 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.802 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.802 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.802 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.802 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.802 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.802 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.802 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.803 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.803 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.803 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.803 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.803 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.803 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.803 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.803 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.804 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.804 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.804 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.804 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.804 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.804 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.804 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.804 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.804 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.804 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.804 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.804 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.804 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.804 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.804 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.805 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.805 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.805 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.805 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.805 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.805 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.805 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.805 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.805 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.805 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.805 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.805 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.806 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.806 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.806 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.806 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.806 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.806 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.806 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.806 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.806 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.806 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.806 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.806 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.806 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.806 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.806 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.807 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.807 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.807 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.807 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.807 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.807 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.807 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.807 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.807 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.807 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.807 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.807 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.807 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.807 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.807 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.807 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.808 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.808 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.808 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.808 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.808 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.808 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.808 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.808 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.808 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.809 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.809 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.809 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.809 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.809 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.809 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.809 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.810 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.810 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.810 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.810 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.810 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.810 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.810 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.810 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.810 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.810 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.810 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.810 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.810 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.810 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.810 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.811 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.811 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.811 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.811 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.811 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.811 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.811 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.811 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.811 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.811 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.811 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.811 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.812 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.812 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.812 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.812 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.812 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.812 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.812 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.812 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.812 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.812 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.812 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.812 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.812 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.812 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.812 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.812 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.812 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.813 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.813 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.813 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.813 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.813 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.813 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.813 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.813 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.813 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.813 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.813 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.813 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.813 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.813 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.813 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.813 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.814 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.814 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.814 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ ERROR at setup of test_progress_expressions __________________ 2023-12-03T12:39:17.814 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.814 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.814 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.814 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.814 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.814 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.814 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.814 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.814 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.814 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.814 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.814 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.815 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.815 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.815 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.815 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.815 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.815 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.815 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.815 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.815 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.815 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.815 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.815 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.816 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.816 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.816 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.816 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.816 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.816 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.816 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.816 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.816 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.816 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.816 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.816 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.816 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.816 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.816 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.816 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.817 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.817 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.817 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.817 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.817 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.817 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.817 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.817 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.817 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.817 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.817 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.817 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.817 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.817 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.817 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.818 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.818 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.818 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.818 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.818 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.818 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.818 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.818 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.818 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.818 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.818 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.818 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.818 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.818 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.819 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.819 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.819 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.819 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.819 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.819 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.819 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.819 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.819 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.819 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.819 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.819 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.819 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.819 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.820 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.820 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.820 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.820 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.820 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.820 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.820 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.820 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.820 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.820 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.820 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.820 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.820 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.820 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.820 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.821 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.821 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.821 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.821 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.821 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.821 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.821 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.821 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.821 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.821 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.821 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.821 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.821 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.821 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.821 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.822 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.822 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.822 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.822 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.822 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.822 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.822 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.822 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.822 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.822 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.822 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.822 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.822 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.822 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.823 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.823 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.823 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.823 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.823 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.823 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.823 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.823 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.823 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.823 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.823 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.823 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.823 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.824 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.824 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.824 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.824 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.824 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.824 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.824 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.824 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.824 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.824 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.824 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.824 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.824 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.824 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.824 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.825 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.825 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.825 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.825 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.825 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.825 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.825 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.825 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.825 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.825 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.825 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.825 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.826 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.826 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.826 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.826 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.826 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.826 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.826 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.826 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.826 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.826 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.827 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.827 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.827 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.827 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.827 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.827 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.827 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.827 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.827 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.827 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.827 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.827 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.827 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.827 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.828 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.828 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.828 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.828 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.828 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.828 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.828 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.828 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.828 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.828 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.828 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.828 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.828 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.828 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.828 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.828 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.828 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.829 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.829 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.829 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.829 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.829 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.829 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.829 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.829 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.829 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.829 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.829 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.829 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.829 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.829 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.829 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.830 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.830 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.830 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.830 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.830 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.830 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.830 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.830 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.830 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.830 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.830 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.830 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.830 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.830 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.831 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.831 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.831 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.831 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.831 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.831 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.831 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.831 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.831 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.831 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.831 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.831 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.831 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.831 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.831 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.832 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.832 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.832 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.832 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.832 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.832 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.832 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.832 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.832 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.832 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.832 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.832 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.832 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.832 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.832 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.833 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.833 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.833 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.833 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.833 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.833 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.833 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ ERROR at setup of test_output_serial_expressions _______________ 2023-12-03T12:39:17.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.833 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.833 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.833 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.833 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.833 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.834 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.834 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.834 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.834 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.834 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.834 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.834 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.834 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.834 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.834 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.834 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.834 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.834 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.834 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.834 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.835 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.835 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.835 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.835 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.835 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.835 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.835 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.835 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.835 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.835 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.835 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.835 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.836 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.836 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.836 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.836 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.836 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.836 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.836 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.836 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.836 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.836 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.836 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.836 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.836 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.836 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.836 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.837 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.837 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.837 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.837 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.837 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.837 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.837 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.837 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.837 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.837 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.837 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.837 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.837 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.837 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.838 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.838 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.838 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.838 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.838 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.838 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.838 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.838 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.838 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.838 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.838 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.838 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.838 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.838 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.839 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.839 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.839 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.839 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.839 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.839 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.839 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.839 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.839 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.839 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.839 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.839 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.840 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.840 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.840 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.840 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.840 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.840 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.840 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.840 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.840 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.840 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.841 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.841 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.841 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.841 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.841 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.841 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.841 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.841 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.841 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.841 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.841 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.841 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.841 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.841 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.841 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.842 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.842 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.842 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.842 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.842 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.842 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.842 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.842 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.842 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.842 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.843 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.843 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.843 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.843 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.843 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.843 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.843 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.843 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.843 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.843 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.843 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.843 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.843 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.843 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.843 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.843 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.844 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.844 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.844 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.844 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.844 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.844 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.844 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.844 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.844 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.844 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.844 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.844 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.844 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.845 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.845 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.845 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.845 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.845 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.845 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.845 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.845 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.845 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.845 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.845 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.845 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.845 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.845 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.845 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.845 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.fixture(scope="package") 2023-12-03T12:39:17.846 INFO:teuthology.orchestra.run.smithi044.stdout: def configfile(): 2023-12-03T12:39:17.846 INFO:teuthology.orchestra.run.smithi044.stdout:> setup() 2023-12-03T12:39:17.846 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.846 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:39:17.846 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.846 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:39:17.846 INFO:teuthology.orchestra.run.smithi044.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:39:17.846 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:39:17.846 INFO:teuthology.orchestra.run.smithi044.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:39:17.846 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:39:17.846 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.list_buckets() 2023-12-03T12:39:17.846 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.846 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.846 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.846 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.847 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.847 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.847 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.847 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.847 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.847 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.847 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.847 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.847 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.847 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.847 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.847 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.847 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.847 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.848 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.848 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.848 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.848 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.848 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.848 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.849 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.849 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.849 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.849 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.849 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.849 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.849 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.849 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.849 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.849 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.849 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.849 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.849 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.849 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.849 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.849 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.850 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.850 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.850 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.850 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.850 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.850 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.850 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.850 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.850 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.850 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.850 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.850 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.850 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.850 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.851 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.851 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.851 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.851 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.851 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.851 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.851 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.851 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.851 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.851 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.851 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.851 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.851 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.851 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.851 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.852 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.852 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.852 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.852 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.852 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.852 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.852 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.852 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.852 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.852 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.852 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/" 2023-12-03T12:39:17.852 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.852 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.852 INFO:teuthology.orchestra.run.smithi044.stdout:=================================== FAILURES =================================== 2023-12-03T12:39:17.852 INFO:teuthology.orchestra.run.smithi044.stdout:_________________________ test_multipart_upload_empty __________________________ 2023-12-03T12:39:17.852 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.852 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.853 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.853 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.853 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.853 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.853 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.853 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.853 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.853 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.853 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.853 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.853 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.853 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.853 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.853 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.853 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.854 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.854 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.854 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.854 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.854 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.854 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.854 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.854 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.854 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.854 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.854 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.854 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.854 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.854 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.855 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.855 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.855 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.855 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.855 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.855 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.855 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.855 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.855 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.855 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.855 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.855 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.855 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.855 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.855 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.855 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.855 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.856 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.856 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.856 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.856 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.856 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.856 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.856 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.856 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.856 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.856 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.856 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.856 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.856 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.856 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.856 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.856 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.857 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.857 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.857 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.857 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.857 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.857 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.857 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.857 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.857 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.857 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.857 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.857 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.857 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.857 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.857 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.857 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.858 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.858 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.858 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.858 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.858 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.858 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.858 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.858 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.858 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.858 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.858 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.858 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.858 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.859 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.859 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.859 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.859 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.859 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.859 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.859 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.859 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.859 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.859 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.859 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.859 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.859 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.859 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.860 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.860 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.860 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.860 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.860 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.860 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.860 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.860 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.860 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.860 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.860 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.860 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.860 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.860 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.860 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.860 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.861 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.861 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.861 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.861 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.861 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.861 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.861 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.861 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.861 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.861 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.861 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.861 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.861 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.861 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.861 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.862 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.862 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.862 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.862 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.862 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.862 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.862 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.862 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.862 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.862 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.862 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.862 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.862 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.862 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.863 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.863 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.863 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.863 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.863 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.863 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.863 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.863 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.863 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.863 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.863 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.863 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.863 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.863 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.863 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.864 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.864 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.864 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.864 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.864 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.864 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.864 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.864 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.864 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.864 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.864 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.864 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.864 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.864 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.864 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.864 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.865 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.865 INFO:teuthology.orchestra.run.smithi044.stdout: def test_multipart_upload_empty(): 2023-12-03T12:39:17.865 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:17.865 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:17.865 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.865 INFO:teuthology.orchestra.run.smithi044.stdout: key1 = "mymultipart" 2023-12-03T12:39:17.865 INFO:teuthology.orchestra.run.smithi044.stdout: objlen = 0 2023-12-03T12:39:17.865 INFO:teuthology.orchestra.run.smithi044.stdout: (upload_id, data, parts) = _multipart_upload(bucket_name=bucket_name, key=key1, size=objlen) 2023-12-03T12:39:17.865 INFO:teuthology.orchestra.run.smithi044.stdout:> e = assert_raises(ClientError, client.complete_multipart_upload,Bucket=bucket_name, Key=key1, UploadId=upload_id) 2023-12-03T12:39:17.865 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.865 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:5811: 2023-12-03T12:39:17.865 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.865 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/utils.py:11: in assert_raises 2023-12-03T12:39:17.865 INFO:teuthology.orchestra.run.smithi044.stdout: callableObj(*args, **kwargs) 2023-12-03T12:39:17.865 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.866 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.866 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.866 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.866 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.866 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.866 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.866 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.866 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.866 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.866 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.866 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.866 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.866 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.866 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.867 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.867 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.867 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.867 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.867 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.867 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.867 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.867 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.867 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.867 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.867 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.867 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.867 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.867 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.867 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.867 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.868 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.868 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.868 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.868 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.868 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.868 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.868 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.868 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.868 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.868 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.868 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.868 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.868 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.868 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.868 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.869 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.869 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.869 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.869 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.869 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.869 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.869 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.869 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.869 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.869 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.869 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.869 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.870 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.870 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.870 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.870 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.870 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.870 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.870 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.870 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.870 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.870 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.870 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.870 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.870 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.871 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.871 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.871 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.871 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.871 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.871 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.871 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.871 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.871 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.871 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.871 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.871 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.871 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.871 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.871 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-323/mymultipart?uploadId=2~2OD3lM5dtrTJdpwULFnb8dIu2x1Tk4I" 2023-12-03T12:39:17.872 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.872 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.872 INFO:teuthology.orchestra.run.smithi044.stdout:_________________________ test_multipart_upload_small __________________________ 2023-12-03T12:39:17.872 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.872 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.872 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.872 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.872 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.872 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.872 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.872 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.872 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.872 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.873 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.873 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.873 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.873 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.873 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.873 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.873 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.873 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.873 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.873 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.873 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.873 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.873 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.873 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.873 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.873 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.874 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.874 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.874 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.874 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.874 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.874 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.874 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.874 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.874 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.874 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.874 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.874 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.874 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.875 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.875 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.875 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.875 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.875 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.875 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.875 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.875 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.875 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.875 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.875 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.875 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.875 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.876 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.876 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.876 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.876 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.876 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.876 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.876 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.876 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.876 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.876 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.876 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.876 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.877 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.877 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.877 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.877 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.877 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.877 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.877 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.877 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.877 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.877 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.878 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.878 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.878 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.878 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.878 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.878 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.878 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.878 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.878 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.878 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.878 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.878 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.878 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.878 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.879 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.879 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.879 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.879 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.879 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.879 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.879 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.879 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.879 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.879 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.879 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.879 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.879 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.879 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.880 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.880 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.880 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.880 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.880 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.880 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.880 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.880 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.880 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.880 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.880 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.880 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.880 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.880 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.881 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.881 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.881 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.881 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.881 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.881 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.881 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.881 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.881 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.881 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.881 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.881 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.881 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.882 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.882 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.882 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.882 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.882 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.882 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.882 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.882 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.882 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.882 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.882 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.883 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.883 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.883 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.883 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.883 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.883 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.883 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.883 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.883 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.883 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.883 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.883 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.883 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.883 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.883 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.883 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.883 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.884 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.884 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.884 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.884 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.884 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.884 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.884 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.884 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.884 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.884 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.884 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.884 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.884 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.884 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.884 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.885 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.885 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:17.885 INFO:teuthology.orchestra.run.smithi044.stdout: def test_multipart_upload_small(): 2023-12-03T12:39:17.885 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:17.885 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.885 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:5818: 2023-12-03T12:39:17.885 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.885 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:17.885 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:17.885 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.885 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.885 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.885 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.885 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.885 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.886 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.886 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.886 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.886 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.886 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.886 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.886 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.886 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.886 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.886 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.886 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.886 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.886 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.886 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.887 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.887 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.887 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.887 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.887 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.887 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.887 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.887 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.887 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.887 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.887 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.887 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.888 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.888 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.888 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.888 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.888 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.888 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.888 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.888 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.888 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.888 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.888 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.888 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.888 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.889 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.889 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.889 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.889 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.889 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.889 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.889 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.889 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.889 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.889 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.889 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.889 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.889 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.889 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.889 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.890 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.890 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.890 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.890 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.890 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.890 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.890 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.890 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.890 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.890 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.890 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.890 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.890 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.890 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.891 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.891 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.891 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.891 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.891 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.891 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.891 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.891 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.891 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.891 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.891 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-324" 2023-12-03T12:39:17.891 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.891 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.891 INFO:teuthology.orchestra.run.smithi044.stdout:__________________________ test_multipart_copy_small ___________________________ 2023-12-03T12:39:17.892 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.892 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.892 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.892 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.892 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.892 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.892 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.892 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.892 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.892 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.892 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.892 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.892 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.892 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.892 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.892 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.893 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.893 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.893 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.893 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.893 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.893 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.893 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.893 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.893 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.893 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.893 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.893 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.893 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.893 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.893 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.894 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.894 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.894 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.894 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.894 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.894 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.894 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.894 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.894 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.894 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.894 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.894 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.894 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.894 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.895 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.895 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.895 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.895 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.895 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.895 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.895 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.895 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.895 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.895 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.895 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.895 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.895 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.895 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.895 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.896 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.896 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.896 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.896 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.896 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.896 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.896 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.896 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.896 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.896 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.896 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.896 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.896 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.896 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.896 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.897 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.897 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.897 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.897 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.897 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.897 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.897 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.897 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.897 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.897 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.897 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.897 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.897 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.897 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.898 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.898 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.898 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.898 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.898 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.898 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.898 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.898 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.898 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.898 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.898 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.899 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.899 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.899 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.899 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.899 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.899 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.899 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.899 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.899 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.899 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.899 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.899 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.899 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.899 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.900 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.900 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.900 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.900 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.900 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.900 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.900 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.900 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.901 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.901 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.901 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.901 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.901 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.901 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.901 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.901 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.901 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.901 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.901 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.902 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.902 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.902 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.902 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.902 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.902 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.902 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.902 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.902 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.902 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.902 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.902 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.902 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.902 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.903 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.903 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.903 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.903 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.903 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.903 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.903 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.903 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.903 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.903 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.903 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.903 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.903 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.903 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.904 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.904 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.904 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.904 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.904 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.904 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.904 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.904 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.904 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.904 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.904 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:17.904 INFO:teuthology.orchestra.run.smithi044.stdout: def test_multipart_copy_small(): 2023-12-03T12:39:17.904 INFO:teuthology.orchestra.run.smithi044.stdout: src_key = 'foo' 2023-12-03T12:39:17.904 INFO:teuthology.orchestra.run.smithi044.stdout:> src_bucket_name = _create_key_with_random_content(src_key) 2023-12-03T12:39:17.904 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.904 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:5894: 2023-12-03T12:39:17.905 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.905 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:39:17.905 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:17.905 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:17.905 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:17.905 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.905 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.905 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.905 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.905 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.905 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.905 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.905 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.905 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.906 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.906 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.906 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.906 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.906 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.906 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.906 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.906 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.906 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.906 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.906 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.906 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.906 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.906 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.906 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.907 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.907 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.907 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.907 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.907 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.907 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.907 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.907 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.907 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.907 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.907 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.907 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.907 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.908 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.908 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.908 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.908 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.908 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.908 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.908 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.908 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.908 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.908 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.908 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.908 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.908 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.908 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.908 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.909 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.909 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.909 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.909 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.909 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.909 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.909 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.909 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.909 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.909 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.909 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.909 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.909 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.909 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.909 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.910 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.910 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.910 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.910 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.910 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.910 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.910 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.910 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.910 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.910 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.910 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.910 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.911 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.911 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.911 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.911 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.911 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.911 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-325" 2023-12-03T12:39:17.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.911 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.911 INFO:teuthology.orchestra.run.smithi044.stdout:______________________ test_multipart_copy_invalid_range _______________________ 2023-12-03T12:39:17.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.911 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.911 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.911 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.912 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.912 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.912 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.912 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.912 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.912 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.912 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.912 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.912 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.912 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.912 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.912 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.912 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.912 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.912 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.913 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.913 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.913 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.913 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.913 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.913 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.913 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.913 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.913 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.913 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.913 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.913 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.913 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.913 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.913 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.913 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.914 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.914 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.914 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.914 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.914 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.914 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.914 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.914 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.914 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.914 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.914 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.914 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.914 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.914 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.914 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.915 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.915 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.915 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.915 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.915 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.915 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.915 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.915 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.915 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.915 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.915 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.915 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.915 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.915 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.915 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.915 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.916 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.916 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.916 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.916 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.916 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.916 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.916 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.916 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.916 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.916 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.916 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.917 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.917 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.917 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.917 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.917 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.917 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.917 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.917 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.917 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.917 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.917 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.917 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.917 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.918 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.918 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.918 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.918 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.918 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.918 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.918 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.918 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.918 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.918 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.918 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.918 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.918 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.919 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.919 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.919 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.919 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.919 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.919 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.919 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.919 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.919 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.920 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.920 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.920 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.920 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.920 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.920 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.920 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.920 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.920 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.920 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.921 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.921 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.921 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.921 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.921 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.921 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.921 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.921 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.921 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.921 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.921 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.921 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.921 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.921 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.921 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.922 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.922 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.922 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.922 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.922 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.922 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.922 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.922 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.922 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.922 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.922 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.922 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.922 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.922 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.922 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.922 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.923 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.923 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.923 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.923 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.923 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.923 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.923 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.923 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.923 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.923 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.923 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.923 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.923 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.923 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.923 INFO:teuthology.orchestra.run.smithi044.stdout: def test_multipart_copy_invalid_range(): 2023-12-03T12:39:17.923 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:17.924 INFO:teuthology.orchestra.run.smithi044.stdout: src_key = 'source' 2023-12-03T12:39:17.924 INFO:teuthology.orchestra.run.smithi044.stdout:> src_bucket_name = _create_key_with_random_content(src_key, size=5) 2023-12-03T12:39:17.924 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.924 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:5911: 2023-12-03T12:39:17.924 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.924 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:39:17.924 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:17.924 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:17.924 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:17.924 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.924 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.925 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.925 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.925 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.925 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.925 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.925 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.925 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.925 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.925 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.925 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.925 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.925 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.925 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.925 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.925 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.925 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.925 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.926 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.926 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.926 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.926 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.926 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.926 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.926 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.926 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.926 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.926 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.926 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.926 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.926 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.926 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.927 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.927 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.927 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.927 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.927 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.927 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.927 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.927 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.927 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.927 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.927 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.927 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.928 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.928 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.928 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.928 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.928 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.928 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.928 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.928 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.928 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.928 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.928 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.928 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.928 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.928 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.928 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.929 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.929 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.929 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.929 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.929 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.929 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.929 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.929 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.929 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.929 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.929 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.929 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.929 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.930 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.930 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.930 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.930 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.930 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.930 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.930 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.930 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.930 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.930 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-326" 2023-12-03T12:39:17.930 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.930 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.930 INFO:teuthology.orchestra.run.smithi044.stdout:______________________ test_multipart_copy_without_range _______________________ 2023-12-03T12:39:17.930 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.931 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.931 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.931 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.931 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.931 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.931 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.931 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.931 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.931 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.931 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.931 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.931 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.931 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.932 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.932 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.932 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.932 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.932 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.932 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.932 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.932 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.932 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.932 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.932 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.932 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.932 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.932 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.932 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.932 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.933 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.933 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.933 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.933 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.933 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.933 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.933 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.933 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.933 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.933 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.933 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.933 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.933 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.933 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.933 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.934 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.934 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.934 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.934 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.934 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.934 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.934 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.934 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.934 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.934 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.934 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.934 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.934 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.934 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.934 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.935 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.935 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.935 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.935 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.935 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.935 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.935 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.935 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.935 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.935 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.935 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.935 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.935 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.935 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.935 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.935 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.936 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.936 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.936 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.936 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.936 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.936 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.936 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.936 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.936 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.936 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.936 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.936 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.937 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.937 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.937 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.937 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.937 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.937 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.937 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.937 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.937 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.937 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.937 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.937 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.937 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.937 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.937 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.938 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.938 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.938 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.938 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.938 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.938 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.938 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.938 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.938 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.938 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.938 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.938 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.938 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.938 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.939 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.939 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.939 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.939 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.939 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.939 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.939 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.939 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.939 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.939 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.939 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.940 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.940 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.940 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.940 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.940 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.940 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.940 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.940 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.940 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.941 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.941 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.941 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.941 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.941 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.941 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.941 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.941 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.941 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.941 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.941 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.942 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.942 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.942 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.942 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.942 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.942 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.942 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.942 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.942 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.942 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.942 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.942 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.942 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.942 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.943 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.943 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.943 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.943 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.943 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.943 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.943 INFO:teuthology.orchestra.run.smithi044.stdout: def test_multipart_copy_without_range(): 2023-12-03T12:39:17.943 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:17.943 INFO:teuthology.orchestra.run.smithi044.stdout: src_key = 'source' 2023-12-03T12:39:17.943 INFO:teuthology.orchestra.run.smithi044.stdout:> src_bucket_name = _create_key_with_random_content(src_key, size=10) 2023-12-03T12:39:17.943 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.943 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:5961: 2023-12-03T12:39:17.943 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.943 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:39:17.943 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:17.944 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:17.944 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:17.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.944 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.944 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.944 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.944 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.944 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.944 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.945 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.945 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.945 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.945 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.945 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.945 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.945 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.945 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.945 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.945 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.945 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.945 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.945 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.945 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.945 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.945 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.946 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.946 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.946 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.946 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.946 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.946 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.946 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.946 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.946 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.946 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.946 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.946 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.946 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.946 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.946 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.947 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.947 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.947 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.947 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.947 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.947 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.947 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.947 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.947 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.947 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.947 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.947 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.947 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.947 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.947 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.948 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.948 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.948 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.948 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.948 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.948 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.948 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.948 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.948 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.948 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.948 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.948 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.949 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.949 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.949 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.949 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.949 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.949 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.949 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.949 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.949 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.949 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.949 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.949 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-327" 2023-12-03T12:39:17.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.950 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.950 INFO:teuthology.orchestra.run.smithi044.stdout:______________________ test_multipart_copy_special_names _______________________ 2023-12-03T12:39:17.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.950 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.950 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.950 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.950 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.950 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.950 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.950 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.950 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.951 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.951 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.951 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.951 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.951 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.951 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.951 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.951 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.951 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.951 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.951 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.951 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.951 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.952 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.952 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.952 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.952 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.952 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.952 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.952 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.952 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.952 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.952 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.952 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.952 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.952 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.952 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.953 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.953 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.953 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.953 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.953 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.953 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.953 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.953 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.953 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.953 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.953 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.953 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.953 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.953 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.953 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.954 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.954 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.954 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.954 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.954 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.954 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.954 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.954 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.954 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.954 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.954 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.954 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.954 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.954 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.955 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.955 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.955 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.955 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.955 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.955 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.955 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.955 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.955 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.955 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.955 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.955 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.956 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.956 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.956 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.956 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.956 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.956 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.956 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.956 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.956 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.956 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.956 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.956 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.956 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.956 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.956 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.956 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.957 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.957 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.957 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.957 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.957 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.957 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.957 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.957 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.957 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.957 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.957 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.957 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.957 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.957 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.957 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.958 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.958 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.958 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.958 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.958 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.958 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.958 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.958 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.958 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.958 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.958 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.958 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.958 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.958 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.958 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.959 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.959 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.959 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.959 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.959 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.959 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.959 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.959 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.959 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.959 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.959 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.959 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.959 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.959 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.959 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.960 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.960 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.960 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.960 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.960 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.960 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.960 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.960 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.960 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.960 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.960 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.960 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.960 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.960 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.960 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.960 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.961 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.961 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.961 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.961 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.961 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.961 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.961 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.961 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.961 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.961 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.961 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.961 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.961 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.961 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.962 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.962 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.962 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.962 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.962 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.962 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.962 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.962 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:17.962 INFO:teuthology.orchestra.run.smithi044.stdout: def test_multipart_copy_special_names(): 2023-12-03T12:39:17.962 INFO:teuthology.orchestra.run.smithi044.stdout:> src_bucket_name = get_new_bucket() 2023-12-03T12:39:17.962 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.962 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:5985: 2023-12-03T12:39:17.962 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.962 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:17.963 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:17.963 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.963 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.963 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.963 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.963 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.963 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.963 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.963 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.963 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.963 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.963 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.963 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.963 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.963 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.964 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.964 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.964 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.964 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.964 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.964 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.964 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.964 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.964 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.964 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.964 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.964 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.964 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.964 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.965 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.965 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.965 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.965 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.965 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.965 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.965 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.965 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.965 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.965 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.965 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.965 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.965 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.965 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.965 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.966 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.966 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.966 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.966 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.966 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.966 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.966 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.966 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.966 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.966 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.966 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.966 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.966 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.966 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.967 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.967 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.967 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.967 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.967 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.967 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.967 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.967 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.967 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.967 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.967 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.967 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.967 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.967 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.967 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.968 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.968 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.968 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.968 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.968 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.968 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.968 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.968 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.968 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.968 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.968 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.968 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.969 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.969 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.969 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-328" 2023-12-03T12:39:17.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.969 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.969 INFO:teuthology.orchestra.run.smithi044.stdout:____________________________ test_multipart_upload _____________________________ 2023-12-03T12:39:17.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.969 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.969 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.970 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.970 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.970 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.970 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.970 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.970 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.970 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.970 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.970 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.970 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.970 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.970 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.970 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.970 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.971 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.971 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.971 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.971 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.971 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.971 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.971 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.971 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.971 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.971 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.971 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.971 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.971 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.971 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.971 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.972 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.972 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.972 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.972 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.972 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.972 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.972 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.972 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.972 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.972 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.972 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.972 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.972 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.972 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.972 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.973 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.973 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.973 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.973 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.973 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.973 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.973 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.973 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.973 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.973 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.973 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.973 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.973 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.973 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.973 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.974 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.974 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.974 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.974 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.974 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.974 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.974 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.974 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.974 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.974 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.974 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.974 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.974 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.974 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.975 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.975 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.975 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.975 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.975 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.975 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.975 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.975 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.975 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.975 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.975 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.975 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.975 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.975 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.976 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.976 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.976 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.976 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.976 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.976 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.976 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.976 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.976 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.976 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.976 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.976 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.976 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.977 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.977 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.977 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.977 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.977 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.977 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.977 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.977 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.977 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.977 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.977 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.977 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.977 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.978 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.978 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.978 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.978 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.978 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.978 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.978 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.978 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.978 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.978 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.978 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.978 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.979 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.979 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.979 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.979 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.979 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.979 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.979 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.979 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.979 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.979 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.979 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.979 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.979 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.979 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.979 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.980 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.980 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.980 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.980 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.980 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.980 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.980 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.980 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.980 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.980 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.980 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.980 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.980 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.980 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.980 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.981 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.981 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.981 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:17.981 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.981 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.981 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.981 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:17.981 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:17.981 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:17.981 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:17.981 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:17.981 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.981 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.981 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:17.981 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:17.982 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:17.982 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.982 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:17.982 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.982 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:17.982 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.982 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.982 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.982 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:17.982 INFO:teuthology.orchestra.run.smithi044.stdout: def test_multipart_upload(): 2023-12-03T12:39:17.982 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:17.982 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.982 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6019: 2023-12-03T12:39:17.982 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.983 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:17.983 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:17.983 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:17.983 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:17.983 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:17.983 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:17.983 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:17.983 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:17.983 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:17.983 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:17.983 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:17.983 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:17.983 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:17.983 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:17.983 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:17.984 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:17.984 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:17.984 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:17.984 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:17.984 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:17.984 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:17.984 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:17.984 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:17.984 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:17.984 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:17.984 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:17.984 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:17.984 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:17.984 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:17.984 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:17.984 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:17.985 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:17.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:17.985 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:17.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:17.985 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:17.985 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.985 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.985 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.985 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.985 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.985 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.985 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.985 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.986 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.986 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.986 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.986 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.986 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.986 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.986 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.986 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.986 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.986 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.986 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.986 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.986 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.986 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.986 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:17.987 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.987 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.987 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.987 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.987 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.987 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.987 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.987 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.987 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.987 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.987 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.987 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:17.987 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:17.987 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:17.988 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:17.988 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:17.988 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.988 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.988 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:17.988 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:17.988 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:17.988 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:17.988 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:17.988 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.988 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:17.988 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:17.988 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.989 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:17.989 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:17.989 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-329" 2023-12-03T12:39:17.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.989 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:17.989 INFO:teuthology.orchestra.run.smithi044.stdout:________________________ test_multipart_copy_versioned _________________________ 2023-12-03T12:39:17.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.989 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.989 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.989 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:17.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.989 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:17.989 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.989 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:17.990 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:17.990 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:17.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.990 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:17.990 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:17.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.990 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.990 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:17.990 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:17.990 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.990 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:17.990 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.990 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:17.991 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:17.991 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.991 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.991 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:17.991 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:17.991 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.991 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:17.991 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:17.991 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:17.991 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:17.991 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:17.991 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.991 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:17.991 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.992 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:17.992 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:17.992 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:17.992 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:17.992 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:17.992 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:17.992 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:17.992 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:17.992 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:17.992 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.992 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:17.992 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:17.992 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:17.992 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:17.992 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.993 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:17.993 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:17.993 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:17.993 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:17.993 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.993 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.993 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:17.993 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:17.993 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:17.993 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:17.993 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.993 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.993 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:17.993 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:17.994 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:17.994 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.994 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:17.994 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.994 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:17.994 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:17.994 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.994 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:17.994 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:17.994 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:17.994 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:17.994 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:17.994 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:17.994 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.995 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:17.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.995 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:17.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.995 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.995 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:17.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.995 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:17.995 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:17.995 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:17.995 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:17.995 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:17.995 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:17.995 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:17.995 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:17.996 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:17.996 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:17.996 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:17.996 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:17.996 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:17.996 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:17.996 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:17.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.996 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:17.996 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:17.996 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:17.996 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:17.996 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:17.996 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:17.996 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:17.996 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:17.997 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:17.997 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:17.997 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:17.997 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:17.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.997 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:17.997 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.997 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:17.997 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:17.997 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:17.997 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:17.997 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:17.997 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:17.997 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:17.998 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:17.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:17.998 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:17.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:17.998 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:17.998 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:17.998 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:17.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:17.998 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:17.998 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:17.998 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.998 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:17.998 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:17.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:17.998 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:17.999 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:17.999 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:17.999 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:17.999 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:17.999 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:17.999 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:17.999 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:17.999 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.999 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:17.999 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:17.999 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:17.999 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.000 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.000 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.000 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.000 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.000 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.000 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.000 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.000 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.000 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.000 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.000 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.000 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.000 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.001 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.001 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.001 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.001 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.001 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.001 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.001 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.001 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.001 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.001 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.001 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.001 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.001 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.001 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.002 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.002 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.002 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:18.002 INFO:teuthology.orchestra.run.smithi044.stdout: def test_multipart_copy_versioned(): 2023-12-03T12:39:18.002 INFO:teuthology.orchestra.run.smithi044.stdout:> src_bucket_name = get_new_bucket() 2023-12-03T12:39:18.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.002 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6077: 2023-12-03T12:39:18.002 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.002 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.002 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.002 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.003 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.003 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.003 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.003 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.003 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.003 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.003 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.003 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.003 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.003 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.003 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.003 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.003 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.003 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.003 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.004 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.004 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.004 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.004 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.004 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.004 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.004 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.004 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.004 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.004 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.004 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.004 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.004 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.004 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.005 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.005 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.005 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.005 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.005 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.005 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.005 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.005 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.005 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.005 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.005 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.005 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.005 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.006 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.006 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.006 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.006 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.006 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.006 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.006 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.006 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.006 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.006 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.006 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.006 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.006 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.006 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.006 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.007 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.007 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.007 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.007 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.007 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.007 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.007 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.007 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.007 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.007 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.007 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.007 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.007 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.008 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.008 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.008 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.008 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.008 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.008 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.008 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.008 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.008 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.008 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.008 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.008 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-330" 2023-12-03T12:39:18.008 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.008 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.008 INFO:teuthology.orchestra.run.smithi044.stdout:______________________ test_multipart_upload_resend_part _______________________ 2023-12-03T12:39:18.008 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.008 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.009 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.009 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.009 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.009 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.009 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.009 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.009 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.009 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.009 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.009 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.010 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.010 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.010 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.010 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.010 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.010 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.010 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.010 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.010 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.010 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.010 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.010 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.011 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.011 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.011 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.011 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.011 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.011 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.011 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.011 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.011 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.011 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.011 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.011 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.012 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.012 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.012 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.012 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.012 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.012 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.012 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.012 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.012 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.012 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.012 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.012 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.012 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.012 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.013 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.013 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.013 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.013 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.013 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.013 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.013 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.013 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.013 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.013 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.013 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.013 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.013 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.013 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.013 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.013 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.014 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.014 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.014 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.014 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.014 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.014 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.014 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.014 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.014 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.014 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.014 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.014 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.014 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.014 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.015 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.015 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.015 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.015 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.015 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.015 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.015 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.015 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.015 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.015 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.015 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.015 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.015 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.016 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.016 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.016 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.016 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.016 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.016 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.016 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.016 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.016 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.016 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.016 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.016 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.016 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.016 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.017 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.017 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.017 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.017 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.017 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.017 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.017 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.017 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.017 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.017 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.017 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.017 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.017 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.017 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.017 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.018 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.018 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.018 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.018 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.018 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.018 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.018 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.018 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.018 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.018 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.018 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.018 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.018 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.018 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.019 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.019 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.019 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.019 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.019 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.019 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.019 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.019 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.019 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.019 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.019 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.019 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.019 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.020 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.020 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.020 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.020 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.020 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.020 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.020 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.020 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.020 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.020 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.020 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.021 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.021 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.021 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.021 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.021 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.021 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.021 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.021 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.021 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.021 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.021 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.021 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.021 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.021 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:18.021 INFO:teuthology.orchestra.run.smithi044.stdout: def test_multipart_upload_resend_part(): 2023-12-03T12:39:18.022 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.022 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.022 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6123: 2023-12-03T12:39:18.022 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.022 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.022 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.022 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.022 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.022 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.022 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.022 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.022 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.022 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.022 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.023 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.023 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.023 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.023 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.023 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.023 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.023 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.024 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.024 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.024 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.024 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.024 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.024 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.024 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.024 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.024 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.024 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.024 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.025 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.025 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.025 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.025 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.025 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.025 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.025 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.025 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.025 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.025 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.025 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.025 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.025 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.025 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.026 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.026 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.026 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.026 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.026 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.026 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.026 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.026 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.026 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.026 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.026 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.026 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.026 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.026 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.027 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.027 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.027 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.027 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.027 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.027 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.027 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.027 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.027 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.027 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.027 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.027 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.027 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.028 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.028 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.028 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.028 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.028 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.028 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.028 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.028 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.028 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.028 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-331" 2023-12-03T12:39:18.028 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.028 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.028 INFO:teuthology.orchestra.run.smithi044.stdout:_____________________ test_multipart_upload_multiple_sizes _____________________ 2023-12-03T12:39:18.028 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.029 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.029 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.029 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.029 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.029 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.029 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.029 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.029 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.029 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.029 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.030 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.030 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.030 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.030 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.030 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.030 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.030 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.030 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.030 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.030 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.030 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.030 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.030 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.030 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.031 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.031 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.031 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.031 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.031 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.031 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.031 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.031 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.031 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.031 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.031 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.031 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.031 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.031 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.032 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.032 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.032 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.032 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.032 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.032 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.032 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.032 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.032 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.032 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.032 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.032 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.032 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.032 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.033 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.033 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.033 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.033 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.033 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.033 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.033 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.033 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.033 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.033 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.033 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.033 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.033 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.033 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.033 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.034 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.034 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.034 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.034 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.034 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.034 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.034 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.034 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.034 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.034 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.034 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.034 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.034 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.034 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.035 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.035 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.035 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.035 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.035 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.035 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.035 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.035 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.035 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.035 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.035 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.035 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.035 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.036 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.036 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.036 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.036 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.036 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.036 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.036 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.036 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.036 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.036 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.037 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.037 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.037 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.037 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.037 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.037 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.037 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.037 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.037 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.037 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.037 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.037 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.037 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.037 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.037 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.038 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.038 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.038 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.038 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.038 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.038 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.038 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.038 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.038 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.038 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.038 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.038 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.038 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.038 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.039 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.039 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.039 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.039 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.039 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.039 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.039 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.039 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.039 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.039 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.039 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.040 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.040 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.040 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.040 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.040 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.040 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.040 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.040 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.040 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.040 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.040 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.040 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.040 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.040 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.040 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.041 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.041 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.041 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.041 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.041 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.041 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.041 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.041 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.041 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.041 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.041 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.041 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.041 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.042 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.042 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.042 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.042 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.042 INFO:teuthology.orchestra.run.smithi044.stdout: def test_multipart_upload_multiple_sizes(): 2023-12-03T12:39:18.042 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.042 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.042 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6134: 2023-12-03T12:39:18.042 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.042 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.042 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.042 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.042 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.042 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.043 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.043 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.043 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.043 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.043 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.043 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.043 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.043 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.044 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.044 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.044 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.044 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.044 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.044 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.044 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.045 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.045 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.045 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.045 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.045 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.045 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.045 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.045 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.045 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.045 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.045 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.045 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.045 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.046 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.046 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.046 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.046 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.046 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.046 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.046 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.046 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.046 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.046 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.046 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.046 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.046 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.046 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.047 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.047 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.047 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.047 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.047 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.047 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.047 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.047 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.047 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.047 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.047 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.047 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.047 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.047 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.048 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.048 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.048 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.048 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.048 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.048 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.048 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.048 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-332" 2023-12-03T12:39:18.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.048 INFO:teuthology.orchestra.run.smithi044.stdout:______________________ test_multipart_copy_multiple_sizes ______________________ 2023-12-03T12:39:18.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.049 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.049 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.049 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.049 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.049 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.049 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.049 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.049 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.049 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.049 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.049 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.049 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.049 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.049 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.050 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.050 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.050 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.050 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.050 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.050 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.050 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.050 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.050 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.050 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.050 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.050 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.050 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.051 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.051 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.051 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.051 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.051 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.051 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.051 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.051 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.051 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.051 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.051 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.051 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.051 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.051 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.052 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.052 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.052 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.052 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.052 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.052 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.052 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.052 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.052 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.052 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.052 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.052 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.052 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.052 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.052 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.053 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.053 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.053 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.053 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.053 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.053 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.053 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.053 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.053 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.053 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.053 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.053 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.053 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.053 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.053 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.054 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.054 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.054 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.054 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.054 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.054 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.054 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.054 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.054 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.054 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.054 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.054 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.054 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.054 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.055 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.055 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.055 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.055 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.055 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.055 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.055 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.055 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.055 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.055 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.055 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.055 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.055 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.055 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.055 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.055 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.056 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.056 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.056 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.056 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.056 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.056 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.056 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.056 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.056 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.056 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.056 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.056 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.056 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.056 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.057 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.057 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.057 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.057 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.057 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.057 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.057 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.057 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.057 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.057 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.057 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.057 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.057 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.057 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.057 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.057 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.057 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.058 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.058 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.058 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.058 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.058 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.058 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.058 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.058 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.058 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.058 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.058 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.058 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.058 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.058 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.059 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.059 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.059 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.059 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.059 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.059 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.059 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.059 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.059 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.059 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.059 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.060 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.060 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.060 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.060 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.060 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.060 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.060 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.060 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.060 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.060 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.060 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.060 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.060 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.060 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.061 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.061 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.061 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.061 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.061 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.061 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.061 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.061 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:18.061 INFO:teuthology.orchestra.run.smithi044.stdout: def test_multipart_copy_multiple_sizes(): 2023-12-03T12:39:18.061 INFO:teuthology.orchestra.run.smithi044.stdout: src_key = 'foo' 2023-12-03T12:39:18.061 INFO:teuthology.orchestra.run.smithi044.stdout:> src_bucket_name = _create_key_with_random_content(src_key, 12*1024*1024) 2023-12-03T12:39:18.061 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.061 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6165: 2023-12-03T12:39:18.061 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.062 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:39:18.062 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:18.062 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.062 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.062 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.062 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.062 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.062 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.062 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.062 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.062 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.062 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.062 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.062 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.063 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.063 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.063 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.063 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.063 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.063 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.063 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.063 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.063 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.063 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.063 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.063 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.063 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.063 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.064 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.064 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.064 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.064 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.064 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.064 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.064 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.064 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.064 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.064 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.064 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.064 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.064 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.064 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.064 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.065 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.065 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.065 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.065 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.065 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.065 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.065 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.065 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.065 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.065 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.065 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.065 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.065 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.065 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.065 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.066 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.066 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.066 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.066 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.066 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.066 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.066 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.066 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.066 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.066 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.066 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.066 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.066 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.066 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.067 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.067 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.067 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.067 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.067 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.067 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.067 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.067 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.067 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.067 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.067 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.067 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.067 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.067 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.067 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.067 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.068 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.068 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.068 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-333" 2023-12-03T12:39:18.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.068 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.068 INFO:teuthology.orchestra.run.smithi044.stdout:_____________________ test_multipart_upload_size_too_small _____________________ 2023-12-03T12:39:18.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.068 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.068 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.068 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.068 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.068 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.068 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.069 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.069 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.069 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.069 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.069 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.069 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.069 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.069 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.069 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.069 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.070 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.070 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.070 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.070 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.070 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.070 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.070 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.070 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.070 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.070 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.070 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.070 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.070 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.071 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.071 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.071 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.071 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.071 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.071 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.071 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.071 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.071 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.071 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.071 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.071 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.071 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.071 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.071 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.072 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.072 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.072 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.072 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.072 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.072 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.072 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.072 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.072 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.072 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.072 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.072 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.072 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.073 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.073 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.073 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.073 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.073 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.073 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.073 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.073 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.073 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.073 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.073 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.073 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.073 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.073 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.073 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.074 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.074 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.074 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.074 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.074 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.074 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.074 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.074 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.074 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.074 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.074 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.074 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.074 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.074 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.075 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.075 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.075 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.075 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.075 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.075 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.075 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.075 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.075 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.075 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.075 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.075 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.075 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.075 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.076 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.076 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.076 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.076 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.076 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.076 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.076 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.076 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.076 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.076 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.076 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.076 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.076 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.076 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.077 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.077 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.077 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.077 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.077 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.077 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.077 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.077 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.077 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.077 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.077 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.077 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.077 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.077 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.078 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.078 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.078 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.078 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.078 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.078 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.078 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.078 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.078 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.078 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.078 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.078 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.079 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.079 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.079 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.079 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.079 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.079 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.079 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.079 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.079 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.079 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.079 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.079 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.079 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.079 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.079 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.080 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.080 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.080 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.080 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.080 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.080 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.080 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.080 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.080 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.080 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.080 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.080 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.081 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.081 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.081 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.081 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.081 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.081 INFO:teuthology.orchestra.run.smithi044.stdout: def test_multipart_upload_size_too_small(): 2023-12-03T12:39:18.081 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.081 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6202: 2023-12-03T12:39:18.081 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.082 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.082 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.082 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.082 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.082 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.082 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.082 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.082 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.082 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.082 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.082 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.082 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.082 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.083 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.083 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.083 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.083 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.083 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.083 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.083 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.083 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.083 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.083 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.083 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.083 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.083 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.083 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.084 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.084 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.084 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.084 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.084 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.084 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.084 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.084 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.084 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.084 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.084 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.084 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.084 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.084 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.085 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.085 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.085 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.085 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.085 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.085 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.085 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.085 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.085 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.085 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.085 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.085 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.085 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.085 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.086 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.086 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.086 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.086 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.086 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.086 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.086 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.086 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.086 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.086 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.086 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.086 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.086 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.086 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.087 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.087 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.087 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.087 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.087 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.087 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.087 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.087 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.087 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.087 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.087 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.087 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.088 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.088 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.088 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.088 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.088 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-334" 2023-12-03T12:39:18.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.088 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.088 INFO:teuthology.orchestra.run.smithi044.stdout:________________________ test_multipart_upload_contents ________________________ 2023-12-03T12:39:18.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.088 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.088 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.089 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.089 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.089 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.089 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.089 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.089 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.089 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.089 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.089 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.089 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.089 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.090 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.090 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.090 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.090 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.090 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.090 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.090 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.090 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.090 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.090 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.090 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.090 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.091 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.091 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.091 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.091 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.091 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.091 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.091 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.091 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.091 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.091 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.091 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.091 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.091 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.091 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.091 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.092 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.092 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.092 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.092 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.092 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.092 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.092 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.092 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.092 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.092 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.092 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.092 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.092 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.092 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.092 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.093 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.093 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.093 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.093 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.093 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.093 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.093 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.093 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.093 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.093 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.093 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.093 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.093 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.093 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.093 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.094 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.094 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.094 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.094 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.094 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.094 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.094 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.094 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.094 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.094 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.095 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.095 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.095 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.095 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.095 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.095 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.095 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.095 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.095 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.095 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.095 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.095 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.095 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.095 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.095 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.095 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.096 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.096 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.096 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.096 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.096 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.096 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.096 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.096 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.096 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.096 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.096 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.096 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.097 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.097 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.097 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.097 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.097 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.097 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.097 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.097 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.097 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.097 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.097 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.097 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.098 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.098 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.098 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.098 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.098 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.098 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.098 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.098 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.098 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.098 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.098 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.098 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.098 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.098 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.098 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.101 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.101 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.101 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.101 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: def test_multipart_upload_contents(): 2023-12-03T12:39:18.101 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.102 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6248: 2023-12-03T12:39:18.102 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.102 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.102 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.102 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.102 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.102 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.102 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.102 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.102 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.102 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.102 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.102 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.102 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.102 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.103 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.103 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.103 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.103 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.103 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.103 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.104 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.104 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.104 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.104 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.104 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.104 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.104 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.104 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.104 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.104 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.105 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.105 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.105 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.108 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.108 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-335" 2023-12-03T12:39:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.108 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.108 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ test_multipart_upload_overwrite_existing_object ________________ 2023-12-03T12:39:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.108 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.109 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.110 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.110 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.110 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.110 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.110 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.110 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.110 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.110 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.110 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.110 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.110 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.110 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.110 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.110 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.114 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.114 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.114 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.114 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.114 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.114 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.114 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.114 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.114 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.114 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.114 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.114 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.114 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.114 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.116 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.117 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.117 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.117 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.117 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.117 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.117 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.117 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.117 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.117 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.117 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.117 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.117 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.117 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.117 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.117 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.118 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.118 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.118 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.118 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.118 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.118 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.118 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.118 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.118 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.118 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.118 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.118 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.118 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.118 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.119 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.119 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.121 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.121 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.121 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.121 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: def test_multipart_upload_overwrite_existing_object(): 2023-12-03T12:39:18.122 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.122 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.122 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6252: 2023-12-03T12:39:18.122 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.122 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.122 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.122 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.122 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.122 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.122 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.122 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.122 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.122 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.122 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.123 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.123 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.123 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.123 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.123 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.123 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.123 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.123 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.124 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.124 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.124 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.124 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.124 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.124 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.124 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.124 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.124 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.124 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.124 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.124 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.124 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.124 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.128 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.128 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-336" 2023-12-03T12:39:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.128 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.128 INFO:teuthology.orchestra.run.smithi044.stdout:_________________________ test_abort_multipart_upload __________________________ 2023-12-03T12:39:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.128 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.129 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.129 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.130 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.130 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.130 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.130 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.130 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.130 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.130 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.130 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.130 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.130 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.130 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.130 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.130 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.134 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.134 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.134 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.134 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.134 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.134 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.136 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.136 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.136 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.136 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.137 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.137 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.137 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.137 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.137 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.137 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.137 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.137 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.137 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.137 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.137 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.137 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.137 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.137 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.137 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.138 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.138 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.138 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.138 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.138 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.138 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.138 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.138 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.138 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.138 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.138 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.139 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.140 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.140 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.141 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.141 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.141 INFO:teuthology.orchestra.run.smithi044.stdout: def test_abort_multipart_upload(): 2023-12-03T12:39:18.141 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.141 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6277: 2023-12-03T12:39:18.141 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.141 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.141 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.141 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.141 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.142 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.142 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.142 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.142 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.142 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.142 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.142 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.142 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.142 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.142 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.142 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.142 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.142 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.142 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.143 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.143 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.143 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.143 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.143 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.143 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.143 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.143 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.143 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.143 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.143 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.143 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.143 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.143 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.144 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.144 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.144 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.144 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.144 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.147 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.147 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-337" 2023-12-03T12:39:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.147 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.148 INFO:teuthology.orchestra.run.smithi044.stdout:____________________ test_abort_multipart_upload_not_found _____________________ 2023-12-03T12:39:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.148 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.149 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.149 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.149 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.149 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.149 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.149 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.150 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.153 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.153 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.153 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.154 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.154 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.155 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.156 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.156 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.156 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.156 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.156 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.156 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.157 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.157 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.157 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.157 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.157 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.157 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.157 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.157 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.157 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.157 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.157 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.157 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.157 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.157 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.157 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.158 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.158 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.158 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.158 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.160 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.160 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.160 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.160 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: def test_abort_multipart_upload_not_found(): 2023-12-03T12:39:18.161 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.161 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.161 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6289: 2023-12-03T12:39:18.161 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.161 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.161 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.161 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.161 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.161 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.161 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.161 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.161 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.161 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.161 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.162 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.162 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.162 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.162 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.162 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.162 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.162 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.162 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.162 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.162 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.162 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.162 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.162 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.162 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.162 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.163 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.163 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.163 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.163 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.163 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.163 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.163 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.163 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.163 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.163 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.163 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.163 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.163 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.163 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.167 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.167 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-338" 2023-12-03T12:39:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.167 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.167 INFO:teuthology.orchestra.run.smithi044.stdout:__________________________ test_list_multipart_upload __________________________ 2023-12-03T12:39:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.167 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.168 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.168 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.168 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.168 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.169 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.169 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.169 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.172 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.173 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.173 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.173 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.173 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.174 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.175 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.176 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.176 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.176 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.177 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.177 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.177 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.177 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.177 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.177 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.177 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.177 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.177 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.177 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.177 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.177 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.177 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.177 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.179 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.179 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.180 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.180 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: def test_list_multipart_upload(): 2023-12-03T12:39:18.180 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.180 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6301: 2023-12-03T12:39:18.180 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.180 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.180 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.181 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.181 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.181 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.181 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.181 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.181 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.181 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.181 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.181 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.181 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.181 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.181 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.181 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.181 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.182 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.182 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.182 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.182 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.182 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.182 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.182 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.182 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.182 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.182 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.182 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.182 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.185 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.185 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.185 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.185 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.185 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.185 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.185 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.185 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.185 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.189 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.189 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.189 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.189 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-339" 2023-12-03T12:39:18.189 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.189 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.189 INFO:teuthology.orchestra.run.smithi044.stdout:_______________________ test_list_multipart_upload_owner _______________________ 2023-12-03T12:39:18.189 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.189 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.189 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.189 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.189 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.189 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.190 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.191 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.191 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.191 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.191 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.191 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.191 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.191 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.191 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.191 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.191 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.195 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.195 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.195 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.195 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.195 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.195 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.196 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.197 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.197 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.197 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.198 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.198 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.198 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.198 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.198 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.198 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.198 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.199 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.199 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.199 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.199 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.199 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.199 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.199 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.199 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.199 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.199 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.199 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.199 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.199 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.199 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.202 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.202 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.202 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.202 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: def test_list_multipart_upload_owner(): 2023-12-03T12:39:18.202 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.203 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6332: 2023-12-03T12:39:18.203 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.203 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.203 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.203 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.203 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.203 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.203 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.203 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.203 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.203 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.203 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.203 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.203 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.203 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.204 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.204 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.204 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.204 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.204 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.204 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.204 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.204 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.204 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.204 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.204 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.204 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.204 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.205 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.205 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.205 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.205 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.205 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.205 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.205 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.205 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.205 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.205 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.205 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.205 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.205 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.205 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.205 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.209 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.209 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-340" 2023-12-03T12:39:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.209 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.209 INFO:teuthology.orchestra.run.smithi044.stdout:______________________ test_multipart_upload_missing_part ______________________ 2023-12-03T12:39:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.209 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.210 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.210 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.210 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.210 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.210 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.210 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.210 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.210 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.210 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.210 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.210 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.210 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.211 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.211 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.211 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.211 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.211 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.211 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.211 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.211 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.211 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.211 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.211 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.211 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.212 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.212 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.212 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.212 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.212 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.212 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.212 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.212 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.212 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.212 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.212 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.212 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.212 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.212 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.212 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.213 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.213 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.213 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.213 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.213 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.213 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.213 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.213 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.213 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.213 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.213 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.213 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.213 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.214 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.214 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.214 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.214 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.214 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.214 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.214 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.214 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.214 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.214 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.214 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.214 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.214 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.214 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.215 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.215 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.215 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.215 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.215 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.215 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.215 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.215 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.215 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.215 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.215 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.215 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.215 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.216 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.216 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.216 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.216 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.216 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.216 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.216 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.216 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.216 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.216 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.216 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.216 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.216 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.216 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.216 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.217 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.217 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.217 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.217 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.217 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.217 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.217 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.217 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.217 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.217 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.217 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.217 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.217 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.217 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.217 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.218 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.218 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.218 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.218 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.218 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.218 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.218 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.218 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.218 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.218 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.218 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.218 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.218 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.218 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.219 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.219 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.219 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.219 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.219 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.219 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.219 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.219 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.219 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.219 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.219 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.219 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.220 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.220 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.220 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.220 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.220 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.220 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.220 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.220 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.220 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.220 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.220 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.221 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.221 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.221 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.221 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.221 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.221 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.221 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.221 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.221 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.221 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.221 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.221 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.221 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.221 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.222 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.222 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.222 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.222 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.222 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.222 INFO:teuthology.orchestra.run.smithi044.stdout: def test_multipart_upload_missing_part(): 2023-12-03T12:39:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.222 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6377: 2023-12-03T12:39:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.223 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.223 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.223 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.223 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.223 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.223 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.223 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.223 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.223 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.223 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.223 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.223 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.223 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.223 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.223 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.224 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.224 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.224 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.224 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.224 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.224 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.224 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.224 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.224 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.224 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.224 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.224 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.224 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.224 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.225 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.225 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.225 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.225 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.225 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.225 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.225 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.225 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.225 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.225 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.225 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.225 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.225 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.225 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.225 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.226 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.226 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.226 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.226 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.226 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.226 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.226 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.226 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.226 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.226 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.226 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.226 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.227 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.227 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.227 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.227 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.227 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.227 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.227 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.227 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.227 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.227 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.227 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.227 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.227 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.227 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.227 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.227 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.228 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.228 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.228 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.228 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.228 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.228 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.228 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.228 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.228 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.228 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.228 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.228 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.228 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.228 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.229 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.229 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-341" 2023-12-03T12:39:18.229 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.229 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.229 INFO:teuthology.orchestra.run.smithi044.stdout:_____________________ test_multipart_upload_incorrect_etag _____________________ 2023-12-03T12:39:18.229 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.229 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.229 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.229 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.229 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.229 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.229 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.229 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.229 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.229 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.230 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.230 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.230 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.230 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.230 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.230 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.230 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.230 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.230 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.230 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.230 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.230 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.231 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.231 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.231 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.231 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.231 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.231 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.231 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.231 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.231 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.231 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.231 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.232 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.232 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.232 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.232 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.232 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.232 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.232 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.232 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.232 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.232 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.232 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.232 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.232 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.233 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.233 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.233 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.233 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.233 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.233 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.233 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.233 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.233 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.233 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.233 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.233 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.233 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.233 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.234 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.234 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.234 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.234 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.234 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.234 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.234 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.234 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.234 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.234 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.234 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.234 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.234 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.235 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.235 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.235 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.235 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.235 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.235 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.235 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.235 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.235 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.235 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.235 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.235 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.235 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.235 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.235 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.236 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.236 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.236 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.236 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.236 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.236 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.236 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.236 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.236 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.236 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.236 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.236 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.236 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.236 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.237 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.237 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.237 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.237 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.237 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.237 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.237 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.237 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.237 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.237 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.237 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.237 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.237 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.237 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.237 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.238 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.238 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.238 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.238 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.238 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.238 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.238 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.238 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.238 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.238 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.238 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.238 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.238 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.238 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.239 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.239 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.239 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.239 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.239 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.239 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.239 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.239 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.239 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.239 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.239 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.239 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.239 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.239 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.239 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.240 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.240 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.240 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.240 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.240 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.240 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.240 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.240 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.240 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.240 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.240 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.240 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.240 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.240 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.240 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.240 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.241 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.241 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.241 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.241 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.241 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.241 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.241 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.241 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.241 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.241 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.241 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.242 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.242 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.242 INFO:teuthology.orchestra.run.smithi044.stdout: def test_multipart_upload_incorrect_etag(): 2023-12-03T12:39:18.242 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.242 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.242 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6396: 2023-12-03T12:39:18.242 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.242 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.242 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.242 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.242 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.242 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.243 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.243 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.243 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.243 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.243 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.243 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.243 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.243 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.243 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.243 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.243 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.243 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.243 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.243 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.244 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.244 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.244 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.244 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.244 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.244 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.244 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.244 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.245 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.245 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.245 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.245 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.245 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.245 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.245 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.245 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.245 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.245 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.245 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.245 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.245 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.245 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.245 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.246 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.246 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.246 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.246 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.246 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.246 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.246 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.246 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.246 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.246 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.246 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.246 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.246 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.247 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.247 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.247 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.247 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.247 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.247 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.247 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.247 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.247 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.247 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.247 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.247 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.247 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.247 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.247 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.248 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.248 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.248 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.248 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.248 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.248 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.248 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.248 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.248 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.248 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.248 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.248 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-342" 2023-12-03T12:39:18.248 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.248 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.248 INFO:teuthology.orchestra.run.smithi044.stdout:___________________________ test_multipart_get_part ____________________________ 2023-12-03T12:39:18.249 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.249 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.249 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.249 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.249 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.249 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.249 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.249 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.249 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.249 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.249 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.249 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.249 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.249 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.250 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.250 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.250 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.250 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.250 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.250 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.250 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.250 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.250 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.250 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.250 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.250 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.250 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.251 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.251 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.251 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.251 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.251 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.251 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.251 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.251 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.251 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.251 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.251 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.251 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.251 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.251 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.251 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.252 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.252 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.252 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.252 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.252 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.252 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.252 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.252 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.252 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.252 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.252 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.252 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.252 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.252 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.252 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.253 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.253 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.253 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.253 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.253 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.253 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.253 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.253 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.253 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.253 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.253 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.253 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.253 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.253 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.254 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.254 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.254 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.254 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.254 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.254 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.254 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.255 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.255 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.255 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.255 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.255 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.255 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.255 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.256 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.256 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.256 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.256 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.256 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.256 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.256 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.256 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.257 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.257 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.257 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.257 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.257 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.257 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.257 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.257 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.257 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.257 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.257 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.257 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.257 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.258 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.258 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.258 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.258 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.258 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.258 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.258 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.258 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.258 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.258 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.258 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.258 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.258 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.259 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.259 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.259 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.259 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.259 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.259 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.259 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.259 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.259 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.259 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.259 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.259 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.259 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.259 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.260 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.260 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.260 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.260 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.260 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.260 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.260 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.260 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.260 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.260 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.260 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.260 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.260 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.260 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.261 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.261 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.261 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.261 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.261 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.261 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.261 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.261 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.261 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.261 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.261 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.261 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.261 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.261 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.262 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.262 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.262 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.262 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.262 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.262 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.262 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.262 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.262 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.262 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.263 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.263 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.263 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.263 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.263 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.263 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.263 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.263 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:18.263 INFO:teuthology.orchestra.run.smithi044.stdout: def test_multipart_get_part(): 2023-12-03T12:39:18.263 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.263 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6416: 2023-12-03T12:39:18.264 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.264 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.264 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.264 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.264 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.264 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.264 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.264 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.264 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.264 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.264 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.264 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.264 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.264 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.265 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.265 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.265 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.265 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.265 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.265 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.265 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.265 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.265 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.265 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.265 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.265 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.265 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.265 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.265 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.266 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.266 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.266 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.266 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.266 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.266 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.266 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.266 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.266 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.266 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.267 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.267 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.267 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.267 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.267 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.267 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.267 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.267 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.267 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.267 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.267 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.267 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.267 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.267 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.267 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.268 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.268 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.268 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.268 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.268 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.268 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.268 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.268 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.268 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.268 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.268 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.268 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.268 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.268 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.268 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.268 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.269 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.269 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.269 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.269 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.269 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.269 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.269 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.269 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.269 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.269 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.269 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.270 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.270 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.270 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-343" 2023-12-03T12:39:18.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.270 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.270 INFO:teuthology.orchestra.run.smithi044.stdout:_________________________ test_non_multipart_get_part __________________________ 2023-12-03T12:39:18.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.270 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.270 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.270 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.270 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.270 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.271 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.271 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.271 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.271 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.271 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.271 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.271 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.271 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.271 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.271 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.271 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.271 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.271 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.272 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.272 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.272 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.272 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.272 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.272 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.272 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.272 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.272 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.272 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.272 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.272 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.272 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.273 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.273 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.273 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.273 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.273 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.273 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.273 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.273 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.273 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.273 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.273 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.273 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.273 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.273 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.273 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.274 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.274 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.274 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.274 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.274 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.274 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.274 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.274 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.274 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.274 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.274 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.274 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.274 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.275 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.275 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.275 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.275 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.275 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.275 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.275 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.275 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.275 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.275 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.275 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.275 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.275 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.276 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.276 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.276 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.276 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.276 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.276 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.276 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.276 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.276 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.276 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.276 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.276 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.277 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.277 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.277 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.277 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.277 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.277 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.277 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.277 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.277 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.277 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.277 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.277 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.277 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.277 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.278 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.278 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.278 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.278 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.278 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.278 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.278 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.278 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.278 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.278 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.278 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.278 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.278 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.278 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.278 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.279 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.279 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.279 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.279 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.279 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.279 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.279 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.279 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.279 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.279 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.279 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.279 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.280 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.280 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.280 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.280 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.280 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.280 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.280 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.280 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.280 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.280 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.280 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.280 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.280 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.281 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.281 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.281 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.281 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.281 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.281 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.281 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.281 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.281 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.281 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.281 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.281 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.281 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.281 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.282 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.282 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.282 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.282 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.282 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.282 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.282 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.282 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.282 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.282 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.282 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.282 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.282 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.283 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.283 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.283 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.283 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.283 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:18.283 INFO:teuthology.orchestra.run.smithi044.stdout: def test_non_multipart_get_part(): 2023-12-03T12:39:18.283 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.283 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.283 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6458: 2023-12-03T12:39:18.283 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.283 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.283 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.283 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.283 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.283 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.283 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.284 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.284 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.284 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.284 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.284 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.284 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.284 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.284 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.284 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.284 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.284 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.284 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.284 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.284 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.285 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.285 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.285 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.285 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.285 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.285 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.285 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.286 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.286 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.286 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.286 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.286 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.286 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.286 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.286 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.286 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.286 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.286 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.286 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.286 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.286 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.287 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.287 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.287 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.287 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.287 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.287 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.287 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.287 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.287 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.287 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.287 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.287 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.287 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.287 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.287 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.287 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.288 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.288 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.288 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.288 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.288 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.288 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.288 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.288 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.288 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.288 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.288 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.288 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.288 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.288 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.288 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.289 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.289 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.289 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.289 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.289 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.289 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.289 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.289 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.289 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-344" 2023-12-03T12:39:18.289 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.289 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.289 INFO:teuthology.orchestra.run.smithi044.stdout:______________________________ test_100_continue _______________________________ 2023-12-03T12:39:18.289 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.289 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.289 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.290 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.290 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.290 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.290 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.290 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.290 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.290 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.290 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.290 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.290 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.290 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.290 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.290 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.291 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.291 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.291 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.291 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.291 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.291 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.291 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.291 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.291 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.291 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.291 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.292 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.292 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.292 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.292 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.292 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.292 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.292 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.292 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.292 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.292 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.292 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.292 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.292 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.292 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.292 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.293 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.293 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.293 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.293 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.293 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.293 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.293 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.293 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.293 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.293 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.293 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.293 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.293 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.293 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.293 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.294 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.294 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.294 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.294 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.294 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.294 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.294 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.294 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.294 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.294 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.294 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.294 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.294 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.294 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.295 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.295 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.295 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.295 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.295 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.295 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.295 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.295 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.295 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.295 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.295 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.296 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.296 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.296 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.296 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.296 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.296 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.296 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.296 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.296 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.296 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.296 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.296 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.296 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.296 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.297 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.297 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.297 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.297 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.297 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.297 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.297 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.297 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.297 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.297 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.297 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.297 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.297 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.297 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.298 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.298 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.298 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.298 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.298 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.298 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.298 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.298 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.298 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.298 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.298 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.298 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.298 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.298 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.298 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.299 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.299 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.299 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.299 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.299 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.299 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.299 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.299 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.299 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.299 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.299 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.299 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.300 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.300 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.300 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.300 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.300 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.300 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.300 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.300 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.300 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.300 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.300 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.300 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.300 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.300 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.301 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.301 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.301 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.301 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.301 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.301 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.301 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.301 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.301 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.301 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.301 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.302 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.302 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.302 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.302 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.302 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.302 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.302 INFO:teuthology.orchestra.run.smithi044.stdout: def test_100_continue(): 2023-12-03T12:39:18.302 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:18.302 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:18.302 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name) 2023-12-03T12:39:18.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.303 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6514: 2023-12-03T12:39:18.303 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.303 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.303 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.303 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.303 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.303 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.303 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.303 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.303 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.303 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.303 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.303 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.303 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.303 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.304 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.304 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.304 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.304 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.304 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.304 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.304 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.304 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.304 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.304 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.304 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.304 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.304 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.304 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.304 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.305 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.305 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.305 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.305 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.305 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.305 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.305 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.305 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.305 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.305 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.306 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.306 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.306 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.306 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.306 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.306 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.306 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.306 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.306 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.306 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.306 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.306 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.307 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.307 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.307 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.307 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.307 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.307 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.307 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.307 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.307 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.307 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.307 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.307 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.307 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.307 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.307 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.308 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.308 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.308 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.308 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.308 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.308 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.308 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.308 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.308 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.308 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.308 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.308 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.308 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.308 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.309 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.309 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.309 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.309 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.309 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-345" 2023-12-03T12:39:18.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.309 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.309 INFO:teuthology.orchestra.run.smithi044.stdout:________________________________ test_set_cors _________________________________ 2023-12-03T12:39:18.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.309 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.309 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.309 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.310 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.310 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.310 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.310 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.310 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.310 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.310 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.310 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.310 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.310 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.310 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.311 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.311 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.311 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.311 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.311 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.311 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.311 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.311 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.311 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.311 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.311 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.312 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.312 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.312 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.312 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.312 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.312 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.312 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.312 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.312 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.312 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.312 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.312 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.312 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.312 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.312 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.313 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.313 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.313 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.313 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.313 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.313 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.313 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.313 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.313 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.313 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.313 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.313 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.313 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.313 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.313 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.314 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.314 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.314 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.314 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.314 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.314 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.314 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.314 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.314 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.314 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.314 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.314 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.314 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.314 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.315 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.315 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.315 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.315 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.315 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.315 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.315 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.315 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.315 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.315 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.315 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.316 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.316 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.316 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.316 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.316 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.316 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.316 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.316 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.316 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.316 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.316 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.316 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.316 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.316 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.317 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.317 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.317 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.317 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.317 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.317 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.317 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.317 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.317 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.317 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.317 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.317 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.317 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.317 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.318 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.318 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.318 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.318 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.318 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.318 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.318 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.318 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.318 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.318 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.318 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.318 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.318 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.318 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.319 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.319 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.319 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.319 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.319 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.319 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.319 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.319 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.319 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.319 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.319 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.319 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.319 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.319 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.319 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.320 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.320 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.320 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.320 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.320 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.320 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.320 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.320 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.320 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.320 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.320 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.320 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.320 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.321 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.321 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.321 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.321 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.321 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.321 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.321 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.321 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.321 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.321 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.321 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.321 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.321 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.321 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.321 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.322 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.322 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.322 INFO:teuthology.orchestra.run.smithi044.stdout: def test_set_cors(): 2023-12-03T12:39:18.322 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.322 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6532: 2023-12-03T12:39:18.322 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.322 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.322 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.322 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.322 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.323 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.323 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.323 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.323 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.323 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.323 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.323 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.323 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.323 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.323 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.323 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.323 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.323 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.323 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.323 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.324 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.324 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.324 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.324 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.324 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.324 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.324 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.324 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.324 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.324 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.324 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.324 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.324 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.324 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.324 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.324 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.325 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.325 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.325 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.325 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.325 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.325 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.325 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.325 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.325 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.325 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.325 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.325 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.325 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.325 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.325 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.326 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.326 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.326 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.326 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.326 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.326 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.326 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.326 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.326 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.326 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.326 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.326 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.326 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.327 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.327 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.327 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.327 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.327 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.327 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.327 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.327 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.327 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.327 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.327 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.327 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.327 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.327 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.328 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.328 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.328 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.328 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.328 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.328 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.328 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.328 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.328 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.328 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.328 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-346" 2023-12-03T12:39:18.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.328 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.328 INFO:teuthology.orchestra.run.smithi044.stdout:__________________________ test_cors_origin_response ___________________________ 2023-12-03T12:39:18.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.329 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.329 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.329 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.329 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.329 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.329 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.329 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.329 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.329 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.329 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.329 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.330 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.330 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.330 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.330 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.330 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.330 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.330 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.330 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.330 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.330 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.331 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.331 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.331 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.331 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.331 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.331 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.331 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.331 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.331 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.331 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.331 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.331 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.331 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.331 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.332 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.332 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.332 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.332 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.332 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.332 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.332 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.332 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.332 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.332 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.332 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.332 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.332 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.332 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.332 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.332 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.333 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.333 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.333 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.333 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.333 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.333 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.333 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.333 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.333 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.333 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.333 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.333 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.333 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.333 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.333 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.334 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.334 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.334 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.334 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.334 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.334 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.334 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.334 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.334 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.334 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.334 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.334 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.334 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.334 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.335 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.335 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.335 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.335 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.335 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.335 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.335 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.335 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.335 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.335 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.335 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.335 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.335 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.335 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.335 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.335 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.336 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.336 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.336 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.336 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.336 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.336 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.336 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.336 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.336 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.336 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.336 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.336 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.336 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.336 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.336 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.337 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.337 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.337 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.337 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.337 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.337 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.337 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.337 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.337 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.337 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.337 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.337 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.337 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.337 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.337 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.337 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.338 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.338 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.338 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.338 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.338 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.338 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.338 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.338 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.338 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.338 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.338 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.338 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.338 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.338 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.339 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.339 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.339 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.339 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.339 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.339 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.339 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.339 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.339 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.339 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.339 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.339 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.339 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.339 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.339 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.339 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.339 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.340 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.340 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.340 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.340 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.340 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.340 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.340 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.340 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.340 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.340 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.340 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.341 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.341 INFO:teuthology.orchestra.run.smithi044.stdout: def test_cors_origin_response(): 2023-12-03T12:39:18.341 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = _setup_bucket_acl(bucket_acl='public-read') 2023-12-03T12:39:18.341 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.341 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6567: 2023-12-03T12:39:18.341 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.341 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:3245: in _setup_bucket_acl 2023-12-03T12:39:18.341 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(ACL=bucket_acl, Bucket=bucket_name) 2023-12-03T12:39:18.341 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.341 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.341 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.341 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.341 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.342 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.342 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.342 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.342 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.342 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.342 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.342 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.342 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.342 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.342 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.342 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.342 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.342 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.342 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.343 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.343 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.343 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.343 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.343 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.343 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.343 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.343 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.343 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.343 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.343 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.343 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.343 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.343 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.343 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.343 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.344 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.344 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.344 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.344 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.344 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.344 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.344 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.344 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.344 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.344 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.344 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.344 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.345 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.345 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.345 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.345 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.345 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.345 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.345 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.345 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.345 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.345 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.345 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.345 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.345 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.345 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.345 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.345 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.346 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.346 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.346 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.346 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.346 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.346 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.346 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.346 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.346 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.346 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.346 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.346 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.346 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.346 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.347 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.347 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.347 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.347 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.347 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.347 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.347 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.347 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-347" 2023-12-03T12:39:18.347 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.347 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.347 INFO:teuthology.orchestra.run.smithi044.stdout:__________________________ test_cors_origin_wildcard ___________________________ 2023-12-03T12:39:18.347 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.347 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.347 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.347 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.347 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.348 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.348 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.348 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.348 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.348 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.348 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.348 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.348 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.348 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.348 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.348 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.349 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.349 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.349 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.349 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.349 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.349 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.349 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.349 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.349 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.349 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.349 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.349 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.349 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.349 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.349 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.350 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.350 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.350 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.350 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.350 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.350 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.350 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.350 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.350 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.350 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.350 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.350 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.351 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.351 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.351 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.351 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.351 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.351 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.351 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.351 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.351 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.351 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.351 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.351 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.352 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.352 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.352 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.352 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.352 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.352 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.352 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.352 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.352 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.352 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.353 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.353 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.353 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.353 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.353 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.353 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.353 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.353 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.353 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.353 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.353 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.354 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.354 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.354 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.354 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.354 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.354 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.354 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.354 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.354 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.354 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.354 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.354 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.354 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.354 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.355 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.355 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.355 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.355 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.355 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.355 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.355 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.355 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.355 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.355 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.355 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.355 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.355 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.355 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.356 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.356 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.356 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.356 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.356 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.356 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.356 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.356 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.356 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.356 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.356 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.356 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.356 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.356 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.356 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.356 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.357 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.357 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.357 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.357 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.357 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.357 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.357 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.357 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.357 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.357 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.357 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.357 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.357 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.357 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.358 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.358 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.358 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.358 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.358 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.358 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.358 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.358 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.358 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.358 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.359 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.359 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.359 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.359 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.359 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.359 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.359 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.359 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.359 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.359 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.359 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.359 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.359 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.359 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.360 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.360 INFO:teuthology.orchestra.run.smithi044.stdout: def test_cors_origin_wildcard(): 2023-12-03T12:39:18.360 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = _setup_bucket_acl(bucket_acl='public-read') 2023-12-03T12:39:18.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.360 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6642: 2023-12-03T12:39:18.360 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.360 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:3245: in _setup_bucket_acl 2023-12-03T12:39:18.360 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(ACL=bucket_acl, Bucket=bucket_name) 2023-12-03T12:39:18.360 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.360 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.360 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.360 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.360 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.361 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.361 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.361 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.361 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.361 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.361 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.361 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.362 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.362 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.362 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.362 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.362 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.362 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.362 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.363 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.363 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.363 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.363 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.363 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.363 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.363 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.363 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.363 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.363 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.363 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.363 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.363 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.363 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.364 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.364 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.364 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.364 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.364 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.364 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.364 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.364 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.364 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.364 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.364 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.364 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.364 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.364 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.364 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.365 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.365 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.365 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.365 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.365 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.365 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.365 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.365 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.365 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.365 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.365 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.365 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.365 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.366 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.366 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.366 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.366 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.366 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.366 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.366 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.366 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.366 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-348" 2023-12-03T12:39:18.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.366 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.366 INFO:teuthology.orchestra.run.smithi044.stdout:___________________________ test_cors_header_option ____________________________ 2023-12-03T12:39:18.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.367 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.367 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.367 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.367 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.367 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.367 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.367 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.367 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.367 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.367 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.367 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.368 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.368 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.368 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.368 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.368 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.368 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.368 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.368 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.368 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.368 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.368 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.368 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.368 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.368 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.369 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.369 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.369 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.369 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.369 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.369 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.369 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.369 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.369 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.369 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.369 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.369 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.369 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.370 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.370 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.370 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.370 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.370 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.370 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.370 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.370 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.370 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.370 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.370 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.370 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.370 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.370 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.370 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.371 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.371 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.371 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.371 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.371 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.371 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.371 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.371 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.371 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.371 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.371 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.371 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.371 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.371 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.371 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.372 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.372 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.372 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.372 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.372 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.372 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.372 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.372 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.372 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.372 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.372 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.373 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.373 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.373 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.373 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.373 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.373 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.373 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.373 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.373 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.373 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.373 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.373 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.373 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.373 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.373 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.373 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.374 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.374 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.374 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.374 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.374 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.374 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.374 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.374 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.374 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.374 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.374 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.374 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.374 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.375 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.375 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.375 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.375 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.375 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.375 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.375 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.375 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.375 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.375 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.375 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.375 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.375 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.375 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.375 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.376 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.376 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.376 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.376 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.376 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.376 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.376 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.376 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.376 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.376 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.376 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.376 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.377 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.377 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.377 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.377 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.377 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.377 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.377 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.377 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.377 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.377 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.377 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.377 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.377 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.377 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.377 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.377 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.377 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.378 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.378 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.378 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.378 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.378 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.378 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.378 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.378 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.378 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.378 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.378 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.378 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.378 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.378 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.379 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.379 INFO:teuthology.orchestra.run.smithi044.stdout: def test_cors_header_option(): 2023-12-03T12:39:18.379 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = _setup_bucket_acl(bucket_acl='public-read') 2023-12-03T12:39:18.379 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.379 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6667: 2023-12-03T12:39:18.379 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.379 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:3245: in _setup_bucket_acl 2023-12-03T12:39:18.379 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(ACL=bucket_acl, Bucket=bucket_name) 2023-12-03T12:39:18.379 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.379 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.379 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.379 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.379 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.380 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.380 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.380 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.380 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.380 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.380 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.380 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.380 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.380 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.380 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.380 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.380 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.380 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.380 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.380 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.381 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.381 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.381 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.381 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.381 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.381 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.381 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.382 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.382 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.382 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.382 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.382 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.382 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.382 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.382 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.382 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.382 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.382 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.382 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.382 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.382 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.383 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.383 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.383 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.383 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.383 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.383 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.383 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.383 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.383 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.383 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.383 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.383 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.383 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.383 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.383 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.383 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.384 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.384 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.384 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.384 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.384 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.384 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.384 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.384 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.384 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.384 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.384 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.384 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.384 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.384 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.384 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.384 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.385 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.385 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.385 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.385 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.385 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.385 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-349" 2023-12-03T12:39:18.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.385 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.385 INFO:teuthology.orchestra.run.smithi044.stdout:________________________ test_cors_presigned_get_object ________________________ 2023-12-03T12:39:18.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.385 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.385 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.385 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.386 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.386 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.386 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.386 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.386 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.386 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.386 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.386 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.386 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.386 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.386 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.386 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.386 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.386 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.386 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.387 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.387 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.387 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.387 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.387 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.387 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.387 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.387 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.387 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.387 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.387 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.387 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.387 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.388 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.388 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.388 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.388 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.388 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.388 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.388 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.388 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.388 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.388 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.388 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.388 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.388 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.388 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.388 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.388 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.389 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.389 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.389 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.389 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.389 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.389 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.389 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.389 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.389 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.389 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.389 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.389 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.389 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.389 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.390 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.390 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.390 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.390 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.390 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.390 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.390 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.390 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.390 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.390 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.390 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.390 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.390 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.391 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.391 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.391 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.391 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.391 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.391 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.391 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.391 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.391 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.392 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.392 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.392 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.392 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.392 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.392 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.392 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.392 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.392 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.392 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.392 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.392 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.392 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.392 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.392 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.393 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.393 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.393 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.393 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.393 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.393 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.393 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.393 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.393 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.393 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.393 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.393 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.393 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.393 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.393 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.394 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.394 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.394 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.394 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.394 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.394 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.394 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.394 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.394 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.394 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.394 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.394 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.394 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.394 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.394 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.395 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.395 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.395 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.395 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.395 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.395 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.395 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.395 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.395 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.395 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.395 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.395 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.395 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.395 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.395 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.395 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.395 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.396 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.396 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.396 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.396 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.396 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.396 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.396 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.396 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.396 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.396 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.396 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.396 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.396 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.396 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.396 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.397 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.397 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.397 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.397 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.397 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.397 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.397 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.397 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.397 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.397 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.397 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.397 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.397 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.397 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.397 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.398 INFO:teuthology.orchestra.run.smithi044.stdout: def test_cors_presigned_get_object(): 2023-12-03T12:39:18.398 INFO:teuthology.orchestra.run.smithi044.stdout:> _test_cors_options_presigned_get_object(client=get_client()) 2023-12-03T12:39:18.398 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.398 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6716: 2023-12-03T12:39:18.398 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.398 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6693: in _test_cors_options_presigned_get_object 2023-12-03T12:39:18.398 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = _setup_bucket_object_acl('public-read', 'public-read', client=client) 2023-12-03T12:39:18.398 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:3234: in _setup_bucket_object_acl 2023-12-03T12:39:18.398 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(ACL=bucket_acl, Bucket=bucket_name) 2023-12-03T12:39:18.398 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.398 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.398 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.398 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.399 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.399 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.399 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.399 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.399 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.399 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.399 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.399 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.399 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.399 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.399 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.399 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.399 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.399 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.399 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.400 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.400 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.400 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.400 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.400 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.400 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.400 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.400 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.400 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.400 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.400 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.400 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.400 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.400 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.400 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.401 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.401 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.401 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.401 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.401 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.401 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.401 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.401 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.401 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.401 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.401 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.401 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.401 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.401 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.401 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.402 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.402 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.402 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.402 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.402 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.402 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.402 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.402 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.402 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.402 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.402 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.402 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.403 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.403 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.403 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.403 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.403 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.403 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.403 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.403 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.403 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.403 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.403 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.403 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.403 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.403 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.403 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.404 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.404 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.404 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.404 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.404 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.404 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.404 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.404 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.404 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.404 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.404 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-350" 2023-12-03T12:39:18.404 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.404 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.404 INFO:teuthology.orchestra.run.smithi044.stdout:____________________ test_cors_presigned_get_object_tenant _____________________ 2023-12-03T12:39:18.404 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.405 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.405 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.405 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.405 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.405 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.405 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.405 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.405 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.405 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.405 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.405 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.405 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.406 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.406 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.406 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.406 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.406 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.406 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.406 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.406 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.406 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.406 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.406 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.406 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.406 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.406 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.407 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.407 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.407 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.407 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.407 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.407 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.407 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.407 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.407 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.407 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.407 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.407 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.407 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.407 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.407 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.407 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.408 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.408 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.408 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.408 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.408 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.408 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.408 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.408 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.408 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.408 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.408 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.408 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.408 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.408 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.408 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.409 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.409 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.409 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.409 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.409 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.409 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.409 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.409 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.409 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.409 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.409 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.409 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.409 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.409 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.410 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.410 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.410 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.410 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.410 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.410 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.410 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.410 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.410 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.410 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.410 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.410 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.410 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.411 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.411 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.411 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.411 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.411 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.411 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.411 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.411 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.411 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.411 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.411 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.411 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.411 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.411 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.412 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.412 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.412 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.412 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.412 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.412 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.412 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.412 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.412 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.412 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.412 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.412 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.412 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.412 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.412 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.413 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.413 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.413 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.413 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.413 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.413 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.413 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.413 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.413 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.413 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.413 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.413 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.413 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.413 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.413 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.413 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.414 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.414 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.414 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.414 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.414 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.414 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.414 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.414 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.414 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.414 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.414 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.414 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.414 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.414 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.415 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.415 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.415 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.415 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.415 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.415 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.415 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.415 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.415 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.415 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.415 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.415 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.415 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.415 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.415 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.415 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.416 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.416 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.416 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.416 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.416 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.416 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.416 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.416 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.416 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.416 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.416 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.416 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.416 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.416 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.416 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.416 INFO:teuthology.orchestra.run.smithi044.stdout: def test_cors_presigned_get_object_tenant(): 2023-12-03T12:39:18.417 INFO:teuthology.orchestra.run.smithi044.stdout:> _test_cors_options_presigned_get_object(client=get_tenant_client()) 2023-12-03T12:39:18.417 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.417 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6719: 2023-12-03T12:39:18.417 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.417 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6693: in _test_cors_options_presigned_get_object 2023-12-03T12:39:18.417 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = _setup_bucket_object_acl('public-read', 'public-read', client=client) 2023-12-03T12:39:18.417 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:3234: in _setup_bucket_object_acl 2023-12-03T12:39:18.417 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(ACL=bucket_acl, Bucket=bucket_name) 2023-12-03T12:39:18.417 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.417 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.417 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.417 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.417 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.417 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.417 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.418 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.418 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.418 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.418 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.418 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.418 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.418 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.418 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.418 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.418 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.418 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.418 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.418 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.419 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.419 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.419 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.419 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.419 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.419 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.419 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.419 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.419 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.419 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.419 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.419 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.419 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.419 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.419 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.420 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.420 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.420 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.420 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.420 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.420 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.420 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.420 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.420 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.420 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.420 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.420 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.420 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.421 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.421 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.421 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.421 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.421 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.421 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.421 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.421 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.421 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.421 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.421 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.421 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.421 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.421 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.422 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.422 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.422 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.422 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.422 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.422 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.422 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.422 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.422 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.422 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.422 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.422 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.422 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.422 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.423 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.423 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.423 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.423 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.423 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.423 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.423 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.423 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.423 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.423 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.423 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-351" 2023-12-03T12:39:18.423 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.423 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.423 INFO:teuthology.orchestra.run.smithi044.stdout:___________________________ test_set_bucket_tagging ____________________________ 2023-12-03T12:39:18.423 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.423 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.423 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.424 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.424 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.424 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.424 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.424 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.424 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.424 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.424 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.424 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.424 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.424 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.424 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.425 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.425 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.425 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.425 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.425 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.425 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.425 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.425 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.425 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.425 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.425 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.425 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.426 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.426 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.426 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.426 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.426 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.426 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.426 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.426 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.426 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.426 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.426 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.426 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.426 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.426 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.426 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.426 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.427 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.427 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.427 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.427 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.427 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.427 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.427 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.427 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.427 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.427 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.427 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.427 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.428 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.428 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.428 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.428 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.428 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.428 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.428 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.428 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.428 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.428 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.428 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.428 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.428 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.428 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.429 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.429 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.429 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.429 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.429 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.429 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.429 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.429 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.429 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.429 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.429 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.429 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.429 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.429 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.429 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.430 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.430 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.430 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.430 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.430 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.430 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.430 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.430 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.430 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.430 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.430 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.430 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.430 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.430 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.430 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.431 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.431 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.431 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.431 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.431 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.431 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.431 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.431 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.431 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.431 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.431 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.431 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.431 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.431 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.432 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.432 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.432 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.432 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.432 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.432 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.432 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.432 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.432 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.432 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.432 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.432 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.432 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.432 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.432 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.432 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.433 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.433 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.433 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.433 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.433 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.433 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.433 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.433 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.433 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.433 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.433 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.433 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.433 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.433 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.433 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.434 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.434 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.434 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.434 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.434 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.434 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.434 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.434 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.434 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.434 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.434 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.434 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.434 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.434 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.435 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.435 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.435 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.435 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.435 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.435 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.435 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.435 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.435 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.435 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.435 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.435 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.435 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.436 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.436 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.436 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.436 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.436 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:18.436 INFO:teuthology.orchestra.run.smithi044.stdout: def test_set_bucket_tagging(): 2023-12-03T12:39:18.436 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.436 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.436 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6723: 2023-12-03T12:39:18.436 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.436 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.436 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.436 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.436 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.437 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.437 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.437 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.437 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.437 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.437 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.437 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.437 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.438 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.438 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.438 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.438 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.438 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.438 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.438 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.439 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.439 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.439 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.439 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.439 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.439 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.439 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.439 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.439 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.439 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.439 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.439 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.439 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.439 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.439 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.440 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.440 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.440 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.440 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.440 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.440 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.440 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.440 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.440 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.440 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.440 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.440 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.440 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.440 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.440 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.440 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.441 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.441 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.441 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.441 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.441 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.441 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.441 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.441 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.441 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.441 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.441 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.441 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.441 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.441 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.441 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.442 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.442 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.442 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.442 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.442 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.442 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.442 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-352" 2023-12-03T12:39:18.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.442 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.442 INFO:teuthology.orchestra.run.smithi044.stdout:_____________________________ test_atomic_read_1mb _____________________________ 2023-12-03T12:39:18.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.442 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.443 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.443 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.443 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.443 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.443 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.443 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.443 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.443 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.443 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.443 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.443 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.443 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.443 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.444 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.444 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.444 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.444 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.444 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.444 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.444 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.444 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.444 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.444 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.444 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.445 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.445 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.445 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.445 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.445 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.445 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.445 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.445 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.445 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.445 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.445 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.445 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.445 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.446 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.446 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.446 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.446 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.446 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.446 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.446 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.446 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.446 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.446 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.446 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.446 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.446 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.446 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.447 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.447 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.447 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.447 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.447 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.447 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.447 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.447 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.447 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.447 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.447 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.447 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.447 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.448 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.448 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.448 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.448 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.448 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.448 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.448 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.448 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.448 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.448 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.448 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.448 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.448 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.448 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.448 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.449 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.449 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.449 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.449 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.449 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.449 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.449 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.449 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.449 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.449 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.449 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.449 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.449 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.449 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.450 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.450 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.450 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.450 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.450 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.450 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.450 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.450 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.450 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.450 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.450 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.450 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.450 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.451 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.451 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.451 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.451 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.451 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.451 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.451 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.451 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.451 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.451 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.451 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.452 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.452 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.452 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.452 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.452 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.452 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.452 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.452 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.452 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.452 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.452 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.452 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.452 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.452 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.452 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.453 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.453 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.453 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.453 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.453 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.453 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.453 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.453 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.453 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.453 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.453 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.453 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.454 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.454 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.454 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.454 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.454 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.454 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.454 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.454 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.454 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.454 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.454 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.454 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.454 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.454 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.455 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.455 INFO:teuthology.orchestra.run.smithi044.stdout: def test_atomic_read_1mb(): 2023-12-03T12:39:18.455 INFO:teuthology.orchestra.run.smithi044.stdout:> _test_atomic_read(1024*1024) 2023-12-03T12:39:18.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.455 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6871: 2023-12-03T12:39:18.455 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.455 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6851: in _test_atomic_read 2023-12-03T12:39:18.455 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:18.455 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.455 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.455 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.455 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.455 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.455 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.456 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.456 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.456 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.456 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.456 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.456 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.456 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.457 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.457 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.457 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.457 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.457 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.457 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.457 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.458 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.458 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.458 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.458 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.458 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.458 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.458 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.458 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.458 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.458 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.458 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.458 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.458 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.459 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.459 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.459 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.459 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.459 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.459 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.459 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.459 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.459 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.459 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.459 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.459 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.459 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.459 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.459 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.459 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.460 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.460 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.460 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.460 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.460 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.460 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.460 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.460 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.460 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.460 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.460 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.460 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.460 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.460 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.460 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.461 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.461 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.461 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.461 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.461 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.461 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.461 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-353" 2023-12-03T12:39:18.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.461 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.461 INFO:teuthology.orchestra.run.smithi044.stdout:_____________________________ test_atomic_read_4mb _____________________________ 2023-12-03T12:39:18.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.461 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.461 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.462 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.462 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.462 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.462 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.462 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.462 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.462 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.462 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.462 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.462 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.462 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.462 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.463 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.463 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.463 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.463 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.463 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.463 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.463 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.463 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.463 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.463 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.463 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.463 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.464 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.464 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.464 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.464 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.464 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.464 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.464 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.464 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.464 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.464 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.464 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.464 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.464 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.464 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.464 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.465 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.465 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.465 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.465 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.465 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.465 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.465 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.465 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.465 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.465 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.465 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.465 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.466 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.466 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.466 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.466 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.466 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.466 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.466 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.466 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.466 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.466 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.466 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.467 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.467 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.467 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.467 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.467 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.467 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.467 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.467 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.467 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.467 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.468 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.468 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.468 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.468 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.468 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.468 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.468 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.468 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.468 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.468 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.468 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.468 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.468 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.468 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.468 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.469 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.469 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.469 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.469 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.469 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.469 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.469 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.469 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.469 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.469 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.470 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.470 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.470 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.470 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.470 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.470 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.470 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.470 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.470 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.471 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.471 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.471 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.471 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.471 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.471 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.471 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.471 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.471 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.471 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.471 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.471 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.471 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.471 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.472 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.472 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.472 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.472 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.472 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.472 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.472 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.472 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.472 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.472 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.472 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.472 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.473 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.473 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.473 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.473 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.473 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.473 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.473 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.473 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.473 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.473 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.473 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.473 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.473 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.473 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.473 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.473 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.474 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.474 INFO:teuthology.orchestra.run.smithi044.stdout: def test_atomic_read_4mb(): 2023-12-03T12:39:18.474 INFO:teuthology.orchestra.run.smithi044.stdout:> _test_atomic_read(1024*1024*4) 2023-12-03T12:39:18.474 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.474 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6874: 2023-12-03T12:39:18.474 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.474 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6851: in _test_atomic_read 2023-12-03T12:39:18.474 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:18.474 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.474 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.474 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.474 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.474 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.475 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.475 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.475 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.475 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.475 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.475 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.475 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.475 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.475 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.475 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.475 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.475 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.475 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.475 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.475 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.475 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.476 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.476 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.476 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.476 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.476 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.476 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.476 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.476 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.476 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.476 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.476 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.476 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.476 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.476 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.476 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.476 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.477 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.477 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.477 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.477 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.477 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.477 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.477 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.477 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.477 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.477 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.477 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.477 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.478 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.478 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.478 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.478 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.478 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.478 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.478 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.478 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.478 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.478 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.478 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.478 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.478 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.479 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.479 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.479 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.479 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.479 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.479 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.479 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.479 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.479 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.479 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.479 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.479 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.479 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.480 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.480 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.480 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.480 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.480 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.480 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.480 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.480 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.480 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.480 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.480 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.480 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-354" 2023-12-03T12:39:18.480 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.480 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.480 INFO:teuthology.orchestra.run.smithi044.stdout:_____________________________ test_atomic_read_8mb _____________________________ 2023-12-03T12:39:18.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.481 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.481 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.481 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.481 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.481 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.481 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.481 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.481 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.481 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.481 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.482 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.482 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.482 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.482 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.482 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.482 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.482 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.482 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.482 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.482 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.482 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.482 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.482 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.482 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.483 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.483 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.483 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.483 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.483 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.483 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.483 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.483 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.483 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.483 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.483 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.483 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.483 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.484 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.484 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.484 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.484 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.484 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.484 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.484 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.484 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.484 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.484 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.484 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.484 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.484 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.484 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.484 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.484 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.484 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.485 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.485 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.485 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.485 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.485 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.485 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.485 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.485 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.485 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.485 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.485 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.485 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.486 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.486 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.486 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.486 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.486 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.486 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.486 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.486 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.486 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.486 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.486 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.486 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.486 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.486 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.486 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.487 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.487 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.487 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.487 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.487 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.487 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.487 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.487 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.487 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.487 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.487 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.487 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.487 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.487 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.487 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.488 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.488 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.488 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.488 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.488 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.488 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.488 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.488 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.488 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.488 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.488 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.488 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.488 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.488 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.488 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.489 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.489 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.489 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.489 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.489 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.489 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.489 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.489 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.489 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.489 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.490 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.490 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.490 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.490 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.490 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.490 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.490 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.490 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.490 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.490 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.490 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.490 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.490 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.491 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.491 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.491 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.491 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.491 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.491 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.491 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.491 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.491 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.491 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.491 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.491 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.492 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.492 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.492 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.492 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.492 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.492 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.492 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.492 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.492 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.492 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.492 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.492 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.493 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.493 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.493 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.493 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.493 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.493 INFO:teuthology.orchestra.run.smithi044.stdout: def test_atomic_read_8mb(): 2023-12-03T12:39:18.493 INFO:teuthology.orchestra.run.smithi044.stdout:> _test_atomic_read(1024*1024*8) 2023-12-03T12:39:18.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.493 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6877: 2023-12-03T12:39:18.493 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.493 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6851: in _test_atomic_read 2023-12-03T12:39:18.493 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:18.493 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.494 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.494 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.494 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.494 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.494 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.494 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.494 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.494 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.494 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.494 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.494 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.494 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.494 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.494 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.495 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.495 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.495 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.495 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.495 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.495 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.495 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.495 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.496 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.496 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.496 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.496 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.496 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.496 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.496 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.496 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.496 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.496 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.497 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.497 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.497 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.497 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.497 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.497 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.497 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.497 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.497 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.497 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.497 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.497 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.497 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.497 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.497 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.497 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.497 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.498 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.498 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.498 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.498 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.498 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.498 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.498 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.498 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.498 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.498 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.498 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.498 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.498 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.498 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.498 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.499 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.499 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.499 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.499 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.499 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.499 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.499 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.499 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.499 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.499 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.499 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.499 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-355" 2023-12-03T12:39:18.499 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.499 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.500 INFO:teuthology.orchestra.run.smithi044.stdout:____________________________ test_atomic_write_1mb _____________________________ 2023-12-03T12:39:18.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.500 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.500 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.500 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.500 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.500 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.500 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.500 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.500 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.500 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.500 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.501 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.501 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.501 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.501 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.501 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.501 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.501 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.501 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.501 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.501 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.501 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.501 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.501 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.502 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.502 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.502 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.502 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.502 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.502 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.502 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.502 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.502 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.502 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.502 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.502 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.503 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.503 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.503 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.503 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.503 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.503 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.503 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.503 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.503 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.503 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.503 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.503 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.503 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.503 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.504 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.504 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.504 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.504 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.504 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.504 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.504 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.504 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.504 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.504 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.504 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.504 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.504 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.504 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.504 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.504 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.504 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.505 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.505 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.505 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.505 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.505 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.505 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.505 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.505 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.505 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.505 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.505 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.505 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.505 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.505 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.505 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.506 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.506 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.506 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.506 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.506 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.506 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.506 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.506 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.506 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.506 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.506 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.506 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.506 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.506 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.507 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.507 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.507 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.507 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.507 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.507 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.507 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.507 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.507 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.507 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.507 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.507 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.507 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.507 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.507 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.507 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.507 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.508 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.508 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.508 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.508 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.508 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.508 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.508 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.508 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.508 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.508 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.508 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.508 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.508 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.508 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.508 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.509 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.509 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.509 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.509 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.509 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.509 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.509 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.509 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.509 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.509 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.509 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.509 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.509 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.510 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.510 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.510 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.510 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.510 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.510 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.510 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.510 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.510 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.510 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.510 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.510 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.510 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.510 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.511 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.511 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.511 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.511 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.511 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.511 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.511 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.511 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.511 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.511 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.511 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.511 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.511 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.511 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.512 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.512 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.512 INFO:teuthology.orchestra.run.smithi044.stdout: def test_atomic_write_1mb(): 2023-12-03T12:39:18.512 INFO:teuthology.orchestra.run.smithi044.stdout:> _test_atomic_write(1024*1024) 2023-12-03T12:39:18.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.512 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6912: 2023-12-03T12:39:18.512 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.512 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6887: in _test_atomic_write 2023-12-03T12:39:18.512 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:18.512 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.512 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.512 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.513 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.513 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.513 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.513 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.513 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.513 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.513 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.513 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.513 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.513 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.513 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.513 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.513 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.513 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.513 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.513 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.514 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.514 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.514 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.514 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.514 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.514 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.514 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.514 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.514 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.514 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.514 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.514 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.514 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.514 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.515 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.515 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.515 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.515 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.515 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.515 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.515 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.515 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.515 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.515 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.515 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.515 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.515 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.515 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.516 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.516 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.516 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.516 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.516 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.516 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.516 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.516 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.516 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.516 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.516 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.516 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.516 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.516 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.516 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.516 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.517 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.517 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.517 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.517 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.517 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.517 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.517 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.517 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.517 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.517 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.517 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.517 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.517 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.517 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.517 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.518 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.518 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.518 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.518 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.518 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.518 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.518 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.518 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.518 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-356" 2023-12-03T12:39:18.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.518 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.518 INFO:teuthology.orchestra.run.smithi044.stdout:____________________________ test_atomic_write_4mb _____________________________ 2023-12-03T12:39:18.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.519 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.519 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.519 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.519 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.519 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.519 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.519 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.519 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.519 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.519 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.519 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.519 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.519 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.519 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.519 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.519 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.520 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.520 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.520 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.520 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.520 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.520 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.520 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.520 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.520 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.521 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.521 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.521 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.521 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.521 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.521 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.521 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.521 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.521 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.521 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.521 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.521 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.521 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.521 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.521 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.522 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.522 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.522 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.522 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.522 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.522 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.522 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.522 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.522 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.522 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.522 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.522 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.522 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.522 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.523 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.523 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.523 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.523 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.523 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.523 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.523 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.523 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.523 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.523 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.523 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.523 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.523 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.523 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.523 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.523 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.524 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.524 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.524 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.524 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.524 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.524 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.524 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.524 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.524 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.524 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.524 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.525 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.525 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.525 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.525 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.525 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.525 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.525 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.525 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.525 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.525 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.525 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.525 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.525 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.525 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.525 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.526 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.526 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.526 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.526 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.526 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.526 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.526 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.526 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.526 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.526 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.526 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.526 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.526 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.526 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.527 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.527 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.527 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.527 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.527 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.527 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.527 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.527 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.528 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.528 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.528 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.528 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.528 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.528 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.528 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.528 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.528 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.528 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.528 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.528 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.529 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.529 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.529 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.529 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.529 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.529 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.529 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.529 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.529 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.529 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.529 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.529 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.529 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.529 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.529 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.529 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.530 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.530 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.530 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.530 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.530 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.530 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.530 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.530 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.530 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.530 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.530 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.530 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.530 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.531 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.531 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.531 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.531 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.531 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.531 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.531 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.531 INFO:teuthology.orchestra.run.smithi044.stdout: def test_atomic_write_4mb(): 2023-12-03T12:39:18.531 INFO:teuthology.orchestra.run.smithi044.stdout:> _test_atomic_write(1024*1024*4) 2023-12-03T12:39:18.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.531 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6915: 2023-12-03T12:39:18.531 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.532 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6887: in _test_atomic_write 2023-12-03T12:39:18.532 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:18.532 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.532 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.532 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.532 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.532 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.532 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.532 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.532 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.532 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.532 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.532 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.532 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.532 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.533 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.533 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.533 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.533 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.533 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.533 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.533 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.533 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.533 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.533 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.533 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.533 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.533 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.533 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.533 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.533 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.534 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.534 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.534 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.534 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.534 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.534 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.534 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.534 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.534 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.534 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.534 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.534 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.534 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.534 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.535 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.535 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.535 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.535 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.535 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.535 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.535 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.535 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.535 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.535 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.535 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.535 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.535 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.535 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.536 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.536 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.536 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.536 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.536 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.536 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.536 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.536 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.536 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.536 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.536 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.536 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.536 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.536 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.536 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.537 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.537 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.537 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.537 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.537 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.537 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.537 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.537 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.537 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.537 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.537 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.537 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.537 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.537 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.537 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.538 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.538 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-357" 2023-12-03T12:39:18.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.538 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.538 INFO:teuthology.orchestra.run.smithi044.stdout:____________________________ test_atomic_write_8mb _____________________________ 2023-12-03T12:39:18.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.538 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.538 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.538 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.538 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.538 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.538 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.539 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.539 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.539 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.539 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.539 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.539 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.539 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.539 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.539 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.539 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.539 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.539 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.539 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.539 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.539 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.540 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.540 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.540 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.540 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.540 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.540 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.540 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.540 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.540 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.540 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.540 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.540 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.540 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.541 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.541 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.541 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.541 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.541 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.541 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.541 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.541 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.541 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.541 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.541 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.541 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.541 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.541 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.542 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.542 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.542 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.542 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.542 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.542 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.542 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.542 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.542 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.542 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.542 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.542 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.542 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.542 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.543 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.543 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.543 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.543 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.543 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.543 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.543 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.543 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.543 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.543 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.543 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.544 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.544 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.544 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.544 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.544 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.544 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.544 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.544 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.544 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.544 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.544 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.544 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.545 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.545 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.545 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.545 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.545 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.545 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.545 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.545 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.545 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.545 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.545 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.545 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.545 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.545 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.545 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.545 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.546 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.546 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.546 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.546 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.546 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.546 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.546 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.546 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.546 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.546 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.546 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.546 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.546 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.546 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.547 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.547 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.547 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.547 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.547 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.547 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.547 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.547 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.547 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.547 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.547 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.547 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.547 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.548 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.548 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.548 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.548 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.548 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.548 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.548 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.548 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.548 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.548 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.548 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.548 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.548 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.548 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.548 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.549 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.549 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.549 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.549 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.549 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.549 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.549 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.549 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.549 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.549 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.549 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.549 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.549 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.550 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.550 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.550 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.550 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.550 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.550 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.550 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.550 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.550 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.550 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.550 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.550 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.550 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.550 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.551 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.551 INFO:teuthology.orchestra.run.smithi044.stdout: def test_atomic_write_8mb(): 2023-12-03T12:39:18.551 INFO:teuthology.orchestra.run.smithi044.stdout:> _test_atomic_write(1024*1024*8) 2023-12-03T12:39:18.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.551 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6918: 2023-12-03T12:39:18.551 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.551 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6887: in _test_atomic_write 2023-12-03T12:39:18.551 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:18.551 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.551 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.551 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.551 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.551 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.552 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.552 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.552 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.552 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.552 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.552 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.552 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.552 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.552 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.552 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.552 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.552 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.552 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.553 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.553 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.553 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.553 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.553 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.553 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.553 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.553 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.553 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.553 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.553 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.553 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.553 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.553 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.553 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.554 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.554 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.554 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.554 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.554 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.554 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.554 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.554 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.554 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.554 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.554 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.554 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.555 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.555 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.555 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.555 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.555 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.555 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.555 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.555 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.555 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.555 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.555 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.555 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.555 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.556 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.556 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.556 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.556 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.556 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.556 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.556 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.556 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.556 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.556 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.556 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.556 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.556 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.556 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.556 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.556 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.557 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.557 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.557 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.557 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.557 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.557 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.557 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.557 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.557 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.558 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.558 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.558 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.558 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-358" 2023-12-03T12:39:18.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.558 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.558 INFO:teuthology.orchestra.run.smithi044.stdout:__________________________ test_atomic_dual_write_1mb __________________________ 2023-12-03T12:39:18.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.558 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.558 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.558 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.558 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.559 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.559 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.559 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.559 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.559 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.559 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.559 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.559 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.559 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.559 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.559 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.559 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.559 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.560 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.560 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.560 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.560 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.560 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.560 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.560 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.560 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.560 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.560 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.560 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.560 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.560 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.560 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.560 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.561 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.561 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.561 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.561 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.561 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.561 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.561 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.561 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.561 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.561 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.561 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.561 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.561 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.561 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.561 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.562 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.562 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.562 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.562 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.562 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.562 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.562 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.562 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.562 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.562 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.562 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.562 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.562 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.562 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.563 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.563 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.563 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.563 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.563 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.563 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.563 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.563 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.563 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.563 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.563 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.563 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.563 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.563 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.563 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.563 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.564 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.564 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.564 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.564 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.564 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.564 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.564 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.564 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.564 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.564 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.564 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.564 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.564 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.564 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.564 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.564 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.565 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.565 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.565 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.565 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.565 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.565 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.565 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.565 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.565 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.565 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.565 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.565 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.565 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.565 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.565 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.566 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.566 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.566 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.566 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.566 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.566 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.566 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.566 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.566 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.566 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.566 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.566 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.566 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.567 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.567 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.567 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.567 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.567 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.567 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.567 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.567 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.567 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.567 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.567 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.567 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.567 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.567 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.567 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.567 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.568 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.568 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.568 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.568 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.568 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.568 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.568 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.568 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.568 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.568 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.568 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.568 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.568 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.568 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.569 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.569 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.569 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.569 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.569 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.569 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.569 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.569 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.569 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.569 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.569 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.569 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.570 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.570 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.570 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.570 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.570 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.570 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.570 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.570 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.570 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.570 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.570 INFO:teuthology.orchestra.run.smithi044.stdout: def test_atomic_dual_write_1mb(): 2023-12-03T12:39:18.570 INFO:teuthology.orchestra.run.smithi044.stdout:> _test_atomic_dual_write(1024*1024) 2023-12-03T12:39:18.570 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.570 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6945: 2023-12-03T12:39:18.570 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.571 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6925: in _test_atomic_dual_write 2023-12-03T12:39:18.571 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:18.571 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.571 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.571 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.571 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.571 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.571 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.571 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.571 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.571 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.571 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.571 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.571 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.572 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.572 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.572 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.572 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.572 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.572 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.572 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.572 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.572 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.572 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.572 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.572 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.572 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.572 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.572 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.573 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.573 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.573 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.573 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.573 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.573 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.573 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.573 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.573 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.573 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.573 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.573 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.573 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.573 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.573 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.574 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.574 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.574 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.574 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.574 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.574 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.574 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.574 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.574 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.574 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.574 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.574 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.574 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.574 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.575 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.575 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.575 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.575 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.575 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.575 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.575 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.575 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.575 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.575 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.575 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.575 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.575 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.575 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.575 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.576 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.576 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.576 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.576 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.576 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.576 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.576 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.576 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.576 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.576 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.576 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.576 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.576 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.576 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.577 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-359" 2023-12-03T12:39:18.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.577 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.577 INFO:teuthology.orchestra.run.smithi044.stdout:__________________________ test_atomic_dual_write_4mb __________________________ 2023-12-03T12:39:18.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.577 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.577 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.577 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.577 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.577 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.577 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.577 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.577 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.578 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.578 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.578 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.578 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.578 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.578 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.578 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.578 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.578 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.578 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.578 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.579 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.579 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.579 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.579 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.579 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.579 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.579 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.579 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.579 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.579 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.579 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.579 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.579 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.579 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.580 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.580 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.580 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.580 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.580 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.580 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.580 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.580 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.580 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.580 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.580 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.580 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.580 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.580 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.581 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.581 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.581 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.581 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.581 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.581 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.581 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.581 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.581 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.581 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.581 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.581 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.581 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.581 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.581 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.582 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.582 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.582 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.582 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.582 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.582 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.582 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.582 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.582 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.582 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.582 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.582 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.582 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.582 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.583 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.583 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.583 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.583 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.583 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.583 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.583 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.583 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.583 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.583 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.583 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.583 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.583 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.583 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.584 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.584 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.584 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.584 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.584 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.584 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.584 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.584 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.584 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.584 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.584 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.584 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.584 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.584 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.585 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.585 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.585 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.585 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.585 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.585 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.585 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.585 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.585 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.585 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.585 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.585 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.585 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.585 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.585 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.586 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.586 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.586 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.586 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.586 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.586 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.586 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.586 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.586 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.586 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.586 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.586 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.586 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.587 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.587 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.587 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.587 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.587 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.587 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.587 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.587 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.587 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.587 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.587 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.588 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.588 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.588 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.588 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.588 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.588 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.588 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.588 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.588 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.588 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.588 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.588 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.588 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.588 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.588 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.589 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.589 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.589 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.589 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.589 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.589 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.589 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.589 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.589 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.589 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.589 INFO:teuthology.orchestra.run.smithi044.stdout: def test_atomic_dual_write_4mb(): 2023-12-03T12:39:18.589 INFO:teuthology.orchestra.run.smithi044.stdout:> _test_atomic_dual_write(1024*1024*4) 2023-12-03T12:39:18.590 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.590 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6948: 2023-12-03T12:39:18.590 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.590 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6925: in _test_atomic_dual_write 2023-12-03T12:39:18.590 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:18.590 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.590 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.590 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.590 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.590 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.590 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.590 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.590 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.590 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.590 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.591 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.591 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.591 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.591 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.591 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.591 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.591 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.591 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.591 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.591 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.591 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.591 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.591 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.591 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.592 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.592 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.592 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.592 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.592 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.592 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.592 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.592 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.592 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.592 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.592 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.592 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.592 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.593 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.593 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.593 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.593 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.593 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.593 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.593 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.593 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.593 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.593 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.593 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.593 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.594 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.594 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.594 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.594 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.594 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.594 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.594 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.594 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.594 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.594 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.594 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.594 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.594 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.595 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.595 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.595 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.595 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.595 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.595 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.595 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.595 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.595 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.595 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.595 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.595 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.595 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.595 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.595 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.595 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.596 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.596 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.596 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.596 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.596 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.596 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.596 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.596 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.596 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-360" 2023-12-03T12:39:18.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.596 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.596 INFO:teuthology.orchestra.run.smithi044.stdout:__________________________ test_atomic_dual_write_8mb __________________________ 2023-12-03T12:39:18.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.597 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.597 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.597 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.597 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.597 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.597 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.597 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.597 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.597 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.597 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.597 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.597 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.598 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.598 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.598 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.598 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.598 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.598 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.598 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.598 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.598 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.598 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.598 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.598 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.598 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.598 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.599 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.599 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.599 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.599 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.599 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.599 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.599 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.599 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.599 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.599 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.599 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.599 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.599 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.599 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.599 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.600 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.600 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.600 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.600 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.600 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.600 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.600 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.600 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.600 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.600 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.600 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.600 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.600 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.600 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.600 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.601 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.601 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.601 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.601 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.601 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.601 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.601 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.601 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.601 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.601 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.601 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.601 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.601 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.601 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.602 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.602 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.602 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.602 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.602 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.602 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.602 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.602 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.602 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.602 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.602 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.602 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.602 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.602 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.603 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.603 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.603 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.603 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.603 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.603 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.603 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.603 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.603 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.603 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.603 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.603 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.603 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.604 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.604 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.604 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.604 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.604 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.604 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.604 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.604 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.604 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.604 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.604 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.604 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.604 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.604 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.605 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.605 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.605 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.605 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.605 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.605 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.605 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.605 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.605 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.606 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.606 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.606 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.606 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.606 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.606 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.606 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.606 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.606 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.606 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.607 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.607 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.607 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.607 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.607 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.607 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.607 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.607 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.607 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.607 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.607 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.607 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.607 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.607 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.607 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.607 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.608 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.608 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.608 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.608 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.608 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.608 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.608 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.608 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.608 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.608 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.608 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.608 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.608 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.608 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.609 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.609 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.609 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.609 INFO:teuthology.orchestra.run.smithi044.stdout: def test_atomic_dual_write_8mb(): 2023-12-03T12:39:18.609 INFO:teuthology.orchestra.run.smithi044.stdout:> _test_atomic_dual_write(1024*1024*8) 2023-12-03T12:39:18.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.609 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6951: 2023-12-03T12:39:18.609 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.609 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6925: in _test_atomic_dual_write 2023-12-03T12:39:18.609 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:18.609 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.609 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.610 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.610 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.610 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.610 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.610 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.610 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.610 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.610 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.610 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.610 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.610 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.610 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.610 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.610 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.611 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.611 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.611 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.611 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.611 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.611 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.611 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.612 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.612 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.612 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.612 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.612 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.612 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.612 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.612 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.612 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.612 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.612 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.612 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.612 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.613 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.613 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.613 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.613 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.613 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.613 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.613 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.613 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.613 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.613 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.613 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.613 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.613 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.613 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.613 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.613 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.614 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.614 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.614 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.614 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.614 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.614 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.614 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.614 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.614 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.614 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.614 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.614 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.614 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.614 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.614 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.615 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.615 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.615 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.615 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.615 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.615 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.615 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.615 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.615 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.615 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.615 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-361" 2023-12-03T12:39:18.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.615 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.615 INFO:teuthology.orchestra.run.smithi044.stdout:______________________ test_atomic_conditional_write_1mb _______________________ 2023-12-03T12:39:18.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.616 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.616 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.616 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.616 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.616 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.616 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.616 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.616 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.616 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.617 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.617 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.617 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.617 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.617 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.617 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.617 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.617 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.617 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.617 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.617 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.617 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.618 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.618 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.618 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.618 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.618 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.618 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.618 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.618 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.618 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.618 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.618 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.618 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.618 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.618 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.618 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.619 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.619 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.619 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.619 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.619 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.619 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.619 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.619 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.619 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.619 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.619 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.619 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.619 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.619 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.619 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.620 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.620 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.620 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.620 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.620 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.620 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.620 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.620 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.620 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.620 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.620 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.620 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.620 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.621 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.621 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.621 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.621 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.621 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.621 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.621 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.621 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.621 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.622 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.622 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.622 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.622 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.622 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.622 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.622 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.622 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.622 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.622 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.622 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.622 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.623 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.623 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.623 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.623 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.623 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.623 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.623 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.623 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.623 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.623 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.623 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.623 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.623 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.623 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.623 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.623 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.624 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.624 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.624 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.624 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.624 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.624 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.624 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.624 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.624 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.624 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.624 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.624 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.624 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.624 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.624 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.625 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.625 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.625 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.625 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.625 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.625 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.625 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.625 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.625 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.625 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.625 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.625 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.626 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.626 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.626 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.626 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.626 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.626 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.626 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.626 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.626 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.626 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.626 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.626 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.626 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.627 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.627 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.627 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.627 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.627 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.627 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.627 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.627 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.627 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.627 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.627 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.627 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.627 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.627 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.627 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.627 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.627 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.628 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.628 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.628 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.628 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.628 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.628 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.628 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.628 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.628 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.628 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_aws 2023-12-03T12:39:18.628 INFO:teuthology.orchestra.run.smithi044.stdout: def test_atomic_conditional_write_1mb(): 2023-12-03T12:39:18.628 INFO:teuthology.orchestra.run.smithi044.stdout:> _test_atomic_conditional_write(1024*1024) 2023-12-03T12:39:18.628 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.629 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6984: 2023-12-03T12:39:18.629 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.629 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:6961: in _test_atomic_conditional_write 2023-12-03T12:39:18.629 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:18.629 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.629 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.629 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.629 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.629 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.629 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.629 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.629 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.629 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.629 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.629 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.630 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.630 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.630 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.630 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.630 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.630 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.630 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.630 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.630 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.630 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.630 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.630 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.630 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.630 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.631 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.631 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.631 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.631 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.631 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.631 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.631 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.631 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.631 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.631 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.631 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.631 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.631 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.631 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.632 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.632 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.632 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.632 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.632 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.632 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.632 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.632 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.632 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.632 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.632 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.632 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.632 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.632 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.633 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.633 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.633 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.633 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.633 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.633 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.633 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.633 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.633 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.633 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.633 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.633 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.633 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.633 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.633 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.633 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.633 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.634 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.634 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.634 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.634 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.634 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.634 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.634 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.634 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.634 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.634 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.634 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.634 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.634 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.635 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.635 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.635 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.635 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.635 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.635 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-362" 2023-12-03T12:39:18.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.635 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.635 INFO:teuthology.orchestra.run.smithi044.stdout:______________________ test_atomic_multipart_upload_write ______________________ 2023-12-03T12:39:18.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.635 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.635 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.635 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.636 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.636 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.636 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.636 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.636 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.636 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.636 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.636 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.636 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.636 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.636 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.637 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.637 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.637 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.637 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.637 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.637 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.637 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.637 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.637 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.637 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.637 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.637 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.637 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.637 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.637 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.637 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.637 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.638 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.638 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.638 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.638 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.638 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.638 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.638 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.638 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.638 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.638 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.638 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.638 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.638 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.638 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.639 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.639 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.639 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.639 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.639 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.639 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.639 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.639 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.639 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.639 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.639 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.639 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.639 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.639 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.639 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.640 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.640 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.640 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.640 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.640 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.640 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.640 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.640 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.640 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.640 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.640 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.640 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.640 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.640 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.640 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.640 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.641 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.641 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.641 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.641 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.641 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.641 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.641 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.641 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.641 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.641 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.641 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.641 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.641 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.641 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.642 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.642 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.642 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.642 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.642 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.642 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.642 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.642 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.642 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.642 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.642 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.642 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.643 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.643 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.643 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.643 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.643 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.643 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.643 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.643 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.643 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.643 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.643 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.643 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.643 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.643 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.644 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.644 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.644 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.644 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.644 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.644 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.644 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.644 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.644 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.644 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.644 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.644 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.645 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.645 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.645 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.645 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.645 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.645 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.645 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.645 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.645 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.645 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.645 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.646 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.646 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.646 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.646 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.646 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.646 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.646 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.646 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.646 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.646 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.646 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.646 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.646 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.646 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.647 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.647 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.647 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.647 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.647 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.647 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.647 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.647 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.647 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.647 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.647 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.647 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.647 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.647 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.647 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.647 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.648 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.648 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.648 INFO:teuthology.orchestra.run.smithi044.stdout: def test_atomic_multipart_upload_write(): 2023-12-03T12:39:18.648 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.648 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.648 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7044: 2023-12-03T12:39:18.648 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.648 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.648 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.648 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.648 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.648 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.648 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.648 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.648 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.649 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.649 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.649 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.649 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.649 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.649 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.649 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.649 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.649 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.649 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.649 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.649 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.649 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.649 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.649 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.650 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.650 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.650 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.650 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.650 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.650 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.650 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.650 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.650 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.650 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.650 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.650 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.650 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.651 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.651 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.651 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.651 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.651 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.651 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.651 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.651 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.651 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.651 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.651 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.651 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.651 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.651 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.652 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.652 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.652 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.652 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.652 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.652 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.652 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.652 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.652 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.652 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.652 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.652 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.652 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.652 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.652 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.652 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.652 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.653 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.653 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.653 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.653 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.653 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.653 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.653 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.653 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.653 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.653 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.653 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.653 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.653 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.654 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.654 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.654 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.654 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.654 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.654 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.654 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.654 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.654 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-363" 2023-12-03T12:39:18.654 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.654 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.654 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ test_multipart_resend_first_finishes_last ___________________ 2023-12-03T12:39:18.654 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.654 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.654 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.655 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.655 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.655 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.655 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.655 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.655 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.655 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.655 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.656 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.656 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.656 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.656 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.656 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.656 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.656 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.656 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.656 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.656 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.656 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.657 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.657 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.657 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.657 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.657 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.657 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.657 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.657 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.657 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.657 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.657 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.657 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.657 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.657 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.657 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.658 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.658 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.658 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.658 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.658 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.658 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.658 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.658 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.658 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.658 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.658 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.658 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.658 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.659 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.659 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.659 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.659 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.659 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.659 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.659 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.659 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.659 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.659 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.659 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.659 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.659 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.659 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.659 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.660 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.660 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.660 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.660 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.660 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.660 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.660 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.660 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.660 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.660 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.660 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.660 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.660 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.661 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.661 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.661 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.661 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.661 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.661 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.661 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.661 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.661 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.661 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.661 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.661 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.661 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.661 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.661 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.662 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.662 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.662 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.662 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.662 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.662 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.662 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.662 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.662 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.662 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.662 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.662 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.662 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.662 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.663 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.663 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.663 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.663 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.663 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.663 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.663 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.663 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.663 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.663 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.663 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.663 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.663 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.663 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.663 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.664 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.664 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.664 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.664 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.664 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.664 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.664 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.664 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.664 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.664 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.664 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.665 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.665 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.665 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.665 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.665 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.665 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.665 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.665 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.665 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.665 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.665 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.665 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.665 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.665 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.665 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.665 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.666 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.666 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.666 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.666 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.666 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.666 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.666 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.666 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.666 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.666 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.666 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.666 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.666 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.666 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.667 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.667 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.667 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.667 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.667 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.667 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.667 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.667 INFO:teuthology.orchestra.run.smithi044.stdout: def test_multipart_resend_first_finishes_last(): 2023-12-03T12:39:18.667 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.667 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7082: 2023-12-03T12:39:18.667 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.668 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.668 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.668 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.668 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.668 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.668 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.668 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.668 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.668 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.668 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.668 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.668 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.668 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.668 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.669 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.669 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.669 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.669 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.669 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.669 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.669 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.669 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.669 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.669 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.670 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.670 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.670 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.670 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.670 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.670 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.670 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.671 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.671 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.671 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.671 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.671 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.671 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.671 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.671 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.671 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.671 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.671 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.671 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.671 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.672 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.672 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.672 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.672 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.672 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.672 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.672 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.672 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.672 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.672 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.672 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.672 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.672 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.672 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.672 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.673 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.673 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.673 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.673 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.673 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.673 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.673 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.673 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.673 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.673 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.673 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.673 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.673 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.673 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.673 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.673 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.674 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.674 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.674 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.674 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.674 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.674 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.674 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-364" 2023-12-03T12:39:18.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.674 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.674 INFO:teuthology.orchestra.run.smithi044.stdout:______________________ test_ranged_request_response_code _______________________ 2023-12-03T12:39:18.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.674 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.674 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.675 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.675 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.675 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.675 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.675 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.675 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.675 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.675 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.675 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.675 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.675 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.675 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.675 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.675 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.675 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.675 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.676 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.676 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.676 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.676 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.676 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.676 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.676 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.676 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.676 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.676 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.676 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.676 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.676 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.677 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.677 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.677 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.677 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.677 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.677 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.677 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.677 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.677 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.677 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.677 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.677 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.677 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.677 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.677 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.677 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.678 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.678 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.678 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.678 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.678 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.678 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.678 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.678 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.678 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.678 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.678 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.678 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.678 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.678 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.679 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.679 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.679 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.679 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.679 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.679 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.679 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.679 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.679 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.679 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.679 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.679 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.679 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.679 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.679 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.680 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.680 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.680 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.680 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.680 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.680 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.680 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.680 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.680 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.680 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.680 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.680 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.681 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.681 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.681 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.681 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.681 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.681 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.681 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.681 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.681 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.681 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.681 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.681 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.681 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.681 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.681 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.682 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.682 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.682 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.682 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.682 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.682 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.682 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.682 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.682 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.682 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.682 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.682 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.682 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.683 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.683 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.683 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.683 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.683 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.683 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.683 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.683 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.683 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.683 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.683 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.683 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.683 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.683 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.683 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.683 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.684 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.684 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.684 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.684 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.684 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.684 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.684 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.684 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.684 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.684 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.684 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.685 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.685 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.685 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.685 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.685 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.685 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.685 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.685 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.685 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.685 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.685 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.685 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.685 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.685 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.685 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.686 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.686 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.686 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.686 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.686 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.686 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.686 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.686 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.686 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.686 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.686 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.686 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.686 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.686 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.687 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.687 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.687 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:18.687 INFO:teuthology.orchestra.run.smithi044.stdout: def test_ranged_request_response_code(): 2023-12-03T12:39:18.687 INFO:teuthology.orchestra.run.smithi044.stdout: content = 'testcontent' 2023-12-03T12:39:18.687 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.687 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.687 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.687 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7141: 2023-12-03T12:39:18.687 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.687 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.687 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.687 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.687 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.687 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.687 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.688 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.688 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.688 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.688 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.688 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.688 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.688 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.688 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.688 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.688 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.688 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.688 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.688 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.688 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.688 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.688 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.689 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.689 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.689 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.689 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.689 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.689 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.689 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.689 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.690 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.690 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.690 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.690 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.690 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.690 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.690 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.690 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.690 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.690 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.690 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.690 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.690 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.690 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.691 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.691 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.691 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.691 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.691 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.691 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.691 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.691 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.691 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.691 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.691 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.691 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.691 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.691 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.692 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.692 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.692 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.692 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.692 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.692 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.692 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.692 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.692 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.692 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.692 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.692 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.693 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.693 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.693 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.693 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.693 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.693 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.693 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.693 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-365" 2023-12-03T12:39:18.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.693 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.693 INFO:teuthology.orchestra.run.smithi044.stdout:____________________ test_ranged_big_request_response_code _____________________ 2023-12-03T12:39:18.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.694 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.694 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.694 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.694 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.694 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.694 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.694 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.694 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.694 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.694 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.695 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.695 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.695 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.695 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.695 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.695 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.695 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.695 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.695 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.695 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.695 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.695 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.695 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.695 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.695 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.696 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.696 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.696 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.696 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.696 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.696 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.696 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.696 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.696 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.696 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.696 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.696 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.696 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.697 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.697 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.697 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.697 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.697 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.697 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.697 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.697 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.697 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.697 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.697 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.697 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.698 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.698 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.698 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.698 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.698 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.698 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.698 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.698 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.698 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.698 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.698 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.699 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.699 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.699 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.699 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.699 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.699 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.699 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.699 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.699 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.699 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.699 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.700 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.700 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.700 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.700 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.700 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.700 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.700 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.700 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.700 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.700 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.700 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.700 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.700 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.700 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.701 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.701 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.701 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.701 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.701 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.701 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.701 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.701 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.701 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.701 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.701 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.701 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.701 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.701 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.702 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.702 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.702 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.702 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.702 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.702 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.703 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.703 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.703 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.703 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.703 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.703 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.703 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.703 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.703 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.703 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.703 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.703 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.703 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.703 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.704 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.704 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.704 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.704 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.704 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.704 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.704 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.704 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.704 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.704 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.704 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.704 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.705 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.705 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.705 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.705 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.705 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.705 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.705 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.705 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.705 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.705 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.705 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.705 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.705 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.705 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.705 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.705 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.706 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.706 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.706 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.706 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.706 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.706 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.706 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.706 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.706 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.706 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.706 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.706 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.706 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.706 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:18.707 INFO:teuthology.orchestra.run.smithi044.stdout: def test_ranged_big_request_response_code(): 2023-12-03T12:39:18.707 INFO:teuthology.orchestra.run.smithi044.stdout: content = _generate_random_string(8*1024*1024) 2023-12-03T12:39:18.707 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.707 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.707 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.707 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7159: 2023-12-03T12:39:18.707 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.707 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.707 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.707 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.707 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.707 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.707 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.707 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.707 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.707 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.708 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.708 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.708 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.708 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.708 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.708 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.708 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.708 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.709 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.709 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.709 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.709 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.709 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.709 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.709 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.709 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.709 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.710 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.710 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.710 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.710 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.710 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.710 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.710 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.710 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.710 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.710 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.710 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.710 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.710 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.710 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.710 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.711 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.711 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.711 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.711 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.711 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.711 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.711 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.711 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.711 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.711 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.711 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.711 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.711 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.711 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.712 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.712 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.712 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.712 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.712 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.712 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.712 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.712 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.712 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.712 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.712 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.712 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.712 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.713 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.713 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.713 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.713 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.713 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-366" 2023-12-03T12:39:18.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.713 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.713 INFO:teuthology.orchestra.run.smithi044.stdout:_____________ test_ranged_request_skip_leading_bytes_response_code _____________ 2023-12-03T12:39:18.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.713 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.713 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.713 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.713 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.714 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.714 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.714 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.714 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.714 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.714 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.714 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.714 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.714 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.714 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.714 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.714 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.714 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.714 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.714 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.715 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.715 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.715 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.715 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.715 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.715 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.715 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.715 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.715 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.715 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.715 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.715 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.716 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.716 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.716 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.716 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.716 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.716 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.716 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.716 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.716 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.716 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.716 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.716 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.716 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.716 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.717 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.717 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.717 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.717 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.717 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.717 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.717 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.717 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.717 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.717 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.717 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.718 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.718 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.718 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.718 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.718 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.718 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.718 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.718 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.718 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.718 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.718 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.718 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.719 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.719 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.719 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.719 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.719 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.719 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.719 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.719 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.719 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.719 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.720 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.720 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.720 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.720 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.720 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.720 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.720 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.720 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.720 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.720 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.720 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.720 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.720 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.720 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.720 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.721 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.721 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.721 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.721 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.721 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.721 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.721 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.721 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.721 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.721 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.721 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.721 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.722 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.722 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.722 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.722 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.722 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.722 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.722 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.722 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.722 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.723 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.723 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.723 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.723 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.723 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.723 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.723 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.723 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.723 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.723 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.723 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.723 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.723 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.723 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.723 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.723 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.724 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.724 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.724 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.724 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.724 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.724 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.724 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.724 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.724 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.724 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.724 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.724 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.725 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.725 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.725 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.725 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.725 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.725 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.725 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.725 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.725 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.725 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.725 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.725 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.725 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.725 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.725 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.725 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.726 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.726 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.726 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:18.726 INFO:teuthology.orchestra.run.smithi044.stdout: def test_ranged_request_skip_leading_bytes_response_code(): 2023-12-03T12:39:18.726 INFO:teuthology.orchestra.run.smithi044.stdout: content = 'testcontent' 2023-12-03T12:39:18.726 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.726 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.726 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.726 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7174: 2023-12-03T12:39:18.726 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.726 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.726 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.726 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.726 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.726 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.727 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.727 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.727 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.727 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.727 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.727 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.727 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.728 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.728 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.728 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.728 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.728 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.728 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.728 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.728 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.729 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.729 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.729 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.729 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.729 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.729 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.729 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.729 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.729 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.729 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.729 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.729 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.729 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.730 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.730 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.730 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.730 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.730 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.730 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.730 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.730 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.730 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.730 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.730 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.730 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.730 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.731 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.731 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.731 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.731 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.731 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.731 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.731 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.731 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.731 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.731 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.731 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.731 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.731 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.731 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.731 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.731 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.732 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.732 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.732 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.732 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.732 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.732 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.732 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.732 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.732 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.732 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.732 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.732 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-367" 2023-12-03T12:39:18.732 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.732 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.732 INFO:teuthology.orchestra.run.smithi044.stdout:___________ test_ranged_request_return_trailing_bytes_response_code ____________ 2023-12-03T12:39:18.733 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.733 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.733 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.733 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.733 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.733 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.733 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.733 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.733 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.733 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.733 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.733 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.733 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.733 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.733 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.733 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.734 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.734 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.734 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.734 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.734 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.734 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.734 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.734 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.734 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.734 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.734 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.734 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.734 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.734 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.734 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.735 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.735 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.735 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.735 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.735 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.735 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.735 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.735 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.735 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.735 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.735 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.735 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.735 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.735 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.735 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.735 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.736 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.736 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.736 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.736 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.736 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.736 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.736 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.736 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.736 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.736 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.736 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.736 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.736 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.736 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.736 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.737 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.737 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.737 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.737 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.737 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.737 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.737 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.737 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.737 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.737 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.737 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.737 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.737 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.738 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.738 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.738 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.738 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.738 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.738 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.738 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.738 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.738 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.738 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.739 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.739 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.739 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.739 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.739 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.739 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.739 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.739 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.739 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.739 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.739 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.739 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.739 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.739 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.739 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.740 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.740 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.740 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.740 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.740 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.740 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.740 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.740 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.740 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.740 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.740 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.740 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.740 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.740 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.740 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.740 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.741 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.741 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.741 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.741 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.741 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.741 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.741 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.741 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.741 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.741 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.742 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.742 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.742 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.742 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.742 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.742 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.742 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.742 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.742 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.742 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.742 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.742 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.742 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.742 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.742 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.743 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.743 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.743 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.743 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.743 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.743 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.743 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.743 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.743 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.743 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.743 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.743 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.743 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.743 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.743 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.744 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.744 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.744 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.744 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.744 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.744 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.744 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.744 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.744 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.744 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.744 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.744 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.744 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.744 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.744 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.745 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:18.745 INFO:teuthology.orchestra.run.smithi044.stdout: def test_ranged_request_return_trailing_bytes_response_code(): 2023-12-03T12:39:18.745 INFO:teuthology.orchestra.run.smithi044.stdout: content = 'testcontent' 2023-12-03T12:39:18.745 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.745 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.745 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.745 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7189: 2023-12-03T12:39:18.745 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.745 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.745 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.745 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.745 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.745 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.745 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.746 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.746 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.746 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.746 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.746 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.746 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.746 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.746 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.746 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.746 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.746 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.746 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.746 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.746 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.747 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.747 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.747 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.747 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.747 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.747 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.747 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.747 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.748 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.748 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.748 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.748 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.748 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.748 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.748 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.748 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.748 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.748 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.748 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.748 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.748 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.749 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.749 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.749 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.749 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.749 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.749 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.749 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.749 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.749 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.749 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.749 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.749 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.749 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.749 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.749 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.750 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.750 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.750 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.750 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.750 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.750 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.750 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.750 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.750 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.750 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.750 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.750 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.750 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.751 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.751 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.751 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.751 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.751 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.751 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.751 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.751 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.751 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.751 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.751 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.751 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.751 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-368" 2023-12-03T12:39:18.751 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.751 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.752 INFO:teuthology.orchestra.run.smithi044.stdout:______________________ test_ranged_request_invalid_range _______________________ 2023-12-03T12:39:18.752 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.752 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.752 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.752 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.752 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.752 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.752 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.752 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.752 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.752 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.752 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.752 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.752 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.752 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.753 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.753 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.753 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.753 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.753 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.753 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.753 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.753 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.753 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.753 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.753 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.753 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.753 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.753 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.753 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.754 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.754 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.754 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.754 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.754 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.754 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.754 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.754 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.754 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.754 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.754 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.754 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.754 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.754 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.755 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.755 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.755 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.755 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.755 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.755 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.755 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.755 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.755 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.755 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.755 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.756 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.756 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.756 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.756 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.756 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.756 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.756 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.756 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.756 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.756 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.756 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.757 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.757 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.757 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.757 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.757 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.757 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.757 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.757 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.757 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.757 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.757 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.757 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.758 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.758 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.758 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.758 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.758 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.758 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.758 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.758 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.758 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.758 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.758 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.758 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.758 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.758 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.759 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.759 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.759 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.759 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.759 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.759 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.759 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.759 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.759 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.759 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.759 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.759 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.759 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.759 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.760 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.760 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.760 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.760 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.760 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.760 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.760 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.760 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.760 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.760 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.760 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.760 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.760 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.760 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.760 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.761 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.761 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.761 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.761 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.761 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.761 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.761 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.761 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.761 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.761 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.761 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.761 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.761 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.761 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.761 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.762 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.762 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.762 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.762 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.762 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.762 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.762 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.762 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.762 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.762 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.762 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.762 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.762 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.762 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.762 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.763 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.763 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.763 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.763 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.763 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.763 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.763 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.763 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.763 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.763 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.763 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.763 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.763 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.763 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.764 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.764 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.764 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.764 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.764 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.764 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.764 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.764 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.764 INFO:teuthology.orchestra.run.smithi044.stdout: def test_ranged_request_invalid_range(): 2023-12-03T12:39:18.764 INFO:teuthology.orchestra.run.smithi044.stdout: content = 'testcontent' 2023-12-03T12:39:18.764 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.764 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.764 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.764 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7203: 2023-12-03T12:39:18.764 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.764 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.765 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.765 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.765 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.765 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.765 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.765 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.765 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.765 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.766 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.766 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.766 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.766 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.766 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.766 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.766 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.766 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.766 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.766 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.766 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.766 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.766 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.766 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.767 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.767 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.767 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.767 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.767 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.767 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.767 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.767 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.767 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.767 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.767 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.767 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.767 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.767 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.768 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.768 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.768 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.768 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.768 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.768 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.768 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.768 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.768 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.768 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.768 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.768 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.768 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.768 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.768 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.768 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.769 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.769 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.769 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.769 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.769 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.769 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.769 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.769 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.769 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.769 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.769 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.769 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.769 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.769 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.770 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.770 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.770 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.770 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.770 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.770 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.770 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.770 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.770 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.770 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.770 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-369" 2023-12-03T12:39:18.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.771 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.771 INFO:teuthology.orchestra.run.smithi044.stdout:_______________________ test_ranged_request_empty_object _______________________ 2023-12-03T12:39:18.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.771 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.771 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.771 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.771 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.771 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.771 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.771 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.771 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.772 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.772 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.772 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.772 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.772 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.772 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.772 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.772 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.772 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.772 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.772 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.772 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.772 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.772 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.772 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.772 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.773 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.773 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.773 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.773 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.773 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.773 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.773 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.773 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.773 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.773 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.773 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.773 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.773 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.774 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.774 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.774 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.774 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.774 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.774 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.774 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.774 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.774 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.774 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.774 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.774 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.774 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.775 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.775 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.775 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.775 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.775 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.775 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.775 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.775 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.775 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.775 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.775 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.775 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.775 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.776 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.776 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.776 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.776 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.776 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.776 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.776 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.776 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.776 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.776 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.777 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.777 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.777 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.777 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.777 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.777 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.777 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.777 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.777 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.777 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.777 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.777 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.777 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.777 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.777 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.778 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.778 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.778 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.778 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.778 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.778 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.778 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.778 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.778 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.778 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.778 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.778 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.778 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.778 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.778 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.779 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.779 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.779 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.779 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.779 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.779 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.779 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.779 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.779 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.779 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.779 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.779 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.779 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.779 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.779 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.779 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.780 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.780 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.780 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.780 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.780 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.780 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.780 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.780 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.780 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.780 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.780 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.780 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.780 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.780 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.781 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.781 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.781 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.781 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.781 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.781 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.781 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.781 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.781 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.781 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.781 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.781 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.781 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.781 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.782 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.782 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.782 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.782 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.782 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.782 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.782 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.782 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.782 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.782 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.782 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.782 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.782 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.782 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.782 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.783 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.783 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.783 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.783 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.783 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.783 INFO:teuthology.orchestra.run.smithi044.stdout: def test_ranged_request_empty_object(): 2023-12-03T12:39:18.783 INFO:teuthology.orchestra.run.smithi044.stdout: content = '' 2023-12-03T12:39:18.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.783 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.783 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7217: 2023-12-03T12:39:18.784 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.784 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.784 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.784 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.784 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.784 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.784 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.784 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.784 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.785 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.785 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.785 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.785 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.785 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.785 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.785 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.785 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.785 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.786 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.786 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.786 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.786 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.786 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.786 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.786 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.786 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.786 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.786 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.786 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.786 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.786 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.786 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.787 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.787 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.787 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.787 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.787 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.787 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.787 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.787 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.787 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.787 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.787 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.787 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.787 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.787 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.787 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.788 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.788 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.788 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.788 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.788 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.788 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.788 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.788 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.788 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.788 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.788 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.788 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.788 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.788 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.789 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.789 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.789 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.789 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.789 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.789 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.789 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.789 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.789 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.789 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.789 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.789 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.789 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.789 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.789 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.789 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.790 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.790 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.790 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.790 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.790 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.790 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-370" 2023-12-03T12:39:18.790 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.790 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.790 INFO:teuthology.orchestra.run.smithi044.stdout:____________________ test_versioning_bucket_create_suspend _____________________ 2023-12-03T12:39:18.790 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.790 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.790 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.790 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.790 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.790 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.791 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.791 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.791 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.791 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.791 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.791 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.791 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.791 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.791 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.791 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.791 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.791 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.791 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.791 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.792 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.792 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.792 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.792 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.792 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.792 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.792 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.792 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.792 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.792 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.792 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.792 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.792 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.792 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.792 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.792 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.793 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.793 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.793 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.793 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.793 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.793 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.793 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.793 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.793 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.793 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.793 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.793 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.793 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.793 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.793 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.794 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.794 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.794 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.794 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.794 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.794 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.794 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.794 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.794 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.794 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.794 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.794 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.795 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.795 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.795 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.795 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.795 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.795 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.795 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.795 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.795 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.795 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.795 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.795 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.796 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.796 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.796 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.796 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.796 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.796 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.796 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.796 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.796 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.796 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.796 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.796 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.797 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.797 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.797 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.797 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.797 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.797 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.797 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.797 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.797 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.797 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.797 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.797 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.797 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.798 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.798 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.798 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.798 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.798 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.798 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.798 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.798 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.798 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.798 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.798 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.798 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.798 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.798 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.799 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.799 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.799 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.799 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.799 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.799 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.799 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.799 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.799 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.799 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.799 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.799 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.799 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.799 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.799 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.799 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.800 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.800 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.800 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.800 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.800 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.800 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.800 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.800 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.800 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.800 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.800 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.800 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.800 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.800 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.800 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.802 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.802 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.802 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.802 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.802 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.802 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.802 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.802 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.802 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.802 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.802 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.802 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.802 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.802 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.802 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.803 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.803 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.803 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.803 INFO:teuthology.orchestra.run.smithi044.stdout: def test_versioning_bucket_create_suspend(): 2023-12-03T12:39:18.803 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.803 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.803 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7229: 2023-12-03T12:39:18.803 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.803 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.803 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.803 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.803 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.804 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.804 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.804 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.804 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.804 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.804 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.804 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.804 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.804 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.804 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.804 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.804 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.805 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.805 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.805 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.805 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.805 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.805 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.805 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.805 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.805 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.805 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.805 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.805 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.805 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.806 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.806 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.806 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.806 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.806 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.806 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.806 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.806 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.806 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.806 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.806 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.806 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.806 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.806 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.809 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.809 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.809 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.809 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.809 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.809 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.809 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.809 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.809 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.809 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.809 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.809 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.809 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-371" 2023-12-03T12:39:18.809 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.810 INFO:teuthology.orchestra.run.smithi044.stdout:____________________ test_versioning_obj_create_read_remove ____________________ 2023-12-03T12:39:18.810 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.810 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.810 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.810 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.810 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.810 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.810 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.810 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.810 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.810 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.810 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.810 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.810 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.811 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.811 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.811 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.811 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.811 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.811 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.811 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.811 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.811 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.811 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.811 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.811 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.811 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.811 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.811 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.813 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.813 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.813 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.813 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.813 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.813 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.813 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.813 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.813 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.813 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.813 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.813 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.813 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.813 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.813 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.813 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.814 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.814 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.814 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.814 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.814 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.814 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.814 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.814 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.814 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.814 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.814 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.814 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.814 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.814 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.815 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.815 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.815 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.815 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.815 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.815 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.815 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.815 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.815 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.815 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.815 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.815 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.816 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.816 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.816 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.816 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.816 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.816 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.816 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.816 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.816 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.816 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.816 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.816 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.816 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.816 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.816 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.816 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.817 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.817 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.817 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.817 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.817 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.817 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.817 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.817 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.817 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.817 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.817 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.817 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.817 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.817 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.817 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.818 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.818 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.818 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.818 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.818 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.818 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.818 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.818 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.818 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.818 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.818 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.818 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.818 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.819 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.819 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.819 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.819 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.819 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.819 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.819 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.819 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.819 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.819 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.819 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.819 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.819 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.819 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.819 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.820 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.820 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.820 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.820 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.820 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.820 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.820 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.820 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.820 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.820 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.820 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.820 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.820 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.820 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.820 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.821 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.821 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.821 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.821 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.821 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.821 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.821 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.821 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.821 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.821 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.821 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.821 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.821 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.822 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.822 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.822 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.822 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.822 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.822 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.822 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.822 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.822 INFO:teuthology.orchestra.run.smithi044.stdout: def test_versioning_obj_create_read_remove(): 2023-12-03T12:39:18.822 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.822 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.822 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7312: 2023-12-03T12:39:18.822 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.822 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.823 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.823 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.823 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.823 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.823 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.823 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.823 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.823 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.823 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.823 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.823 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.823 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.823 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.823 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.823 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.824 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.824 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.824 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.824 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.824 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.824 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.824 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.824 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.824 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.824 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.824 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.824 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.824 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.824 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.824 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.825 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.825 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.825 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.825 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.825 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.825 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.825 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.825 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.825 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.825 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.825 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.825 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.825 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.828 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.828 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.828 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.828 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.828 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.828 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.828 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.828 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.828 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.828 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.828 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.828 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-372" 2023-12-03T12:39:18.828 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.828 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.828 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ test_versioning_obj_create_read_remove_head __________________ 2023-12-03T12:39:18.829 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.829 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.829 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.829 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.829 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.829 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.829 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.829 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.829 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.829 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.829 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.829 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.829 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.829 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.830 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.830 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.830 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.830 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.830 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.830 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.830 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.830 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.830 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.830 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.830 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.830 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.830 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.831 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.831 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.831 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.831 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.831 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.831 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.831 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.831 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.831 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.831 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.831 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.831 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.831 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.831 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.831 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.832 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.832 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.832 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.832 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.832 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.832 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.832 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.832 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.832 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.832 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.832 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.832 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.832 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.832 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.832 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.833 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.833 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.833 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.833 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.833 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.833 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.833 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.833 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.833 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.833 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.833 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.833 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.833 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.834 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.834 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.834 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.834 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.834 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.834 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.834 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.834 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.834 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.834 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.834 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.834 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.834 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.834 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.835 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.835 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.835 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.835 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.835 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.835 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.835 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.835 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.835 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.835 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.835 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.835 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.835 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.835 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.835 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.836 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.836 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.836 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.836 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.836 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.836 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.836 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.836 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.836 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.836 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.836 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.836 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.836 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.836 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.837 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.837 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.837 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.837 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.837 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.837 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.837 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.837 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.837 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.837 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.837 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.837 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.837 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.837 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.837 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.838 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.838 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.838 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.838 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.838 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.838 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.838 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.838 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.838 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.838 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.838 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.838 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.838 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.838 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.838 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.838 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.839 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.839 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.839 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.839 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.839 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.839 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.839 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.839 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.839 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.839 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.840 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.840 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.840 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.840 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.840 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.840 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.840 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.840 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.840 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.840 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.840 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.840 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.840 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.840 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.840 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.840 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.841 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.841 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.841 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.841 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.841 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.841 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.841 INFO:teuthology.orchestra.run.smithi044.stdout: def test_versioning_obj_create_read_remove_head(): 2023-12-03T12:39:18.841 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.841 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.841 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7326: 2023-12-03T12:39:18.841 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.841 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.841 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.841 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.842 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.842 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.842 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.842 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.842 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.842 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.842 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.842 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.843 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.843 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.843 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.843 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.843 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.843 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.843 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.843 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.843 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.843 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.843 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.843 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.843 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.843 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.844 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.844 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.844 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.844 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.844 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.844 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.844 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.844 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.844 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.844 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.844 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.844 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.844 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.844 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.845 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.845 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.845 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.845 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.845 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.845 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.845 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.845 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.845 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.845 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.845 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.845 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.845 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.845 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.845 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.845 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.846 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.846 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.846 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.846 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.846 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.846 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.846 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.846 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.846 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.846 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.846 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.847 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.847 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.847 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.847 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.847 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.847 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.847 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.847 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.847 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.847 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.847 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.847 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.847 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.847 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-373" 2023-12-03T12:39:18.848 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.848 INFO:teuthology.orchestra.run.smithi044.stdout:________________ test_versioning_obj_plain_null_version_removal ________________ 2023-12-03T12:39:18.848 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.848 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.848 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.848 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.848 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.848 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.848 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.848 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.848 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.848 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.848 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.848 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.849 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.849 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.849 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.849 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.849 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.849 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.849 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.849 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.849 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.849 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.849 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.849 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.849 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.849 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.849 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.849 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.850 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.850 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.850 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.850 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.850 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.850 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.850 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.850 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.850 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.850 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.850 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.850 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.851 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.851 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.851 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.851 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.851 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.851 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.851 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.851 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.851 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.851 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.851 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.851 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.851 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.851 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.851 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.852 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.852 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.852 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.852 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.852 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.852 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.852 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.852 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.852 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.852 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.852 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.852 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.852 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.852 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.852 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.853 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.853 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.853 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.853 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.853 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.853 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.853 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.853 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.853 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.853 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.853 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.853 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.853 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.853 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.853 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.854 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.854 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.854 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.854 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.854 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.854 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.854 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.854 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.854 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.854 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.854 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.854 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.854 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.854 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.854 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.855 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.855 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.855 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.855 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.855 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.855 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.855 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.855 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.855 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.855 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.855 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.855 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.855 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.855 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.856 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.856 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.856 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.856 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.856 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.856 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.856 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.856 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.856 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.856 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.856 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.856 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.857 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.857 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.857 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.857 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.857 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.857 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.857 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.857 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.857 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.857 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.857 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.857 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.857 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.857 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.857 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.858 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.858 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.858 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.858 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.858 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.858 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.858 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.858 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.858 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.858 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.858 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.858 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.858 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.858 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.858 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.859 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.859 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.859 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.859 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.859 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.859 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.859 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.859 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.859 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.859 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.859 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.859 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.859 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.859 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.859 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.859 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.860 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.860 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.860 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.860 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.860 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.860 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.860 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.860 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.860 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.860 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.860 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.860 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.860 INFO:teuthology.orchestra.run.smithi044.stdout: def test_versioning_obj_plain_null_version_removal(): 2023-12-03T12:39:18.860 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.860 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.861 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7360: 2023-12-03T12:39:18.861 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.861 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.861 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.861 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.861 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.861 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.861 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.861 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.861 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.861 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.861 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.861 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.861 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.861 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.862 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.862 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.862 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.862 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.862 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.862 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.862 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.862 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.862 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.862 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.862 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.862 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.862 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.862 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.862 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.863 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.863 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.863 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.863 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.863 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.863 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.863 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.863 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.863 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.863 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.863 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.863 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.863 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.863 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.863 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.863 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.864 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.864 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.864 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.864 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.864 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.864 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.864 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.864 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.864 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.864 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.864 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.864 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.864 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.864 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.864 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.865 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.865 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.865 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.865 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.865 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.865 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.865 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.865 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.865 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.865 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.865 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.865 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.865 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.865 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.865 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.866 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.866 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.866 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.866 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.866 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.866 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.866 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.866 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.866 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.866 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.866 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.866 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.866 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.866 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.867 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-374" 2023-12-03T12:39:18.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.867 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.867 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ test_versioning_obj_plain_null_version_overwrite _______________ 2023-12-03T12:39:18.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.867 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.867 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.867 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.867 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.867 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.867 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.867 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.868 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.868 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.868 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.868 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.868 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.868 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.868 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.868 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.868 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.868 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.868 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.868 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.868 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.868 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.868 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.869 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.869 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.869 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.869 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.869 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.869 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.869 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.869 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.869 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.869 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.869 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.870 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.870 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.870 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.870 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.870 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.870 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.870 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.870 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.870 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.870 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.870 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.870 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.870 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.870 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.870 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.871 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.871 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.871 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.871 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.871 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.871 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.871 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.871 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.871 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.871 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.871 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.871 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.871 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.871 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.872 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.872 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.872 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.872 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.872 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.872 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.872 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.872 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.872 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.872 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.872 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.872 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.872 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.872 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.872 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.872 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.873 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.873 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.873 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.873 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.873 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.873 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.873 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.873 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.873 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.873 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.873 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.873 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.873 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.873 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.873 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.874 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.874 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.874 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.874 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.874 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.874 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.874 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.874 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.874 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.874 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.874 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.874 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.874 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.874 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.874 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.875 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.875 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.875 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.875 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.875 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.875 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.875 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.875 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.875 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.875 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.875 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.875 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.875 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.875 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.875 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.876 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.876 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.876 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.876 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.876 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.876 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.876 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.876 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.876 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.876 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.876 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.876 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.876 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.876 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.877 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.877 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.877 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.877 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.877 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.877 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.877 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.877 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.877 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.877 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.877 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.878 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.878 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.878 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.878 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.878 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.878 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.878 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.878 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.878 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.878 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.878 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.878 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.878 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.878 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.878 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.879 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.879 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.879 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.879 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.879 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.879 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.879 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.879 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.879 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.879 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.879 INFO:teuthology.orchestra.run.smithi044.stdout: def test_versioning_obj_plain_null_version_overwrite(): 2023-12-03T12:39:18.879 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.879 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.879 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7380: 2023-12-03T12:39:18.880 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.880 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.880 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.880 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.880 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.880 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.880 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.880 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.880 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.880 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.880 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.880 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.880 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.881 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.881 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.881 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.881 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.881 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.881 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.881 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.881 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.881 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.881 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.881 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.881 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.881 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.881 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.882 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.882 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.882 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.882 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.882 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.882 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.882 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.882 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.882 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.882 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.882 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.882 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.883 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.883 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.883 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.883 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.883 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.883 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.883 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.883 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.883 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.883 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.883 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.883 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.883 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.883 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.884 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.884 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.884 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.884 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.884 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.884 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.884 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.884 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.884 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.884 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.884 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.884 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.884 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.884 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.884 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.885 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.885 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.885 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.885 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.885 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.885 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.885 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.885 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.885 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.885 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.885 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.885 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.885 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.885 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.885 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.886 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.886 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.886 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.886 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.886 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.886 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-375" 2023-12-03T12:39:18.886 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.886 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.886 INFO:teuthology.orchestra.run.smithi044.stdout:__________ test_versioning_obj_plain_null_version_overwrite_suspended __________ 2023-12-03T12:39:18.886 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.886 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.886 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.887 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.887 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.887 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.887 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.887 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.887 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.887 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.887 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.887 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.887 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.887 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.887 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.888 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.888 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.888 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.888 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.888 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.888 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.888 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.888 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.888 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.888 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.888 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.888 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.889 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.889 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.889 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.889 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.889 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.889 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.889 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.889 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.889 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.889 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.889 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.889 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.889 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.889 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.889 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.890 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.890 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.890 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.890 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.890 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.890 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.890 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.890 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.890 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.890 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.890 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.890 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.890 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.890 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.891 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.891 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.891 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.891 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.891 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.891 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.891 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.891 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.891 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.891 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.891 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.891 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.891 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.891 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.892 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.892 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.892 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.892 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.892 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.892 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.892 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.892 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.892 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.892 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.892 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.892 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.892 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.892 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.892 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.892 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.893 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.893 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.893 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.893 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.893 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.893 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.893 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.893 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.893 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.893 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.893 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.893 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.893 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.893 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.894 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.894 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.894 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.894 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.894 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.894 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.894 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.894 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.894 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.894 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.894 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.894 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.894 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.894 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.895 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.895 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.895 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.895 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.895 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.895 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.895 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.895 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.895 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.895 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.895 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.895 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.895 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.896 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.896 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.896 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.896 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.896 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.896 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.896 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.896 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.896 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.896 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.896 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.896 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.896 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.896 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.896 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.897 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.897 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.897 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.897 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.897 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.897 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.897 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.897 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.897 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.897 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.897 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.897 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.897 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.897 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.897 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.898 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.898 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.898 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.898 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.898 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.898 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.898 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.898 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.898 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.898 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.898 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.898 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.898 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.898 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.899 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.899 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.899 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.899 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.899 INFO:teuthology.orchestra.run.smithi044.stdout: def test_versioning_obj_plain_null_version_overwrite_suspended(): 2023-12-03T12:39:18.899 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.899 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7413: 2023-12-03T12:39:18.899 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.899 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.899 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.899 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.899 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.900 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.900 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.900 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.900 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.900 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.900 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.900 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.901 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.901 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.901 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.901 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.901 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.901 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.901 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.902 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.902 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.902 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.902 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.902 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.902 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.902 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.902 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.902 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.902 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.902 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.902 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.902 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.903 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.903 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.903 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.903 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.903 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.903 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.903 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.903 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.903 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.903 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.903 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.903 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.903 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.903 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.903 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.904 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.904 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.904 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.904 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.904 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.904 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.904 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.904 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.904 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.904 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.904 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.904 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.904 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.904 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.904 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.904 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.905 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.905 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.905 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.905 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.905 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.905 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.905 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.905 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.905 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.905 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.905 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.905 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-376" 2023-12-03T12:39:18.906 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.906 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.906 INFO:teuthology.orchestra.run.smithi044.stdout:_____________________ test_versioning_obj_suspend_versions _____________________ 2023-12-03T12:39:18.906 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.906 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.906 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.906 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.906 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.906 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.906 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.906 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.906 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.906 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.906 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.907 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.907 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.907 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.907 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.907 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.907 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.907 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.907 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.907 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.907 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.907 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.908 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.908 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.908 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.908 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.908 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.908 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.908 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.908 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.908 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.908 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.908 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.908 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.908 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.908 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.908 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.908 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.909 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.909 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.909 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.909 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.909 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.909 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.909 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.909 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.909 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.909 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.909 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.909 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.909 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.909 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.909 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.910 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.910 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.910 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.910 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.910 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.910 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.910 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.910 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.910 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.910 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.910 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.910 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.910 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.910 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.911 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.911 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.911 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.911 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.911 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.911 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.911 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.911 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.911 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.911 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.911 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.912 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.912 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.912 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.912 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.912 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.912 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.912 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.912 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.912 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.912 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.912 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.912 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.912 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.912 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.912 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.913 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.913 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.913 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.913 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.913 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.913 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.913 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.913 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.913 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.913 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.913 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.913 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.913 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.913 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.913 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.914 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.914 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.914 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.914 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.914 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.914 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.914 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.914 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.914 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.914 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.914 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.914 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.915 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.915 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.915 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.915 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.915 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.915 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.915 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.915 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.915 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.915 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.915 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.915 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.915 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.915 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.915 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.915 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.916 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.916 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.916 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.916 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.916 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.916 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.916 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.916 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.916 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.916 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.916 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.917 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.917 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.917 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.917 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.917 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.917 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.917 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.917 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.917 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.917 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.917 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.917 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.917 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.917 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.918 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.918 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.918 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.918 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.918 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.918 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.918 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.918 INFO:teuthology.orchestra.run.smithi044.stdout: def test_versioning_obj_suspend_versions(): 2023-12-03T12:39:18.919 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.919 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.919 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7478: 2023-12-03T12:39:18.919 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.919 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.919 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.919 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.919 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.919 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.919 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.920 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.920 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.920 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.920 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.920 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.920 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.920 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.921 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.921 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.921 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.921 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.921 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.921 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.921 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.921 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.921 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.921 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.921 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.921 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.921 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.922 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.922 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.922 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.922 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.922 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.922 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.922 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.922 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.922 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.922 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.922 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.922 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.922 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.922 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.923 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.923 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.923 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.923 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.923 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.923 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.923 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.923 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.923 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.923 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.923 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.923 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.923 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.923 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.923 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.923 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.924 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.924 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.924 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.924 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.924 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.924 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.924 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.924 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.924 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.924 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.924 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.924 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.924 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.924 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.924 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.925 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.925 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.925 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.925 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.925 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.925 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-377" 2023-12-03T12:39:18.925 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.925 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.925 INFO:teuthology.orchestra.run.smithi044.stdout:________________ test_versioning_obj_create_versions_remove_all ________________ 2023-12-03T12:39:18.925 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.925 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.925 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.925 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.925 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.925 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.926 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.926 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.926 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.926 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.926 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.926 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.926 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.926 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.926 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.926 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.926 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.926 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.926 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.926 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.927 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.927 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.927 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.927 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.927 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.927 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.927 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.927 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.927 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.927 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.927 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.927 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.927 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.928 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.928 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.928 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.928 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.928 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.928 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.928 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.928 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.928 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.928 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.928 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.928 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.928 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.928 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.928 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.929 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.929 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.929 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.929 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.929 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.929 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.929 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.929 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.929 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.929 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.929 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.929 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.930 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.930 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.930 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.930 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.930 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.930 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.930 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.930 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.930 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.930 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.930 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.931 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.931 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.931 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.931 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.931 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.931 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.931 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.931 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.931 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.931 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.931 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.931 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.931 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.931 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.932 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.932 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.932 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.932 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.932 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.932 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.932 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.932 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.932 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.932 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.932 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.932 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.932 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.932 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.932 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.933 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.933 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.933 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.933 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.933 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.933 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.933 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.933 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.933 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.933 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.933 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.933 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.933 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.933 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.934 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.934 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.934 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.934 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.934 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.934 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.934 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.934 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.934 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.934 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.934 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.934 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.934 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.934 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.934 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.935 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.935 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.935 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.935 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.935 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.935 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.935 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.935 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.935 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.935 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.935 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.935 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.935 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.935 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.935 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.936 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.936 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.936 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.936 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.936 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.936 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.936 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.936 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.936 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.936 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.937 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.937 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.937 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.937 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.937 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.937 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.937 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.937 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.937 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.937 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.937 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.937 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.937 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.938 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.938 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.938 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.938 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.938 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.938 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.938 INFO:teuthology.orchestra.run.smithi044.stdout: def test_versioning_obj_create_versions_remove_all(): 2023-12-03T12:39:18.938 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.938 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.938 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7510: 2023-12-03T12:39:18.938 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.938 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.938 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.938 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.939 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.939 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.939 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.939 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.939 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.939 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.939 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.940 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.940 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.940 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.940 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.940 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.940 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.940 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.940 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.940 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.941 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.941 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.941 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.941 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.941 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.941 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.941 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.941 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.941 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.941 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.941 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.941 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.941 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.942 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.942 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.942 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.942 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.942 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.942 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.942 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.942 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.942 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.942 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.942 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.942 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.942 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.943 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.943 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.943 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.943 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.943 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.943 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.943 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.943 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.943 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.943 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.943 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.943 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.943 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.943 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.943 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.944 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.944 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.944 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.944 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.944 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.944 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.944 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.944 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.944 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.944 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.944 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.944 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.944 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-378" 2023-12-03T12:39:18.944 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.944 INFO:teuthology.orchestra.run.smithi044.stdout:___________ test_versioning_obj_create_versions_remove_special_names ___________ 2023-12-03T12:39:18.945 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.945 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.945 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.945 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.945 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.945 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.945 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.945 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.945 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.945 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.945 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.945 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.945 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.945 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.946 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.946 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.946 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.946 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.946 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.946 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.946 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.946 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.946 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.946 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.946 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.946 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.946 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.946 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.947 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.947 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.947 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.947 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.947 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.947 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.947 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.947 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.947 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.947 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.947 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.947 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.947 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.947 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.948 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.948 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.948 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.948 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.948 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.948 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.948 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.948 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.948 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.948 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.948 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.948 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.949 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.949 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.949 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.949 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.949 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.949 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.949 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.949 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.949 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.949 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.949 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.949 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.949 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.950 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.950 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.950 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.950 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.950 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.950 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.950 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.950 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.951 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.951 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.951 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.951 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.951 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.951 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.951 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.951 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.951 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.951 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.951 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.951 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.951 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.951 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.952 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.952 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.952 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.952 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.952 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.952 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.952 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.952 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.952 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.952 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.952 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.952 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.952 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.952 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.952 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.952 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.953 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.953 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.953 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.953 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.953 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.953 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.953 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.953 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.953 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.953 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.953 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.953 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.953 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.953 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.953 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.954 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.954 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.954 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.954 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.954 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.954 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.954 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.954 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.954 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.954 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.954 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.954 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.954 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.954 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.955 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.955 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.955 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.955 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.955 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.955 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.955 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.955 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.955 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.955 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.955 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.956 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.956 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.956 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.956 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.956 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.956 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.956 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.956 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.956 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.956 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.956 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.956 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.957 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.957 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.957 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.957 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.957 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.957 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.957 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.957 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.957 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.957 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.957 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.957 INFO:teuthology.orchestra.run.smithi044.stdout: def test_versioning_obj_create_versions_remove_special_names(): 2023-12-03T12:39:18.957 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.957 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.957 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7526: 2023-12-03T12:39:18.958 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.958 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.958 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.958 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.958 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.958 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.958 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.958 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.958 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.958 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.958 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.958 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.958 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.958 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.959 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.959 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.959 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.959 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.959 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.959 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.959 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.959 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.959 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.959 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.959 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.959 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.959 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.959 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.959 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.960 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.960 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.960 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.960 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.960 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.960 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.960 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.960 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.960 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.960 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.960 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.960 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.960 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.960 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.961 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.961 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.961 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.961 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.961 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.961 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.961 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.961 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.961 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.961 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.961 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.961 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.961 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.962 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.962 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.962 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.962 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.962 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.962 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.962 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.962 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.962 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.962 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.962 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.962 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.963 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.963 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.963 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.963 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.963 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.963 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.963 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.963 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.963 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.963 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.963 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.963 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.963 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.963 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.963 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.964 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.964 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.964 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.964 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.964 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.964 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.964 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-379" 2023-12-03T12:39:18.964 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.964 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.964 INFO:teuthology.orchestra.run.smithi044.stdout:________________ test_versioning_obj_create_overwrite_multipart ________________ 2023-12-03T12:39:18.964 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.964 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.964 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.964 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.965 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.965 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.965 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.965 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.965 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.965 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.965 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.965 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.965 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.965 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.965 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.965 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.965 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.965 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.966 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.966 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.966 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.966 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.966 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.966 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.966 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.966 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.966 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.966 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.966 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.966 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.966 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.966 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.967 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.967 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.967 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.967 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.967 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.967 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.967 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.967 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.967 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.967 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.967 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.967 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.967 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.967 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.967 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.968 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.968 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.968 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.968 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.968 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.968 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.968 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.968 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.968 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.968 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.968 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.968 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.968 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.968 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.968 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.969 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.969 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.969 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.969 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.969 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.969 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.969 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.969 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.969 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.969 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.969 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.969 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.969 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.970 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.970 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.970 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.970 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.970 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.970 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.970 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.970 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.970 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.970 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.970 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.970 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.970 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.970 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.971 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.971 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.971 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.971 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.971 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.971 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.971 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.971 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.971 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.971 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.971 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.971 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.971 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.971 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.971 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.972 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.972 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.972 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.972 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.972 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.972 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.972 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.972 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.972 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.972 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.972 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.972 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.972 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.972 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.973 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.973 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.973 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.973 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.973 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.973 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.973 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.973 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.973 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.973 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.973 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.973 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.973 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.973 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.973 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.974 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.974 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.974 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.974 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.974 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.974 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.974 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.974 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.974 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.974 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.974 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.974 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.974 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.975 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.975 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.975 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.975 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.975 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.975 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.975 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.975 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.975 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.975 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.975 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.975 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.975 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.975 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.975 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.976 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.976 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.976 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.976 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.976 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.976 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.976 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.976 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.976 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.976 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.976 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.976 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.976 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.977 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.977 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.977 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:18.977 INFO:teuthology.orchestra.run.smithi044.stdout: def test_versioning_obj_create_overwrite_multipart(): 2023-12-03T12:39:18.977 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.977 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7544: 2023-12-03T12:39:18.977 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.977 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.977 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.977 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.977 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.978 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.978 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.978 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.978 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.978 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.978 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.978 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.978 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.978 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.978 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.978 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.978 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.978 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.978 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.979 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.979 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.979 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.979 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.979 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.979 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.979 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.980 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.980 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.980 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.980 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.980 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.980 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.980 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:18.980 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:18.980 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:18.980 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:18.980 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:18.980 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.980 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.980 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.981 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.981 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.981 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.981 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.981 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.981 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.981 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.981 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.981 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.981 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.981 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.981 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.982 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.982 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.982 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.982 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.982 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.982 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.982 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.982 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:18.982 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.982 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.982 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.982 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.982 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.982 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.983 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.983 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.983 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.983 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.983 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.983 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:18.983 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:18.983 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:18.983 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:18.983 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:18.983 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.983 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.983 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:18.983 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:18.983 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:18.984 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:18.984 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:18.984 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.984 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:18.984 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:18.984 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.984 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:18.984 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:18.984 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-380" 2023-12-03T12:39:18.984 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.984 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:18.984 INFO:teuthology.orchestra.run.smithi044.stdout:_______________________ test_versioning_obj_list_marker ________________________ 2023-12-03T12:39:18.984 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.985 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.985 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.985 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.985 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.985 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.985 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.985 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.985 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.985 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.985 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.985 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.985 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.985 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.985 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.985 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.985 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:18.986 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.986 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.986 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.986 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:18.986 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.986 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:18.986 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:18.986 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.986 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.986 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:18.986 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:18.986 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.986 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:18.986 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:18.987 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:18.987 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:18.987 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:18.987 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.987 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:18.987 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.987 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:18.987 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:18.987 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:18.987 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:18.987 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:18.987 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:18.987 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:18.987 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:18.988 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.988 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.988 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:18.988 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:18.988 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:18.988 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:18.988 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.988 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:18.988 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:18.988 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:18.988 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:18.988 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.988 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.988 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:18.988 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:18.988 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:18.989 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:18.989 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.989 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:18.989 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:18.989 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:18.989 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.989 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:18.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.989 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:18.989 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:18.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.989 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:18.989 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:18.990 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:18.990 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:18.990 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:18.990 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:18.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.990 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:18.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.990 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.990 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.990 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:18.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.990 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:18.990 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.991 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:18.991 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:18.991 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:18.991 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:18.991 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:18.991 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:18.991 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:18.991 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:18.991 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:18.991 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:18.991 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:18.991 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:18.991 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:18.992 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.992 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:18.992 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:18.992 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:18.992 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:18.992 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:18.992 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:18.992 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:18.992 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:18.992 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:18.992 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:18.992 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:18.992 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.992 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:18.993 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:18.993 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:18.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:18.993 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:18.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:18.993 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:18.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:18.993 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:18.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:18.993 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:18.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:18.993 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:18.993 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:18.993 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:18.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:18.994 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:18.994 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:18.994 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.994 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:18.994 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:18.994 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:18.994 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:18.994 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:18.994 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:18.994 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:18.994 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:18.994 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:18.994 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:18.994 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.995 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:18.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.995 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:18.995 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:18.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.995 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:18.995 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:18.995 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:18.995 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:18.995 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:18.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.995 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:18.995 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:18.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.996 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:18.996 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:18.996 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:18.996 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.996 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:18.996 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:18.996 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:18.996 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:18.996 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:18.996 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.996 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:18.996 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:18.997 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:18.997 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:18.997 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:18.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.997 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:18.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.997 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:18.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.997 INFO:teuthology.orchestra.run.smithi044.stdout: def test_versioning_obj_list_marker(): 2023-12-03T12:39:18.997 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:18.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:18.997 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7572: 2023-12-03T12:39:18.997 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:18.997 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:18.997 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:18.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:18.998 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:18.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:18.998 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:18.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:18.998 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:18.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:18.998 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:18.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:18.998 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:18.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:18.998 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:18.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:18.998 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:18.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:18.999 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:18.999 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:18.999 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:18.999 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:18.999 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:18.999 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:18.999 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:18.999 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:18.999 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:18.999 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:18.999 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:18.999 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:18.999 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:18.999 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:18.999 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.000 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.000 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.000 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.000 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.000 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.000 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.000 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.000 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.000 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.000 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.000 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.000 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.000 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.000 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.000 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.001 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.001 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.001 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.001 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.001 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.001 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.001 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.001 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.001 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.001 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.001 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.001 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.001 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.001 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.002 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.002 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.002 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.002 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.002 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.002 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.002 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.002 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.002 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.002 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.002 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.002 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.002 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.003 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.003 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.003 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.003 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.003 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.003 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.003 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.003 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.003 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.003 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.003 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.003 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.003 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.003 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-381" 2023-12-03T12:39:19.003 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.004 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.004 INFO:teuthology.orchestra.run.smithi044.stdout:_______________________ test_versioning_copy_obj_version _______________________ 2023-12-03T12:39:19.004 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.004 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.004 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.004 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.004 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.004 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.004 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.004 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.004 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.004 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.004 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.004 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.004 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.005 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.005 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.005 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.005 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.005 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.005 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.005 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.005 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.005 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.005 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.005 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.005 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.006 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.006 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.006 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.006 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.006 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.006 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.006 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.006 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.006 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.006 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.006 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.006 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.007 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.007 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.007 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.007 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.007 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.007 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.007 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.007 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.007 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.007 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.007 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.007 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.007 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.007 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.008 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.008 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.008 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.008 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.008 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.008 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.008 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.008 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.008 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.008 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.008 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.008 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.008 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.008 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.008 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.009 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.009 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.009 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.009 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.009 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.009 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.009 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.009 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.009 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.009 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.010 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.010 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.010 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.010 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.010 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.010 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.010 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.010 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.010 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.010 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.010 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.010 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.010 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.010 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.011 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.011 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.011 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.011 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.011 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.011 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.011 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.011 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.011 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.011 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.011 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.011 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.011 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.011 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.011 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout: def test_versioning_copy_obj_version(): 2023-12-03T12:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7628: 2023-12-03T12:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-382" 2023-12-03T12:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout:_____________________ test_versioning_multi_object_delete ______________________ 2023-12-03T12:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: def test_versioning_multi_object_delete(): 2023-12-03T12:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7665: 2023-12-03T12:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-383" 2023-12-03T12:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ test_versioning_multi_object_delete_with_marker ________________ 2023-12-03T12:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout: def test_versioning_multi_object_delete_with_marker(): 2023-12-03T12:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7690: 2023-12-03T12:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-384" 2023-12-03T12:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout:____________ test_versioning_multi_object_delete_with_marker_create ____________ 2023-12-03T12:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: def test_versioning_multi_object_delete_with_marker_create(): 2023-12-03T12:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7723: 2023-12-03T12:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-385" 2023-12-03T12:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout:__________________________ test_versioned_object_acl ___________________________ 2023-12-03T12:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.092 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.092 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.092 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.092 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.092 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.092 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.092 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.092 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.092 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.092 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.092 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.092 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.092 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.092 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.093 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.093 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.093 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.093 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.093 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.093 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.093 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.093 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.093 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.093 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.093 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.093 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.093 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.093 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.093 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.093 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout: def test_versioned_object_acl(): 2023-12-03T12:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7744: 2023-12-03T12:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-386" 2023-12-03T12:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout:________________ test_versioned_object_acl_no_version_specified ________________ 2023-12-03T12:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout: def test_versioned_object_acl_no_version_specified(): 2023-12-03T12:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7812: 2023-12-03T12:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.117 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.117 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.117 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.117 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.117 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.117 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.117 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.117 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.117 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.117 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.117 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.117 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.117 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.117 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.118 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.118 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.118 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.118 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.118 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.118 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.118 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.118 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.118 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.118 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.118 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.118 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.118 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.118 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.119 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.119 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.119 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.119 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.119 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.119 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.119 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.119 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.119 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.119 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.119 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.120 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.120 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.120 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.120 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.120 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.120 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.120 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.120 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.120 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-387" 2023-12-03T12:39:19.120 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.120 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.120 INFO:teuthology.orchestra.run.smithi044.stdout:______________ test_versioned_concurrent_object_create_and_remove ______________ 2023-12-03T12:39:19.120 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.120 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.121 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.121 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.121 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.121 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.121 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.121 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.121 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.121 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.121 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.121 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.121 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.122 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.122 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.122 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.122 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.122 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.122 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.122 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.122 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.122 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.122 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.122 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.122 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.122 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.123 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.123 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.123 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.123 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.123 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.123 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.123 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.123 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.123 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.123 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.123 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.123 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.123 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.123 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.124 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.124 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.124 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.124 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.124 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.124 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.124 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.124 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.124 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.124 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.124 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.124 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.124 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.124 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.125 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.125 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.125 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.125 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.125 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.125 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.125 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.125 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.125 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.125 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.125 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.125 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.125 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.125 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.126 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.126 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.126 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.126 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.126 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.126 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.126 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.126 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.126 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.126 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.126 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.126 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.126 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.126 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.127 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.127 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.127 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.127 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.127 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.127 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.127 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.127 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.127 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.127 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.127 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.127 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.127 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.128 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.128 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.128 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.128 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.128 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.128 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.128 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.128 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.128 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.128 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.128 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.128 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.128 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.129 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.129 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.129 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.129 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.129 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.129 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.129 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.129 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.129 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.129 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.129 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.129 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.129 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.129 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.130 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.130 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.130 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.130 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.130 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.130 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.130 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.130 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.130 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.130 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.131 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.131 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.131 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.131 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.131 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.131 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.131 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.131 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.131 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.131 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.131 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.131 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.132 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.132 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.132 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.132 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.132 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.132 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.132 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.132 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.132 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.132 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.132 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.132 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.132 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.132 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.133 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.133 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.133 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.133 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.133 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.133 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.133 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.133 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.133 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.133 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.133 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.133 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.133 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.133 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.133 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.134 INFO:teuthology.orchestra.run.smithi044.stdout: def test_versioned_concurrent_object_create_and_remove(): 2023-12-03T12:39:19.134 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.134 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.134 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7924: 2023-12-03T12:39:19.134 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.134 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.134 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.134 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.134 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.134 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.134 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.134 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.134 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.134 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.135 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.135 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.135 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.135 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.135 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.135 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.135 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.135 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.135 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.135 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.135 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.135 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.135 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.135 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.136 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.136 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.136 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.136 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.136 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.136 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.136 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.136 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.136 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.136 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.136 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.136 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.136 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.136 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.136 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.137 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.137 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.137 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.137 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.137 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.137 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.137 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.137 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.137 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.137 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.137 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.137 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.137 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.137 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.137 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.138 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.138 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.138 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.138 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.138 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.138 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.138 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.138 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.138 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.138 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.138 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.138 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.138 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.138 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.139 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.139 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.139 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.139 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.139 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.139 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.139 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.139 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.139 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.139 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.139 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.139 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.139 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.139 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.139 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.140 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.140 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.140 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.140 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.140 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.140 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-388" 2023-12-03T12:39:19.140 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.140 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.140 INFO:teuthology.orchestra.run.smithi044.stdout:______________________________ test_lifecycle_set ______________________________ 2023-12-03T12:39:19.140 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.140 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.140 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.140 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.140 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.141 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.141 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.141 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.141 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.141 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.141 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.141 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.141 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.141 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.141 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.141 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.142 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.142 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.142 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.142 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.142 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.142 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.142 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.142 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.142 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.142 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.142 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.142 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.142 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.142 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.143 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.143 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.143 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.143 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.143 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.143 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.143 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.143 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.143 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.143 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.143 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.143 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.143 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.143 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.143 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.144 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.144 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.144 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.144 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.144 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.144 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.144 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.144 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.144 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.144 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.144 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.144 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.145 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.145 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.145 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.145 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.145 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.145 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.145 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.145 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.145 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.145 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.145 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.145 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.146 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.146 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.146 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.146 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.146 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.146 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.146 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.146 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.146 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.146 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.146 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.146 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.146 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.147 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.147 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.147 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.147 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.147 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.147 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.147 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.147 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.147 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.147 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.147 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.147 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.147 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.147 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.147 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.148 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.148 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.148 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.148 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.148 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.148 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.148 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.148 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.148 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.148 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.148 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.148 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.148 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.148 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.148 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.148 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.149 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.149 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.149 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.149 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.149 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.149 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.149 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.149 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.149 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.149 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.149 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.149 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.149 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.149 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.150 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.150 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.150 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.150 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.150 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.150 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.150 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.150 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.150 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.150 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.150 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.150 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.152 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.153 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.153 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.153 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.153 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.153 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.153 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.153 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.lifecycle 2023-12-03T12:39:19.153 INFO:teuthology.orchestra.run.smithi044.stdout: def test_lifecycle_set(): 2023-12-03T12:39:19.153 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.153 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.153 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7953: 2023-12-03T12:39:19.153 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.153 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.153 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.154 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.154 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.154 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.154 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.154 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.154 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.154 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.154 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.154 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.154 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.154 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.154 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.154 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.154 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.155 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.155 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.155 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.155 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.155 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.155 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.155 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.155 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.156 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.156 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.156 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.156 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.156 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.158 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.158 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.158 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.158 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.158 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.158 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.158 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.158 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.158 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.158 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.158 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.158 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.158 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.158 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.159 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.159 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.159 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.159 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.159 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.159 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.159 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.159 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.159 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.159 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.159 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.159 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.160 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.160 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.160 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.160 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-389" 2023-12-03T12:39:19.160 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.160 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.160 INFO:teuthology.orchestra.run.smithi044.stdout:______________________________ test_lifecycle_get ______________________________ 2023-12-03T12:39:19.160 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.160 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.160 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.160 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.160 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.160 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.160 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.161 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.161 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.161 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.161 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.162 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.162 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.162 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.165 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.165 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.165 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.165 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.165 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.165 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.165 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.165 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.165 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.165 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.165 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.166 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.166 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.166 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.166 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.166 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.166 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.166 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.166 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.166 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.166 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.166 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.166 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.166 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.167 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.167 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.167 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.167 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.167 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.167 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.167 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.167 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.167 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.167 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.167 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.167 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.167 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.167 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.167 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.168 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.168 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.168 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.168 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.168 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.168 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.168 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.168 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.168 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.168 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.168 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.168 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.168 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.168 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.169 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.169 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.169 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.169 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.169 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.169 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.169 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.169 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.169 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.169 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.169 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.169 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.169 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.169 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.170 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.170 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.170 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.170 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.170 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.170 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.170 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.170 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.170 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.170 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.170 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.171 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.171 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.171 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.171 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.171 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.171 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.171 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.171 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.171 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.171 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.171 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.171 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.171 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.171 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.171 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.172 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.172 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.172 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.172 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.172 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.172 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.172 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.172 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.172 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.172 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.172 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.172 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.172 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.172 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.173 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.173 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.173 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.lifecycle 2023-12-03T12:39:19.173 INFO:teuthology.orchestra.run.smithi044.stdout: def test_lifecycle_get(): 2023-12-03T12:39:19.173 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.173 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.173 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7963: 2023-12-03T12:39:19.173 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.173 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.173 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.173 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.173 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.174 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.174 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.174 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.174 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.174 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.174 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.174 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.174 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.175 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.175 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.175 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.175 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.175 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.175 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.175 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.175 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.176 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.176 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.176 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.176 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.176 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.176 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.176 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.176 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.176 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.176 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.176 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.176 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.176 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.177 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.177 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.177 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.177 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.177 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.177 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.177 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.177 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.177 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.177 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.177 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.177 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.177 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.177 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.178 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.178 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.178 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.178 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.178 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.178 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.178 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.178 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.178 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.178 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.178 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.178 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.178 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.179 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.179 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.179 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.179 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.179 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.179 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.179 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-390" 2023-12-03T12:39:19.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.179 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.179 INFO:teuthology.orchestra.run.smithi044.stdout:___________________________ test_lifecycle_get_no_id ___________________________ 2023-12-03T12:39:19.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.179 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.180 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.180 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.180 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.180 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.180 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.180 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.180 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.180 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.180 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.181 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.181 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.181 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.181 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.181 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.181 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.181 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.181 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.181 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.181 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.181 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.181 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.181 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.185 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.185 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.185 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.185 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.185 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.185 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.185 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.185 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.185 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.185 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.185 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.187 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.188 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.188 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.188 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.188 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.188 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.188 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.188 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.188 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.188 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.189 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.189 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.189 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.189 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.189 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.189 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.189 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.189 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.189 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.189 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.189 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.189 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.189 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.189 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.190 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.190 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.192 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.192 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.192 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.192 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.192 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.192 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.192 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.192 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.192 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.192 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.lifecycle 2023-12-03T12:39:19.192 INFO:teuthology.orchestra.run.smithi044.stdout: def test_lifecycle_get_no_id(): 2023-12-03T12:39:19.192 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.192 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.192 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:7974: 2023-12-03T12:39:19.192 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.193 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.193 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.193 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.193 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.193 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.193 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.193 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.193 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.194 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.194 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.194 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.194 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.194 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.194 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.195 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.195 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.195 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.195 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.195 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.195 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.195 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.195 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.195 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.195 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.195 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.195 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.195 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.195 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.196 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.196 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.196 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.196 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.196 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.196 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.196 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.196 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.196 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.196 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.196 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.196 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.196 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.196 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.196 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.197 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.197 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.197 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.197 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.197 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.197 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.197 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.197 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.197 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.197 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.197 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.197 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.198 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.198 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.198 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.198 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.198 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.198 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.198 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.198 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.198 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.198 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.198 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.198 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.199 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.199 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.199 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.199 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.199 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.199 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-391" 2023-12-03T12:39:19.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.199 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.199 INFO:teuthology.orchestra.run.smithi044.stdout:__________________________ test_lifecycle_id_too_long __________________________ 2023-12-03T12:39:19.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.199 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.199 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.199 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.200 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.200 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.200 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.200 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.200 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.200 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.200 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.200 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.200 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.200 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.200 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.201 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.201 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.201 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.201 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.201 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.201 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.201 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.201 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.201 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.201 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.201 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.201 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.201 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.201 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.201 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.202 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.202 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.202 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.202 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.202 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.202 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.202 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.202 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.202 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.202 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.202 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.202 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.202 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.203 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.203 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.203 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.203 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.203 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.203 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.205 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.205 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.205 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.205 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.205 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.205 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.205 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.205 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.205 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.205 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.205 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.205 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.206 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.206 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.206 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.206 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.206 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.206 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.206 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.206 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.206 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.206 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.206 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.206 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.206 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.206 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.207 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.207 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.207 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.207 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.207 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.207 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.207 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.207 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.207 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.207 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.207 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.207 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.207 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.207 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.208 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.208 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.208 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.208 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.208 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.208 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.208 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.208 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.208 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.208 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.208 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.208 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.208 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.208 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.209 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.209 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.209 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.209 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.209 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.209 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.209 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.209 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.209 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.209 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.209 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.209 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.209 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.209 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.210 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.210 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.210 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.210 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.210 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.210 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.210 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.210 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.210 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.210 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.210 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.210 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.210 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.211 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.211 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.211 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.211 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.211 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.211 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.211 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.211 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.211 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.211 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.211 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.211 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.211 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.212 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.212 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.212 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.212 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.212 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.212 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.212 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.212 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.212 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.212 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.212 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.212 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.212 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.212 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.213 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.213 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.213 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.213 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.213 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.213 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.213 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.213 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.213 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.213 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.213 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.213 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.213 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.213 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.213 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.214 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.214 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.214 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.214 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.lifecycle 2023-12-03T12:39:19.214 INFO:teuthology.orchestra.run.smithi044.stdout: def test_lifecycle_id_too_long(): 2023-12-03T12:39:19.214 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.214 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.214 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:8322: 2023-12-03T12:39:19.214 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.214 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.214 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.214 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.215 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.215 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.215 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.215 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.215 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.215 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.215 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.215 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.216 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.216 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.216 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.216 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.216 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.216 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.216 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.216 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.216 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.216 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.216 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.216 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.216 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.216 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.217 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.217 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.217 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.217 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.217 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.217 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.217 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.217 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.217 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.217 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.217 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.217 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.217 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.217 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.217 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.218 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.218 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.218 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.218 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.218 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.218 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.218 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.218 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.218 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.218 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.218 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.218 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.218 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.218 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.218 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.219 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.219 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.219 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.219 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.219 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.219 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.219 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.219 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.219 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.219 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.219 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.220 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.220 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.220 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.220 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.220 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.220 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.220 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.220 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.220 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.220 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.220 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.220 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.220 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.220 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.221 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-392" 2023-12-03T12:39:19.221 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.221 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.221 INFO:teuthology.orchestra.run.smithi044.stdout:____________________________ test_lifecycle_same_id ____________________________ 2023-12-03T12:39:19.221 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.221 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.221 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.221 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.221 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.221 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.221 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.221 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.221 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.221 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.221 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.221 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.222 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.222 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.222 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.222 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.222 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.222 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.222 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.222 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.222 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.222 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.222 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.222 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.223 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.223 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.223 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.223 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.223 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.223 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.223 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.223 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.223 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.223 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.223 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.223 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.223 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.223 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.223 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.224 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.224 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.224 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.224 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.224 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.224 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.224 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.224 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.224 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.224 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.224 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.224 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.224 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.224 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.224 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.224 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.225 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.225 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.225 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.225 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.225 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.225 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.225 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.225 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.225 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.225 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.225 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.225 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.225 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.225 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.226 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.226 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.226 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.226 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.226 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.226 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.226 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.226 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.226 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.226 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.226 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.226 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.226 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.226 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.227 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.227 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.227 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.227 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.227 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.227 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.227 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.227 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.227 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.227 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.227 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.227 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.227 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.227 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.228 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.228 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.228 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.228 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.228 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.228 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.228 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.228 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.228 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.228 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.228 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.228 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.228 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.228 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.228 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.229 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.229 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.229 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.229 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.229 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.229 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.229 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.229 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.229 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.229 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.229 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.229 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.229 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.230 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.230 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.230 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.230 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.230 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.230 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.230 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.230 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.230 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.230 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.230 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.230 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.230 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.230 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.230 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.231 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.231 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.231 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.231 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.231 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.231 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.231 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.231 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.231 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.231 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.232 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.232 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.232 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.232 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.232 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.232 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.232 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.232 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.232 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.232 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.232 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.232 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.233 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.233 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.233 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.233 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.233 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.233 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.233 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.233 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.233 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.233 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.233 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.233 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.233 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.233 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.233 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.234 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.234 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.234 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.234 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.lifecycle 2023-12-03T12:39:19.234 INFO:teuthology.orchestra.run.smithi044.stdout: def test_lifecycle_same_id(): 2023-12-03T12:39:19.234 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.234 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.234 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:8334: 2023-12-03T12:39:19.234 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.234 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.234 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.234 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.234 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.234 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.234 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.235 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.235 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.235 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.235 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.235 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.235 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.235 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.235 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.235 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.235 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.235 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.235 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.235 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.235 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.235 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.235 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.236 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.236 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.236 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.236 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.236 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.236 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.236 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.236 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.236 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.236 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.236 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.236 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.236 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.236 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.237 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.237 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.237 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.237 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.237 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.237 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.237 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.237 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.237 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.237 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.237 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.237 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.237 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.237 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.237 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.237 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.266 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T12:39:19.267 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.267 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.267 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.267 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.267 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.267 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.267 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.267 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.267 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.267 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.267 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.267 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.268 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.268 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.268 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.268 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.268 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.268 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.268 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.268 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.268 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.268 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.268 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.268 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.268 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.268 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.269 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.269 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.269 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.269 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.269 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.269 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.269 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.269 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.269 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.269 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-393" 2023-12-03T12:39:19.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.269 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.270 INFO:teuthology.orchestra.run.smithi044.stdout:________________________ test_lifecycle_invalid_status _________________________ 2023-12-03T12:39:19.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.270 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.270 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.270 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.270 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.270 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.270 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.270 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.271 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.271 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.271 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.271 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.271 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.271 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.271 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.271 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.271 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.271 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.272 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.272 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.272 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.272 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.272 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.272 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.273 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.273 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.273 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.273 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.273 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.273 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.273 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.273 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.273 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.273 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.273 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.273 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.274 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.274 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.274 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.274 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.274 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.274 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.274 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.274 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.274 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.275 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.275 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.275 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.275 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.275 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.275 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.275 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.275 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.275 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.275 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.275 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.275 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.275 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.276 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.276 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.276 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.276 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.276 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.276 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.276 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.276 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.276 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.276 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.276 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.276 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.277 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.277 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.277 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.277 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.277 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.277 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.277 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.277 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.277 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.277 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.277 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.277 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.277 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.277 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.277 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.278 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.278 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.278 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.278 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.278 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.278 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.278 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.278 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.278 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.278 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.278 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.278 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.278 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.278 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.279 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.279 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.279 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.279 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.279 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.279 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.279 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.279 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.279 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.279 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.279 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.279 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.279 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.279 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.280 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.280 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.280 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.280 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.280 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.280 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.280 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.280 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.280 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.280 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.280 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.281 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.281 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.281 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.281 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.281 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.281 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.281 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.281 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.281 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.281 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.282 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.282 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.282 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.282 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.282 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.282 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.282 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.282 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.282 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.282 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.282 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.282 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.283 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.283 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.283 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.283 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.283 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.283 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.283 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.283 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.283 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.283 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.283 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.283 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.283 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.283 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.284 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.284 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.284 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.284 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.284 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.284 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.284 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.284 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.lifecycle 2023-12-03T12:39:19.284 INFO:teuthology.orchestra.run.smithi044.stdout: def test_lifecycle_invalid_status(): 2023-12-03T12:39:19.284 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.285 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:8347: 2023-12-03T12:39:19.285 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.285 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.285 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.285 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.285 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.285 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.285 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.285 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.286 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.286 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.286 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.286 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.286 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.286 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.286 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.287 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.287 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.287 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.287 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.287 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.287 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.287 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.287 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.287 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.287 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.287 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.287 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.287 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.287 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.287 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.288 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.288 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.288 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.288 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.288 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.288 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.288 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.288 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.288 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.288 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.288 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.288 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.288 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.288 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.288 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.288 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.289 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.289 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.289 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.289 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.289 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.289 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.289 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.289 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.289 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.289 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.289 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.289 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.289 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.289 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.289 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.290 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.290 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.290 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.290 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.290 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.290 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.290 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.290 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.290 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.290 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.290 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.290 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.290 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.291 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.291 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.291 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.291 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-394" 2023-12-03T12:39:19.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.291 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.291 INFO:teuthology.orchestra.run.smithi044.stdout:___________________________ test_lifecycle_set_date ____________________________ 2023-12-03T12:39:19.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.291 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.291 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.291 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.291 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.292 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.292 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.292 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.292 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.292 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.292 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.292 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.292 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.292 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.292 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.292 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.292 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.292 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.292 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.292 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.293 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.293 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.293 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.293 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.293 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.293 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.293 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.293 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.293 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.293 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.293 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.293 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.293 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.294 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.294 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.294 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.294 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.294 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.294 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.294 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.294 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.294 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.294 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.294 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.294 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.294 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.295 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.295 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.295 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.295 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.295 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.295 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.295 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.295 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.295 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.295 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.295 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.295 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.296 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.296 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.296 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.296 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.296 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.296 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.296 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.296 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.296 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.296 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.296 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.297 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.297 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.297 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.297 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.297 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.297 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.297 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.297 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.297 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.297 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.297 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.297 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.298 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.298 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.298 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.298 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.298 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.298 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.298 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.298 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.298 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.298 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.298 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.298 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.298 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.298 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.299 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.299 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.299 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.299 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.299 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.299 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.299 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.299 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.299 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.299 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.299 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.299 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.299 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.299 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.300 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.300 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.300 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.300 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.300 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.300 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.300 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.300 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.300 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.300 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.300 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.300 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.300 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.300 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.300 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.301 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.301 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.301 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.301 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.301 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.301 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.301 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.301 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.301 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.301 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.301 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.301 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.301 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.301 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.301 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.302 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.302 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.302 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.302 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.302 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.302 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.302 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.302 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.302 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.303 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.303 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.303 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.303 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.303 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.303 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.303 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.303 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.303 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.303 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.303 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.303 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.304 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.304 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.304 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.304 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.304 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.304 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.304 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.304 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.lifecycle 2023-12-03T12:39:19.304 INFO:teuthology.orchestra.run.smithi044.stdout: def test_lifecycle_set_date(): 2023-12-03T12:39:19.304 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.305 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:8375: 2023-12-03T12:39:19.305 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.305 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.305 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.305 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.305 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.305 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.305 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.305 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.305 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.306 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.306 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.306 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.306 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.306 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.306 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.306 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.306 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.306 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.306 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.307 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.307 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.307 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.307 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.307 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.307 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.307 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.307 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.307 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.307 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.307 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.307 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.307 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.307 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.308 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.308 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.308 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.308 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.308 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.308 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.308 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.308 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.308 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.308 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.308 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.308 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.308 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.308 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.309 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.309 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.309 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.309 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.309 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.309 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.309 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.309 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.309 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.309 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.309 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.309 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.309 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.309 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.310 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.310 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.310 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.310 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.310 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.310 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.310 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.310 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.310 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.310 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.310 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.310 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.311 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.311 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.311 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.311 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.311 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.311 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.311 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-395" 2023-12-03T12:39:19.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.311 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.311 INFO:teuthology.orchestra.run.smithi044.stdout:_______________________ test_lifecycle_set_invalid_date ________________________ 2023-12-03T12:39:19.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.311 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.312 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.312 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.312 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.312 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.312 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.312 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.312 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.312 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.312 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.312 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.312 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.312 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.312 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.312 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.312 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.312 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.313 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.313 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.313 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.313 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.313 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.313 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.313 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.313 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.313 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.313 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.313 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.313 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.314 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.314 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.314 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.314 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.314 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.314 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.314 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.314 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.314 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.314 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.314 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.314 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.314 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.315 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.315 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.315 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.315 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.315 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.315 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.315 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.315 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.315 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.315 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.315 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.315 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.316 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.316 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.316 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.316 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.316 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.316 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.316 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.316 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.316 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.316 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.316 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.316 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.317 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.317 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.317 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.317 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.317 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.317 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.317 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.317 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.317 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.317 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.318 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.318 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.318 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.318 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.318 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.318 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.318 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.318 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.318 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.318 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.318 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.318 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.319 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.319 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.319 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.319 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.319 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.319 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.319 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.319 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.319 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.319 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.319 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.319 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.319 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.319 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.320 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.320 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.320 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.320 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.320 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.320 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.321 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.321 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.321 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.321 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.321 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.321 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.321 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.321 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.321 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.321 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.321 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.321 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.321 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.322 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.322 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.322 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.322 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.322 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.322 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.322 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.322 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.322 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.323 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.323 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.323 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.323 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.323 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.323 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.323 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.323 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.323 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.323 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.323 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.323 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.323 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.324 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.324 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.324 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.324 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.324 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.324 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.324 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.324 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.324 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.324 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.324 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.324 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.324 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.324 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.325 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.lifecycle 2023-12-03T12:39:19.325 INFO:teuthology.orchestra.run.smithi044.stdout: def test_lifecycle_set_invalid_date(): 2023-12-03T12:39:19.325 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.325 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.325 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:8385: 2023-12-03T12:39:19.325 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.325 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.325 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.325 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.325 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.325 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.325 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.325 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.325 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.325 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.326 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.326 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.326 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.326 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.326 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.326 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.326 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.327 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.327 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.327 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.327 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.327 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.327 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.327 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.327 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.327 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.327 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.327 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.327 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.327 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.327 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.327 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.328 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.328 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.328 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.328 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.328 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.328 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.328 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.328 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.328 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.328 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.328 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.328 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.328 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.329 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.329 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.329 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.329 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.329 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.329 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.329 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.329 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.329 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.329 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.329 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.329 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.329 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.329 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.330 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.330 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.330 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.330 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.330 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.330 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.330 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.330 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.330 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.331 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.331 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.331 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.331 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.331 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.331 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.331 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.331 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.331 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.331 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-396" 2023-12-03T12:39:19.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.331 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.331 INFO:teuthology.orchestra.run.smithi044.stdout:________________________ test_lifecycle_set_noncurrent _________________________ 2023-12-03T12:39:19.332 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.332 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.332 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.332 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.332 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.332 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.332 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.332 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.332 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.332 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.332 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.332 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.332 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.332 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.332 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.333 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.333 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.333 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.333 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.333 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.333 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.333 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.333 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.333 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.333 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.333 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.333 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.334 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.334 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.334 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.334 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.334 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.334 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.334 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.334 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.334 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.334 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.334 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.334 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.334 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.334 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.334 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.335 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.335 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.335 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.335 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.335 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.335 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.335 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.335 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.335 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.335 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.335 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.335 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.335 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.335 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.335 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.336 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.336 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.336 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.336 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.336 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.336 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.336 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.336 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.336 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.336 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.336 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.336 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.337 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.337 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.337 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.337 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.337 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.337 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.337 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.337 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.337 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.337 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.337 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.337 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.337 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.337 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.338 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.338 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.338 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.338 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.338 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.338 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.338 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.338 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.338 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.338 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.338 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.338 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.338 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.338 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.338 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.339 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.339 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.339 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.339 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.339 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.339 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.339 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.339 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.339 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.339 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.339 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.339 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.339 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.339 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.339 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.340 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.340 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.340 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.340 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.340 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.340 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.340 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.341 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.341 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.341 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.341 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.341 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.341 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.341 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.341 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.341 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.341 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.341 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.341 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.341 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.341 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.342 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.342 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.342 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.342 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.342 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.342 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.342 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.342 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.342 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.342 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.342 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.342 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.342 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.343 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.343 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.343 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.343 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.343 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.343 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.343 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.343 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.343 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.343 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.343 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.343 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.343 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.344 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.344 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.344 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.344 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.344 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.344 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.344 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.344 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.344 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.344 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.345 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.lifecycle 2023-12-03T12:39:19.345 INFO:teuthology.orchestra.run.smithi044.stdout: def test_lifecycle_set_noncurrent(): 2023-12-03T12:39:19.345 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = _create_objects(keys=['past/foo', 'future/bar']) 2023-12-03T12:39:19.345 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.345 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:8602: 2023-12-03T12:39:19.345 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.345 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-12-03T12:39:19.345 INFO:teuthology.orchestra.run.smithi044.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-12-03T12:39:19.345 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-12-03T12:39:19.345 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_location = bucket.create() 2023-12-03T12:39:19.345 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-12-03T12:39:19.345 INFO:teuthology.orchestra.run.smithi044.stdout: response = action(self, *args, **kwargs) 2023-12-03T12:39:19.345 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-12-03T12:39:19.345 INFO:teuthology.orchestra.run.smithi044.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-12-03T12:39:19.345 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.346 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.346 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.346 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.346 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.346 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.346 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.346 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.346 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.346 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.346 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.346 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.346 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.346 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.346 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.347 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.347 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.347 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.347 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.347 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.347 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.347 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.347 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.347 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.347 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.347 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.347 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.347 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.347 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.348 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.348 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.348 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.348 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.348 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.348 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.348 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.348 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.348 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.348 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.348 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.348 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.348 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.349 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.349 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.349 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.349 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.349 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.349 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.349 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.349 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.349 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.349 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.349 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.349 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.349 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.349 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.349 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.350 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.350 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.350 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.350 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.350 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.350 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.350 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.350 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.350 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.350 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.350 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.350 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.350 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.351 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.351 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.351 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.351 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.351 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.351 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.351 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.351 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.351 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.351 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.352 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.352 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-397" 2023-12-03T12:39:19.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.352 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.352 INFO:teuthology.orchestra.run.smithi044.stdout:_______________________ test_lifecycle_set_deletemarker ________________________ 2023-12-03T12:39:19.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.352 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.352 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.352 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.352 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.352 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.352 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.352 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.353 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.353 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.353 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.353 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.353 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.353 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.353 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.353 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.353 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.353 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.353 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.353 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.354 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.354 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.354 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.354 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.354 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.354 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.354 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.354 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.354 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.354 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.354 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.354 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.354 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.354 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.355 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.355 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.355 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.355 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.355 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.355 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.355 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.355 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.355 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.355 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.355 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.355 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.356 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.356 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.356 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.356 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.356 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.356 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.356 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.356 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.356 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.356 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.356 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.356 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.356 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.356 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.357 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.357 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.357 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.357 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.357 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.357 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.357 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.357 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.357 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.357 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.357 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.357 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.358 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.358 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.358 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.358 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.358 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.358 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.358 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.358 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.359 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.359 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.359 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.359 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.359 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.359 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.359 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.359 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.359 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.359 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.359 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.359 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.359 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.359 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.360 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.360 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.360 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.360 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.360 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.360 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.360 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.360 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.360 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.360 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.360 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.360 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.360 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.361 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.361 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.361 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.361 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.361 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.361 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.361 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.361 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.362 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.362 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.362 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.362 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.362 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.362 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.362 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.362 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.362 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.362 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.362 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.363 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.363 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.363 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.363 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.363 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.363 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.363 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.363 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.363 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.363 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.363 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.363 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.363 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.363 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.364 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.364 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.364 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.364 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.364 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.364 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.364 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.364 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.364 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.364 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.364 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.364 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.364 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.364 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.365 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.365 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.365 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.365 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.365 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.365 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.lifecycle 2023-12-03T12:39:19.365 INFO:teuthology.orchestra.run.smithi044.stdout: def test_lifecycle_set_deletemarker(): 2023-12-03T12:39:19.365 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.365 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:8641: 2023-12-03T12:39:19.365 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.365 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.365 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.366 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.366 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.366 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.366 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.366 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.366 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.366 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.366 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.366 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.366 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.366 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.366 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.366 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.366 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.367 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.367 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.367 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.367 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.367 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.367 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.367 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.367 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.367 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.367 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.367 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.367 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.368 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.368 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.368 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.368 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.368 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.368 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.368 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.368 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.368 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.368 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.368 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.369 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.369 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.369 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.369 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.369 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.369 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.369 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.369 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.369 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.369 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.369 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.369 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.369 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.370 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.370 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.370 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.370 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.370 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.370 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.370 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.370 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.370 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.370 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.370 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.370 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.370 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.372 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.372 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.372 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.372 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-398" 2023-12-03T12:39:19.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.372 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.372 INFO:teuthology.orchestra.run.smithi044.stdout:__________________________ test_lifecycle_set_filter ___________________________ 2023-12-03T12:39:19.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.372 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.372 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.372 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.372 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.373 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.373 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.373 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.374 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.374 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.374 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.374 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.377 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.377 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.377 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.377 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.377 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.377 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.377 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.377 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.377 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.377 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.377 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.377 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.377 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.377 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.377 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.378 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.378 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.378 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.378 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.378 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.378 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.378 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.378 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.378 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.378 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.378 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.378 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.378 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.378 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.379 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.380 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.380 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.380 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.381 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.381 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.381 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.381 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.381 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.381 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.381 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.381 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.382 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.382 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.382 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.382 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.382 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.382 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.382 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.382 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.382 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.382 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.382 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.382 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.383 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.383 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.385 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.385 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.385 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.385 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.385 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.385 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.385 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.385 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.lifecycle 2023-12-03T12:39:19.385 INFO:teuthology.orchestra.run.smithi044.stdout: def test_lifecycle_set_filter(): 2023-12-03T12:39:19.385 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.386 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:8650: 2023-12-03T12:39:19.386 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.386 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.386 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.386 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.386 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.386 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.386 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.386 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.386 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.386 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.386 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.386 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.386 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.386 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.387 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.387 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.387 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.387 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.387 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.387 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.387 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.387 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.387 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.387 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.387 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.387 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.387 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.387 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.387 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.388 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.388 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.388 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.388 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.388 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.388 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.388 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.388 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.388 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.388 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.388 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.388 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.388 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.388 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.388 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.389 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.389 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.389 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.389 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.389 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.389 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.389 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.389 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.389 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.389 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.389 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.389 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.389 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.389 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.389 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.390 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.390 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.390 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.390 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.390 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.390 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.390 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.390 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.390 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.390 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.390 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.390 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.390 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.390 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.391 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.391 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.391 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.391 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.391 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.391 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.391 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.391 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.391 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.391 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.391 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.392 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.392 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.392 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.392 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-399" 2023-12-03T12:39:19.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.392 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.392 INFO:teuthology.orchestra.run.smithi044.stdout:_______________________ test_lifecycle_set_empty_filter ________________________ 2023-12-03T12:39:19.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.392 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.392 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.392 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.392 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.392 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.393 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.393 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.393 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.393 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.393 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.393 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.393 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.393 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.393 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.393 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.394 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.394 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.394 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.394 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.394 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.394 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.394 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.394 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.394 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.394 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.394 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.394 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.394 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.394 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.394 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.395 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.395 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.395 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.395 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.395 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.395 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.395 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.395 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.395 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.395 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.395 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.395 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.395 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.395 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.396 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.396 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.396 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.396 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.396 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.396 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.396 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.396 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.396 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.396 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.396 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.396 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.396 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.396 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.397 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.397 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.397 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.397 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.397 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.397 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.397 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.397 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.397 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.397 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.397 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.397 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.397 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.397 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.397 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.398 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.398 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.398 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.398 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.398 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.398 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.398 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.398 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.398 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.398 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.398 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.398 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.399 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.399 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.399 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.399 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.399 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.399 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.399 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.399 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.399 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.399 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.399 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.399 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.399 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.399 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.400 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.400 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.400 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.400 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.400 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.400 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.400 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.400 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.400 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.400 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.400 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.400 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.400 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.400 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.400 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.401 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.401 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.401 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.401 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.401 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.401 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.401 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.401 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.401 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.401 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.401 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.401 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.401 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.401 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.401 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.402 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.402 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.402 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.402 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.402 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.402 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.402 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.402 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.402 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.402 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.402 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.402 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.402 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.403 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.403 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.403 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.403 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.403 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.403 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.403 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.403 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.403 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.403 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.403 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.403 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.403 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.403 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.403 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.404 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.404 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.404 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.404 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.404 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.404 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.404 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.404 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.404 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.404 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.404 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.404 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.405 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.405 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.405 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.405 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.405 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.405 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.405 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.lifecycle 2023-12-03T12:39:19.405 INFO:teuthology.orchestra.run.smithi044.stdout: def test_lifecycle_set_empty_filter(): 2023-12-03T12:39:19.405 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.405 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:8659: 2023-12-03T12:39:19.406 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.406 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.406 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.406 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.406 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.406 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.406 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.406 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.406 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.406 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.406 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.406 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.406 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.406 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.407 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.407 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.407 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.407 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.407 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.407 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.407 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.407 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.407 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.407 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.407 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.407 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.407 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.407 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.409 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.409 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.409 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.409 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.409 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.409 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.409 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.410 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.410 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.410 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.410 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.410 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.410 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.410 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.410 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.410 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.410 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.410 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.410 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.410 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.410 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.411 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.411 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.411 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.411 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.411 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.411 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.411 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.411 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.411 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.411 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.411 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.411 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.411 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.412 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.412 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.412 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.412 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.412 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.412 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.412 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.412 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.412 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.412 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.412 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.412 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.412 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.412 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.412 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.413 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.413 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.413 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.413 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.413 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.413 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.413 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.413 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.413 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.413 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.413 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-400" 2023-12-03T12:39:19.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.413 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.414 INFO:teuthology.orchestra.run.smithi044.stdout:_________________________ test_lifecycle_set_multipart _________________________ 2023-12-03T12:39:19.414 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.414 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.414 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.414 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.414 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.414 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.414 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.414 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.414 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.414 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.414 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.414 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.414 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.415 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.415 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.415 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.415 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.415 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.415 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.415 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.415 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.415 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.415 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.415 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.415 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.415 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.415 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.415 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.416 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.416 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.416 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.416 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.416 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.416 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.416 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.416 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.416 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.416 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.416 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.416 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.416 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.416 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.416 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.417 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.417 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.417 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.417 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.417 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.417 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.417 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.417 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.417 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.417 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.417 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.417 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.418 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.418 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.418 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.418 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.418 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.418 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.418 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.418 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.418 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.418 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.418 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.418 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.419 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.419 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.419 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.419 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.419 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.419 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.419 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.419 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.419 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.419 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.419 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.419 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.419 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.419 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.420 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.420 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.420 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.420 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.420 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.420 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.420 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.420 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.420 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.420 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.420 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.420 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.420 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.420 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.420 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.421 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.421 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.421 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.421 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.421 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.421 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.421 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.421 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.421 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.421 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.421 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.421 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.422 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.422 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.422 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.422 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.422 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.422 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.422 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.422 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.422 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.422 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.422 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.422 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.422 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.423 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.423 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.423 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.423 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.423 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.423 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.423 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.423 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.423 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.423 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.423 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.423 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.423 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.424 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.424 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.424 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.424 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.424 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.424 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.424 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.424 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.424 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.424 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.424 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.424 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.424 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.425 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.425 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.425 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.425 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.425 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.425 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.425 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.425 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.425 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.425 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.425 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.425 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.426 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.426 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.426 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.426 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.426 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.426 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.426 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.426 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.426 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.426 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.426 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.426 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.426 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.426 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.427 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.427 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.427 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.427 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.427 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.lifecycle 2023-12-03T12:39:19.427 INFO:teuthology.orchestra.run.smithi044.stdout: def test_lifecycle_set_multipart(): 2023-12-03T12:39:19.427 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.427 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.427 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:8703: 2023-12-03T12:39:19.427 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.427 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.427 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.427 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.427 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.427 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.428 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.428 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.428 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.428 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.428 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.428 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.428 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.428 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.428 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.428 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.428 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.428 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.428 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.428 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.429 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.429 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.429 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.429 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.429 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.429 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.429 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.429 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.429 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.429 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.429 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.429 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.429 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.430 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.430 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.430 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.430 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.430 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.430 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.430 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.430 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.430 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.430 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.430 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.430 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.430 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.431 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.431 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.431 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.431 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.431 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.431 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.431 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.431 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.431 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.431 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.431 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.431 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.431 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.431 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.432 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.432 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.432 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.432 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.432 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.432 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.432 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.432 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.432 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.432 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.432 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.432 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.432 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.432 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.432 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.433 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.433 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.433 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.433 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.433 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.433 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.433 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.433 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.433 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.433 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.433 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.433 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.434 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.434 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.434 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-401" 2023-12-03T12:39:19.434 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.434 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.434 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ test_lifecycle_transition_set_invalid_date __________________ 2023-12-03T12:39:19.434 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.434 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.434 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.434 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.434 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.434 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.434 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.434 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.434 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.435 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.435 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.435 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.435 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.435 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.435 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.435 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.435 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.435 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.435 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.435 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.436 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.436 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.436 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.436 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.436 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.436 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.436 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.436 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.436 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.436 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.436 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.436 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.436 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.436 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.437 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.437 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.437 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.437 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.437 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.437 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.437 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.437 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.437 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.437 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.437 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.437 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.437 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.437 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.437 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.438 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.438 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.438 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.438 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.438 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.438 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.438 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.438 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.438 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.438 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.438 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.438 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.438 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.438 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.438 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.439 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.439 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.439 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.439 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.439 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.439 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.439 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.439 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.439 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.439 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.439 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.439 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.439 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.439 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.440 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.440 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.440 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.440 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.440 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.440 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.440 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.440 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.440 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.440 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.440 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.440 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.440 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.440 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.440 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.441 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.441 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.441 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.441 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.441 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.441 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.441 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.441 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.441 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.441 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.441 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.441 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.441 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.442 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.442 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.442 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.442 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.442 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.442 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.442 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.442 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.442 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.442 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.442 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.442 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.443 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.443 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.443 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.443 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.443 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.443 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.443 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.443 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.443 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.443 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.443 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.443 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.443 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.443 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.444 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.444 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.444 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.444 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.444 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.444 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.444 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.444 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.444 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.444 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.444 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.444 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.444 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.445 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.445 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.445 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.445 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.445 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.445 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.445 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.445 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.445 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.445 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.445 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.445 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.446 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.446 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.446 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.446 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.446 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.446 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.446 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.446 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.446 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.446 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.446 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.446 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.446 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.446 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.447 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.447 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.447 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.lifecycle 2023-12-03T12:39:19.447 INFO:teuthology.orchestra.run.smithi044.stdout: def test_lifecycle_transition_set_invalid_date(): 2023-12-03T12:39:19.447 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.447 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:8752: 2023-12-03T12:39:19.447 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.447 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.447 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.447 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.447 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.448 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.448 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.448 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.448 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.448 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.448 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.448 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.449 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.449 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.449 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.449 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.449 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.449 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.449 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.449 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.449 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.449 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.449 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.449 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.449 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.449 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.450 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.450 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.450 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.450 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.450 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.450 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.450 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.450 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.450 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.450 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.450 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.450 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.450 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.450 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.451 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.451 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.451 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.451 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.451 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.451 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.451 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.451 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.451 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.451 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.451 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.451 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.451 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.451 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.452 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.452 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.452 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.452 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.452 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.452 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.452 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.452 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.452 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.452 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.452 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.452 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.452 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.452 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.453 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.453 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.453 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.453 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.453 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.453 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.453 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.453 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.453 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.453 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.453 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.453 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-402" 2023-12-03T12:39:19.454 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.454 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.454 INFO:teuthology.orchestra.run.smithi044.stdout:__________________________ test_encrypted_transfer_1b __________________________ 2023-12-03T12:39:19.454 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.454 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.454 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.454 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.454 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.454 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.454 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.454 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.454 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.455 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.455 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.455 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.455 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.455 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.455 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.455 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.455 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.455 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.455 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.455 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.455 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.456 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.456 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.456 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.456 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.456 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.456 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.456 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.456 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.456 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.456 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.456 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.456 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.456 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.456 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.457 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.457 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.457 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.457 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.457 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.457 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.457 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.457 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.457 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.457 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.457 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.457 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.457 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.457 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.458 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.458 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.458 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.458 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.458 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.458 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.458 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.458 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.458 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.458 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.459 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.459 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.459 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.459 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.459 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.459 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.459 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.459 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.459 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.459 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.459 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.459 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.459 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.459 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.459 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.460 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.460 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.460 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.460 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.460 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.460 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.460 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.460 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.460 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.460 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.460 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.460 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.460 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.461 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.461 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.461 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.461 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.461 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.461 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.461 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.461 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.461 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.461 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.461 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.461 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.461 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.461 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.462 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.462 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.462 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.462 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.462 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.462 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.462 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.462 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.462 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.462 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.462 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.462 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.462 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.463 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.463 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.463 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.463 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.463 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.463 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.463 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.463 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.463 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.463 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.463 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.463 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.463 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.463 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.463 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.464 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.464 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.464 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.464 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.464 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.464 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.464 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.464 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.464 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.464 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.464 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.464 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.464 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.464 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.465 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.465 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.465 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.465 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.465 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.465 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.465 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.465 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.465 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.465 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.465 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.466 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.466 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.466 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.466 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.466 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.466 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.466 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.466 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.466 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.466 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.466 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.467 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.467 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.467 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.467 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:19.468 INFO:teuthology.orchestra.run.smithi044.stdout: def test_encrypted_transfer_1b(): 2023-12-03T12:39:19.468 INFO:teuthology.orchestra.run.smithi044.stdout:> _test_encryption_sse_customer_write(1) 2023-12-03T12:39:19.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.468 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9326: 2023-12-03T12:39:19.468 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.468 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:8766: in _test_encryption_sse_customer_write 2023-12-03T12:39:19.468 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:19.468 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.468 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.468 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.468 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.468 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.468 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.469 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.469 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.469 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.469 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.469 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.469 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.469 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.470 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.470 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.470 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.470 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.470 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.470 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.470 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.471 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.471 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.471 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.471 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.471 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.471 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.471 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.471 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.471 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.471 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.471 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.471 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.471 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.471 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.472 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.472 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.472 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.472 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.472 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.472 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.472 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.472 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.472 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.472 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.472 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.472 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.472 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.473 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.473 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.473 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.473 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.473 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.473 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.473 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.473 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.473 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.473 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.473 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.473 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.473 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.473 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.474 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.474 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.474 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.474 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.474 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.474 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.474 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.474 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.474 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.474 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.474 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.474 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-403" 2023-12-03T12:39:19.474 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.474 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.475 INFO:teuthology.orchestra.run.smithi044.stdout:_________________________ test_encrypted_transfer_1kb __________________________ 2023-12-03T12:39:19.475 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.475 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.475 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.475 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.475 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.475 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.475 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.475 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.475 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.475 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.475 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.475 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.475 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.475 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.476 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.476 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.476 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.476 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.476 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.476 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.476 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.476 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.476 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.476 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.476 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.477 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.477 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.477 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.477 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.477 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.477 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.477 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.477 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.477 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.477 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.477 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.477 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.477 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.477 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.478 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.478 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.478 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.478 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.478 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.478 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.478 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.478 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.478 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.478 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.478 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.478 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.478 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.478 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.479 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.479 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.479 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.479 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.479 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.479 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.479 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.479 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.479 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.479 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.479 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.479 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.479 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.480 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.480 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.480 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.480 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.480 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.480 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.480 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.480 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.480 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.480 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.480 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.480 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.480 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.480 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.481 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.481 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.481 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.481 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.481 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.481 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.481 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.481 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.481 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.481 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.481 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.481 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.481 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.482 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.482 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.482 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.482 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.482 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.482 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.482 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.482 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.482 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.482 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.482 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.483 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.483 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.483 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.483 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.483 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.483 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.483 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.483 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.483 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.483 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.483 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.483 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.483 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.484 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.484 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.484 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.484 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.484 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.484 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.484 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.484 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.484 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.484 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.484 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.484 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.484 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.484 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.484 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.485 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.485 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.485 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.485 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.485 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.485 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.485 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.485 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.485 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.485 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.485 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.485 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.486 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.486 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.486 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.486 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.486 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.486 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.486 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.486 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.486 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.486 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.486 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.486 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.486 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.486 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.487 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.487 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.487 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.487 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.487 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.487 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.487 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.487 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.487 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.487 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.487 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.487 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.487 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.487 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.488 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.488 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.488 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.488 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:19.488 INFO:teuthology.orchestra.run.smithi044.stdout: def test_encrypted_transfer_1kb(): 2023-12-03T12:39:19.488 INFO:teuthology.orchestra.run.smithi044.stdout:> _test_encryption_sse_customer_write(1024) 2023-12-03T12:39:19.488 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.488 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9332: 2023-12-03T12:39:19.488 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.488 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:8766: in _test_encryption_sse_customer_write 2023-12-03T12:39:19.488 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:19.488 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.488 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.488 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.488 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.489 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.489 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.489 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.489 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.489 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.489 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.489 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.490 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.490 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.490 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.490 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.490 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.490 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.490 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.490 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.490 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.490 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.490 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.490 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.490 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.491 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.491 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.491 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.491 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.491 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.491 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.491 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.491 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.491 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.491 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.491 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.491 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.492 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.492 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.492 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.492 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.492 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.492 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.492 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.492 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.492 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.492 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.492 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.492 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.492 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.492 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.493 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.493 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.493 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.493 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.493 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.493 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.493 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.493 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.493 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.493 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.493 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.493 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.493 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.494 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.494 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.494 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.494 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.494 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.494 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.494 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.494 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.494 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.494 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.494 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.494 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.494 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.494 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.494 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.495 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-404" 2023-12-03T12:39:19.495 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.495 INFO:teuthology.orchestra.run.smithi044.stdout:_________________________ test_encrypted_transfer_1MB __________________________ 2023-12-03T12:39:19.495 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.495 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.495 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.495 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.495 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.495 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.495 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.495 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.495 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.495 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.495 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.496 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.496 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.496 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.496 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.496 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.496 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.496 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.496 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.496 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.497 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.497 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.497 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.497 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.497 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.497 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.497 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.497 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.497 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.497 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.497 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.497 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.497 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.497 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.498 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.498 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.498 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.498 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.498 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.498 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.498 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.498 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.498 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.498 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.498 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.498 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.498 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.499 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.499 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.499 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.499 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.499 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.499 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.499 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.499 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.499 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.499 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.499 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.499 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.499 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.499 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.500 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.500 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.500 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.500 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.500 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.500 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.500 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.500 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.500 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.500 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.500 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.501 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.501 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.501 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.501 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.501 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.501 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.501 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.501 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.501 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.501 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.501 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.501 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.502 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.502 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.502 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.502 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.502 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.502 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.502 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.502 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.502 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.502 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.502 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.502 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.502 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.502 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.502 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.503 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.503 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.503 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.503 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.503 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.503 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.503 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.503 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.503 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.503 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.503 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.503 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.503 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.504 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.504 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.504 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.504 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.504 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.504 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.504 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.504 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.504 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.504 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.504 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.504 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.504 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.504 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.505 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.505 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.505 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.505 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.505 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.505 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.505 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.505 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.505 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.505 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.505 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.505 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.505 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.505 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.505 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.506 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.506 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.506 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.506 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.506 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.506 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.506 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.506 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.506 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.506 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.506 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.506 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.506 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.506 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.507 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.507 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.507 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.507 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.507 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.507 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.507 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.507 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.507 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.507 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.507 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.507 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.507 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.507 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.507 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.508 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.508 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.508 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.508 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:19.508 INFO:teuthology.orchestra.run.smithi044.stdout: def test_encrypted_transfer_1MB(): 2023-12-03T12:39:19.508 INFO:teuthology.orchestra.run.smithi044.stdout:> _test_encryption_sse_customer_write(1024*1024) 2023-12-03T12:39:19.508 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.508 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9338: 2023-12-03T12:39:19.508 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.508 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:8766: in _test_encryption_sse_customer_write 2023-12-03T12:39:19.508 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:19.508 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.508 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.508 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.508 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.509 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.509 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.509 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.509 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.509 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.509 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.509 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.510 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.510 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.510 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.510 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.510 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.510 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.510 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.510 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.510 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.510 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.510 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.511 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.511 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.511 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.511 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.511 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.511 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.511 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.511 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.511 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.511 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.511 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.511 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.511 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.511 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.512 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.512 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.512 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.512 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.512 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.512 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.512 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.512 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.512 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.512 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.512 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.512 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.512 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.513 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.513 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.513 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.513 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.513 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.513 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.513 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.513 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.513 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.513 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.513 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.513 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.513 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.513 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.513 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.514 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.514 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.514 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.514 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.514 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.514 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.514 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.514 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.514 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.514 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.514 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.514 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.514 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.514 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.515 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-405" 2023-12-03T12:39:19.515 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.515 INFO:teuthology.orchestra.run.smithi044.stdout:_________________________ test_encrypted_transfer_13b __________________________ 2023-12-03T12:39:19.515 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.515 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.515 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.515 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.515 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.515 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.515 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.515 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.516 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.516 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.516 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.516 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.516 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.516 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.516 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.516 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.516 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.516 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.516 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.516 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.516 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.517 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.517 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.517 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.517 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.517 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.517 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.517 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.517 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.517 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.517 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.517 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.517 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.517 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.517 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.517 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.518 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.518 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.518 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.518 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.518 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.518 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.518 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.518 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.518 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.518 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.518 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.518 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.518 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.519 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.519 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.519 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.519 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.519 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.519 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.519 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.519 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.519 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.519 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.519 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.519 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.519 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.519 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.520 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.520 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.520 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.520 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.520 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.520 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.520 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.520 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.520 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.520 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.520 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.520 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.521 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.521 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.521 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.521 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.521 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.521 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.521 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.521 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.521 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.521 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.521 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.521 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.521 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.521 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.522 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.522 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.522 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.522 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.522 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.522 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.522 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.522 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.522 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.522 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.522 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.522 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.523 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.523 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.523 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.523 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.523 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.523 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.523 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.523 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.523 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.523 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.523 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.523 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.524 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.524 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.524 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.524 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.524 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.524 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.524 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.524 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.524 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.524 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.524 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.524 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.524 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.524 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.525 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.525 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.525 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.525 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.525 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.525 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.525 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.525 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.525 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.525 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.525 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.525 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.525 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.525 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.525 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.526 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.526 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.526 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.526 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.526 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.526 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.526 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.526 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.526 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.526 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.526 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.526 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.526 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.526 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.527 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.527 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.527 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.527 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.527 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.527 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.527 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.527 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.527 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.527 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.527 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.527 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.527 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.527 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.527 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.528 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.528 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.528 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.528 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.528 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.528 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.528 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.528 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.528 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.528 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:19.528 INFO:teuthology.orchestra.run.smithi044.stdout: def test_encrypted_transfer_13b(): 2023-12-03T12:39:19.528 INFO:teuthology.orchestra.run.smithi044.stdout:> _test_encryption_sse_customer_write(13) 2023-12-03T12:39:19.528 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.529 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9344: 2023-12-03T12:39:19.529 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.529 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:8766: in _test_encryption_sse_customer_write 2023-12-03T12:39:19.529 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:19.529 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.529 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.529 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.529 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.529 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.529 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.529 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.529 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.529 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.529 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.530 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.530 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.530 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.530 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.530 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.530 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.530 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.530 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.530 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.530 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.530 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.530 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.530 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.530 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.531 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.531 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.531 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.531 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.531 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.531 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.531 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.531 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.531 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.531 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.531 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.531 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.531 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.532 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.532 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.532 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.532 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.532 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.532 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.532 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.532 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.532 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.532 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.532 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.532 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.532 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.532 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.533 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.533 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.533 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.533 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.533 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.533 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.533 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.533 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.533 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.533 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.533 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.533 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.533 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.533 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.534 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.534 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.534 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.534 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.534 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.534 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.534 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.534 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.534 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.534 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.534 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.534 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.535 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.535 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.535 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.535 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.535 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.535 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.535 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.535 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.535 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-406" 2023-12-03T12:39:19.535 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.535 INFO:teuthology.orchestra.run.smithi044.stdout:______________________ test_encryption_sse_c_method_head _______________________ 2023-12-03T12:39:19.535 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.535 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.535 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.536 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.536 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.536 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.536 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.536 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.536 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.536 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.536 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.536 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.536 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.536 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.536 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.536 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.536 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.536 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.537 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.537 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.537 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.537 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.537 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.537 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.537 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.537 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.537 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.537 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.537 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.537 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.537 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.537 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.538 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.538 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.538 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.538 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.538 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.538 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.538 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.538 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.538 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.538 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.538 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.538 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.538 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.539 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.539 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.539 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.539 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.539 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.539 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.539 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.539 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.539 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.539 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.539 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.539 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.539 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.539 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.539 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.540 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.540 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.540 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.540 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.540 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.540 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.540 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.540 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.540 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.540 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.541 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.541 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.541 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.541 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.541 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.541 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.541 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.541 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.541 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.541 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.541 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.541 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.541 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.541 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.542 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.542 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.542 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.542 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.542 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.542 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.542 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.542 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.542 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.542 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.542 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.542 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.542 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.543 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.543 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.543 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.543 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.543 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.543 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.543 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.543 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.543 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.543 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.543 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.543 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.543 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.544 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.544 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.544 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.544 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.544 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.544 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.544 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.544 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.545 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.545 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.545 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.545 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.545 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.545 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.545 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.545 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.545 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.545 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.545 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.545 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.545 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.545 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.546 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.546 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.546 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.546 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.546 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.546 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.546 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.546 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.546 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.546 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.546 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.546 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.546 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.546 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.547 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.547 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.547 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.547 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.547 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.547 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.547 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.547 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.547 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.547 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.547 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.547 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.547 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.547 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.547 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.547 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.548 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.548 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.548 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.548 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.548 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.548 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.548 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.548 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.548 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.548 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.548 INFO:teuthology.orchestra.run.smithi044.stdout: def test_encryption_sse_c_method_head(): 2023-12-03T12:39:19.548 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.548 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.548 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9349: 2023-12-03T12:39:19.548 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.548 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.549 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.549 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.549 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.549 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.549 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.549 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.549 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.550 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.550 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.550 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.550 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.550 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.550 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.550 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.550 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.550 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.550 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.550 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.550 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.550 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.550 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.550 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.551 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.551 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.551 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.551 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.551 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.551 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.551 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.551 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.551 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.551 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.551 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.551 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.552 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.552 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.552 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.552 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.552 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.552 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.552 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.552 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.552 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.552 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.552 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.553 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.553 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.553 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.553 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.553 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.553 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.553 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.553 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.553 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.553 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.553 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.553 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.553 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.554 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.554 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.554 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.554 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.554 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.554 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.554 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.554 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.554 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.554 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.554 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.555 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.555 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.555 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.555 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.555 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.555 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-407" 2023-12-03T12:39:19.555 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.556 INFO:teuthology.orchestra.run.smithi044.stdout:________________________ test_encryption_sse_c_present _________________________ 2023-12-03T12:39:19.556 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.556 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.556 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.556 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.556 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.556 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.556 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.556 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.556 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.556 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.556 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.556 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.556 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.556 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.557 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.557 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.557 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.557 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.557 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.557 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.557 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.557 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.557 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.557 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.557 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.557 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.557 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.557 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.557 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.558 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.558 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.558 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.558 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.558 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.558 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.558 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.558 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.558 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.558 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.559 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.559 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.559 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.559 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.559 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.559 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.559 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.559 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.559 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.559 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.559 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.559 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.560 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.560 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.560 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.560 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.560 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.560 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.560 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.560 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.560 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.560 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.560 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.560 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.560 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.560 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.561 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.561 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.561 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.561 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.561 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.561 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.561 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.561 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.561 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.561 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.561 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.561 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.561 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.561 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.562 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.562 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.562 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.562 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.562 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.562 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.562 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.562 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.562 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.562 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.562 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.562 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.562 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.562 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.563 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.563 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.563 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.563 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.563 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.563 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.563 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.563 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.563 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.563 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.563 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.563 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.563 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.563 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.564 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.564 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.564 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.564 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.564 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.564 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.564 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.564 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.564 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.564 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.564 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.564 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.564 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.564 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.564 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.565 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.565 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.565 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.565 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.565 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.565 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.565 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.565 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.565 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.565 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.565 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.565 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.565 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.566 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.566 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.566 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.566 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.566 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.566 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.566 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.566 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.566 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.566 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.566 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.566 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.567 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.567 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.567 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.567 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.567 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.567 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.567 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.567 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.567 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.567 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.567 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.567 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.567 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.567 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.567 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.568 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.568 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.568 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.568 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.568 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.568 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.568 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.568 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.568 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.568 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.568 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.568 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.568 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.568 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.568 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.569 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.569 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.569 INFO:teuthology.orchestra.run.smithi044.stdout: def test_encryption_sse_c_present(): 2023-12-03T12:39:19.569 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.569 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9374: 2023-12-03T12:39:19.569 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.569 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.569 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.569 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.569 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.569 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.569 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.569 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.570 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.570 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.570 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.570 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.570 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.570 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.570 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.570 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.570 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.570 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.570 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.570 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.570 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.570 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.571 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.571 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.571 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.571 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.571 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.571 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.571 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.571 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.571 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.571 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.571 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.571 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.571 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.571 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.572 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.572 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.572 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.572 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.572 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.572 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.572 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.572 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.572 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.572 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.572 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.572 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.572 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.572 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.573 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.573 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.573 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.573 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.573 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.573 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.573 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.573 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.573 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.573 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.573 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.573 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.573 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.573 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.574 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.574 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.574 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.574 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.574 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.574 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.574 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.574 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.574 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.574 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.574 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.574 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.575 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.575 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.575 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.575 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.575 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.575 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.575 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.575 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.575 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.575 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.575 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.575 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-408" 2023-12-03T12:39:19.575 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.576 INFO:teuthology.orchestra.run.smithi044.stdout:_______________________ test_encryption_sse_c_other_key ________________________ 2023-12-03T12:39:19.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.576 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.576 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.576 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.576 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.576 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.576 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.576 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.576 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.576 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.576 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.577 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.577 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.577 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.577 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.577 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.577 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.577 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.577 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.577 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.577 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.578 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.578 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.578 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.578 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.578 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.578 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.578 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.578 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.578 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.578 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.578 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.579 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.579 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.579 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.579 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.579 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.579 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.579 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.579 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.579 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.579 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.579 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.579 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.579 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.579 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.580 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.580 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.580 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.580 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.580 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.580 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.580 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.580 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.580 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.580 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.580 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.580 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.580 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.580 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.581 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.581 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.581 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.581 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.581 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.581 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.581 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.581 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.581 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.581 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.581 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.581 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.581 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.581 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.582 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.582 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.582 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.582 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.582 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.582 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.582 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.582 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.582 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.582 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.582 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.582 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.582 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.583 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.583 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.583 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.583 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.583 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.583 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.583 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.583 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.583 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.583 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.583 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.583 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.584 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.584 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.584 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.584 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.584 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.584 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.584 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.584 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.584 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.584 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.584 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.584 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.584 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.584 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.584 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.585 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.585 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.585 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.585 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.585 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.585 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.585 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.585 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.585 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.585 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.585 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.585 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.585 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.585 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.585 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.586 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.586 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.586 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.586 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.586 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.586 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.586 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.586 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.586 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.586 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.586 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.586 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.587 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.587 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.587 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.587 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.587 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.587 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.587 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.587 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.587 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.587 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.587 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.588 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.588 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.588 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.588 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.588 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.588 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.588 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.588 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.588 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.588 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.588 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.588 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.588 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.588 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.588 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.588 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.589 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.589 INFO:teuthology.orchestra.run.smithi044.stdout: def test_encryption_sse_c_other_key(): 2023-12-03T12:39:19.589 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.589 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9394: 2023-12-03T12:39:19.589 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.589 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.589 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.589 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.589 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.589 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.589 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.589 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.590 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.590 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.590 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.590 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.590 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.590 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.590 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.590 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.590 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.590 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.590 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.590 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.591 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.591 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.591 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.591 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.591 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.591 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.591 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.591 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.591 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.591 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.591 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.591 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.591 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.591 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.591 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.592 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.592 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.592 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.592 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.592 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.592 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.592 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.592 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.592 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.592 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.592 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.592 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.592 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.592 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.592 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.593 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.593 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.593 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.593 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.593 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.593 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.593 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.593 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.593 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.593 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.593 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.593 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.593 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.593 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.594 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.594 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.594 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.594 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.594 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.594 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.594 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.594 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.594 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.594 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.594 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.594 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.595 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.595 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.595 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.595 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.595 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.595 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.595 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.595 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.595 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.595 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.595 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.595 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-409" 2023-12-03T12:39:19.595 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.595 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.596 INFO:teuthology.orchestra.run.smithi044.stdout:______________________ test_encryption_sse_c_invalid_md5 _______________________ 2023-12-03T12:39:19.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.596 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.596 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.596 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.596 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.596 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.596 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.596 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.596 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.596 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.596 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.597 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.597 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.597 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.597 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.597 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.597 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.597 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.597 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.597 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.597 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.597 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.598 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.598 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.598 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.598 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.598 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.598 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.598 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.598 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.598 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.598 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.598 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.598 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.598 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.598 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.598 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.599 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.599 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.599 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.599 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.599 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.599 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.599 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.599 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.599 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.599 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.599 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.599 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.600 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.600 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.600 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.600 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.600 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.600 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.600 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.600 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.600 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.600 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.600 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.600 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.600 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.600 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.600 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.601 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.601 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.601 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.601 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.601 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.601 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.601 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.601 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.601 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.601 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.601 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.601 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.601 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.602 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.602 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.602 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.602 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.602 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.602 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.602 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.602 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.602 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.602 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.602 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.602 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.603 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.603 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.603 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.603 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.603 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.603 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.603 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.603 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.603 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.603 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.603 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.603 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.603 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.603 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.604 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.604 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.604 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.604 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.604 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.604 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.604 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.604 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.604 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.604 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.604 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.604 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.604 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.604 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.605 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.605 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.605 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.605 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.605 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.605 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.605 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.605 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.605 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.605 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.605 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.606 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.606 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.606 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.606 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.606 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.606 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.606 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.606 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.606 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.606 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.606 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.606 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.607 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.607 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.607 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.607 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.607 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.607 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.607 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.607 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.607 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.607 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.607 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.607 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.607 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.607 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.608 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.608 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.608 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.608 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.608 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.608 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.608 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.608 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.608 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.608 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.608 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.609 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.609 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.609 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.609 INFO:teuthology.orchestra.run.smithi044.stdout: def test_encryption_sse_c_invalid_md5(): 2023-12-03T12:39:19.609 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.609 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9421: 2023-12-03T12:39:19.609 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.609 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.609 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.609 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.609 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.609 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.610 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.610 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.610 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.610 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.610 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.610 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.610 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.610 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.610 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.610 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.610 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.610 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.610 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.611 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.611 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.611 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.611 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.611 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.611 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.612 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.612 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.612 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.612 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.612 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.612 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.612 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.612 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.612 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.612 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.612 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.612 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.613 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.613 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.613 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.613 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.613 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.613 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.613 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.613 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.613 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.613 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.613 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.613 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.613 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.614 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.614 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.614 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.614 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.614 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.614 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.614 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.614 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.614 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.614 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.614 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.614 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.614 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.614 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.615 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.615 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.615 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.615 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.615 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.615 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.615 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.615 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.615 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.615 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.615 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.615 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.616 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.616 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.616 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-410" 2023-12-03T12:39:19.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.616 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.616 INFO:teuthology.orchestra.run.smithi044.stdout:_________________________ test_encryption_sse_c_no_md5 _________________________ 2023-12-03T12:39:19.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.616 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.616 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.616 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.616 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.616 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.616 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.617 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.617 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.617 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.617 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.617 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.617 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.617 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.617 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.617 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.617 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.617 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.618 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.618 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.618 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.618 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.618 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.618 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.618 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.618 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.618 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.618 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.618 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.618 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.618 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.618 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.619 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.619 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.619 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.619 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.619 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.619 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.619 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.619 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.619 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.619 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.619 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.619 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.619 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.619 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.620 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.620 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.620 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.620 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.620 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.620 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.620 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.620 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.620 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.620 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.620 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.620 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.620 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.620 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.620 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.621 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.621 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.621 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.621 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.621 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.621 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.621 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.621 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.621 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.621 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.621 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.622 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.622 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.622 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.622 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.622 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.622 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.622 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.622 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.622 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.623 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.623 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.623 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.623 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.623 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.623 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.623 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.623 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.623 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.623 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.623 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.623 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.624 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.624 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.624 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.624 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.624 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.624 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.624 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.624 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.624 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.624 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.624 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.624 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.625 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.625 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.625 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.625 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.625 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.625 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.625 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.625 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.625 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.625 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.626 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.626 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.626 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.626 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.626 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.626 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.626 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.626 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.626 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.627 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.627 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.627 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.627 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.627 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.627 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.627 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.627 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.627 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.627 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.627 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.627 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.627 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.627 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.627 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.628 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.628 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.628 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.628 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.628 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.628 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.628 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.628 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.628 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.628 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.628 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.628 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.628 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.628 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.629 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.629 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.629 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.629 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.629 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.629 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.629 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.629 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.629 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.629 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.629 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.629 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.629 INFO:teuthology.orchestra.run.smithi044.stdout: def test_encryption_sse_c_no_md5(): 2023-12-03T12:39:19.629 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.629 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.630 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9439: 2023-12-03T12:39:19.630 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.630 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.630 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.630 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.630 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.630 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.630 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.630 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.630 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.630 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.630 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.630 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.630 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.631 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.631 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.631 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.631 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.631 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.631 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.631 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.631 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.631 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.631 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.631 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.631 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.631 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.631 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.631 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.632 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.632 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.632 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.632 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.632 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.632 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.632 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.632 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.632 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.632 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.632 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.632 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.632 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.632 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.632 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.632 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.633 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.633 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.633 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.633 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.633 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.633 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.633 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.633 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.633 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.633 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.633 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.633 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.633 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.633 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.633 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.634 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.634 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.634 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.634 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.634 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.634 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.634 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.634 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.634 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.634 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.634 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.634 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.634 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.634 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.635 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.635 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.635 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.635 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.635 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.635 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.635 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.635 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.635 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.635 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.636 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.636 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.636 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.636 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.636 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-411" 2023-12-03T12:39:19.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.636 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.636 INFO:teuthology.orchestra.run.smithi044.stdout:_________________________ test_encryption_sse_c_no_key _________________________ 2023-12-03T12:39:19.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.636 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.636 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.636 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.637 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.637 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.637 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.637 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.637 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.637 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.637 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.637 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.637 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.637 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.637 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.637 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.637 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.637 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.637 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.638 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.638 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.638 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.638 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.638 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.638 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.638 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.638 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.638 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.638 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.638 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.638 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.638 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.639 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.639 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.639 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.639 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.639 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.639 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.639 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.639 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.639 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.639 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.639 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.639 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.639 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.640 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.640 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.640 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.640 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.640 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.640 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.640 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.640 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.640 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.640 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.640 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.640 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.640 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.640 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.641 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.641 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.641 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.641 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.641 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.641 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.641 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.641 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.641 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.641 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.641 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.641 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.641 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.641 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.642 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.642 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.642 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.642 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.642 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.642 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.642 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.642 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.642 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.642 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.643 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.643 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.643 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.643 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.643 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.643 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.643 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.643 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.643 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.643 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.643 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.643 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.643 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.644 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.644 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.644 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.644 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.644 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.644 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.644 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.644 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.644 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.644 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.644 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.644 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.644 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.644 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.645 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.645 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.645 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.645 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.645 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.645 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.645 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.645 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.645 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.646 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.646 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.646 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.646 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.646 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.646 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.646 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.646 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.646 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.646 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.647 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.647 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.647 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.647 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.647 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.647 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.647 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.647 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.647 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.647 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.647 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.647 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.647 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.647 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.647 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.647 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.648 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.648 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.648 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.648 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.648 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.648 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.648 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.648 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.648 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.648 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.648 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.648 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.648 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.648 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.648 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.648 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.649 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.649 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.649 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.649 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.649 INFO:teuthology.orchestra.run.smithi044.stdout: def test_encryption_sse_c_no_key(): 2023-12-03T12:39:19.649 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.649 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9454: 2023-12-03T12:39:19.649 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.649 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.649 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.649 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.649 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.650 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.650 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.650 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.650 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.650 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.650 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.650 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.650 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.650 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.650 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.650 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.650 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.650 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.651 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.651 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.651 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.651 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.651 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.651 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.651 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.651 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.651 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.651 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.651 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.652 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.652 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.652 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.652 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.652 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.652 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.652 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.652 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.652 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.652 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.652 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.652 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.653 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.653 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.653 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.653 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.653 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.653 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.653 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.653 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.653 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.653 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.653 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.653 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.653 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.653 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.654 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.654 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.654 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.654 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.654 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.654 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.654 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.654 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.654 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.654 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.654 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.654 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.654 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.654 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.655 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.655 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.655 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.655 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.655 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.655 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.655 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.655 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.655 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.655 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.655 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.655 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.656 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.656 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.656 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.656 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.656 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.656 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-412" 2023-12-03T12:39:19.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.656 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.656 INFO:teuthology.orchestra.run.smithi044.stdout:_________________________ test_encryption_key_no_sse_c _________________________ 2023-12-03T12:39:19.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.657 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.657 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.657 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.657 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.657 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.657 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.657 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.657 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.657 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.657 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.657 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.657 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.657 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.657 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.657 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.658 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.658 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.658 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.658 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.658 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.658 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.658 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.658 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.658 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.658 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.658 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.658 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.658 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.658 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.659 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.659 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.659 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.659 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.659 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.659 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.659 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.659 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.659 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.659 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.659 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.659 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.659 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.659 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.660 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.660 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.660 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.660 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.660 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.660 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.660 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.660 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.660 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.660 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.660 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.660 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.660 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.660 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.660 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.661 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.661 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.661 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.661 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.661 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.661 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.661 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.661 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.661 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.661 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.661 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.661 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.661 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.661 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.661 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.662 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.662 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.662 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.662 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.662 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.662 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.662 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.662 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.662 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.662 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.662 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.663 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.663 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.663 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.663 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.663 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.663 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.663 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.663 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.663 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.663 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.663 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.663 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.663 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.664 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.664 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.664 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.664 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.664 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.664 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.664 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.664 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.664 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.664 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.664 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.664 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.664 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.664 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.664 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.665 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.665 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.665 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.665 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.665 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.665 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.665 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.665 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.666 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.666 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.666 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.666 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.666 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.666 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.666 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.666 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.666 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.666 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.666 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.666 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.666 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.666 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.667 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.667 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.667 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.667 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.667 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.667 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.667 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.667 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.667 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.667 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.667 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.668 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.668 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.668 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.668 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.668 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.668 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.668 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.668 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.668 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.668 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.668 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.668 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.668 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.668 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.668 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.669 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.669 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.669 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.669 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.669 INFO:teuthology.orchestra.run.smithi044.stdout: def test_encryption_key_no_sse_c(): 2023-12-03T12:39:19.669 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.669 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9468: 2023-12-03T12:39:19.669 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.669 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.669 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.669 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.670 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.670 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.670 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.670 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.670 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.670 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.670 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.670 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.671 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.671 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.671 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.671 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.671 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.671 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.671 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.671 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.671 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.671 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.671 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.671 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.671 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.671 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.671 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.672 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.672 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.672 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.672 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.672 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.672 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.672 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.672 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.672 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.672 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.672 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.672 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.672 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.672 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.672 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.673 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.673 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.673 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.673 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.673 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.673 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.673 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.673 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.673 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.673 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.673 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.673 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.673 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.673 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.673 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.674 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.674 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.674 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.674 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.674 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.674 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.674 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.674 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.674 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.674 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.674 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.674 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.675 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.675 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.675 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.675 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.675 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.675 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.675 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.675 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.675 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.675 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.675 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.675 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-413" 2023-12-03T12:39:19.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.676 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.676 INFO:teuthology.orchestra.run.smithi044.stdout:____________________ test_encryption_sse_c_multipart_upload ____________________ 2023-12-03T12:39:19.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.676 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.676 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.676 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.676 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.676 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.676 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.676 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.676 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.676 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.677 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.677 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.677 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.677 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.677 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.677 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.677 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.677 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.678 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.678 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.678 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.678 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.678 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.678 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.678 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.678 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.678 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.678 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.678 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.678 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.678 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.678 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.679 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.679 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.679 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.679 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.679 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.679 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.679 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.679 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.679 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.679 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.679 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.679 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.679 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.679 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.680 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.680 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.680 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.680 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.680 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.680 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.680 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.680 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.680 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.680 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.680 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.680 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.680 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.680 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.680 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.681 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.681 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.681 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.681 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.681 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.681 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.681 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.681 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.681 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.681 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.682 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.682 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.682 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.682 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.682 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.682 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.682 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.682 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.682 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.682 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.682 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.682 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.682 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.682 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.682 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.683 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.683 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.683 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.683 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.683 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.683 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.683 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.683 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.683 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.683 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.683 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.683 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.684 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.684 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.684 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.684 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.684 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.684 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.684 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.684 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.684 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.685 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.685 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.685 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.685 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.685 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.685 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.685 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.686 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.686 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.686 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.686 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.686 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.686 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.686 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.686 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.686 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.686 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.686 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.686 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.686 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.687 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.687 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.687 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.687 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.687 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.687 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.687 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.687 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.687 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.687 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.687 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.687 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.687 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.687 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.688 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.688 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.688 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.688 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.688 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.688 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.688 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.688 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.688 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.688 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.688 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.688 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.688 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.689 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.689 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.689 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.689 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:19.689 INFO:teuthology.orchestra.run.smithi044.stdout: def test_encryption_sse_c_multipart_upload(): 2023-12-03T12:39:19.689 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.689 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.689 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9535: 2023-12-03T12:39:19.689 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.689 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.689 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.689 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.689 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.690 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.690 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.690 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.690 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.690 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.690 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.690 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.690 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.690 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.690 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.690 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.690 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.690 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.690 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.690 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.691 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.691 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.691 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.691 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.691 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.691 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.691 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.691 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.691 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.691 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.691 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.691 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.691 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.691 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.692 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.692 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.692 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.692 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.692 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.692 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.692 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.692 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.692 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.692 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.692 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.692 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.693 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.693 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.693 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.693 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.693 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.693 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.693 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.693 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.693 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.693 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.693 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.693 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.693 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.694 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.694 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.694 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.694 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.694 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.694 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.694 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.694 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.694 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.694 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.694 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.694 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.694 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.695 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.695 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.695 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.695 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.695 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.695 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.695 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.695 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.695 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.695 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.695 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.695 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.695 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-414" 2023-12-03T12:39:19.695 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.695 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.696 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ test_encryption_sse_c_unaligned_multipart_upload _______________ 2023-12-03T12:39:19.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.696 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.696 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.696 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.696 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.696 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.696 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.696 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.696 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.696 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.696 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.697 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.697 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.697 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.697 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.697 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.697 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.697 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.697 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.697 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.697 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.697 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.697 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.697 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.698 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.698 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.698 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.698 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.698 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.698 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.698 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.698 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.698 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.698 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.698 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.698 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.698 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.699 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.699 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.699 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.699 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.699 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.699 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.699 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.699 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.699 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.699 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.700 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.700 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.700 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.700 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.700 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.700 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.700 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.700 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.700 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.700 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.700 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.700 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.701 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.701 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.701 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.701 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.701 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.701 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.701 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.701 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.701 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.701 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.702 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.702 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.702 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.702 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.702 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.702 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.702 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.702 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.702 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.702 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.702 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.702 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.702 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.702 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.703 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.703 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.703 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.703 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.703 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.703 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.703 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.703 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.703 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.703 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.703 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.703 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.703 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.703 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.704 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.704 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.704 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.704 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.704 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.704 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.704 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.704 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.704 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.704 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.704 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.704 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.704 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.704 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.704 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.705 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.705 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.705 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.705 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.705 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.705 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.705 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.705 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.705 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.705 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.705 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.706 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.706 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.706 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.706 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.706 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.706 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.706 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.706 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.706 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.706 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.706 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.706 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.706 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.707 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.707 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.707 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.707 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.707 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.707 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.707 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.707 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.707 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.707 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.707 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.707 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.707 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.707 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.707 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.708 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.708 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.708 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.708 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.708 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.708 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.708 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.708 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.708 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.708 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.708 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.708 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.708 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.708 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.708 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.708 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:19.709 INFO:teuthology.orchestra.run.smithi044.stdout: def test_encryption_sse_c_unaligned_multipart_upload(): 2023-12-03T12:39:19.709 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.709 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.709 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9581: 2023-12-03T12:39:19.709 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.709 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.709 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.709 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.709 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.709 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.709 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.710 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.710 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.710 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.710 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.710 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.710 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.710 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.710 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.710 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.710 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.710 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.710 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.710 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.710 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.711 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.711 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.711 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.711 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.711 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.711 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.711 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.711 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.711 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.711 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.712 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.712 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.712 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.712 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.712 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.712 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.712 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.712 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.712 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.712 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.712 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.712 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.712 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.713 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.713 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.713 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.713 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.713 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.713 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.713 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.713 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.713 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.713 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.713 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.713 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.713 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.713 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.714 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.714 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.714 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.714 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.714 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.714 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.714 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.714 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.714 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.714 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.714 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.714 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.714 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.714 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.715 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.715 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.715 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.715 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.715 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.715 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.715 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.715 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.715 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.715 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-415" 2023-12-03T12:39:19.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.715 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.715 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ test_encryption_sse_c_multipart_bad_download _________________ 2023-12-03T12:39:19.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.716 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.716 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.716 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.716 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.716 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.716 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.716 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.716 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.716 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.716 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.716 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.716 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.716 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.716 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.716 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.716 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.717 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.717 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.717 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.717 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.717 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.717 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.717 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.717 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.717 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.717 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.717 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.717 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.718 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.718 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.718 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.718 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.718 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.718 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.718 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.718 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.718 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.718 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.718 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.718 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.718 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.719 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.719 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.719 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.719 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.719 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.719 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.719 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.719 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.719 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.719 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.719 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.720 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.720 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.720 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.720 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.720 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.720 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.720 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.720 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.720 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.720 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.720 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.720 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.720 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.720 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.720 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.721 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.721 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.721 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.721 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.721 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.721 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.721 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.721 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.721 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.721 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.721 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.722 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.722 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.722 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.722 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.722 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.722 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.722 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.722 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.722 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.722 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.722 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.722 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.722 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.722 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.723 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.723 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.723 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.723 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.723 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.723 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.723 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.723 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.723 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.723 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.724 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.724 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.724 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.724 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.724 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.724 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.724 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.724 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.724 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.724 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.724 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.724 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.725 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.725 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.725 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.725 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.725 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.725 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.725 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.725 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.725 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.725 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.725 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.725 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.725 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.725 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.725 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.725 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.726 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.726 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.726 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.726 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.726 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.726 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.726 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.726 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.726 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.726 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.726 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.726 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.726 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.726 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.727 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.727 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.727 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.727 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.727 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.727 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.727 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.727 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.727 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.727 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.727 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.727 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.728 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.728 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.728 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.728 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.728 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.728 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.728 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.728 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.728 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.728 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.728 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.728 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.728 INFO:teuthology.orchestra.run.smithi044.stdout: def test_encryption_sse_c_multipart_bad_download(): 2023-12-03T12:39:19.729 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.729 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.729 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9682: 2023-12-03T12:39:19.729 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.729 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.729 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.729 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.729 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.729 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.729 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.729 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.729 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.729 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.729 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.729 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.730 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.730 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.730 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.730 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.730 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.730 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.730 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.730 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.730 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.730 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.730 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.730 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.730 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.730 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.731 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.731 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.731 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.731 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.731 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.731 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.731 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.731 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.731 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.731 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.731 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.731 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.731 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.731 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.732 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.732 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.732 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.732 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.732 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.732 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.732 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.732 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.732 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.732 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.732 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.732 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.732 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.732 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.733 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.733 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.733 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.733 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.733 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.733 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.733 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.733 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.733 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.733 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.733 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.733 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.733 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.733 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.734 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.734 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.734 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.734 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.734 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.734 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.734 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.735 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.735 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.735 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.735 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.735 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.735 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.735 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.735 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.735 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.735 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.735 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.735 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.736 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.736 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.736 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-416" 2023-12-03T12:39:19.736 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.736 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.736 INFO:teuthology.orchestra.run.smithi044.stdout:___________ test_encryption_sse_c_post_object_authenticated_request ____________ 2023-12-03T12:39:19.736 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.736 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.736 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.736 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.736 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.736 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.736 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.736 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.737 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.737 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.737 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.737 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.737 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.737 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.737 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.737 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.737 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.737 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.737 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.738 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.738 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.738 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.738 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.738 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.738 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.738 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.738 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.738 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.738 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.738 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.738 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.739 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.739 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.739 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.739 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.739 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.739 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.739 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.739 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.739 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.739 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.739 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.739 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.739 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.740 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.740 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.740 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.740 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.740 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.740 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.740 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.740 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.740 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.740 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.740 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.740 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.740 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.740 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.740 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.741 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.741 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.741 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.741 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.741 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.741 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.741 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.741 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.741 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.741 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.741 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.741 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.741 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.741 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.742 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.742 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.742 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.742 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.742 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.742 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.742 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.742 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.742 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.742 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.742 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.742 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.742 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.742 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.743 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.743 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.743 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.743 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.743 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.743 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.743 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.743 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.743 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.743 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.743 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.743 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.743 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.743 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.743 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.744 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.744 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.744 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.744 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.744 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.744 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.744 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.744 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.744 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.744 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.744 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.744 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.744 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.744 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.744 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.745 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.745 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.745 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.745 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.745 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.745 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.745 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.745 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.745 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.745 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.745 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.745 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.745 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.745 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.745 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.746 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.746 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.746 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.746 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.746 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.746 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.746 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.746 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.746 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.746 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.746 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.746 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.746 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.746 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.747 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.747 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.747 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.747 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.747 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.747 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.747 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.747 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.747 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.747 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.747 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.747 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.747 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.747 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.747 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.748 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.748 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.748 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.748 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.748 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.748 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.748 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.748 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.748 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.748 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.748 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.748 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.748 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.748 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.749 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.749 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:19.749 INFO:teuthology.orchestra.run.smithi044.stdout: def test_encryption_sse_c_post_object_authenticated_request(): 2023-12-03T12:39:19.749 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.749 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.749 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9729: 2023-12-03T12:39:19.749 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.749 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.749 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.749 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.749 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.749 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.749 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.749 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.749 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.750 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.750 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.750 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.750 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.750 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.750 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.750 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.751 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.751 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.751 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.751 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.751 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.751 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.751 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.751 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.751 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.751 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.751 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.751 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.751 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.751 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.752 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.752 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.752 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.752 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.752 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.752 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.752 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.752 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.752 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.752 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.752 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.752 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.752 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.752 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.753 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.753 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.753 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.753 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.753 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.753 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.753 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.753 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.753 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.753 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.753 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.753 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.753 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.753 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.754 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.754 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.754 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.754 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.754 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.754 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.754 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.754 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.754 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.754 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.754 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.754 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.754 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.754 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.755 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.755 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.755 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.755 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.755 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.755 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.755 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.755 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.755 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-417" 2023-12-03T12:39:19.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.755 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.755 INFO:teuthology.orchestra.run.smithi044.stdout:___________________________ test_sse_kms_method_head ___________________________ 2023-12-03T12:39:19.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.755 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.756 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.756 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.756 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.756 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.756 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.756 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.756 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.756 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.756 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.756 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.756 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.757 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.757 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.757 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.757 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.757 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.757 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.757 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.757 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.757 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.757 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.757 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.757 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.758 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.758 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.758 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.758 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.758 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.758 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.758 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.758 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.758 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.758 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.758 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.758 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.758 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.758 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.758 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.759 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.759 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.759 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.759 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.759 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.759 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.759 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.759 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.759 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.759 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.759 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.760 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.760 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.760 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.760 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.760 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.760 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.760 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.760 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.760 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.760 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.760 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.760 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.760 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.761 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.761 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.761 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.761 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.761 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.761 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.761 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.761 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.761 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.761 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.761 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.761 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.761 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.762 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.762 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.762 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.762 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.762 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.762 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.762 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.762 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.762 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.762 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.762 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.762 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.762 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.762 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.763 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.763 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.763 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.763 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.763 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.763 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.763 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.763 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.763 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.763 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.763 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.763 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.763 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.763 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.764 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.764 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.764 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.764 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.764 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.764 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.764 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.764 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.764 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.764 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.764 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.764 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.764 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.764 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.765 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.765 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.765 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.765 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.765 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.765 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.765 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.765 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.766 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.766 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.766 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.766 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.766 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.766 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.766 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.766 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.766 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.766 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.766 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.766 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.766 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.766 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.766 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.767 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.767 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.767 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.767 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.767 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.767 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.767 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.767 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.767 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.767 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.767 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.767 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.767 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.768 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.768 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.768 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.768 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.768 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.768 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.768 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.768 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.768 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.768 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.768 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:19.768 INFO:teuthology.orchestra.run.smithi044.stdout: def test_sse_kms_method_head(): 2023-12-03T12:39:19.768 INFO:teuthology.orchestra.run.smithi044.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:39:19.768 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.768 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.769 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9813: 2023-12-03T12:39:19.769 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.769 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.769 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.769 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.769 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.769 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.769 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.769 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.770 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.770 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.770 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.770 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.770 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.770 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.770 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.770 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.771 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.771 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.771 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.771 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.771 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.771 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.771 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.771 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.771 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.771 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.771 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.772 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.772 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.772 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.772 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.772 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.772 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.772 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.772 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.772 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.772 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.772 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.772 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.772 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.772 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.772 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.773 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.773 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.773 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.773 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.773 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.773 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.773 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.773 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.773 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.773 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.773 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.773 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.773 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.773 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.774 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.774 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.774 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.774 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.774 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.774 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.774 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.774 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.774 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.774 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.774 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.774 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.775 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.775 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.775 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.775 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.775 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-418" 2023-12-03T12:39:19.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.775 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.775 INFO:teuthology.orchestra.run.smithi044.stdout:_____________________________ test_sse_kms_present _____________________________ 2023-12-03T12:39:19.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.775 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.775 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.775 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.776 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.776 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.776 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.776 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.776 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.776 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.776 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.776 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.776 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.776 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.776 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.776 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.776 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.777 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.777 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.777 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.777 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.777 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.777 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.777 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.777 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.777 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.777 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.777 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.777 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.777 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.777 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.777 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.778 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.778 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.778 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.778 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.778 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.778 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.778 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.778 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.778 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.778 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.778 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.778 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.778 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.778 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.779 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.779 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.779 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.779 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.779 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.779 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.779 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.779 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.779 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.779 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.779 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.779 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.779 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.779 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.779 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.779 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.780 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.780 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.780 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.780 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.780 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.780 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.780 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.780 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.780 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.780 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.780 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.780 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.780 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.780 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.780 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.781 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.781 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.781 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.781 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.781 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.781 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.781 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.781 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.781 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.781 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.781 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.781 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.781 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.781 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.782 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.782 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.782 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.782 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.782 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.782 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.782 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.782 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.782 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.782 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.782 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.782 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.782 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.782 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.782 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.783 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.783 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.783 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.783 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.783 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.783 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.783 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.783 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.783 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.783 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.783 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.784 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.784 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.784 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.784 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.784 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.784 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.784 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.784 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.784 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.785 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.785 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.785 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.785 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.785 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.785 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.785 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.785 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.785 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.785 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.785 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.785 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.785 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.786 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.786 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.786 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.786 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.786 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.786 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.786 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.786 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.786 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.786 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.786 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.787 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.787 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.787 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.787 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.787 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.787 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.787 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.787 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.787 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.787 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.787 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.787 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.787 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.787 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.787 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.788 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.788 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.788 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.788 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.788 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:19.788 INFO:teuthology.orchestra.run.smithi044.stdout: def test_sse_kms_present(): 2023-12-03T12:39:19.788 INFO:teuthology.orchestra.run.smithi044.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:39:19.788 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.788 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.788 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9840: 2023-12-03T12:39:19.788 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.788 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.788 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.788 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.789 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.789 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.789 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.789 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.789 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.789 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.789 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.790 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.790 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.790 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.790 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.790 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.790 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.790 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.790 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.790 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.790 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.790 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.790 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.790 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.790 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.791 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.791 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.791 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.791 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.791 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.791 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.791 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.791 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.791 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.791 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.791 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.791 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.791 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.791 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.791 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.792 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.792 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.792 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.792 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.792 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.792 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.792 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.792 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.792 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.792 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.792 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.792 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.792 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.792 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.793 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.793 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.793 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.793 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.793 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.793 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.793 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.793 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.793 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.793 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.793 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.793 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.793 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.793 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.793 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.793 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.794 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.794 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.794 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.794 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.794 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.794 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.794 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.794 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.794 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.794 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.794 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-419" 2023-12-03T12:39:19.794 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.794 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.794 INFO:teuthology.orchestra.run.smithi044.stdout:_____________________________ test_sse_kms_no_key ______________________________ 2023-12-03T12:39:19.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.795 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.795 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.795 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.795 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.795 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.795 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.795 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.795 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.795 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.796 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.796 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.796 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.796 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.796 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.796 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.796 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.796 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.796 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.796 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.796 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.796 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.797 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.797 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.797 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.797 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.797 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.797 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.797 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.797 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.797 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.797 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.797 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.797 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.797 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.797 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.797 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.797 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.798 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.798 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.798 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.798 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.798 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.798 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.798 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.798 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.798 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.798 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.798 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.798 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.798 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.798 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.798 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.799 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.799 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.799 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.799 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.799 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.799 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.799 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.799 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.799 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.799 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.799 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.800 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.800 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.800 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.800 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.800 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.800 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.800 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.800 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.800 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.800 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.800 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.800 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.800 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.800 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.801 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.801 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.801 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.801 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.801 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.801 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.801 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.801 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.801 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.801 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.801 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.801 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.801 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.802 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.802 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.802 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.802 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.802 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.802 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.802 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.802 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.802 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.802 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.802 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.802 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.802 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.802 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.803 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.803 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.803 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.803 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.803 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.803 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.803 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.803 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.804 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.804 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.804 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.804 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.804 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.804 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.804 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.804 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.804 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.804 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.804 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.804 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.804 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.804 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.804 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.805 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.805 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.805 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.805 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.805 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.805 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.805 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.805 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.805 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.805 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.805 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.805 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.806 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.806 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.806 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.806 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.806 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.806 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.806 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.806 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.806 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.806 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.806 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.806 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.806 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.806 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.806 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.807 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.807 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.807 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.807 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.807 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.807 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.807 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.807 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.807 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.807 INFO:teuthology.orchestra.run.smithi044.stdout: def test_sse_kms_no_key(): 2023-12-03T12:39:19.807 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.807 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.807 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9859: 2023-12-03T12:39:19.807 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.808 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.808 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.808 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.808 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.808 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.808 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.808 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.809 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.809 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.809 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.809 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.809 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.809 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.809 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.809 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.810 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.810 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.810 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.810 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.810 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.810 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.810 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.810 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.810 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.810 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.810 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.810 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.810 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.810 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.810 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.811 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.811 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.811 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.811 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.811 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.811 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.811 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.811 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.811 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.811 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.811 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.811 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.811 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.811 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.812 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.812 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.812 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.812 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.812 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.812 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.812 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.812 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.812 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.812 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.812 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.812 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.813 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.813 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.813 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.813 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.813 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.813 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.813 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.813 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.813 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.813 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.813 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.813 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.813 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.813 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.813 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.814 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.814 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.814 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.814 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.814 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-420" 2023-12-03T12:39:19.814 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.814 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.814 INFO:teuthology.orchestra.run.smithi044.stdout:__________________________ test_sse_kms_not_declared ___________________________ 2023-12-03T12:39:19.814 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.814 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.814 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.814 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.814 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.814 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.815 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.815 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.815 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.815 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.815 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.815 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.815 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.815 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.815 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.815 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.815 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.815 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.817 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.817 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.817 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.817 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.817 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.817 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.817 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.817 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.817 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.818 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.818 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.818 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.818 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.818 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.818 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.818 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.818 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.818 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.818 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.818 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.818 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.818 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.818 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.819 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.819 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.819 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.819 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.819 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.819 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.819 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.819 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.819 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.819 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.819 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.819 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.819 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.819 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.820 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.820 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.820 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.820 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.820 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.820 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.820 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.820 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.820 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.820 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.820 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.820 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.820 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.820 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.820 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.821 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.821 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.821 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.821 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.821 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.821 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.821 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.821 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.821 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.821 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.821 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.821 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.822 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.822 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.822 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.822 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.822 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.822 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.822 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.822 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.822 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.822 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.822 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.822 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.822 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.822 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.823 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.823 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.823 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.823 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.823 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.823 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.823 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.823 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.823 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.823 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.823 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.823 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.823 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.823 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.823 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.824 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.824 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.824 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.824 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.824 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.824 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.824 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.824 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.824 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.824 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.824 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.824 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.825 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.825 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.825 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.825 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.825 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.825 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.825 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.825 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.825 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.825 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.825 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.825 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.825 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.825 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.825 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.826 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.826 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.826 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.826 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.826 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.826 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.826 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.826 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.826 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.826 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.827 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.827 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.827 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.827 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.827 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.827 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.827 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.827 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.827 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.827 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.827 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.827 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.827 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.827 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.828 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.828 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.828 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.828 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.828 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.828 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.828 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.828 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.828 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.828 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.828 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.828 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.828 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.828 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.829 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.829 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.829 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.829 INFO:teuthology.orchestra.run.smithi044.stdout: def test_sse_kms_not_declared(): 2023-12-03T12:39:19.829 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.829 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.829 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9875: 2023-12-03T12:39:19.829 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.829 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.829 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.829 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.829 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.829 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.829 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.829 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.830 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.830 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.830 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.830 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.830 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.830 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.830 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.830 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.830 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.830 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.830 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.830 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.830 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.830 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.830 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.831 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.831 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.831 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.831 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.831 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.831 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.831 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.831 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.831 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.831 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.831 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.831 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.831 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.831 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.831 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.832 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.832 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.832 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.832 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.832 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.832 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.832 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.832 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.832 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.832 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.832 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.832 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.832 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.833 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.833 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.833 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.833 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.833 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.833 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.833 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.833 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.833 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.833 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.833 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.833 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.833 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.833 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.834 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.834 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.834 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.834 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.834 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.834 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.834 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.834 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.834 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.834 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.834 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.834 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.834 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.834 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.835 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.835 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.835 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.835 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.835 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.835 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.835 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.835 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.835 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-421" 2023-12-03T12:39:19.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.835 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.835 INFO:teuthology.orchestra.run.smithi044.stdout:________________________ test_sse_kms_multipart_upload _________________________ 2023-12-03T12:39:19.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.835 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.836 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.836 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.836 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.836 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.836 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.836 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.836 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.836 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.836 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.836 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.836 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.836 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.836 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.837 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.837 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.837 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.837 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.837 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.837 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.837 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.837 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.837 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.837 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.837 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.838 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.838 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.838 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.838 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.838 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.838 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.838 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.838 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.838 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.838 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.838 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.838 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.838 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.838 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.838 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.839 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.839 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.839 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.839 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.839 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.839 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.839 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.839 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.839 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.839 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.839 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.840 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.840 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.840 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.840 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.840 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.840 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.840 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.840 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.840 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.840 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.840 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.840 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.840 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.840 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.840 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.840 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.841 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.841 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.841 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.841 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.841 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.841 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.841 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.841 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.841 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.841 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.841 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.841 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.841 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.841 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.842 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.842 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.842 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.842 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.842 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.842 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.842 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.842 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.842 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.842 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.842 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.842 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.842 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.842 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.842 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.843 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.843 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.843 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.843 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.843 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.843 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.843 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.843 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.843 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.843 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.843 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.843 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.843 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.843 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.843 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.843 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.844 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.844 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.844 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.844 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.844 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.844 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.844 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.844 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.844 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.844 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.844 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.844 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.844 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.844 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.844 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.845 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.845 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.845 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.845 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.845 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.845 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.845 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.845 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.845 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.845 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.845 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.845 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.845 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.846 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.846 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.846 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.846 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.846 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.846 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.846 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.846 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.846 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.846 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.846 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.846 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.846 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.846 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.847 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.847 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.847 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.847 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.847 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.847 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.847 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.847 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.847 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.847 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.847 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.847 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.847 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.847 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.847 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.848 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.848 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.848 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.848 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.848 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.848 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.848 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.848 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.848 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:19.848 INFO:teuthology.orchestra.run.smithi044.stdout: def test_sse_kms_multipart_upload(): 2023-12-03T12:39:19.848 INFO:teuthology.orchestra.run.smithi044.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:39:19.848 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.848 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.848 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9894: 2023-12-03T12:39:19.849 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.849 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.849 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.849 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.849 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.849 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.849 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.849 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.849 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.849 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.849 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.849 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.849 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.849 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.849 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.850 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.850 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.850 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.850 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.850 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.850 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.850 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.850 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.850 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.850 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.850 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.850 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.850 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.851 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.851 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.851 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.851 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.851 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.851 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.851 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.851 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.851 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.851 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.851 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.851 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.851 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.851 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.851 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.852 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.852 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.852 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.852 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.852 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.852 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.852 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.852 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.852 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.852 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.852 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.852 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.852 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.852 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.852 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.853 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.853 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.853 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.853 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.853 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.853 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.853 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.853 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.853 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.853 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.853 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.853 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.853 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.853 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.854 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.854 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.854 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.854 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.854 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.854 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.854 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.854 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.854 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.854 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.854 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.854 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.854 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.854 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.855 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.855 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.855 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.855 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-422" 2023-12-03T12:39:19.855 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.855 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.855 INFO:teuthology.orchestra.run.smithi044.stdout:___________________ test_sse_kms_multipart_invalid_chunks_1 ____________________ 2023-12-03T12:39:19.855 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.855 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.855 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.855 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.855 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.855 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.855 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.855 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.856 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.856 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.856 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.856 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.856 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.856 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.856 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.856 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.856 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.856 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.856 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.856 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.856 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.856 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.856 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.856 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.857 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.857 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.857 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.857 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.857 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.857 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.857 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.857 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.857 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.857 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.857 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.857 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.858 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.858 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.858 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.858 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.858 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.858 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.858 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.858 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.858 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.858 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.858 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.858 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.858 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.859 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.859 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.859 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.859 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.859 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.859 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.859 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.859 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.859 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.859 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.859 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.859 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.860 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.860 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.860 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.860 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.860 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.860 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.860 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.860 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.860 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.860 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.860 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.860 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.860 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.860 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.860 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.861 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.861 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.861 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.861 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.861 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.861 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.861 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.861 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.861 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.861 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.861 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.861 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.861 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.861 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.861 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.862 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.862 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.862 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.862 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.862 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.862 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.862 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.862 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.862 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.862 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.862 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.862 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.862 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.862 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.863 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.863 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.863 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.863 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.863 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.863 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.863 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.863 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.863 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.863 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.863 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.863 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.863 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.863 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.863 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.864 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.864 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.864 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.864 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.864 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.864 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.864 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.864 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.864 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.864 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.864 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.864 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.864 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.864 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.865 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.865 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.865 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.865 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.865 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.865 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.865 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.865 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.865 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.865 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.865 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.865 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.865 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.865 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.865 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.865 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.865 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.865 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.866 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.866 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.866 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.866 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.866 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.866 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.866 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.866 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.866 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.866 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.866 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.866 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.866 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.866 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.866 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.867 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.867 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.867 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.867 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.867 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.867 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.867 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.867 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.867 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.867 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.867 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.867 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.867 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.868 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.868 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.868 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:19.868 INFO:teuthology.orchestra.run.smithi044.stdout: def test_sse_kms_multipart_invalid_chunks_1(): 2023-12-03T12:39:19.868 INFO:teuthology.orchestra.run.smithi044.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:39:19.868 INFO:teuthology.orchestra.run.smithi044.stdout: kms_keyid2 = get_secondary_kms_keyid() 2023-12-03T12:39:19.868 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.868 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.868 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9940: 2023-12-03T12:39:19.868 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.868 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.868 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.868 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.868 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.868 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.869 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.869 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.869 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.869 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.869 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.869 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.869 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.870 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.870 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.870 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.870 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.870 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.870 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.870 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.871 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.871 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.871 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.871 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.871 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.871 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.871 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.871 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.871 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.871 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.872 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.872 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.872 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.872 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.872 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.872 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.872 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.872 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.872 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.872 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.872 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.872 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.872 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.873 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.873 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.873 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.873 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.873 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.873 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.873 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.873 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.873 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.873 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.873 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.873 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.873 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.873 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.873 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.874 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.874 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.874 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.874 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.874 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.874 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.874 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.874 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.874 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.874 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.874 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.874 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-423" 2023-12-03T12:39:19.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.875 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.875 INFO:teuthology.orchestra.run.smithi044.stdout:___________________ test_sse_kms_multipart_invalid_chunks_2 ____________________ 2023-12-03T12:39:19.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.875 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.875 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.875 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.875 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.875 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.875 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.875 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.875 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.876 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.876 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.876 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.876 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.876 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.876 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.876 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.876 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.876 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.876 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.876 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.877 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.877 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.877 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.877 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.877 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.877 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.877 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.877 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.877 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.877 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.877 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.878 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.878 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.878 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.878 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.878 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.878 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.878 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.878 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.878 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.878 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.878 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.878 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.878 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.878 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.879 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.879 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.879 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.879 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.879 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.879 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.879 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.879 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.879 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.879 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.879 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.879 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.879 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.879 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.879 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.880 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.880 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.880 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.880 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.880 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.880 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.880 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.880 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.880 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.880 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.881 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.881 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.881 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.881 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.881 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.881 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.881 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.881 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.881 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.881 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.881 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.881 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.882 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.882 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.882 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.882 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.882 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.882 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.882 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.882 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.882 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.882 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.882 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.882 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.882 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.883 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.883 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.883 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.883 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.883 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.883 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.883 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.883 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.883 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.883 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.883 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.883 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.883 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.883 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.884 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.884 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.884 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.884 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.884 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.884 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.884 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.884 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.884 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.884 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.884 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.884 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.884 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.884 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.885 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.885 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.885 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.885 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.885 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.885 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.885 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.885 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.885 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.885 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.885 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.885 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.885 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.885 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.885 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.886 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.886 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.886 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.886 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.886 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.886 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.886 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.886 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.886 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.886 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.886 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.886 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.886 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.887 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.887 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.887 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.887 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.887 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.887 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.887 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.887 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.887 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.887 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.887 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.887 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.887 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.887 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.888 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.888 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.888 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:19.888 INFO:teuthology.orchestra.run.smithi044.stdout: def test_sse_kms_multipart_invalid_chunks_2(): 2023-12-03T12:39:19.888 INFO:teuthology.orchestra.run.smithi044.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:39:19.888 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.888 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9966: 2023-12-03T12:39:19.888 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.888 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.888 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.888 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.888 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.889 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.889 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.889 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.889 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.889 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.889 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.889 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.890 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.890 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.890 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.890 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.890 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.890 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.890 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.891 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.891 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.891 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.891 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.891 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.891 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.891 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.891 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.891 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.891 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.891 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.891 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.891 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.891 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.892 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.892 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.892 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.892 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.892 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.892 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.892 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.892 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.892 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.892 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.892 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.892 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.892 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.893 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.893 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.893 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.893 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.893 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.893 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.893 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.893 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.893 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.893 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.893 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.893 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.893 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.893 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.893 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.894 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.894 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.894 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.894 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.894 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.894 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.894 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.894 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.894 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.894 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.894 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.894 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.894 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.894 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-424" 2023-12-03T12:39:19.895 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.895 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.895 INFO:teuthology.orchestra.run.smithi044.stdout:________________ test_sse_kms_post_object_authenticated_request ________________ 2023-12-03T12:39:19.895 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.895 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.895 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.895 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.895 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.895 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.895 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.895 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.895 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.895 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.895 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.896 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.896 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.896 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.896 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.896 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.896 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.896 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.896 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.896 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.896 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.896 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.896 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.896 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.896 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.896 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.896 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.897 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.897 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.897 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.897 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.897 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.897 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.897 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.897 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.897 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.897 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.897 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.897 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.897 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.897 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.897 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.897 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.898 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.898 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.898 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.898 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.898 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.898 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.898 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.898 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.898 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.898 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.898 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.898 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.898 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.899 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.899 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.899 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.899 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.899 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.899 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.899 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.899 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.899 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.899 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.899 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.899 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.900 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.900 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.900 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.900 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.900 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.900 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.900 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.900 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.900 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.900 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.900 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.900 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.900 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.900 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.901 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.901 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.901 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.901 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.901 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.901 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.901 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.901 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.901 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.901 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.901 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.901 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.901 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.902 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.902 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.902 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.902 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.902 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.902 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.902 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.902 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.902 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.902 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.902 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.902 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.902 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.902 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.903 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.903 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.903 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.903 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.903 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.903 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.903 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.903 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.903 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.903 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.903 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.903 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.903 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.903 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.903 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.904 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.904 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.904 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.904 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.904 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.904 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.904 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.904 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.904 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.904 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.904 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.904 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.904 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.904 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.905 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.905 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.905 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.905 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.905 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.905 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.905 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.905 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.905 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.905 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.905 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.905 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.905 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.905 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.906 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.906 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.906 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.906 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.906 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.906 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.906 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.906 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.906 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.906 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.906 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.906 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.906 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.906 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.907 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.907 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.907 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.907 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.907 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.907 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.907 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.907 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.907 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.907 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.907 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.908 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:19.908 INFO:teuthology.orchestra.run.smithi044.stdout: def test_sse_kms_post_object_authenticated_request(): 2023-12-03T12:39:19.908 INFO:teuthology.orchestra.run.smithi044.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:39:19.908 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:19.908 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.908 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9992: 2023-12-03T12:39:19.908 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.908 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.908 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.908 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.908 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.908 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.908 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.908 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.909 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.909 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.909 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.909 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.909 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.909 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.909 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.909 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.909 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.909 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.909 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.909 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.909 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.909 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.910 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.910 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.910 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.910 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.910 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.910 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.910 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.910 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.910 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.910 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.910 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.910 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.910 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.910 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.910 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.911 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.911 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.911 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.911 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.911 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.911 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.911 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.911 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.911 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.911 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.911 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.911 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.912 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.912 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.912 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.912 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.912 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.912 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.912 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.912 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.912 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.912 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.912 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.912 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.912 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.913 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.913 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.913 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.913 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.913 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.913 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.913 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.913 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.913 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.913 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.913 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.913 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.913 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.913 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.914 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.914 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.914 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.914 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.914 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.914 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.914 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.914 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.914 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.914 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.914 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.914 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-425" 2023-12-03T12:39:19.914 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.914 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.914 INFO:teuthology.orchestra.run.smithi044.stdout:___________________________ test_sse_kms_transfer_1b ___________________________ 2023-12-03T12:39:19.915 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.915 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.915 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.915 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.915 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.915 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.915 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.915 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.915 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.915 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.915 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.915 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.915 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.915 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.916 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.916 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.916 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.916 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.916 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.916 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.916 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.916 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.916 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.916 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.916 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.917 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.917 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.917 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.917 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.917 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.917 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.917 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.917 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.917 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.917 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.917 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.917 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.917 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.917 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.918 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.918 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.918 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.918 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.918 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.918 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.918 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.918 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.918 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.918 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.918 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.919 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.919 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.919 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.919 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.919 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.919 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.919 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.919 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.919 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.919 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.919 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.919 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.919 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.919 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.920 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.920 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.920 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.920 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.920 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.920 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.920 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.920 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.920 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.920 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.920 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.920 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.920 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.920 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.921 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.921 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.921 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.921 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.921 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.921 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.921 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.921 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.921 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.921 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.921 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.921 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.921 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.921 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.922 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.922 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.922 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.922 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.922 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.922 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.922 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.922 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.922 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.922 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.922 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.922 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.922 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.922 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.923 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.923 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.923 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.923 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.923 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.923 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.923 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.923 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.923 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.923 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.923 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.923 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.923 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.923 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.924 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.924 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.924 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.924 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.924 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.924 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.924 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.924 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.924 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.924 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.924 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.924 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.924 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.925 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.925 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.925 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.925 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.925 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.925 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.925 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.925 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.925 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.925 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.925 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.925 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.925 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.926 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.926 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.926 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.926 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.926 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.926 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.926 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.926 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.926 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.926 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.926 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.926 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.926 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.927 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.927 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.927 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.927 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.927 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.927 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.927 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.927 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.927 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.927 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.927 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.927 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.928 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.928 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.928 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.928 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.928 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.928 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:19.928 INFO:teuthology.orchestra.run.smithi044.stdout: def test_sse_kms_transfer_1b(): 2023-12-03T12:39:19.928 INFO:teuthology.orchestra.run.smithi044.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:39:19.928 INFO:teuthology.orchestra.run.smithi044.stdout: if kms_keyid is None: 2023-12-03T12:39:19.928 INFO:teuthology.orchestra.run.smithi044.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-12-03T12:39:19.928 INFO:teuthology.orchestra.run.smithi044.stdout:> _test_sse_kms_customer_write(1, key_id = kms_keyid) 2023-12-03T12:39:19.928 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.928 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10040: 2023-12-03T12:39:19.928 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.928 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9788: in _test_sse_kms_customer_write 2023-12-03T12:39:19.929 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.929 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.929 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.929 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.929 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.929 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.929 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.930 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.930 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.930 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.930 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.930 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.930 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.930 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.930 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.930 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.930 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.930 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.930 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.931 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.931 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.931 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.931 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.931 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.931 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.931 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.931 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.931 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.931 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.931 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.931 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.931 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.931 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.932 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.932 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.932 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.932 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.932 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.932 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.932 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.932 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.932 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.932 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.932 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.932 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.932 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.932 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.933 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.933 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.933 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.933 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.933 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.933 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.933 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.933 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.933 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.933 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.933 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.933 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.933 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.933 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.934 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.934 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.934 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.934 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.934 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.934 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.934 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.934 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.934 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.934 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.934 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.934 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.934 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.934 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.934 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.935 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.935 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.935 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.935 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.935 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.935 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-426" 2023-12-03T12:39:19.935 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:__________________________ test_sse_kms_transfer_1kb ___________________________ 2023-12-03T12:39:19.935 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.935 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.936 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.936 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.936 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.936 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.936 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.936 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.936 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.936 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.936 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.936 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.936 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.936 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.937 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.937 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.937 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.938 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.938 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.938 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.938 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.938 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.938 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.938 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.938 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.938 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.938 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.938 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.938 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.938 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.938 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.939 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.939 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.939 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.939 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.939 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.939 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.939 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.939 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.939 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.939 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.939 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.939 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.939 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.939 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.939 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.940 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.940 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.940 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.940 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.940 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.940 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.940 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.940 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.940 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.940 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.940 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.940 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.940 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.940 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.941 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.941 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.941 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.941 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.941 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.941 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.941 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.941 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.941 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.941 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.942 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.942 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.942 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.942 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.942 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.942 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.942 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.942 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.942 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.942 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.942 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.942 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.942 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.943 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.943 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.943 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.943 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.943 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.943 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.943 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.943 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.943 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.943 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.943 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.943 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.943 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.943 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.944 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.944 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.944 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.944 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.944 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.944 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.944 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.944 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.945 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.945 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.945 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.945 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.945 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.945 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.945 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.945 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.945 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.945 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.945 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.945 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.945 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.945 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.945 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.946 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.946 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.946 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.946 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.946 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.946 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.946 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.946 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.946 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.946 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.946 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.946 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.946 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.946 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.947 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.947 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.947 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.947 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.947 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.947 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.947 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.947 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.947 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.947 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.947 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.948 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.948 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.948 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.948 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.948 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.948 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.948 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.948 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.948 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.948 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.949 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:19.949 INFO:teuthology.orchestra.run.smithi044.stdout: def test_sse_kms_transfer_1kb(): 2023-12-03T12:39:19.949 INFO:teuthology.orchestra.run.smithi044.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:39:19.949 INFO:teuthology.orchestra.run.smithi044.stdout: if kms_keyid is None: 2023-12-03T12:39:19.949 INFO:teuthology.orchestra.run.smithi044.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-12-03T12:39:19.949 INFO:teuthology.orchestra.run.smithi044.stdout:> _test_sse_kms_customer_write(1024, key_id = kms_keyid) 2023-12-03T12:39:19.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.949 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10049: 2023-12-03T12:39:19.949 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.949 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9788: in _test_sse_kms_customer_write 2023-12-03T12:39:19.949 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:19.949 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.949 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.949 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.949 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.950 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.950 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.950 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.950 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.950 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.950 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.950 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.950 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.950 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.950 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.950 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.950 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.950 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.950 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.950 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.951 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.951 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.951 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.951 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.951 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.951 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.951 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.952 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.952 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.952 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.952 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.952 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.952 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.952 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.952 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.952 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.952 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.952 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.952 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.952 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.952 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.952 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.953 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.953 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.953 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.953 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.953 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.953 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.953 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.953 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.953 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.953 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.953 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.954 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.954 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.954 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.954 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.954 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.954 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.954 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.954 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.954 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.954 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.954 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.954 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.954 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.954 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.955 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.955 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.955 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.955 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.955 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.955 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.955 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.955 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.955 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.955 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.955 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.955 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.956 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.956 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-427" 2023-12-03T12:39:19.956 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.956 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.956 INFO:teuthology.orchestra.run.smithi044.stdout:__________________________ test_sse_kms_transfer_1MB ___________________________ 2023-12-03T12:39:19.956 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.956 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.956 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.956 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.956 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.956 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.956 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.956 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.956 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.956 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.957 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.957 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.957 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.957 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.957 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.957 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.957 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.957 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.957 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.957 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.957 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.957 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.957 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.957 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.957 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.958 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.958 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.958 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.958 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.958 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.958 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.958 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.958 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.958 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.958 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.958 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.958 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.958 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.958 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.959 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.959 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.959 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.959 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.959 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.959 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.959 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.959 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.959 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.959 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.959 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.959 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.959 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.959 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.960 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.960 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.960 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.960 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.960 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.960 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.960 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.960 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.960 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.960 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.960 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.960 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.960 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.960 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.961 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.961 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.961 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.961 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.961 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.961 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.961 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.961 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.961 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.961 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.961 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.961 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.961 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.961 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.961 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.962 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.962 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.962 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.962 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.962 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.962 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.962 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.962 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.962 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.962 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.962 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.962 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.962 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.963 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.963 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.963 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.963 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.963 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.963 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.963 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.963 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.963 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.963 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.963 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.963 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.963 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.963 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.963 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.964 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.964 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.964 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.964 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.964 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.964 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.964 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.964 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.964 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.964 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.964 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.964 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.964 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.965 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.965 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.965 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.965 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.965 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.965 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.965 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.965 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.965 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.965 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.965 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.965 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.965 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.965 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.965 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.966 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.966 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.966 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.966 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.966 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.966 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.966 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.966 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.966 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.966 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.966 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.966 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.967 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.967 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.967 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.967 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.967 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.967 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.967 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.967 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.967 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.967 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.967 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.967 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.967 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.967 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.968 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.968 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.968 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.968 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.968 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.968 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.968 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.968 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.968 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.968 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.968 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.968 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.968 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.968 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.969 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.969 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.969 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.969 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.969 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:19.969 INFO:teuthology.orchestra.run.smithi044.stdout: def test_sse_kms_transfer_1MB(): 2023-12-03T12:39:19.969 INFO:teuthology.orchestra.run.smithi044.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:39:19.969 INFO:teuthology.orchestra.run.smithi044.stdout: if kms_keyid is None: 2023-12-03T12:39:19.969 INFO:teuthology.orchestra.run.smithi044.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-12-03T12:39:19.969 INFO:teuthology.orchestra.run.smithi044.stdout:> _test_sse_kms_customer_write(1024*1024, key_id = kms_keyid) 2023-12-03T12:39:19.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.969 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10058: 2023-12-03T12:39:19.970 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.970 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9788: in _test_sse_kms_customer_write 2023-12-03T12:39:19.970 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:19.970 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.970 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.970 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.970 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.970 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.970 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.970 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.970 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.970 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.970 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.970 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.971 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.971 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.971 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.971 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.971 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.971 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.971 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.971 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.971 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.971 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.971 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.971 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.971 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.971 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.972 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.972 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.972 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.972 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.972 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.972 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.972 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.972 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.972 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.972 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.972 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.972 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.972 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.972 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.972 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.973 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.973 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.973 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.973 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.973 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.973 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.973 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.973 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.973 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.973 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.973 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.973 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.973 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.973 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.974 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.974 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.974 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.974 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.974 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.974 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.974 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.974 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.974 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.974 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.974 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.974 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.974 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.974 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.974 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.975 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.975 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.975 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.975 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.975 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.975 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.975 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.975 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.975 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.975 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.975 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.975 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.975 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.975 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.976 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.976 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.976 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.976 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.976 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.976 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-428" 2023-12-03T12:39:19.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.976 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.976 INFO:teuthology.orchestra.run.smithi044.stdout:__________________________ test_sse_kms_transfer_13b ___________________________ 2023-12-03T12:39:19.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.976 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.976 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.976 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.977 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.977 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.977 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.977 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.977 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.977 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.977 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.977 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.977 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.977 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.977 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.978 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.978 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.978 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.978 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.978 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.978 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.978 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.978 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.978 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.978 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.978 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.978 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.978 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.979 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.979 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.979 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.979 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.979 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.979 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.979 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.979 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.979 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.979 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.979 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.979 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.979 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.979 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.979 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.980 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:19.980 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:19.980 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:19.980 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:19.980 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.980 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:19.980 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:19.980 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:19.980 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:19.980 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.980 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.980 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:19.980 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:19.980 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:19.981 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:19.981 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.981 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.981 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:19.981 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:19.981 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:19.981 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.981 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:19.981 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.981 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:19.981 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:19.981 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.982 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:19.982 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:19.982 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:19.982 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:19.982 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:19.982 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:19.982 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.982 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:19.982 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.982 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.982 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.982 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.982 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.982 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.982 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.983 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.983 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.983 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.983 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.983 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.983 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.983 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.983 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.983 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.983 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.983 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.983 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.983 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.983 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.983 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.984 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.984 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:19.984 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.984 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.984 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.984 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.984 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.984 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.984 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.984 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.984 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.984 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.985 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:19.985 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:19.985 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:19.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:19.985 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:19.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:19.985 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:19.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:19.985 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:19.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:19.985 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:19.985 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:19.985 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:19.986 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:19.986 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:19.986 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:19.986 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:19.986 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:19.986 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.986 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:19.986 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:19.986 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:19.986 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:19.986 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:19.986 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:19.986 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:19.986 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:19.987 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:19.987 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:19.987 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.987 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.987 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.987 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.987 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.987 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.987 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.987 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.987 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.987 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.987 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.987 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.987 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.988 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.988 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.988 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.988 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.988 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:19.988 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.988 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.988 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.988 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:19.988 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:19.988 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:19.988 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:19.988 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:19.988 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.988 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.989 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:19.989 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:19.989 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:19.989 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.989 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:19.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.989 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:19.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.989 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:19.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.989 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:19.989 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:19.989 INFO:teuthology.orchestra.run.smithi044.stdout: def test_sse_kms_transfer_13b(): 2023-12-03T12:39:19.989 INFO:teuthology.orchestra.run.smithi044.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:39:19.989 INFO:teuthology.orchestra.run.smithi044.stdout: if kms_keyid is None: 2023-12-03T12:39:19.990 INFO:teuthology.orchestra.run.smithi044.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-12-03T12:39:19.990 INFO:teuthology.orchestra.run.smithi044.stdout:> _test_sse_kms_customer_write(13, key_id = kms_keyid) 2023-12-03T12:39:19.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.990 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10067: 2023-12-03T12:39:19.990 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.990 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:9788: in _test_sse_kms_customer_write 2023-12-03T12:39:19.990 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:19.990 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:19.990 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:19.990 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:19.990 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:19.990 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:19.990 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:19.990 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:19.991 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:19.991 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:19.991 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:19.991 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:19.991 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:19.991 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:19.991 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:19.991 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:19.991 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:19.991 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:19.991 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:19.991 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:19.991 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:19.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:19.992 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:19.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:19.992 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:19.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:19.992 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:19.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:19.992 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:19.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:19.992 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:19.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:19.992 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:19.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:19.992 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:19.993 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.993 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:19.993 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.993 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:19.993 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.993 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:19.993 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:19.993 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:19.993 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:19.993 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:19.993 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:19.994 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.994 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:19.994 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:19.994 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:19.994 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:19.994 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:19.994 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:19.994 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.994 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:19.994 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:19.994 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:19.994 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:19.994 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:19.994 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:19.995 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:19.995 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:19.995 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:19.995 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:19.995 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:19.995 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.995 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:19.995 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:19.995 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:19.995 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:19.995 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:19.995 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.995 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:19.996 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:19.996 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:19.996 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:19.996 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:19.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.996 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:19.996 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:19.996 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.996 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:19.996 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:19.996 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-429" 2023-12-03T12:39:19.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.996 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:19.996 INFO:teuthology.orchestra.run.smithi044.stdout:__________________________ test_sse_kms_read_declare ___________________________ 2023-12-03T12:39:19.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.997 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:19.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.997 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:19.997 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:19.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.997 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:19.997 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:19.997 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:19.997 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:19.997 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:19.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.997 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:19.997 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:19.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.997 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:19.998 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:19.998 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:19.998 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:19.998 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:19.998 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:19.998 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:19.998 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:19.998 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.998 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:19.998 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:19.998 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.998 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:19.998 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:19.999 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:19.999 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:19.999 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:19.999 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:19.999 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:19.999 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:19.999 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:19.999 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:19.999 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:19.999 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:19.999 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:19.999 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:19.999 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:19.999 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:19.999 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.000 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.000 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.000 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.000 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.000 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.000 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.000 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.000 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.000 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.000 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.000 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.000 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.000 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.000 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.001 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.001 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.001 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.001 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.001 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.001 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.001 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.001 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.001 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.001 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.001 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.001 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.001 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.001 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.001 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.001 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.002 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.002 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.002 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.002 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.002 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.002 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.002 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.002 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.002 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.003 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.003 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.003 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.003 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.003 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.003 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.003 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.003 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.003 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.003 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.003 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.003 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.003 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.004 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.004 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.004 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.004 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.004 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.004 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.004 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.004 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.004 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.004 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.004 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.004 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.004 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.004 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.004 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.004 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.005 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.005 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.005 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.005 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.005 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.005 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.005 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.005 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.006 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.006 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.006 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.006 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.006 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.006 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.006 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.006 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.006 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.006 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.007 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.007 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.007 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.007 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.007 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.007 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.007 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.007 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.007 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.007 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.008 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.008 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.008 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.008 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.008 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.008 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.008 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.008 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.008 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.008 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.008 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.008 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.008 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.008 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.008 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.009 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.009 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.009 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.009 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.009 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.009 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.009 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:20.009 INFO:teuthology.orchestra.run.smithi044.stdout: def test_sse_kms_read_declare(): 2023-12-03T12:39:20.009 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:20.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.009 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10072: 2023-12-03T12:39:20.009 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.010 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.010 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.010 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.010 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.010 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.010 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.010 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.010 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.011 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.011 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.011 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.011 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.011 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.011 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.011 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.011 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.012 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.012 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.012 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.012 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.012 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.012 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.012 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.012 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.012 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.012 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.012 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.012 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.012 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.012 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.012 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.013 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.013 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.013 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.013 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.013 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.013 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.013 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.013 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.013 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.013 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.013 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.013 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.013 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.013 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.014 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.014 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.014 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.014 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.014 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.014 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.014 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.014 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.014 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.014 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.014 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.014 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.015 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.015 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.015 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.015 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.015 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.015 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.015 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.015 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.015 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.015 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.015 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.015 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.016 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.016 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.016 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.016 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-430" 2023-12-03T12:39:20.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.016 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.016 INFO:teuthology.orchestra.run.smithi044.stdout:______________________________ test_bucket_policy ______________________________ 2023-12-03T12:39:20.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.016 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.016 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.016 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.016 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.016 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.017 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.017 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.017 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.017 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.017 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.017 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.017 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.017 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.017 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.017 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.017 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.017 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.017 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.017 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.017 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.018 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.018 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.018 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.018 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.018 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.018 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.018 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.018 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.018 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.018 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.018 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.018 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.018 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.018 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.021 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.021 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.021 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.021 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.021 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.021 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.021 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.021 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.021 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.021 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.021 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.022 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.022 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.022 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.022 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.022 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.022 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.022 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.022 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.022 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.022 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.022 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.022 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.022 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.022 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.022 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.023 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.023 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.023 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.023 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.023 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.023 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.023 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.023 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.023 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.023 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.023 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.023 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.023 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.023 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.024 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.024 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.024 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.024 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.024 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.024 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.024 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.024 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.024 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.024 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.024 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.024 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.025 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.025 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.025 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.025 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.025 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.025 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.025 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.025 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.025 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.025 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.025 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.025 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.025 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.025 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.025 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.026 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.026 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.026 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.026 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.026 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.026 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.026 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.026 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.026 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.026 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.026 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.026 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.026 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.026 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.027 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.027 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.027 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.027 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.027 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.027 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.027 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.027 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.027 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.027 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.027 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.027 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.027 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.027 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.027 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.028 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.028 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.028 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.028 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.028 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.028 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.028 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.028 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.028 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.028 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.028 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.028 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.029 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.029 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.029 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.029 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.029 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.029 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.029 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.029 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.029 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.030 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.030 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.030 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.030 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.030 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.030 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.030 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.030 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.030 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.030 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.030 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.030 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.030 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.030 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.031 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.031 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.031 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.031 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.031 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.031 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.031 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.031 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.031 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.031 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.031 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.031 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.031 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.032 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.bucket_policy 2023-12-03T12:39:20.032 INFO:teuthology.orchestra.run.smithi044.stdout: def test_bucket_policy(): 2023-12-03T12:39:20.032 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:20.032 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.032 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10091: 2023-12-03T12:39:20.032 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.032 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.032 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.032 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.032 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.032 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.032 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.032 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.032 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.032 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.033 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.033 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.033 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.033 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.033 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.033 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.033 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.033 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.033 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.033 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.033 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.033 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.033 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.034 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.034 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.034 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.034 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.034 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.034 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.034 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.034 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.034 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.034 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.034 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.034 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.034 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.034 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.035 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.035 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.035 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.035 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.035 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.035 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.035 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.035 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.035 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.035 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.035 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.035 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.035 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.036 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.036 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.036 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.036 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.036 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.036 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.036 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.036 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.036 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.036 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.036 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.036 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.036 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.036 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.037 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.037 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.037 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.037 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.037 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.037 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.037 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.037 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.037 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.037 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.037 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.037 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.037 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.037 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.038 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.038 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.038 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.038 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.038 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.038 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.038 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.038 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.038 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.038 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-431" 2023-12-03T12:39:20.038 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.038 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.038 INFO:teuthology.orchestra.run.smithi044.stdout:_____________________________ test_bucketv2_policy _____________________________ 2023-12-03T12:39:20.038 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.039 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.039 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.039 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.039 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.039 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.039 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.039 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.039 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.039 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.039 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.039 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.040 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.040 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.040 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.040 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.040 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.040 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.040 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.040 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.040 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.040 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.040 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.040 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.040 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.040 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.040 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.041 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.041 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.041 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.041 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.041 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.041 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.041 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.041 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.041 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.041 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.041 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.041 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.042 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.042 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.042 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.042 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.042 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.042 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.042 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.042 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.042 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.042 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.042 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.042 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.042 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.043 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.043 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.043 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.043 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.043 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.043 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.043 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.043 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.043 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.043 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.043 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.043 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.043 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.043 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.044 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.044 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.044 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.044 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.044 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.044 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.044 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.044 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.044 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.044 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.044 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.044 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.044 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.045 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.045 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.045 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.045 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.045 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.045 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.045 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.045 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.045 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.045 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.045 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.045 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.045 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.045 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.045 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.046 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.046 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.046 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.046 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.046 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.046 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.046 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.046 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.046 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.046 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.046 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.046 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.046 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.046 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.047 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.047 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.047 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.047 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.047 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.047 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.047 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.047 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.047 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.047 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.047 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.047 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.047 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.048 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.048 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.048 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.048 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.048 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.048 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.048 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.048 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.048 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.049 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.049 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.049 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.049 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.049 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.049 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.049 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.049 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.049 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.049 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.049 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.049 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.049 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.049 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.049 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.049 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.049 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.050 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.050 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.050 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.050 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.050 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.050 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.050 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.050 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.050 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.050 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.050 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.050 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.050 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.050 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.051 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.051 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.051 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.051 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.051 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.051 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.051 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.051 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.051 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.051 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.051 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.051 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.051 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.bucket_policy 2023-12-03T12:39:20.051 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.list_objects_v2 2023-12-03T12:39:20.052 INFO:teuthology.orchestra.run.smithi044.stdout: def test_bucketv2_policy(): 2023-12-03T12:39:20.052 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:20.052 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.052 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10121: 2023-12-03T12:39:20.052 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.052 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.052 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.052 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.052 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.052 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.052 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.052 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.052 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.052 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.052 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.053 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.053 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.053 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.053 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.053 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.053 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.053 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.053 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.053 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.053 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.053 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.053 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.053 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.054 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.054 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.054 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.054 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.054 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.054 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.054 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.054 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.054 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.054 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.054 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.054 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.054 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.055 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.055 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.055 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.055 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.055 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.055 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.055 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.055 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.055 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.055 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.055 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.055 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.055 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.055 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.055 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.056 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.056 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.056 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.056 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.056 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.056 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.056 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.056 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.056 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.056 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.056 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.056 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.056 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.056 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.056 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.056 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.056 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.057 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.057 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.057 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.057 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.057 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.057 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.057 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.057 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.057 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.057 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.057 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.057 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.057 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.057 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.058 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.058 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.058 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.058 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.058 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.058 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-432" 2023-12-03T12:39:20.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.058 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.058 INFO:teuthology.orchestra.run.smithi044.stdout:____________________________ test_bucket_policy_acl ____________________________ 2023-12-03T12:39:20.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.058 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.059 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.059 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.059 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.059 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.059 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.059 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.059 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.059 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.059 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.059 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.059 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.059 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.060 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.060 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.060 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.060 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.060 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.060 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.060 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.060 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.060 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.060 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.060 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.060 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.060 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.061 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.061 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.061 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.061 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.061 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.061 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.061 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.061 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.061 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.061 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.061 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.061 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.061 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.061 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.062 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.062 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.062 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.062 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.062 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.062 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.062 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.062 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.062 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.062 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.062 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.063 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.063 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.063 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.063 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.063 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.063 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.063 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.063 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.063 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.063 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.063 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.063 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.063 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.063 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.063 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.064 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.064 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.064 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.064 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.064 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.064 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.064 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.064 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.064 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.064 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.064 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.064 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.064 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.064 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.064 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.065 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.065 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.065 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.065 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.065 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.065 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.065 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.065 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.065 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.065 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.065 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.065 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.065 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.066 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.066 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.066 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.066 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.066 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.066 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.066 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.066 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.066 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.066 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.066 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.066 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.066 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.066 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.066 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.067 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.067 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.067 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.067 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.067 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.067 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.067 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.067 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.067 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.067 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.067 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.067 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.067 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.068 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.068 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.068 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.068 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.068 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.068 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.068 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.068 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.068 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.068 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.068 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.068 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.068 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.068 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.068 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.068 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.069 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.069 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.069 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.069 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.069 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.069 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.069 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.069 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.069 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.069 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.069 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.070 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.070 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.070 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.070 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.070 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.070 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.070 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.070 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.070 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.070 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.070 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.070 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.070 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.070 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.070 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.071 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.071 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.071 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.071 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.071 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.071 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.071 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.071 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.bucket_policy 2023-12-03T12:39:20.071 INFO:teuthology.orchestra.run.smithi044.stdout: def test_bucket_policy_acl(): 2023-12-03T12:39:20.071 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:20.071 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.071 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10150: 2023-12-03T12:39:20.071 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.071 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.072 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.072 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.072 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.072 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.072 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.072 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.072 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.072 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.073 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.073 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.073 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.073 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.073 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.073 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.073 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.073 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.073 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.073 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.073 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.073 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.073 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.073 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.073 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.074 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.074 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.074 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.074 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.074 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.074 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.074 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.074 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.074 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.074 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.074 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.074 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.074 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.074 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.075 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.075 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.075 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.075 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.075 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.075 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.075 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.075 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.075 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.075 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.075 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.075 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.075 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.075 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.075 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.075 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.076 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.076 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.076 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.076 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.076 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.076 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.076 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.076 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.076 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.076 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.076 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.076 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.076 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.076 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.077 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.077 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.077 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.077 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.077 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.077 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.077 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.077 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.077 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.077 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.077 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.077 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-433" 2023-12-03T12:39:20.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.078 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.078 INFO:teuthology.orchestra.run.smithi044.stdout:___________________________ test_bucketv2_policy_acl ___________________________ 2023-12-03T12:39:20.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.078 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.078 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.078 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.078 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.078 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.078 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.078 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.078 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.079 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.079 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.079 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.079 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.079 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.079 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.079 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.079 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.079 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.079 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.079 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.079 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.079 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.079 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.079 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.080 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.080 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.080 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.080 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.080 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.080 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.080 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.080 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.080 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.080 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.080 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.081 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.081 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.081 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.081 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.081 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.081 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.081 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.081 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.081 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.081 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.081 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.081 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.081 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.082 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.082 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.082 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.082 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.082 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.082 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.082 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.082 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.082 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.082 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.082 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.082 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.083 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.083 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.083 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.083 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.083 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.083 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.083 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.083 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.083 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.083 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.084 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.084 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.084 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.084 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.084 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.084 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.084 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.084 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.084 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.084 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.084 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.084 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.085 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.085 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.085 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.085 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.085 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.085 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.085 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.085 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.085 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.085 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.085 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.085 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.085 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.085 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.085 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.086 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.086 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.086 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.086 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.086 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.086 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.086 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.086 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.086 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.086 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.086 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.086 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.086 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.086 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.086 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.087 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.087 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.087 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.087 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.087 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.087 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.087 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.087 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.087 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.087 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.087 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.087 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.087 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.087 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.088 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.088 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.088 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.088 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.088 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.088 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.088 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.088 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.088 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.088 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.088 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.088 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.089 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.089 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.089 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.089 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.089 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.089 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.089 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.089 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.089 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.089 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.089 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.090 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.090 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.090 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.090 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.090 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.090 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.090 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.090 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.090 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.090 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.090 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.091 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.091 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.091 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.bucket_policy 2023-12-03T12:39:20.091 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.list_objects_v2 2023-12-03T12:39:20.091 INFO:teuthology.orchestra.run.smithi044.stdout: def test_bucketv2_policy_acl(): 2023-12-03T12:39:20.091 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:20.091 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.091 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10186: 2023-12-03T12:39:20.091 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.091 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.091 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.091 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.092 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.092 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.092 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.092 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.092 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.092 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.092 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.092 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.092 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.093 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.093 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.093 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.093 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.093 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.093 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.093 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.093 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.093 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.093 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.093 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.093 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.093 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.093 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.094 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.094 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.094 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.094 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.094 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.094 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.094 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.094 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.094 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.094 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.094 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.094 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.095 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.095 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.095 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.095 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.095 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.095 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.095 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.095 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.095 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.095 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.095 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.095 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.095 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.095 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.095 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.095 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.096 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.096 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.096 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.096 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.096 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.096 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.096 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.096 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.096 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.096 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.096 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.096 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.096 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.097 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.097 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.097 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.097 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.097 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.097 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.097 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.097 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-434" 2023-12-03T12:39:20.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.097 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.097 INFO:teuthology.orchestra.run.smithi044.stdout:______________________ test_bucket_policy_another_bucket _______________________ 2023-12-03T12:39:20.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.097 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.098 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.098 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.098 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.098 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.098 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.098 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.098 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.098 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.098 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.098 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.098 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.098 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.098 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.099 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.099 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.099 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.099 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.099 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.099 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.099 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.099 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.099 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.099 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.099 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.099 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.099 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.100 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.100 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.100 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.100 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.100 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.100 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.100 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.100 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.100 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.100 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.100 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.100 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.100 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.100 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.100 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.101 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.101 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.101 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.101 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.101 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.101 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.101 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.101 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.101 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.101 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.102 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.102 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.102 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.102 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.102 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.102 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.102 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.102 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.102 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.102 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.102 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.102 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.102 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.102 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.103 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.103 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.103 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.103 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.103 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.103 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.103 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.103 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.103 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.103 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.103 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.103 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.103 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.103 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.103 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.104 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.104 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.104 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.104 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.104 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.104 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.104 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.104 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.104 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.104 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.104 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.104 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.104 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.105 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.105 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.105 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.105 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.105 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.105 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.105 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.105 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.105 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.105 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.105 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.105 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.105 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.105 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.105 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.106 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.106 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.106 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.106 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.106 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.106 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.106 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.106 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.106 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.106 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.106 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.106 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.106 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.106 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.107 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.107 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.107 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.107 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.107 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.107 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.107 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.107 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.107 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.107 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.107 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.107 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.107 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.107 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.108 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.108 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.108 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.108 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.108 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.108 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.108 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.108 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.108 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.108 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.108 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.109 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.109 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.109 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.109 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.109 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.109 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.109 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.109 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.109 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.109 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.109 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.109 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.109 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.109 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.109 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.109 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.110 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.110 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.110 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.110 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.110 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.110 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.110 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.110 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.110 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.110 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.bucket_policy 2023-12-03T12:39:20.110 INFO:teuthology.orchestra.run.smithi044.stdout: def test_bucket_policy_another_bucket(): 2023-12-03T12:39:20.110 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:20.110 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.110 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10310: 2023-12-03T12:39:20.110 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.111 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.111 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.111 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.111 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.111 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.111 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.111 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.111 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.111 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.112 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.112 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.112 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.112 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.112 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.112 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.112 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.112 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.112 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.112 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.112 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.112 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.112 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.112 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.112 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.112 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.112 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.113 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.113 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.113 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.113 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.113 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.113 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.113 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.113 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.113 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.113 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.113 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.113 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.113 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.114 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.114 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.114 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.114 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.114 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.114 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.114 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.114 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.114 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.114 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.114 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.114 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.114 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.114 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.114 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.115 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.115 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.115 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.115 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.115 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.115 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.115 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.115 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.115 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.115 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.115 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.115 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.115 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.115 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.115 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.115 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.116 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.116 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.116 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.116 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.116 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.116 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.116 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.116 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.116 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.116 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.116 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.116 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.116 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.116 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-435" 2023-12-03T12:39:20.116 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.117 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.117 INFO:teuthology.orchestra.run.smithi044.stdout:_____________________ test_bucketv2_policy_another_bucket ______________________ 2023-12-03T12:39:20.117 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.117 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.117 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.117 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.117 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.117 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.117 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.117 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.117 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.117 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.117 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.117 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.117 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.118 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.118 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.118 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.118 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.118 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.118 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.118 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.118 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.118 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.118 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.118 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.118 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.118 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.118 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.119 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.119 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.119 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.119 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.119 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.119 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.119 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.119 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.119 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.119 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.119 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.119 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.119 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.119 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.119 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.120 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.120 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.120 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.120 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.120 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.120 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.120 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.120 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.120 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.120 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.120 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.120 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.120 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.120 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.121 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.121 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.121 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.121 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.121 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.121 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.121 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.121 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.121 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.121 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.121 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.121 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.122 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.122 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.122 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.122 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.122 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.122 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.122 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.122 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.122 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.122 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.122 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.122 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.122 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.123 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.123 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.123 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.123 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.123 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.123 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.123 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.123 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.123 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.123 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.123 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.123 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.123 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.123 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.123 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.124 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.124 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.124 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.124 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.124 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.124 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.124 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.124 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.124 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.124 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.124 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.124 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.124 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.125 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.125 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.125 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.125 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.125 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.125 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.125 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.125 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.125 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.125 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.125 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.125 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.126 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.126 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.126 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.126 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.126 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.126 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.126 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.127 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.127 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.127 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.127 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.127 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.127 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.128 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.128 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.128 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.128 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.128 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.128 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.128 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.128 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.128 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.128 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.128 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.129 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.129 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.129 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.129 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.129 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.129 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.129 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.129 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.129 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.129 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.129 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.129 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.129 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.130 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.130 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.bucket_policy 2023-12-03T12:39:20.130 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.list_objects_v2 2023-12-03T12:39:20.130 INFO:teuthology.orchestra.run.smithi044.stdout: def test_bucketv2_policy_another_bucket(): 2023-12-03T12:39:20.130 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:20.130 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.130 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10348: 2023-12-03T12:39:20.130 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.130 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.130 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.130 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.130 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.130 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.130 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.131 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.131 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.131 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.131 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.131 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.131 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.131 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.131 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.131 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.131 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.131 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.131 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.131 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.131 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.132 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.132 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.132 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.132 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.132 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.132 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.132 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.133 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.133 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.133 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.133 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.133 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.133 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.133 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.133 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.133 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.133 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.133 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.133 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.133 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.133 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.133 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.133 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.134 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.134 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.134 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.134 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.134 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.134 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.134 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.134 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.134 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.134 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.134 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.134 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.134 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.134 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.135 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.135 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.135 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.135 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.135 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.135 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.135 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.135 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.135 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.135 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.135 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.135 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.135 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.135 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.136 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.136 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.136 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.136 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.136 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.136 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.136 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.136 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.136 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.136 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-436" 2023-12-03T12:39:20.136 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.136 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.137 INFO:teuthology.orchestra.run.smithi044.stdout:_____________________________ test_get_obj_tagging _____________________________ 2023-12-03T12:39:20.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.137 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.137 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.137 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.137 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.137 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.137 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.137 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.137 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.137 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.138 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.138 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.138 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.138 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.138 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.138 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.138 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.138 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.138 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.138 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.138 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.138 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.138 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.139 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.139 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.139 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.139 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.139 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.139 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.139 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.139 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.139 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.139 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.139 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.139 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.139 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.139 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.139 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.140 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.140 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.140 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.140 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.140 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.140 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.140 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.140 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.140 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.140 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.140 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.140 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.140 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.140 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.140 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.141 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.141 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.141 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.141 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.141 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.141 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.141 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.141 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.141 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.141 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.141 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.142 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.142 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.142 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.142 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.142 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.142 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.142 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.142 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.142 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.142 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.142 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.142 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.142 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.142 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.143 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.143 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.143 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.143 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.143 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.143 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.143 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.143 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.143 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.143 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.143 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.143 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.143 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.143 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.143 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.144 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.144 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.144 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.144 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.144 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.144 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.144 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.144 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.144 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.144 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.144 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.144 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.144 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.144 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.145 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.145 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.145 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.145 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.145 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.145 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.145 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.145 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.145 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.145 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.145 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.145 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.145 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.146 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.146 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.146 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.146 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.146 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.146 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.146 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.146 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.146 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.146 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.146 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.146 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.146 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.146 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.147 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.147 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.147 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.147 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.147 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.147 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.147 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.147 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.147 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.147 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.147 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.147 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.147 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.147 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.148 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.148 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.148 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.148 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.148 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.148 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.148 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.148 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.148 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.148 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.148 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.148 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.149 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.149 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.149 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.149 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.149 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.149 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.149 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.149 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.149 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.149 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.149 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.150 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.150 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:20.150 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.150 INFO:teuthology.orchestra.run.smithi044.stdout: def test_get_obj_tagging(): 2023-12-03T12:39:20.150 INFO:teuthology.orchestra.run.smithi044.stdout: key = 'testputtags' 2023-12-03T12:39:20.150 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:39:20.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.150 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10458: 2023-12-03T12:39:20.150 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.150 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:39:20.150 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:20.151 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.151 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.151 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.151 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.151 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.151 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.151 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.151 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.151 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.151 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.151 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.151 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.151 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.151 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.152 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.152 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.152 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.152 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.152 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.152 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.152 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.153 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.153 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.153 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.153 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.153 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.153 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.153 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.153 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.153 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.154 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.154 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.154 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.154 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.154 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.154 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.154 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.154 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.154 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.154 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.154 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.154 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.154 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.155 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.155 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.155 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.155 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.155 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.155 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.155 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.155 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.155 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.155 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.155 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.155 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.155 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.155 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.156 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.156 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.156 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.156 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.156 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.156 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.156 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.156 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.156 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.156 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.156 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.156 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.156 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.156 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.157 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.157 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.157 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.157 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.157 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.157 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.157 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-437" 2023-12-03T12:39:20.157 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.157 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.157 INFO:teuthology.orchestra.run.smithi044.stdout:__________________________ test_get_obj_head_tagging ___________________________ 2023-12-03T12:39:20.157 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.157 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.157 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.157 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.157 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.158 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.158 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.158 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.158 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.158 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.158 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.158 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.158 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.158 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.158 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.158 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.158 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.158 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.158 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.159 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.159 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.159 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.159 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.159 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.159 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.159 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.159 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.159 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.159 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.159 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.159 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.160 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.160 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.160 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.160 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.160 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.160 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.160 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.160 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.160 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.160 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.160 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.160 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.161 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.161 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.161 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.161 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.161 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.161 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.161 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.161 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.161 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.161 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.161 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.161 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.161 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.162 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.162 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.162 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.162 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.162 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.162 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.162 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.162 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.162 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.162 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.162 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.162 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.162 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.163 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.163 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.163 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.163 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.163 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.163 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.163 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.163 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.163 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.163 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.164 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.164 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.164 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.164 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.164 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.164 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.164 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.164 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.164 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.164 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.164 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.164 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.164 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.164 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.164 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.165 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.165 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.165 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.165 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.165 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.165 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.165 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.165 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.165 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.165 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.165 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.165 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.165 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.166 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.166 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.166 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.166 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.166 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.166 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.166 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.166 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.166 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.166 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.166 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.166 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.166 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.166 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.167 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.167 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.167 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.167 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.167 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.167 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.167 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.167 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.167 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.167 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.167 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.167 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.167 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.167 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.168 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.168 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.168 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.168 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.168 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.168 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.168 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.168 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.168 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.168 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.168 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.168 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.169 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.169 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.169 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.169 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.169 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.169 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.169 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.169 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.169 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.169 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.169 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.169 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.170 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.170 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.170 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.170 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.170 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.170 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.170 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.170 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:20.170 INFO:teuthology.orchestra.run.smithi044.stdout: def test_get_obj_head_tagging(): 2023-12-03T12:39:20.170 INFO:teuthology.orchestra.run.smithi044.stdout: key = 'testputtags' 2023-12-03T12:39:20.171 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:39:20.171 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.171 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10472: 2023-12-03T12:39:20.171 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.171 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:39:20.171 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:20.171 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.171 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.171 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.171 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.171 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.171 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.171 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.171 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.171 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.172 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.172 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.172 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.172 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.172 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.172 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.172 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.172 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.172 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.172 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.172 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.172 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.172 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.172 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.172 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.173 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.173 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.173 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.173 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.173 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.173 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.173 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.173 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.173 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.174 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.174 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.174 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.174 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.174 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.174 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.174 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.174 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.174 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.174 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.174 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.174 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.174 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.174 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.175 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.175 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.175 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.175 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.175 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.175 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.175 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.175 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.175 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.175 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.175 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.175 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.175 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.175 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.176 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.176 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.176 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.176 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.176 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.176 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.176 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.176 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.176 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.176 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.176 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.176 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.176 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.177 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.177 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.177 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.177 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.177 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.177 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.177 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.177 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-438" 2023-12-03T12:39:20.177 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.177 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.177 INFO:teuthology.orchestra.run.smithi044.stdout:______________________________ test_put_max_tags _______________________________ 2023-12-03T12:39:20.177 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.177 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.177 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.177 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.178 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.178 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.178 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.178 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.178 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.178 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.178 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.178 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.178 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.178 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.178 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.178 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.179 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.179 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.179 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.179 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.179 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.179 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.179 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.179 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.179 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.179 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.179 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.179 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.180 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.180 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.180 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.180 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.180 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.180 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.180 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.180 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.180 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.180 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.180 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.180 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.181 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.181 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.181 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.181 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.181 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.181 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.181 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.181 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.181 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.181 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.181 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.181 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.181 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.181 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.182 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.182 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.182 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.182 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.182 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.182 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.182 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.182 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.182 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.182 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.182 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.182 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.182 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.182 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.183 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.183 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.183 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.183 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.183 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.183 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.183 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.183 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.183 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.183 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.183 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.183 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.183 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.183 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.184 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.184 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.184 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.184 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.184 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.184 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.184 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.184 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.184 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.184 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.184 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.184 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.185 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.185 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.185 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.185 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.185 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.185 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.185 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.185 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.185 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.185 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.185 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.185 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.186 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.186 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.186 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.186 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.186 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.186 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.186 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.186 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.186 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.186 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.186 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.186 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.187 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.187 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.187 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.187 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.187 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.187 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.187 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.187 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.187 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.187 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.187 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.187 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.187 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.188 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.188 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.188 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.188 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.188 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.188 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.188 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.188 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.188 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.188 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.188 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.188 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.188 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.189 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.189 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.189 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.189 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.189 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.189 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.189 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.189 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.189 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.189 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.189 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.189 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.189 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.189 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.189 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.190 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.190 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.190 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.190 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.190 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.190 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.190 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.190 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.190 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.190 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.191 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:20.191 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.191 INFO:teuthology.orchestra.run.smithi044.stdout: def test_put_max_tags(): 2023-12-03T12:39:20.191 INFO:teuthology.orchestra.run.smithi044.stdout: key = 'testputmaxtags' 2023-12-03T12:39:20.191 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:39:20.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.191 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10488: 2023-12-03T12:39:20.191 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.191 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:39:20.191 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:20.191 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.191 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.191 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.191 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.192 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.192 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.192 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.192 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.192 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.192 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.192 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.192 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.192 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.192 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.192 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.192 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.192 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.192 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.192 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.193 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.193 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.193 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.193 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.193 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.193 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.193 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.194 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.194 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.194 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.194 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.194 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.194 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.194 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.194 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.194 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.194 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.194 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.194 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.195 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.195 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.195 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.195 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.195 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.195 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.195 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.195 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.195 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.195 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.195 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.195 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.195 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.195 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.195 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.196 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.196 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.196 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.196 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.196 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.196 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.196 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.196 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.196 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.196 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.196 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.196 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.196 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.196 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.196 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.196 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.197 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.197 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.197 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.197 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.197 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.197 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.197 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.197 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.197 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.197 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.197 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.197 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-439" 2023-12-03T12:39:20.197 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.197 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.198 INFO:teuthology.orchestra.run.smithi044.stdout:_____________________________ test_put_excess_tags _____________________________ 2023-12-03T12:39:20.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.198 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.198 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.198 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.198 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.198 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.198 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.198 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.198 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.199 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.199 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.199 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.199 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.199 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.199 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.199 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.199 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.199 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.199 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.199 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.199 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.200 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.200 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.200 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.200 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.200 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.200 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.200 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.200 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.200 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.200 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.200 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.200 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.200 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.201 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.201 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.201 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.201 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.201 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.201 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.201 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.201 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.201 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.201 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.201 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.201 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.201 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.201 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.202 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.202 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.202 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.202 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.202 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.202 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.202 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.202 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.202 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.202 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.202 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.202 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.202 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.202 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.203 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.203 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.203 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.203 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.203 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.203 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.203 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.203 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.203 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.203 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.203 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.204 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.204 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.204 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.204 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.204 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.204 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.204 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.204 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.204 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.204 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.204 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.204 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.204 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.204 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.205 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.205 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.205 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.205 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.205 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.205 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.205 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.205 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.205 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.205 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.205 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.205 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.205 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.205 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.206 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.206 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.206 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.206 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.206 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.206 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.206 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.206 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.206 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.206 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.206 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.206 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.206 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.207 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.207 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.207 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.207 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.207 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.207 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.207 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.207 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.207 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.207 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.207 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.207 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.207 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.207 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.208 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.208 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.208 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.208 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.208 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.208 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.208 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.208 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.208 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.208 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.208 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.208 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.208 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.208 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.208 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.209 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.209 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.209 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.209 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.209 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.209 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.209 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.209 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.209 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.209 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.209 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.210 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.210 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.210 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.210 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.210 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.210 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.210 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.210 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.210 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.210 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.211 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.211 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:20.211 INFO:teuthology.orchestra.run.smithi044.stdout: def test_put_excess_tags(): 2023-12-03T12:39:20.211 INFO:teuthology.orchestra.run.smithi044.stdout: key = 'testputmaxtags' 2023-12-03T12:39:20.211 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:39:20.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.211 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10501: 2023-12-03T12:39:20.211 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.211 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:39:20.211 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:20.211 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.211 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.212 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.212 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.212 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.212 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.212 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.212 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.212 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.212 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.212 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.212 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.212 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.212 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.212 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.212 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.212 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.213 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.213 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.213 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.213 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.213 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.213 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.213 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.213 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.213 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.214 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.214 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.214 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.214 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.214 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.214 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.214 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.214 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.214 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.214 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.214 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.214 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.214 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.214 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.215 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.215 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.215 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.215 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.215 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.215 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.215 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.215 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.215 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.215 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.215 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.215 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.215 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.216 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.216 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.216 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.216 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.216 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.216 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.216 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.216 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.216 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.216 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.216 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.216 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.216 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.216 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.217 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.217 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.217 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.217 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.217 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.217 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.217 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.217 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.217 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.217 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.217 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.217 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.217 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.217 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.217 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-440" 2023-12-03T12:39:20.218 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.218 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.218 INFO:teuthology.orchestra.run.smithi044.stdout:___________________________ test_put_max_kvsize_tags ___________________________ 2023-12-03T12:39:20.218 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.218 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.218 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.218 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.218 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.218 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.218 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.218 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.218 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.218 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.218 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.219 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.219 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.219 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.219 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.219 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.219 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.219 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.219 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.219 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.219 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.219 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.220 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.220 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.220 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.220 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.220 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.220 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.220 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.220 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.220 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.220 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.220 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.220 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.220 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.220 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.220 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.220 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.220 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.221 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.221 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.221 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.221 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.221 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.221 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.221 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.221 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.221 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.221 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.221 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.221 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.221 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.221 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.222 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.222 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.222 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.222 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.222 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.222 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.222 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.222 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.222 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.222 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.222 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.222 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.222 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.222 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.222 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.223 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.223 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.223 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.223 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.223 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.223 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.223 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.223 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.223 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.223 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.223 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.223 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.224 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.224 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.224 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.224 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.224 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.224 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.224 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.224 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.224 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.224 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.224 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.224 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.224 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.224 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.225 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.225 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.225 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.225 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.225 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.225 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.225 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.225 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.225 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.225 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.225 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.225 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.225 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.225 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.226 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.226 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.226 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.226 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.226 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.226 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.226 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.226 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.226 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.226 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.226 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.226 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.226 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.227 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.227 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.227 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.227 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.227 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.227 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.227 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.227 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.227 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.227 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.227 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.227 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.227 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.227 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.227 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.228 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.228 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.228 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.228 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.228 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.228 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.228 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.228 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.228 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.228 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.228 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.228 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.228 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.228 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.229 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.229 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.229 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.229 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.229 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.229 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.229 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.229 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.229 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.229 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.229 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.229 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.229 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.229 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.230 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.230 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.230 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.230 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.230 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.230 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.230 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.230 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.230 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.230 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.230 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.230 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.231 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.231 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:20.231 INFO:teuthology.orchestra.run.smithi044.stdout: def test_put_max_kvsize_tags(): 2023-12-03T12:39:20.231 INFO:teuthology.orchestra.run.smithi044.stdout: key = 'testputmaxkeysize' 2023-12-03T12:39:20.231 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:39:20.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.231 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10516: 2023-12-03T12:39:20.231 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.231 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:39:20.231 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:20.231 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.231 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.232 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.232 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.232 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.232 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.232 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.232 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.232 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.232 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.232 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.232 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.232 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.232 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.232 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.232 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.232 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.233 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.233 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.233 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.233 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.233 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.233 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.233 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.233 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.233 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.233 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.233 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.233 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.233 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.233 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.233 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.234 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.234 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.234 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.234 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.234 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.234 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.234 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.234 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.234 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.234 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.234 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.234 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.234 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.235 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.235 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.235 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.235 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.235 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.235 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.235 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.235 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.235 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.235 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.235 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.235 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.235 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.235 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.236 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.236 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.236 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.236 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.236 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.236 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.236 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.236 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.236 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.236 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.236 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.236 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.236 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.236 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.237 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.237 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.237 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.237 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.237 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.237 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.237 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.237 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.237 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.237 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.237 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.237 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.238 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.238 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.238 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.238 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-441" 2023-12-03T12:39:20.238 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.238 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.238 INFO:teuthology.orchestra.run.smithi044.stdout:___________________________ test_put_excess_key_tags ___________________________ 2023-12-03T12:39:20.238 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.238 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.238 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.238 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.238 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.238 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.238 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.239 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.239 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.239 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.239 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.239 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.239 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.239 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.239 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.239 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.239 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.239 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.239 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.239 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.239 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.240 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.240 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.240 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.240 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.240 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.240 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.240 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.240 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.240 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.240 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.240 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.240 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.240 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.240 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.241 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.241 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.241 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.241 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.241 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.241 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.241 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.241 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.241 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.241 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.241 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.241 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.242 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.242 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.242 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.242 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.242 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.242 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.242 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.242 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.242 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.242 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.242 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.242 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.242 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.242 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.243 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.243 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.243 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.243 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.243 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.243 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.243 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.243 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.243 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.243 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.243 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.243 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.243 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.243 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.243 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.244 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.244 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.244 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.244 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.244 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.244 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.244 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.244 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.244 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.244 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.244 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.244 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.244 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.244 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.245 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.245 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.245 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.245 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.245 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.245 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.245 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.245 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.245 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.245 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.245 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.245 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.245 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.245 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.245 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.246 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.246 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.246 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.246 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.246 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.246 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.246 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.246 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.246 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.246 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.246 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.246 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.246 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.246 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.246 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.247 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.247 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.247 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.247 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.247 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.247 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.247 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.247 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.247 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.247 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.247 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.247 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.247 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.248 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.248 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.248 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.248 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.248 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.248 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.248 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.248 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.248 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.248 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.248 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.248 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.248 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.248 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.248 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.249 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.249 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.249 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.249 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.249 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.249 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.249 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.249 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.249 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.249 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.249 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.249 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.250 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.250 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.250 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.250 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.250 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.250 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.250 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.250 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.250 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.250 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.250 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.250 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.250 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.250 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.251 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.251 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.251 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.251 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.251 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.251 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.251 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.251 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.251 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:20.251 INFO:teuthology.orchestra.run.smithi044.stdout: def test_put_excess_key_tags(): 2023-12-03T12:39:20.251 INFO:teuthology.orchestra.run.smithi044.stdout: key = 'testputexcesskeytags' 2023-12-03T12:39:20.251 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:39:20.251 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.251 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10537: 2023-12-03T12:39:20.252 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.252 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:39:20.252 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:20.252 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.252 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.252 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.252 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.252 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.252 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.252 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.252 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.252 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.252 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.252 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.253 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.253 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.253 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.253 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.253 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.253 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.253 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.253 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.253 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.253 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.253 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.253 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.253 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.253 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.254 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.254 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.254 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.254 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.254 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.254 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.254 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.254 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.254 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.254 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.254 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.254 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.254 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.255 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.255 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.255 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.255 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.255 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.255 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.255 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.255 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.255 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.255 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.255 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.255 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.255 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.255 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.256 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.256 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.256 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.256 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.256 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.256 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.256 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.256 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.256 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.256 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.256 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.256 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.256 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.256 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.256 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.257 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.257 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.257 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.257 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.257 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.257 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.257 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.257 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.257 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.257 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.257 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.257 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.257 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.257 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.257 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.257 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.258 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.258 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.258 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.258 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.258 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.258 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-442" 2023-12-03T12:39:20.258 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.258 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.258 INFO:teuthology.orchestra.run.smithi044.stdout:___________________________ test_put_excess_val_tags ___________________________ 2023-12-03T12:39:20.258 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.258 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.258 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.258 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.258 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.259 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.259 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.259 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.259 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.259 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.259 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.259 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.259 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.259 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.259 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.259 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.259 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.259 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.259 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.260 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.260 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.260 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.260 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.260 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.260 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.260 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.260 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.260 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.260 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.261 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.261 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.261 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.261 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.261 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.261 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.261 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.261 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.261 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.261 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.261 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.261 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.261 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.261 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.261 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.262 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.262 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.262 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.262 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.262 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.262 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.262 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.262 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.262 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.262 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.263 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.263 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.263 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.263 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.263 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.263 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.263 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.263 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.263 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.263 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.263 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.263 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.263 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.264 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.264 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.264 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.264 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.264 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.264 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.264 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.264 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.264 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.264 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.265 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.265 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.265 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.265 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.265 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.265 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.265 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.265 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.265 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.265 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.265 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.265 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.265 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.265 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.266 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.266 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.266 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.266 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.266 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.266 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.266 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.266 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.266 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.266 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.266 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.266 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.266 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.266 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.267 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.267 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.267 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.267 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.267 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.267 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.267 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.268 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.268 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.268 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.268 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.268 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.268 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.268 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.268 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.268 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.268 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.268 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.268 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.268 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.268 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.269 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.269 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.269 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.269 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.269 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.269 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.269 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.269 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.269 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.269 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.269 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.269 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.270 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.270 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.270 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.270 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.270 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.270 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.270 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.270 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.270 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.271 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.271 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.271 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.271 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.271 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.271 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.272 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.272 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.272 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.272 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.272 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.273 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:20.273 INFO:teuthology.orchestra.run.smithi044.stdout: def test_put_excess_val_tags(): 2023-12-03T12:39:20.273 INFO:teuthology.orchestra.run.smithi044.stdout: key = 'testputexcesskeytags' 2023-12-03T12:39:20.273 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:39:20.273 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.273 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10559: 2023-12-03T12:39:20.273 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.273 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:39:20.273 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:20.273 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.273 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.273 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.273 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.274 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.274 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.274 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.274 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.274 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.274 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.274 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.274 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.274 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.274 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.274 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.274 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.274 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.275 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.275 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.275 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.275 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.275 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.275 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.275 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.275 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.275 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.275 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.275 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.275 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.275 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.275 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.275 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.276 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.276 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.276 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.276 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.276 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.276 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.276 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.276 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.276 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.276 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.276 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.276 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.276 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.276 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.277 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.277 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.277 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.277 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.277 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.277 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.277 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.277 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.277 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.277 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.277 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.277 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.277 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.277 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.278 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.278 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.278 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.278 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.278 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.278 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.278 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.278 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.278 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.278 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.278 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.278 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.278 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.278 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.279 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.279 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.279 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.279 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.279 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.279 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.279 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.279 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.279 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.279 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.279 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.279 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.279 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-443" 2023-12-03T12:39:20.279 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.280 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.280 INFO:teuthology.orchestra.run.smithi044.stdout:_____________________________ test_put_modify_tags _____________________________ 2023-12-03T12:39:20.280 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.280 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.280 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.280 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.280 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.280 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.280 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.280 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.280 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.280 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.280 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.280 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.281 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.281 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.281 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.281 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.281 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.281 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.281 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.281 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.281 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.281 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.281 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.281 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.281 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.281 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.282 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.282 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.282 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.282 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.282 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.282 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.282 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.282 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.282 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.282 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.282 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.282 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.282 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.282 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.283 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.283 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.283 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.283 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.283 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.283 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.283 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.283 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.283 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.283 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.283 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.283 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.283 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.283 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.283 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.284 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.284 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.284 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.284 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.284 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.284 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.284 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.284 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.284 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.284 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.284 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.284 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.285 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.285 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.285 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.285 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.285 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.285 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.285 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.285 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.285 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.285 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.286 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.286 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.286 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.286 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.286 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.286 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.286 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.286 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.286 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.286 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.286 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.286 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.286 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.286 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.287 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.287 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.287 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.287 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.287 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.287 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.287 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.287 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.287 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.287 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.287 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.287 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.287 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.287 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.288 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.288 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.288 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.288 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.288 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.288 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.288 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.288 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.288 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.288 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.288 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.288 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.288 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.288 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.288 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.289 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.289 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.289 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.289 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.289 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.289 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.289 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.289 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.289 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.289 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.289 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.289 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.289 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.289 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.290 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.290 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.290 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.290 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.290 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.290 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.290 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.290 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.290 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.290 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.290 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.290 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.290 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.291 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.291 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.291 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.291 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.291 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.291 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.291 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.291 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.291 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.291 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.292 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.292 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.292 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.292 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.292 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.292 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.292 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.292 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.292 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.292 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.292 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.292 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.292 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.292 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.292 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.293 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.293 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.293 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.293 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.293 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.293 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.293 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:20.293 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.293 INFO:teuthology.orchestra.run.smithi044.stdout: def test_put_modify_tags(): 2023-12-03T12:39:20.293 INFO:teuthology.orchestra.run.smithi044.stdout: key = 'testputmodifytags' 2023-12-03T12:39:20.293 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:39:20.293 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.293 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10582: 2023-12-03T12:39:20.293 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.293 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:39:20.294 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:20.294 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.294 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.294 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.294 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.294 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.294 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.294 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.294 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.294 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.294 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.294 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.294 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.295 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.295 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.295 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.295 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.295 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.295 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.295 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.295 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.295 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.295 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.295 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.295 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.295 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.295 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.296 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.296 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.296 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.296 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.296 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.296 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.296 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.296 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.296 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.296 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.296 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.296 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.296 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.297 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.297 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.297 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.297 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.297 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.297 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.297 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.297 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.297 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.297 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.297 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.297 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.297 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.298 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.298 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.298 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.298 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.298 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.298 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.298 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.298 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.298 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.298 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.298 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.298 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.298 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.299 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.299 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.299 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.299 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.299 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.299 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.299 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.299 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.299 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.299 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.299 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.299 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.299 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.299 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.300 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.300 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.300 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.300 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.300 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.300 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.300 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.300 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-444" 2023-12-03T12:39:20.300 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.300 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.300 INFO:teuthology.orchestra.run.smithi044.stdout:_____________________________ test_put_delete_tags _____________________________ 2023-12-03T12:39:20.300 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.300 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.300 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.300 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.300 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.301 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.301 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.301 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.301 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.301 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.301 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.301 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.301 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.301 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.301 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.301 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.302 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.302 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.302 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.302 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.302 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.302 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.302 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.302 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.302 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.302 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.303 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.303 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.303 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.303 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.303 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.303 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.303 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.303 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.303 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.303 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.303 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.303 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.303 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.304 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.304 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.304 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.304 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.304 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.304 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.304 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.304 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.304 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.304 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.304 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.304 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.304 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.305 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.305 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.305 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.305 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.305 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.305 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.305 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.305 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.305 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.305 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.305 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.305 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.305 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.305 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.305 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.305 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.306 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.306 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.306 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.306 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.306 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.306 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.306 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.306 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.306 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.306 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.306 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.306 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.306 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.307 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.307 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.307 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.307 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.307 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.307 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.307 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.307 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.307 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.307 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.307 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.307 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.307 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.307 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.307 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.307 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.307 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.308 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.308 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.308 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.308 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.308 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.308 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.308 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.308 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.308 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.308 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.308 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.308 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.308 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.308 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.308 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.309 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.309 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.309 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.309 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.309 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.309 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.309 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.309 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.309 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.309 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.309 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.309 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.310 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.310 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.310 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.310 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.310 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.310 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.310 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.310 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.310 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.310 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.310 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.310 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.310 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.311 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.311 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.311 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.311 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.311 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.311 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.311 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.311 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.311 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.311 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.312 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.312 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.312 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.312 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.312 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.312 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.312 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.312 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.312 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.312 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.312 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.312 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.312 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.312 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.312 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.313 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.313 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.313 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.313 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.313 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.313 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:20.313 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.313 INFO:teuthology.orchestra.run.smithi044.stdout: def test_put_delete_tags(): 2023-12-03T12:39:20.313 INFO:teuthology.orchestra.run.smithi044.stdout: key = 'testputmodifytags' 2023-12-03T12:39:20.313 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:39:20.313 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.313 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10612: 2023-12-03T12:39:20.313 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.313 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:39:20.314 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:20.314 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.314 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.314 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.314 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.314 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.314 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.314 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.314 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.314 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.314 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.314 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.314 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.314 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.315 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.315 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.315 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.315 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.315 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.315 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.315 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.315 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.315 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.315 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.315 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.315 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.315 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.315 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.316 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.316 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.316 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.316 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.316 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.316 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.316 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.316 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.316 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.316 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.316 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.316 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.317 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.317 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.317 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.317 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.317 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.317 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.317 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.317 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.317 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.317 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.317 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.317 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.317 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.317 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.317 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.318 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.318 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.318 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.318 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.318 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.318 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.318 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.318 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.318 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.318 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.318 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.318 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.318 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.318 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.319 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.319 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.319 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.319 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.319 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.319 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.319 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.319 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.319 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.319 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.319 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.319 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.319 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.319 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.319 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.320 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.320 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.320 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-445" 2023-12-03T12:39:20.320 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.320 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.320 INFO:teuthology.orchestra.run.smithi044.stdout:___________________ test_post_object_tags_anonymous_request ____________________ 2023-12-03T12:39:20.320 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.320 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.320 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.320 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.320 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.320 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.320 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.320 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.321 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.321 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.321 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.321 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.321 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.321 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.321 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.321 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.321 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.321 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.321 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.321 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.321 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.322 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.322 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.322 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.322 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.322 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.322 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.322 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.322 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.322 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.322 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.322 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.322 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.323 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.323 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.323 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.323 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.323 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.323 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.323 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.323 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.323 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.323 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.323 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.323 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.324 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.324 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.324 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.324 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.324 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.324 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.324 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.324 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.324 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.324 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.324 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.324 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.324 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.324 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.324 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.325 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.325 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.325 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.325 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.325 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.325 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.325 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.325 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.325 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.325 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.325 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.325 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.325 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.326 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.326 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.326 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.326 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.326 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.326 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.326 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.326 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.326 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.326 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.326 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.326 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.327 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.327 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.327 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.327 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.327 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.327 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.327 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.327 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.327 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.327 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.327 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.327 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.327 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.327 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.328 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.328 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.328 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.328 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.328 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.328 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.328 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.328 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.328 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.328 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.328 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.328 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.328 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.328 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.328 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.329 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.329 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.329 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.329 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.329 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.329 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.329 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.329 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.329 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.329 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.329 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.329 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.329 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.329 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.329 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.330 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.330 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.330 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.330 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.330 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.330 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.330 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.330 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.330 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.330 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.330 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.330 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.330 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.331 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.331 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.331 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.331 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.331 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.331 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.331 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.331 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.331 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.331 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.332 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.332 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.332 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.332 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.332 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.332 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.332 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.332 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.332 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.332 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.332 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.332 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.332 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.332 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.332 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.333 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.333 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.333 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.333 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.333 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.333 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.333 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:20.333 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.333 INFO:teuthology.orchestra.run.smithi044.stdout: def test_post_object_tags_anonymous_request(): 2023-12-03T12:39:20.333 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:20.333 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:20.333 INFO:teuthology.orchestra.run.smithi044.stdout: url = _get_post_url(bucket_name) 2023-12-03T12:39:20.333 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(ACL='public-read-write', Bucket=bucket_name) 2023-12-03T12:39:20.333 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.334 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10634: 2023-12-03T12:39:20.334 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.334 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.334 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.334 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.334 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.334 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.334 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.334 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.334 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.334 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.334 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.335 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.335 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.335 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.335 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.335 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.335 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.335 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.335 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.335 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.335 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.335 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.335 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.335 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.335 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.335 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.335 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.336 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.336 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.336 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.336 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.336 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.336 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.336 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.336 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.336 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.336 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.336 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.336 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.337 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.337 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.337 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.337 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.337 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.337 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.337 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.337 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.337 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.337 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.337 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.337 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.338 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.338 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.338 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.338 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.338 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.338 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.338 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.338 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.338 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.338 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.338 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.338 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.338 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.338 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.339 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.339 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.339 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.339 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.339 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.339 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.339 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.339 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.339 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.339 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.339 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.339 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.339 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.339 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.340 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.340 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.340 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.340 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.340 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.340 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-446" 2023-12-03T12:39:20.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.340 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.340 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ test_post_object_tags_authenticated_request __________________ 2023-12-03T12:39:20.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.340 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.340 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.340 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.341 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.341 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.341 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.341 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.341 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.341 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.341 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.341 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.341 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.341 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.341 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.341 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.341 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.341 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.341 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.342 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.342 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.342 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.342 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.342 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.342 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.342 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.342 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.342 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.342 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.342 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.342 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.342 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.342 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.342 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.343 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.343 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.343 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.343 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.343 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.343 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.343 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.343 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.343 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.343 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.343 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.343 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.343 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.343 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.343 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.344 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.344 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.344 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.344 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.344 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.344 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.344 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.344 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.344 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.344 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.344 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.344 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.345 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.345 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.345 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.345 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.345 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.345 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.345 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.345 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.345 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.345 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.345 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.345 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.345 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.345 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.345 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.346 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.346 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.346 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.346 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.346 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.346 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.346 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.346 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.346 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.346 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.346 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.346 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.346 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.346 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.347 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.347 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.347 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.347 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.347 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.347 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.347 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.347 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.347 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.347 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.347 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.347 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.347 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.347 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.348 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.348 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.348 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.348 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.348 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.348 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.348 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.348 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.348 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.348 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.348 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.348 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.348 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.348 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.349 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.349 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.349 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.349 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.349 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.349 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.349 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.349 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.349 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.349 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.349 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.349 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.349 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.350 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.350 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.350 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.350 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.350 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.350 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.350 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.350 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.350 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.350 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.350 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.350 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.351 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.351 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.351 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.351 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.351 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.351 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.351 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.351 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.351 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.351 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.351 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.352 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.352 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.352 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.352 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.352 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.352 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.352 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.352 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.352 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.352 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.352 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.352 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.352 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.353 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.353 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.353 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:20.353 INFO:teuthology.orchestra.run.smithi044.stdout: def test_post_object_tags_authenticated_request(): 2023-12-03T12:39:20.353 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:20.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.353 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10662: 2023-12-03T12:39:20.353 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.353 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.353 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.353 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.353 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.353 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.354 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.354 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.354 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.354 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.354 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.354 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.354 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.354 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.354 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.354 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.354 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.354 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.355 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.355 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.355 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.355 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.355 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.355 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.355 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.355 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.355 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.355 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.355 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.355 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.355 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.355 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.355 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.356 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.356 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.356 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.356 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.356 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.356 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.356 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.356 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.356 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.356 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.356 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.356 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.356 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.356 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.357 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.357 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.357 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.357 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.357 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.357 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.357 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.357 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.357 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.357 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.357 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.357 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.358 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.358 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.358 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.358 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.358 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.358 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.358 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.358 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.358 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.358 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.358 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.358 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.358 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.359 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.359 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.359 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.359 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.359 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.359 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.359 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.359 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.359 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.359 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.359 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.359 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.359 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.360 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-447" 2023-12-03T12:39:20.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.360 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.360 INFO:teuthology.orchestra.run.smithi044.stdout:____________________________ test_put_obj_with_tags ____________________________ 2023-12-03T12:39:20.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.360 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.360 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.360 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.360 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.360 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.360 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.360 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.361 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.361 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.361 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.361 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.361 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.361 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.361 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.361 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.361 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.361 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.361 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.361 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.361 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.361 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.362 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.362 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.362 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.362 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.362 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.362 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.362 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.362 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.362 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.362 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.362 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.362 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.362 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.362 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.363 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.363 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.363 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.363 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.363 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.363 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.363 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.363 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.363 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.363 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.363 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.363 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.363 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.363 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.364 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.364 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.364 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.364 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.364 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.364 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.364 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.364 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.364 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.364 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.364 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.364 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.364 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.364 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.364 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.365 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.365 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.365 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.365 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.365 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.365 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.365 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.365 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.365 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.365 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.366 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.366 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.366 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.366 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.366 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.366 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.366 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.366 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.366 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.366 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.366 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.366 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.366 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.367 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.367 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.367 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.367 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.367 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.367 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.367 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.367 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.367 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.367 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.367 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.367 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.367 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.368 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.368 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.368 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.368 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.368 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.368 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.368 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.368 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.368 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.368 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.369 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.369 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.369 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.369 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.369 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.369 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.369 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.369 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.369 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.369 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.369 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.369 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.369 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.369 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.370 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.370 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.370 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.370 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.370 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.370 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.370 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.370 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.370 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.370 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.370 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.370 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.370 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.371 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.371 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.371 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.371 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.371 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.371 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.371 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.371 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.371 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.371 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.371 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.371 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.371 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.371 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.371 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.372 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.372 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.372 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.372 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.372 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.372 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.372 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.372 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.372 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.372 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.372 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.372 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.373 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:20.373 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.373 INFO:teuthology.orchestra.run.smithi044.stdout: def test_put_obj_with_tags(): 2023-12-03T12:39:20.373 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:20.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.373 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10709: 2023-12-03T12:39:20.373 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.373 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.373 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.373 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.373 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.373 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.373 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.373 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.374 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.374 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.374 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.374 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.374 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.374 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.374 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.374 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.374 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.374 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.374 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.374 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.374 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.374 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.375 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.375 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.375 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.375 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.375 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.375 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.375 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.375 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.375 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.375 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.375 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.375 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.375 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.375 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.375 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.376 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.376 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.376 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.376 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.376 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.376 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.376 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.376 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.376 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.376 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.376 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.376 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.377 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.377 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.377 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.377 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.377 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.377 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.377 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.377 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.377 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.377 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.377 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.377 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.377 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.377 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.377 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.378 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.378 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.378 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.378 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.378 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.378 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.378 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.378 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.378 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.378 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.378 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.378 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.378 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.378 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.379 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.379 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.379 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.379 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.379 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.379 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.379 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.379 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.379 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.379 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-448" 2023-12-03T12:39:20.379 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.379 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.379 INFO:teuthology.orchestra.run.smithi044.stdout:___________________________ test_get_tags_acl_public ___________________________ 2023-12-03T12:39:20.379 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.379 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.380 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.380 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.380 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.380 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.380 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.380 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.380 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.380 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.380 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.380 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.380 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.380 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.380 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.380 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.381 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.381 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.381 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.381 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.381 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.381 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.381 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.381 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.381 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.381 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.382 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.382 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.382 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.382 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.382 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.382 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.382 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.382 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.382 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.382 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.382 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.382 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.382 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.382 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.382 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.383 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.383 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.383 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.383 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.383 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.383 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.383 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.383 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.383 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.383 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.383 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.384 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.384 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.384 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.384 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.384 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.384 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.384 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.384 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.384 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.384 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.384 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.384 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.384 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.385 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.385 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.385 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.385 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.385 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.385 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.385 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.385 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.385 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.386 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.386 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.386 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.386 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.386 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.386 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.386 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.386 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.386 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.386 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.386 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.386 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.386 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.386 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.387 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.387 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.387 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.387 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.387 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.387 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.387 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.387 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.387 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.387 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.387 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.387 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.387 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.387 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.387 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.388 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.388 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.388 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.388 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.388 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.388 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.388 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.388 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.388 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.388 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.388 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.388 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.388 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.388 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.388 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.389 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.389 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.389 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.389 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.389 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.389 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.389 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.389 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.389 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.389 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.389 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.389 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.389 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.389 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.389 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.390 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.390 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.390 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.390 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.390 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.390 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.390 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.390 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.390 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.390 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.390 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.390 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.390 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.390 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.390 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.391 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.391 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.391 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.391 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.391 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.391 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.391 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.391 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.391 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.391 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.391 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.392 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.392 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.392 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.392 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.392 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.392 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.392 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.392 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.392 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.392 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.392 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:20.393 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.bucket_policy 2023-12-03T12:39:20.393 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.393 INFO:teuthology.orchestra.run.smithi044.stdout: def test_get_tags_acl_public(): 2023-12-03T12:39:20.393 INFO:teuthology.orchestra.run.smithi044.stdout: key = 'testputtagsacl' 2023-12-03T12:39:20.393 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:39:20.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.393 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10743: 2023-12-03T12:39:20.393 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.393 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:39:20.393 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:20.393 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.393 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.393 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.393 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.394 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.394 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.394 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.394 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.394 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.394 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.394 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.394 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.394 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.394 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.394 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.394 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.394 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.395 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.395 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.395 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.395 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.395 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.395 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.395 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.395 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.395 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.395 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.395 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.395 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.395 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.395 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.395 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.396 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.396 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.396 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.396 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.396 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.396 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.396 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.396 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.396 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.396 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.396 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.396 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.396 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.396 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.397 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.397 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.397 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.397 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.397 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.397 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.397 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.397 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.397 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.397 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.397 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.397 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.397 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.397 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.397 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.398 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.398 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.398 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.398 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.398 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.398 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.398 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.398 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.398 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.398 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.398 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.398 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.398 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.398 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.398 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.399 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.399 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.399 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.399 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.399 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.399 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.399 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.399 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.399 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.399 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.399 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.399 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.399 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-449" 2023-12-03T12:39:20.399 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.400 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.400 INFO:teuthology.orchestra.run.smithi044.stdout:___________________________ test_put_tags_acl_public ___________________________ 2023-12-03T12:39:20.400 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.400 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.400 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.400 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.400 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.400 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.400 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.400 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.400 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.400 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.400 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.400 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.401 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.401 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.401 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.401 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.401 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.401 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.401 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.401 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.401 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.401 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.401 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.401 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.401 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.401 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.401 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.401 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.402 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.402 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.402 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.402 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.402 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.402 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.402 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.402 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.402 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.402 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.402 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.402 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.402 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.402 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.402 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.403 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.403 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.403 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.403 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.403 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.403 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.403 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.403 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.403 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.403 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.403 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.403 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.403 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.403 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.403 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.404 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.404 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.404 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.404 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.404 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.404 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.404 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.404 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.404 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.404 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.404 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.404 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.404 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.404 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.405 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.405 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.405 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.405 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.405 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.405 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.405 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.405 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.405 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.405 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.406 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.406 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.406 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.406 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.406 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.406 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.406 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.406 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.406 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.406 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.406 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.406 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.406 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.407 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.407 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.407 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.407 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.407 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.407 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.407 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.407 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.407 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.407 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.407 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.407 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.407 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.407 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.407 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.408 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.408 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.408 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.408 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.408 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.408 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.408 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.408 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.408 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.408 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.408 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.408 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.408 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.409 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.409 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.409 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.409 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.409 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.409 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.409 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.409 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.409 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.409 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.409 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.409 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.409 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.409 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.410 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.410 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.410 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.410 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.410 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.410 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.410 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.410 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.410 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.410 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.410 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.410 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.410 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.410 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.410 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.411 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.411 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.411 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.411 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.411 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.411 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.411 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.411 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.411 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.411 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.411 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.412 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.412 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.412 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.412 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.412 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.412 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.412 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.412 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.412 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.412 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.412 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.412 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.412 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.412 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.412 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:20.412 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.bucket_policy 2023-12-03T12:39:20.413 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.413 INFO:teuthology.orchestra.run.smithi044.stdout: def test_put_tags_acl_public(): 2023-12-03T12:39:20.413 INFO:teuthology.orchestra.run.smithi044.stdout: key = 'testputtagsacl' 2023-12-03T12:39:20.413 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:39:20.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.413 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10766: 2023-12-03T12:39:20.413 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.413 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:39:20.413 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:20.413 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.413 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.413 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.413 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.413 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.413 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.413 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.414 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.414 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.414 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.414 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.414 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.414 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.414 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.414 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.414 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.414 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.414 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.414 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.414 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.414 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.414 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.415 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.415 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.415 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.415 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.415 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.415 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.415 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.415 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.415 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.415 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.415 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.415 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.415 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.415 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.415 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.416 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.416 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.416 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.416 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.416 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.416 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.416 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.416 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.416 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.416 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.416 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.416 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.416 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.416 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.416 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.416 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.416 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.417 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.417 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.417 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.417 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.417 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.417 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.417 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.417 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.417 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.417 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.417 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.417 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.417 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.418 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.418 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.418 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.418 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.418 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.418 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.418 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.418 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.418 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.418 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.418 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.418 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.419 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.419 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.419 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.419 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.419 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.419 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.419 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.419 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-450" 2023-12-03T12:39:20.419 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.419 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.419 INFO:teuthology.orchestra.run.smithi044.stdout:_________________________ test_delete_tags_obj_public __________________________ 2023-12-03T12:39:20.419 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.419 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.419 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.419 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.420 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.420 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.420 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.420 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.420 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.420 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.420 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.420 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.420 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.420 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.420 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.420 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.420 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.420 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.420 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.421 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.421 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.421 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.421 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.421 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.421 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.421 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.421 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.421 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.421 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.421 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.421 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.422 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.422 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.422 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.422 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.422 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.422 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.422 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.422 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.422 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.422 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.422 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.422 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.422 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.422 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.423 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.423 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.423 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.423 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.423 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.423 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.423 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.423 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.423 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.423 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.423 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.423 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.423 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.423 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.423 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.424 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.424 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.424 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.424 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.424 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.424 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.424 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.424 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.424 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.424 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.424 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.425 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.425 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.425 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.425 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.425 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.425 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.425 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.425 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.425 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.426 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.426 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.426 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.426 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.426 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.426 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.426 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.426 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.426 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.426 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.426 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.426 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.426 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.426 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.427 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.427 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.427 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.427 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.427 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.427 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.429 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.429 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.429 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.429 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.430 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.430 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.430 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.430 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.430 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.430 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.430 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.430 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.430 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.430 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.430 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.430 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.430 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.430 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.430 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.431 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.431 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.431 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.431 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.431 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.431 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.431 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.431 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.431 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.431 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.431 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.431 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.432 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.432 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.432 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.432 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.432 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.432 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.432 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.432 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.432 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.432 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.432 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.432 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.432 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.432 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.433 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.433 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.433 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.433 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.433 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.433 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.433 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.433 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.433 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.433 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.433 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.433 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.433 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.433 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.433 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.434 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.434 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.434 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.434 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.434 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.434 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.434 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.434 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.434 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.434 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.434 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.434 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.434 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.434 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.435 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:20.435 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.bucket_policy 2023-12-03T12:39:20.435 INFO:teuthology.orchestra.run.smithi044.stdout: def test_delete_tags_obj_public(): 2023-12-03T12:39:20.435 INFO:teuthology.orchestra.run.smithi044.stdout: key = 'testputtagsacl' 2023-12-03T12:39:20.435 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:39:20.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.435 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10787: 2023-12-03T12:39:20.435 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.435 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:39:20.435 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket() 2023-12-03T12:39:20.435 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.435 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.435 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.436 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.436 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.436 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.436 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.436 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.436 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.436 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.436 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.436 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.436 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.436 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.436 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.436 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.436 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.436 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.437 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.437 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.437 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.437 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.437 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.437 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.437 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.438 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.438 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.438 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.438 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.438 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.438 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.438 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.438 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.438 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.438 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.438 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.439 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.439 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.439 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.439 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.439 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.439 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.439 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.439 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.439 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.439 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.439 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.439 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.439 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.439 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.440 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.440 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.440 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.440 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.440 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.440 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.440 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.440 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.440 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.440 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.440 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.440 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.440 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.440 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.440 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.441 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.441 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.441 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.441 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.441 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.441 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.441 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.441 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.441 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.441 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.441 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.441 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.441 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.441 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.442 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-451" 2023-12-03T12:39:20.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.442 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.442 INFO:teuthology.orchestra.run.smithi044.stdout:____________ test_versioning_bucket_atomic_upload_return_version_id ____________ 2023-12-03T12:39:20.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.442 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.442 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.442 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.442 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.442 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.442 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.442 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.443 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.443 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.443 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.443 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.443 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.443 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.443 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.443 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.443 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.443 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.443 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.443 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.444 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.444 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.444 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.444 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.444 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.444 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.444 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.444 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.444 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.444 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.444 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.445 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.445 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.445 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.445 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.445 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.445 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.445 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.445 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.445 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.445 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.445 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.445 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.445 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.446 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.446 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.446 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.446 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.446 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.446 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.446 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.446 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.446 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.446 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.446 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.446 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.446 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.446 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.447 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.447 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.447 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.447 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.447 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.447 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.447 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.447 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.447 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.447 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.447 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.448 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.448 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.448 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.448 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.448 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.448 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.448 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.448 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.448 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.448 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.448 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.448 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.448 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.448 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.448 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.449 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.449 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.449 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.449 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.449 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.449 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.449 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.449 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.449 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.449 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.449 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.449 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.449 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.449 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.449 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.450 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.450 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.450 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.450 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.450 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.450 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.450 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.450 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.450 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.450 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.451 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.451 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.451 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.451 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.451 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.451 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.451 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.451 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.451 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.451 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.452 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.452 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.452 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.452 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.452 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.452 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.452 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.452 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.452 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.452 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.452 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.452 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.452 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.452 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.452 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.453 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.453 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.453 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.453 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.453 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.453 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.453 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.453 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.453 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.453 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.453 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.453 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.454 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.454 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.454 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.454 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.454 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.454 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.454 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.454 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.454 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.454 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.454 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.454 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.454 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.455 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.455 INFO:teuthology.orchestra.run.smithi044.stdout: def test_versioning_bucket_atomic_upload_return_version_id(): 2023-12-03T12:39:20.455 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:20.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.455 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10809: 2023-12-03T12:39:20.455 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.455 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.455 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.455 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.455 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.455 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.455 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.455 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.455 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.456 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.456 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.456 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.456 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.456 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.456 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.457 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.457 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.457 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.457 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.457 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.457 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.457 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.457 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.457 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.458 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.458 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.458 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.458 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.458 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.458 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.458 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.458 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.458 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.458 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.458 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.458 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.459 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.459 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.459 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.459 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.459 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.459 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.459 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.459 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.459 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.459 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.459 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.459 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.459 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.459 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.459 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.459 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.460 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.460 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.460 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.460 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.460 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.460 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.460 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.460 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.460 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.460 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.460 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.460 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.460 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.460 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.460 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.461 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.461 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.461 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.461 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.461 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.461 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-452" 2023-12-03T12:39:20.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.461 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.461 INFO:teuthology.orchestra.run.smithi044.stdout:__________ test_versioning_bucket_multipart_upload_return_version_id ___________ 2023-12-03T12:39:20.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.461 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.461 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.462 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.462 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.462 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.462 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.462 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.462 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.462 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.462 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.462 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.462 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.462 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.463 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.463 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.463 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.463 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.463 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.463 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.463 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.463 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.463 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.463 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.463 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.464 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.464 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.464 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.464 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.464 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.464 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.464 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.464 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.464 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.464 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.464 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.464 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.464 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.465 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.465 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.465 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.465 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.465 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.465 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.465 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.465 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.465 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.465 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.465 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.465 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.465 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.466 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.466 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.466 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.466 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.466 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.466 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.466 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.466 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.466 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.466 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.466 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.467 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.467 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.467 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.467 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.467 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.467 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.467 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.467 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.467 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.467 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.467 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.467 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.468 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.468 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.468 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.468 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.468 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.468 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.468 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.468 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.468 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.468 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.468 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.468 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.468 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.469 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.469 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.469 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.469 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.469 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.469 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.469 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.469 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.469 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.469 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.469 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.470 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.470 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.470 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.470 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.470 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.470 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.470 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.470 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.471 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.471 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.471 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.471 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.471 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.471 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.471 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.471 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.471 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.471 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.471 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.471 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.471 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.471 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.471 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.472 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.472 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.472 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.472 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.472 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.472 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.472 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.472 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.472 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.472 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.472 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.473 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.473 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.473 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.473 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.473 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.473 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.473 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.473 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.473 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.473 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.473 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.473 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.473 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.473 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.473 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.474 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.474 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.474 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.474 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.474 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.474 INFO:teuthology.orchestra.run.smithi044.stdout: def test_versioning_bucket_multipart_upload_return_version_id(): 2023-12-03T12:39:20.474 INFO:teuthology.orchestra.run.smithi044.stdout: content_type='text/bla' 2023-12-03T12:39:20.474 INFO:teuthology.orchestra.run.smithi044.stdout: objlen = 30 * 1024 * 1024 2023-12-03T12:39:20.474 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.474 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:20.474 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.474 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10841: 2023-12-03T12:39:20.474 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.474 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.475 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.475 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.475 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.475 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.475 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.475 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.475 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.475 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.475 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.475 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.475 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.475 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.475 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.475 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.475 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.476 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.476 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.476 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.476 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.476 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.476 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.476 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.476 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.476 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.476 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.476 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.476 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.476 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.476 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.476 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.477 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.477 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.477 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.477 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.477 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.477 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.477 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.477 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.477 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.477 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.477 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.477 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.477 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.477 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.478 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.478 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.478 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.478 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.478 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.478 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.478 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.478 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.478 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.478 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.478 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.478 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.478 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.478 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.479 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.479 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.479 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.479 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.479 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.479 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.479 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.479 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.479 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.479 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.479 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.479 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.479 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.480 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.480 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.480 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.480 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.480 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.480 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.480 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.480 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.480 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.480 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.480 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.480 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.480 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.480 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.481 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-453" 2023-12-03T12:39:20.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.481 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.481 INFO:teuthology.orchestra.run.smithi044.stdout:___________________ test_bucket_policy_get_obj_existing_tag ____________________ 2023-12-03T12:39:20.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.481 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.481 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.481 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.481 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.481 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.481 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.481 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.481 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.482 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.482 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.482 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.482 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.482 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.482 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.482 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.482 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.482 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.482 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.482 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.482 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.482 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.483 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.483 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.483 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.483 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.483 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.483 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.483 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.483 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.483 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.483 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.483 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.483 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.484 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.484 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.484 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.484 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.484 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.484 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.484 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.484 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.484 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.484 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.484 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.484 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.484 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.484 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.484 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.484 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.485 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.485 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.485 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.485 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.485 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.485 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.485 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.485 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.485 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.485 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.485 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.485 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.486 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.486 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.486 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.486 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.486 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.486 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.486 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.486 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.486 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.486 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.486 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.486 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.486 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.487 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.487 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.487 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.487 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.487 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.487 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.487 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.487 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.487 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.487 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.487 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.487 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.487 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.487 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.487 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.488 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.488 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.488 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.488 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.488 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.488 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.488 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.488 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.488 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.488 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.488 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.488 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.488 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.488 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.488 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.489 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.489 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.489 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.489 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.489 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.489 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.489 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.489 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.489 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.490 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.490 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.490 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.490 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.490 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.490 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.490 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.490 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.490 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.490 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.490 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.490 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.490 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.491 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.491 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.491 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.491 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.491 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.491 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.491 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.491 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.491 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.491 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.491 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.491 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.491 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.491 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.492 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.492 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.492 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.492 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.492 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.492 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.492 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.492 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.492 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.492 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.492 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.493 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.493 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.493 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.493 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.493 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.493 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.493 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.493 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.493 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.493 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.493 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.493 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.494 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.494 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:20.494 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.bucket_policy 2023-12-03T12:39:20.494 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.494 INFO:teuthology.orchestra.run.smithi044.stdout: def test_bucket_policy_get_obj_existing_tag(): 2023-12-03T12:39:20.494 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = _create_objects(keys=['publictag', 'privatetag', 'invalidtag']) 2023-12-03T12:39:20.494 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.494 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10882: 2023-12-03T12:39:20.494 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.494 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-12-03T12:39:20.494 INFO:teuthology.orchestra.run.smithi044.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-12-03T12:39:20.494 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-12-03T12:39:20.494 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_location = bucket.create() 2023-12-03T12:39:20.494 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-12-03T12:39:20.495 INFO:teuthology.orchestra.run.smithi044.stdout: response = action(self, *args, **kwargs) 2023-12-03T12:39:20.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-12-03T12:39:20.495 INFO:teuthology.orchestra.run.smithi044.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-12-03T12:39:20.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.495 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.495 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.495 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.495 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.495 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.495 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.495 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.496 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.496 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.496 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.496 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.496 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.496 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.496 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.497 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.497 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.497 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.497 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.497 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.497 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.497 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.497 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.497 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.497 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.497 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.497 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.497 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.497 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.497 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.497 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.498 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.498 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.498 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.498 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.498 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.498 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.498 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.498 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.498 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.498 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.498 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.498 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.498 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.499 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.499 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.499 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.499 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.499 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.499 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.499 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.499 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.499 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.499 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.499 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.499 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.499 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.499 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.499 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.500 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.500 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.500 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.500 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.500 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.500 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.500 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.500 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.500 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.500 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.500 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.500 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.500 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.501 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-454" 2023-12-03T12:39:20.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.501 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.501 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ test_bucket_policy_get_obj_tagging_existing_tag ________________ 2023-12-03T12:39:20.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.501 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.501 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.501 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.501 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.501 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.501 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.502 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.502 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.502 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.502 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.502 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.502 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.502 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.502 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.502 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.502 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.502 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.502 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.502 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.502 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.502 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.503 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.503 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.503 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.503 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.503 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.503 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.503 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.503 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.503 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.503 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.503 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.503 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.503 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.503 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.504 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.504 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.504 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.504 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.504 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.504 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.504 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.504 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.504 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.504 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.504 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.504 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.504 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.504 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.504 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.505 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.505 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.505 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.505 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.505 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.505 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.505 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.505 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.505 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.505 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.505 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.505 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.505 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.505 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.506 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.506 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.506 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.506 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.506 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.506 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.506 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.506 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.506 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.506 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.506 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.506 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.506 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.506 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.506 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.507 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.507 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.507 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.507 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.507 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.507 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.507 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.507 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.507 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.507 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.507 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.507 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.507 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.507 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.507 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.508 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.508 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.508 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.508 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.508 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.508 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.508 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.508 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.508 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.508 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.508 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.508 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.508 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.508 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.509 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.509 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.509 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.509 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.509 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.509 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.509 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.509 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.509 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.509 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.510 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.510 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.510 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.510 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.510 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.510 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.510 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.510 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.510 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.510 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.510 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.510 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.510 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.510 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.511 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.511 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.511 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.511 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.511 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.511 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.511 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.511 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.511 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.511 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.511 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.511 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.511 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.511 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.512 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.512 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.512 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.512 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.512 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.512 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.512 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.512 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.512 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.512 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.512 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.512 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.512 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.513 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.513 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.513 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.513 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.513 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.513 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.513 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.513 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.513 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.513 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:20.513 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.bucket_policy 2023-12-03T12:39:20.514 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.514 INFO:teuthology.orchestra.run.smithi044.stdout: def test_bucket_policy_get_obj_tagging_existing_tag(): 2023-12-03T12:39:20.514 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = _create_objects(keys=['publictag', 'privatetag', 'invalidtag']) 2023-12-03T12:39:20.514 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.514 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10937: 2023-12-03T12:39:20.514 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.514 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-12-03T12:39:20.514 INFO:teuthology.orchestra.run.smithi044.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-12-03T12:39:20.514 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-12-03T12:39:20.514 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_location = bucket.create() 2023-12-03T12:39:20.514 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-12-03T12:39:20.514 INFO:teuthology.orchestra.run.smithi044.stdout: response = action(self, *args, **kwargs) 2023-12-03T12:39:20.514 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-12-03T12:39:20.514 INFO:teuthology.orchestra.run.smithi044.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-12-03T12:39:20.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.515 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.515 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.515 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.515 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.515 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.515 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.515 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.516 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.516 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.516 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.516 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.516 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.516 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.516 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.516 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.517 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.517 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.517 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.517 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.517 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.517 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.517 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.517 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.517 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.517 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.517 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.517 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.517 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.517 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.517 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.517 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.518 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.518 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.518 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.518 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.518 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.518 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.518 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.518 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.518 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.518 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.518 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.518 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.518 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.518 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.519 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.519 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.519 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.519 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.519 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.519 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.519 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.519 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.519 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.519 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.519 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.519 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.519 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.519 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.520 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.520 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.520 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.520 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.520 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.520 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.520 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.520 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.520 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.520 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.520 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-455" 2023-12-03T12:39:20.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.520 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.520 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ test_bucket_policy_put_obj_tagging_existing_tag ________________ 2023-12-03T12:39:20.521 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.521 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.521 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.521 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.521 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.521 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.521 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.521 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.521 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.521 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.521 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.521 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.521 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.521 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.521 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.522 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.522 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.522 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.522 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.522 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.522 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.522 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.522 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.522 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.522 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.522 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.522 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.522 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.522 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.523 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.523 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.523 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.523 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.523 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.523 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.523 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.523 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.523 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.523 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.523 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.523 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.523 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.523 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.524 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.524 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.524 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.524 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.524 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.524 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.524 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.524 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.524 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.524 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.524 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.524 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.525 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.525 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.525 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.525 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.525 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.525 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.525 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.525 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.525 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.525 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.525 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.525 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.525 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.525 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.525 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.526 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.526 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.526 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.526 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.526 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.526 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.526 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.526 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.526 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.526 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.526 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.526 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.527 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.527 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.527 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.527 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.527 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.527 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.527 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.527 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.527 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.527 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.528 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.528 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.528 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.528 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.528 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.528 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.528 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.528 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.528 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.528 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.528 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.528 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.528 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.528 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.528 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.529 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.529 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.529 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.529 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.529 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.529 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.529 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.529 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.529 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.529 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.529 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.529 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.529 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.529 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.529 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.530 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.530 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.530 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.530 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.530 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.530 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.530 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.530 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.530 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.530 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.530 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.530 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.530 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.530 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.531 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.531 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.531 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.531 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.531 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.531 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.531 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.531 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.531 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.531 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.531 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.531 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.532 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.532 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.532 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.532 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.532 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.532 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.532 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.532 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.532 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.532 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.532 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.532 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.532 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.533 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.533 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.533 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.533 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.533 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.533 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.533 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.533 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.533 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.533 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.533 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:20.534 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.bucket_policy 2023-12-03T12:39:20.534 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.534 INFO:teuthology.orchestra.run.smithi044.stdout: def test_bucket_policy_put_obj_tagging_existing_tag(): 2023-12-03T12:39:20.534 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = _create_objects(keys=['publictag', 'privatetag', 'invalidtag']) 2023-12-03T12:39:20.534 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.534 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:10999: 2023-12-03T12:39:20.534 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.534 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-12-03T12:39:20.534 INFO:teuthology.orchestra.run.smithi044.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-12-03T12:39:20.534 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-12-03T12:39:20.534 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_location = bucket.create() 2023-12-03T12:39:20.534 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-12-03T12:39:20.534 INFO:teuthology.orchestra.run.smithi044.stdout: response = action(self, *args, **kwargs) 2023-12-03T12:39:20.534 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-12-03T12:39:20.535 INFO:teuthology.orchestra.run.smithi044.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-12-03T12:39:20.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.535 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.535 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.535 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.535 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.535 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.535 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.535 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.535 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.536 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.536 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.536 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.536 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.536 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.536 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.536 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.536 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.537 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.537 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.537 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.537 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.537 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.537 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.537 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.537 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.537 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.537 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.537 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.537 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.537 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.537 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.537 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.538 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.538 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.538 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.538 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.538 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.538 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.538 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.538 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.538 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.538 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.539 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.539 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.539 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.539 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.539 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.539 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.539 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.539 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.539 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.539 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.539 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.539 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.539 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.539 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.539 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.540 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.540 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.540 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.540 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.540 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.540 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.540 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.540 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.540 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.541 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.541 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.541 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.541 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.541 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-456" 2023-12-03T12:39:20.541 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.541 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.541 INFO:teuthology.orchestra.run.smithi044.stdout:____________________ test_bucket_policy_put_obj_copy_source ____________________ 2023-12-03T12:39:20.541 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.541 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.541 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.541 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.541 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.541 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.541 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.542 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.542 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.542 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.542 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.542 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.542 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.542 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.542 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.542 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.542 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.542 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.542 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.542 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.542 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.543 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.543 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.543 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.543 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.543 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.543 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.543 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.543 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.543 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.543 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.543 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.543 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.543 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.544 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.544 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.544 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.544 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.544 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.544 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.544 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.544 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.544 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.544 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.544 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.544 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.544 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.544 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.544 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.545 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.545 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.545 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.545 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.545 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.545 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.545 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.545 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.545 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.545 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.545 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.545 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.545 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.545 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.545 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.545 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.546 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.546 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.546 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.546 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.546 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.546 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.546 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.546 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.546 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.546 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.546 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.546 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.546 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.546 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.547 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.547 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.547 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.547 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.547 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.547 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.547 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.547 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.547 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.547 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.547 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.547 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.547 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.547 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.547 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.547 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.548 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.548 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.548 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.548 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.548 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.548 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.548 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.548 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.548 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.548 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.548 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.548 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.548 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.548 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.548 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.549 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.549 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.549 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.549 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.549 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.549 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.549 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.549 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.549 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.550 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.550 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.550 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.550 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.550 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.550 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.550 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.550 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.550 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.550 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.550 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.551 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.551 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.551 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.551 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.551 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.551 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.551 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.551 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.551 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.551 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.552 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.552 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.552 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.552 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.552 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.552 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.552 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.552 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.552 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.552 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.552 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.552 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.552 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.552 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.552 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.553 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.553 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.553 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.554 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.554 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:20.554 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.bucket_policy 2023-12-03T12:39:20.554 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.554 INFO:teuthology.orchestra.run.smithi044.stdout: def test_bucket_policy_put_obj_copy_source(): 2023-12-03T12:39:20.554 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = _create_objects(keys=['public/foo', 'public/bar', 'private/foo']) 2023-12-03T12:39:20.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.554 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11068: 2023-12-03T12:39:20.554 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.554 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-12-03T12:39:20.554 INFO:teuthology.orchestra.run.smithi044.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-12-03T12:39:20.555 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-12-03T12:39:20.555 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_location = bucket.create() 2023-12-03T12:39:20.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-12-03T12:39:20.555 INFO:teuthology.orchestra.run.smithi044.stdout: response = action(self, *args, **kwargs) 2023-12-03T12:39:20.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-12-03T12:39:20.555 INFO:teuthology.orchestra.run.smithi044.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-12-03T12:39:20.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.555 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.555 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.555 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.555 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.555 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.556 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.556 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.556 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.556 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.556 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.556 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.556 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.556 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.557 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.557 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.557 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.557 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.557 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.557 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.557 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.557 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.557 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.557 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.557 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.557 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.557 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.557 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.557 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.557 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.560 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.561 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-457" 2023-12-03T12:39:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.561 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.561 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ test_bucket_policy_put_obj_copy_source_meta __________________ 2023-12-03T12:39:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.561 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.562 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.562 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.562 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.562 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.562 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.562 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.562 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.562 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.562 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.562 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.562 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.563 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.563 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.563 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.566 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.566 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.566 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.566 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.566 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.566 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.566 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.566 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.566 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.566 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.567 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.567 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.567 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.568 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.569 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.569 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.569 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.569 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.569 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.569 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.569 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.569 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.570 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.570 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.570 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.570 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.570 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.570 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.570 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.570 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.570 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.570 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.570 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.570 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.570 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.570 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.570 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.571 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.571 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.572 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.573 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.573 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.573 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.bucket_policy 2023-12-03T12:39:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: def test_bucket_policy_put_obj_copy_source_meta(): 2023-12-03T12:39:20.573 INFO:teuthology.orchestra.run.smithi044.stdout:> src_bucket_name = _create_objects(keys=['public/foo', 'public/bar']) 2023-12-03T12:39:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.573 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11115: 2023-12-03T12:39:20.573 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.574 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-12-03T12:39:20.574 INFO:teuthology.orchestra.run.smithi044.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-12-03T12:39:20.574 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-12-03T12:39:20.574 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_location = bucket.create() 2023-12-03T12:39:20.574 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-12-03T12:39:20.574 INFO:teuthology.orchestra.run.smithi044.stdout: response = action(self, *args, **kwargs) 2023-12-03T12:39:20.574 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-12-03T12:39:20.574 INFO:teuthology.orchestra.run.smithi044.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-12-03T12:39:20.574 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.574 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.574 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.574 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.576 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.576 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.576 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.576 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.576 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.576 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.576 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.576 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.576 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.576 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.576 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.576 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.576 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.576 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.576 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.577 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.577 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.580 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.580 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-458" 2023-12-03T12:39:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.580 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.580 INFO:teuthology.orchestra.run.smithi044.stdout:________________________ test_bucket_policy_put_obj_acl ________________________ 2023-12-03T12:39:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.580 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.582 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.582 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.582 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.582 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.582 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.582 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.582 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.582 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.582 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.582 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.582 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.582 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.582 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.582 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.582 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.586 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.586 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.586 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.586 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.586 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.586 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.586 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.588 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.588 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.588 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.589 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.589 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.589 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.589 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.589 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.589 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.589 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.589 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.589 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.589 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.589 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.589 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.589 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.589 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.589 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.590 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.590 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.590 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.590 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.590 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.590 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.590 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.590 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.590 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.590 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.590 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.590 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.590 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.590 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.591 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.592 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.593 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.593 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.593 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.bucket_policy 2023-12-03T12:39:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: def test_bucket_policy_put_obj_acl(): 2023-12-03T12:39:20.593 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.593 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11165: 2023-12-03T12:39:20.593 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.593 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.593 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.594 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.594 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.594 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.594 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.594 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.594 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.594 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.594 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.594 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.594 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.594 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.594 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.594 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.594 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.595 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.595 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.595 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.595 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.595 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.595 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.595 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.595 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.595 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.595 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.595 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.595 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.595 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.595 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.595 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.595 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.596 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.596 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.596 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.596 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.599 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.599 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.599 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.599 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.599 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.599 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.599 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.599 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.599 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.599 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.599 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-459" 2023-12-03T12:39:20.599 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.599 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.599 INFO:teuthology.orchestra.run.smithi044.stdout:_______________________ test_bucket_policy_put_obj_grant _______________________ 2023-12-03T12:39:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.600 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.600 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.601 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.601 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.601 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.601 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.601 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.601 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.604 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.604 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.605 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.605 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.605 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.606 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.607 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.607 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.608 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.608 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.608 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.608 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.608 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.608 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.608 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.608 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.608 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.608 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.608 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.608 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.608 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.609 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.609 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.609 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.609 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.609 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.609 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.611 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.611 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.612 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.bucket_policy 2023-12-03T12:39:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: def test_bucket_policy_put_obj_grant(): 2023-12-03T12:39:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.612 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.612 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11206: 2023-12-03T12:39:20.612 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.612 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.612 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.612 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.613 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.613 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.613 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.613 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.613 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.613 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.613 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.613 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.614 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.614 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.614 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.614 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.614 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.614 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.614 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.615 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.615 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.615 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.618 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.618 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-460" 2023-12-03T12:39:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.618 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.618 INFO:teuthology.orchestra.run.smithi044.stdout:________________________ test_put_obj_enc_conflict_c_s3 ________________________ 2023-12-03T12:39:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.618 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.619 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.620 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.620 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.620 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.620 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.620 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.623 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.624 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.624 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.624 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.624 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.624 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.625 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.626 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.627 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.627 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.627 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.627 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.627 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.627 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.627 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.627 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.627 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.627 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.627 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.627 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.628 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.628 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.628 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.628 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.628 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.628 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.628 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.629 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.630 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.630 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.631 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.631 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.631 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.631 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.631 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.631 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:20.631 INFO:teuthology.orchestra.run.smithi044.stdout: def test_put_obj_enc_conflict_c_s3(): 2023-12-03T12:39:20.631 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:20.631 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.631 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11267: 2023-12-03T12:39:20.631 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.633 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.633 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.633 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.633 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.633 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.634 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.634 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.634 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.634 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.634 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.634 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.634 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.634 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.634 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.634 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.634 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.634 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.634 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.634 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.635 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.635 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.635 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.635 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.635 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.635 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.635 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.636 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.636 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.639 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.639 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-461" 2023-12-03T12:39:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.639 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.639 INFO:teuthology.orchestra.run.smithi044.stdout:_______________________ test_put_obj_enc_conflict_c_kms ________________________ 2023-12-03T12:39:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.639 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.640 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.640 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.641 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.641 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.641 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.641 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.641 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.644 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.644 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.645 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.645 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.645 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.645 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.646 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.647 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.647 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.647 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.647 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.647 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.648 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.648 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.648 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.648 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.648 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.648 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.648 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.648 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.648 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.648 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.648 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.648 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.648 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.648 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.648 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.649 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.649 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.649 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.649 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.649 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.651 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.651 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.652 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.652 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: def test_put_obj_enc_conflict_c_kms(): 2023-12-03T12:39:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:39:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: if kms_keyid is None: 2023-12-03T12:39:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: kms_keyid = 'fool-me-once' 2023-12-03T12:39:20.652 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.652 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11293: 2023-12-03T12:39:20.652 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.652 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.653 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.653 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.653 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.653 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.653 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.653 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.653 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.653 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.653 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.653 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.653 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.653 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.653 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.653 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.653 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.654 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.654 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.654 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.654 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.654 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.654 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.654 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.654 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.654 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.654 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.654 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.654 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.654 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.654 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.655 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.655 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.655 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.655 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.655 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.658 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.659 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-462" 2023-12-03T12:39:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.659 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.659 INFO:teuthology.orchestra.run.smithi044.stdout:_______________________ test_put_obj_enc_conflict_s3_kms _______________________ 2023-12-03T12:39:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.659 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.660 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.660 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.660 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.660 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.660 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.660 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.661 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.663 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.663 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.663 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.663 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.663 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.663 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.663 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.663 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.663 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.663 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.663 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.663 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.663 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.663 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.663 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.664 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.664 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.664 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.664 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.664 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.664 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.664 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.664 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.664 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.664 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.664 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.664 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.664 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.664 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.665 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.665 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.665 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.665 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.665 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.665 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.665 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.665 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.665 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.665 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.665 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.665 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.665 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.665 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.665 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.666 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.666 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.666 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.666 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.666 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.666 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.666 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.666 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.666 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.666 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.666 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.666 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.666 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.666 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.667 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.667 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.667 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.667 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.667 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.667 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.667 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.667 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.667 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.667 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.667 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.667 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.667 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.667 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.668 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.668 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.668 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.668 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.668 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.668 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.668 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.668 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.668 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.668 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.668 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.668 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.668 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.668 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.669 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.669 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.669 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.669 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.669 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.669 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.669 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.669 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.669 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.669 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.669 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.669 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.669 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.670 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.670 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.670 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.670 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.670 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.670 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.670 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.670 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.670 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.670 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.670 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.670 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.670 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.670 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.671 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.671 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.671 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.671 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.671 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.671 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.671 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.671 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.671 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.671 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:20.671 INFO:teuthology.orchestra.run.smithi044.stdout: def test_put_obj_enc_conflict_s3_kms(): 2023-12-03T12:39:20.671 INFO:teuthology.orchestra.run.smithi044.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:39:20.671 INFO:teuthology.orchestra.run.smithi044.stdout: if kms_keyid is None: 2023-12-03T12:39:20.671 INFO:teuthology.orchestra.run.smithi044.stdout: kms_keyid = 'fool-me-once' 2023-12-03T12:39:20.671 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:20.672 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.672 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11320: 2023-12-03T12:39:20.672 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.672 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.672 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.672 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.672 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.672 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.672 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.672 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.672 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.672 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.672 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.672 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.672 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.673 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.673 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.673 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.673 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.673 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.673 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.673 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.673 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.673 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.673 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.673 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.673 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.673 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.673 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.673 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.673 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.674 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.674 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.674 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.674 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.674 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.674 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.674 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.674 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.674 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.674 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.674 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.674 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.675 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.675 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.675 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.675 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.675 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.675 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.675 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.675 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.675 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.675 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.675 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.675 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.675 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.675 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.675 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.675 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.676 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.676 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.676 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.676 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.676 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.676 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.676 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.676 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.676 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.676 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.676 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.676 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.676 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.676 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.676 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.677 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.677 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.677 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.677 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.677 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.677 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.677 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.677 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.677 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.677 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.677 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.677 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.677 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.677 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.677 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-463" 2023-12-03T12:39:20.677 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.678 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.678 INFO:teuthology.orchestra.run.smithi044.stdout:____________________ test_put_obj_enc_conflict_bad_enc_kms _____________________ 2023-12-03T12:39:20.678 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.678 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.678 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.678 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.678 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.678 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.678 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.678 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.678 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.678 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.678 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.678 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.679 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.679 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.679 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.679 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.679 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.679 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.679 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.679 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.679 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.679 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.679 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.679 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.679 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.679 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.680 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.680 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.680 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.680 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.680 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.680 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.680 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.680 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.680 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.680 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.680 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.680 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.680 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.680 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.680 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.681 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.681 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.681 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.681 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.681 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.681 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.681 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.681 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.681 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.681 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.681 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.681 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.681 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.682 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.682 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.682 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.682 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.682 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.682 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.682 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.682 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.682 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.682 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.682 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.682 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.682 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.682 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.682 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.683 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.683 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.683 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.683 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.683 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.683 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.683 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.683 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.683 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.683 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.683 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.683 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.683 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.683 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.683 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.683 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.683 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.684 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.684 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.684 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.684 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.684 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.684 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.684 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.684 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.684 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.684 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.684 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.684 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.684 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.684 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.684 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.685 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.685 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.685 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.685 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.685 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.685 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.685 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.685 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.685 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.685 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.685 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.685 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.685 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.685 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.685 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.686 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.686 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.686 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.686 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.686 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.686 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.687 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.687 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.687 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.687 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.687 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.687 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.687 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.687 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.687 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.687 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.687 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.687 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.687 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.687 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.688 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.688 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.688 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.688 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.688 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.688 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.688 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.688 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.688 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.688 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.688 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.688 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.688 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.688 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.688 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.689 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.689 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.689 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.689 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.689 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.689 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.689 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.689 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.689 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.689 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.689 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.689 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.689 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.689 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.690 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.690 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.690 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.690 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.690 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.690 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.690 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.690 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.690 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.690 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.690 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.690 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:20.690 INFO:teuthology.orchestra.run.smithi044.stdout: def test_put_obj_enc_conflict_bad_enc_kms(): 2023-12-03T12:39:20.690 INFO:teuthology.orchestra.run.smithi044.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:39:20.690 INFO:teuthology.orchestra.run.smithi044.stdout: if kms_keyid is None: 2023-12-03T12:39:20.691 INFO:teuthology.orchestra.run.smithi044.stdout: kms_keyid = 'fool-me-once' 2023-12-03T12:39:20.691 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:20.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.691 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11344: 2023-12-03T12:39:20.691 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.691 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.691 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.691 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.691 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.691 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.691 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.691 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.691 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.691 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.692 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.692 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.692 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.692 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.692 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.692 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.692 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.692 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.692 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.692 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.692 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.692 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.692 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.692 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.693 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.693 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.693 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.693 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.693 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.693 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.693 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.693 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.693 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.693 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.693 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.693 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.693 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.693 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.694 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.694 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.694 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.694 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.694 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.694 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.694 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.694 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.694 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.694 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.694 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.694 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.694 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.695 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.695 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.695 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.695 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.695 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.695 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.695 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.695 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.695 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.695 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.695 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.695 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.695 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.695 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.695 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.695 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.696 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.696 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.696 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.696 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.696 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.696 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.696 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.696 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.696 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.696 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.696 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.696 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.697 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.697 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.697 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.697 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.697 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.697 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-464" 2023-12-03T12:39:20.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.697 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.697 INFO:teuthology.orchestra.run.smithi044.stdout:_____________________ test_bucket_policy_put_obj_kms_noenc _____________________ 2023-12-03T12:39:20.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.697 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.697 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.697 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.697 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.698 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.698 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.698 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.698 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.698 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.698 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.698 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.698 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.698 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.698 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.698 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.698 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.699 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.699 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.699 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.699 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.699 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.699 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.699 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.699 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.699 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.699 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.699 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.699 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.699 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.700 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.700 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.700 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.700 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.700 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.700 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.700 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.700 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.700 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.700 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.700 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.700 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.700 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.700 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.701 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.701 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.701 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.701 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.701 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.701 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.701 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.701 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.701 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.701 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.701 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.701 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.701 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.702 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.702 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.702 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.702 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.702 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.702 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.702 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.702 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.702 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.702 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.702 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.702 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.702 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.702 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.703 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.703 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.703 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.703 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.703 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.703 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.703 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.703 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.703 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.703 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.703 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.703 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.703 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.703 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.704 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.704 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.704 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.704 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.704 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.704 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.704 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.704 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.704 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.704 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.704 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.704 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.704 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.704 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.705 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.705 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.705 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.705 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.705 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.705 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.705 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.705 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.705 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.705 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.706 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.706 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.706 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.706 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.706 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.706 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.706 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.706 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.706 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.706 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.706 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.706 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.706 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.706 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.707 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.707 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.707 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.707 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.707 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.707 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.707 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.707 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.707 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.707 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.707 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.707 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.707 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.707 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.707 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.708 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.708 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.708 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.708 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.708 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.708 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.708 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.708 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.708 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.708 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.708 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.708 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.708 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.708 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.709 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.709 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.709 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.709 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.709 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.709 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.709 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.709 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.709 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.709 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.709 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.709 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.709 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.709 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.710 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.710 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.710 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.710 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:20.710 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.710 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.bucket_policy 2023-12-03T12:39:20.710 INFO:teuthology.orchestra.run.smithi044.stdout: def test_bucket_policy_put_obj_kms_noenc(): 2023-12-03T12:39:20.710 INFO:teuthology.orchestra.run.smithi044.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:39:20.710 INFO:teuthology.orchestra.run.smithi044.stdout: if kms_keyid is None: 2023-12-03T12:39:20.710 INFO:teuthology.orchestra.run.smithi044.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-12-03T12:39:20.710 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:20.710 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.710 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11469: 2023-12-03T12:39:20.710 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.710 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.711 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.711 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.711 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.711 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.711 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.711 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.711 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.711 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.711 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.711 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.711 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.711 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.711 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.711 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.711 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.712 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.712 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.712 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.712 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.712 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.712 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.712 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.712 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.712 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.712 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.712 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.712 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.712 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.712 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.713 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.713 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.713 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.713 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.713 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.713 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.713 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.713 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.713 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.713 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.713 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.713 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.713 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.714 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.714 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.714 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.714 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.714 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.714 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.714 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.714 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.714 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.714 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.714 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.714 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.714 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.714 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.715 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.715 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.715 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.715 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.715 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.715 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.715 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.715 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.715 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.715 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.715 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.715 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.715 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.716 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.716 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.716 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.716 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.716 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.716 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.716 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.716 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.716 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.716 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.716 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.716 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.716 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.716 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.716 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.716 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-465" 2023-12-03T12:39:20.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.717 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.717 INFO:teuthology.orchestra.run.smithi044.stdout:______________________ test_bucket_policy_put_obj_kms_s3 _______________________ 2023-12-03T12:39:20.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.717 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.717 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.717 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.717 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.717 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.717 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.717 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.717 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.717 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.718 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.718 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.718 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.718 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.718 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.718 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.718 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.718 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.718 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.718 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.718 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.718 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.719 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.719 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.719 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.719 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.719 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.719 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.719 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.719 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.719 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.719 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.719 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.719 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.719 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.720 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.720 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.720 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.720 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.720 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.720 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.720 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.720 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.720 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.720 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.720 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.720 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.720 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.720 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.720 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.720 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.721 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.721 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.721 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.721 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.721 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.721 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.721 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.721 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.721 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.721 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.721 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.721 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.722 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.722 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.722 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.722 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.722 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.722 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.722 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.722 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.722 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.722 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.722 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.722 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.723 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.723 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.723 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.723 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.723 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.723 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.723 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.723 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.723 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.723 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.723 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.723 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.723 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.723 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.723 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.724 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.724 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.724 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.724 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.724 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.724 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.724 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.724 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.724 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.724 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.724 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.724 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.724 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.725 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.725 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.725 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.725 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.725 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.725 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.725 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.725 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.725 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.725 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.725 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.725 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.725 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.725 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.725 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.726 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.726 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.726 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.726 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.726 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.726 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.726 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.726 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.726 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.726 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.726 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.726 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.727 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.727 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.727 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.727 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.727 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.727 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.727 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.727 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.727 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.727 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.727 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.728 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.728 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.728 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.728 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.728 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.728 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.728 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.728 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.728 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.728 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.728 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.729 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.729 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.729 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.729 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.729 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.729 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.729 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.729 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.729 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.729 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.729 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.729 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.729 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.729 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:20.729 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.bucket_policy 2023-12-03T12:39:20.730 INFO:teuthology.orchestra.run.smithi044.stdout: def test_bucket_policy_put_obj_kms_s3(): 2023-12-03T12:39:20.730 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:20.730 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.730 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11512: 2023-12-03T12:39:20.730 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.730 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:20.730 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:20.730 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.730 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.730 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.730 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.730 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.730 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.731 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.731 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.731 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.731 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.731 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.731 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.731 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.731 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.731 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.731 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.731 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.731 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.731 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.731 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.731 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.732 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.732 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.732 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.732 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.732 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.732 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.732 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.732 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.732 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.732 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.732 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.732 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.732 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.732 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.732 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.733 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.733 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.733 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.733 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.733 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.733 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.733 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.733 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.733 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.733 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.733 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.733 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.733 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.733 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.733 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.733 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.734 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.734 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.734 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.734 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.734 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.734 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.734 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.734 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.734 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.734 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.734 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.734 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.734 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.734 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.734 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.734 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.735 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.735 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.735 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.735 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.735 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.735 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.735 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.735 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.735 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.735 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.735 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.735 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.735 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.735 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.735 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.736 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.736 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.736 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.736 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-466" 2023-12-03T12:39:20.736 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.736 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.736 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ test_bucket_policy_get_obj_acl_existing_tag __________________ 2023-12-03T12:39:20.736 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.736 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.736 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.736 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.736 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.736 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.736 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.736 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.736 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.737 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.737 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.737 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.737 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.737 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.737 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.737 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.737 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.737 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.737 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.737 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.737 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.738 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.738 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.738 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.738 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.738 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.738 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.738 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.738 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.738 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.738 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.738 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.739 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.739 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.739 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.739 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.739 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.739 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.739 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.739 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.739 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.739 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.739 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.739 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.740 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.740 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.740 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.740 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.740 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.740 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.740 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.740 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.740 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.740 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.740 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.740 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.740 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.740 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.740 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.741 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.741 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.741 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.741 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.741 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.741 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.741 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.741 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.741 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.741 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.741 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.741 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.742 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.742 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.742 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.742 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.742 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.742 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.742 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.742 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.742 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.742 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.742 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.742 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.742 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.742 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.743 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.743 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.743 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.743 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.743 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.743 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.743 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.743 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.743 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.743 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.743 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.743 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.743 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.743 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.743 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.744 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.744 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.744 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.744 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.744 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.744 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.744 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.744 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.744 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.744 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.744 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.744 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.744 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.744 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.744 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.744 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.745 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.745 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.745 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.745 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.745 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.745 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.745 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.745 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.745 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.745 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.745 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.745 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.745 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.745 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.745 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.745 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.746 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.746 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.746 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.746 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.746 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.746 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.746 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.746 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.746 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.746 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.746 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.746 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.746 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.746 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.746 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.747 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.747 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.747 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.747 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.747 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.747 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.747 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.747 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.747 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.747 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.747 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.747 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.747 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.747 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.748 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.748 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.748 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.748 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.748 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.748 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.748 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.748 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.748 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.748 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.748 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.748 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.748 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.748 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.748 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.748 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.749 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.tagging 2023-12-03T12:39:20.749 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.bucket_policy 2023-12-03T12:39:20.749 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.749 INFO:teuthology.orchestra.run.smithi044.stdout: def test_bucket_policy_get_obj_acl_existing_tag(): 2023-12-03T12:39:20.749 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = _create_objects(keys=['publictag', 'privatetag', 'invalidtag']) 2023-12-03T12:39:20.749 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.749 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11584: 2023-12-03T12:39:20.749 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.749 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-12-03T12:39:20.749 INFO:teuthology.orchestra.run.smithi044.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-12-03T12:39:20.749 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-12-03T12:39:20.749 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_location = bucket.create() 2023-12-03T12:39:20.749 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-12-03T12:39:20.749 INFO:teuthology.orchestra.run.smithi044.stdout: response = action(self, *args, **kwargs) 2023-12-03T12:39:20.749 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-12-03T12:39:20.749 INFO:teuthology.orchestra.run.smithi044.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-12-03T12:39:20.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.750 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.750 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.750 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.750 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.750 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.750 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.751 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.751 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.751 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.751 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.751 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.751 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.751 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.751 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.751 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.751 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.751 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.751 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.752 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.752 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.752 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.752 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.752 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.752 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.752 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.752 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.752 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.752 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.752 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.752 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.752 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.752 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.752 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.753 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.753 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.753 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.753 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.753 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.753 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.753 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.753 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.753 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.753 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.753 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.753 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.753 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.753 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.753 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.754 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.754 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.754 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.754 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.754 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.754 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.754 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.754 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.754 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.754 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.754 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.754 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.754 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.754 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.755 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.755 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.755 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.755 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.755 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.755 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.755 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.755 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.755 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.755 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.755 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.755 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.756 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.756 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.756 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.756 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-467" 2023-12-03T12:39:20.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.756 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.756 INFO:teuthology.orchestra.run.smithi044.stdout:________________________ test_object_lock_put_obj_lock _________________________ 2023-12-03T12:39:20.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.756 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.756 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.756 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.756 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.756 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.756 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.757 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.757 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.757 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.757 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.757 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.757 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.757 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.757 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.757 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.757 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.757 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.757 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.758 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.758 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.758 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.758 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.758 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.758 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.758 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.758 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.758 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.758 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.758 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.758 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.758 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.758 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.758 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.759 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.759 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.759 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.759 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.759 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.759 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.759 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.759 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.759 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.759 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.759 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.759 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.759 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.760 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.760 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.760 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.760 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.760 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.760 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.760 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.760 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.760 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.760 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.760 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.760 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.760 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.760 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.760 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.761 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.761 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.761 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.761 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.761 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.761 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.761 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.761 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.761 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.761 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.761 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.761 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.761 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.761 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.761 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.762 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.762 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.762 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.762 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.762 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.762 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.762 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.762 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.762 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.762 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.762 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.762 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.762 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.763 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.763 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.763 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.763 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.763 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.763 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.763 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.763 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.763 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.763 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.763 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.763 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.763 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.763 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.763 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.763 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.764 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.764 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.764 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.764 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.764 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.764 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.764 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.764 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.764 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.764 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.764 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.764 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.764 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.764 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.764 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.765 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.765 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.765 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.765 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.765 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.765 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.766 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.766 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.766 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.766 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.766 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.766 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.766 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.766 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.766 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.766 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.766 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.766 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.766 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.766 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.767 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.767 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.767 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.767 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.767 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.767 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.767 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.767 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.767 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.767 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.767 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.767 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.768 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.768 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.768 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.768 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.768 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.768 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.768 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.768 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.768 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.768 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.768 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.768 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.768 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.768 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.768 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_put_obj_lock(): 2023-12-03T12:39:20.768 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:20.769 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:20.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11645: 2023-12-03T12:39:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.769 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.769 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.769 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.769 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.769 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.770 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.770 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.770 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.770 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.770 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.770 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.770 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.770 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.770 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.771 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.771 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.771 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.771 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.771 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.771 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.771 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.771 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.771 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.771 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.771 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.771 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.771 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.771 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.772 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.772 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.772 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.772 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.772 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.772 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.772 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.772 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.772 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.772 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.772 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.772 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.772 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.772 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.773 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.773 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.773 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.773 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.773 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.773 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.773 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.773 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.773 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.773 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.773 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.773 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.773 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.773 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.773 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.773 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.774 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.774 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.774 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.774 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.774 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.774 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.774 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.774 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.774 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.774 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.774 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.774 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.774 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-468" 2023-12-03T12:39:20.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.775 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.775 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ test_object_lock_put_obj_lock_invalid_bucket _________________ 2023-12-03T12:39:20.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.775 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.775 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.775 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.775 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.775 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.775 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.775 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.775 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.776 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.776 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.776 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.776 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.776 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.776 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.776 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.776 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.776 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.776 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.776 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.776 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.777 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.777 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.777 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.777 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.777 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.777 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.777 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.777 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.777 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.777 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.777 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.777 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.777 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.777 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.777 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.777 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.778 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.778 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.778 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.778 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.778 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.778 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.778 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.778 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.778 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.778 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.778 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.778 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.778 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.778 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.779 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.779 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.779 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.779 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.779 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.779 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.779 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.779 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.779 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.779 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.779 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.779 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.779 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.779 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.779 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.780 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.780 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.780 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.780 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.780 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.780 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.780 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.780 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.780 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.780 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.780 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.780 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.780 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.780 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.780 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.780 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.781 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.781 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.781 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.781 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.781 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.781 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.781 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.781 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.781 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.781 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.781 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.781 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.781 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.781 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.781 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.782 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.782 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.782 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.782 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.782 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.782 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.782 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.782 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.782 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.782 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.782 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.782 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.782 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.782 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.783 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.783 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.783 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.783 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.783 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.783 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.783 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.783 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.783 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.783 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.783 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.783 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.783 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.783 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.784 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.784 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.784 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.784 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.784 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.784 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.784 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.784 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.784 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.784 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.784 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.784 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.785 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.785 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.785 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.785 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.785 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.785 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.785 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.785 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.785 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.785 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.785 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.786 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.786 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.786 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.786 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.786 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.786 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.786 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.786 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.786 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.786 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.786 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.786 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.787 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.787 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.787 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.787 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.787 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.787 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.787 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.787 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.787 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_put_obj_lock_invalid_bucket(): 2023-12-03T12:39:20.787 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:20.787 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:20.787 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name) 2023-12-03T12:39:20.787 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.788 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11677: 2023-12-03T12:39:20.788 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.788 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.788 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.788 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.788 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.788 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.788 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.788 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.788 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.789 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.789 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.789 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.789 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.789 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.789 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.789 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.789 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.790 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.790 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.790 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.790 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.790 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.790 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.790 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.790 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.790 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.790 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.790 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.790 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.790 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.790 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.791 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.791 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.791 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.791 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.791 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.791 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.791 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.791 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.791 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.791 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.791 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.791 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.791 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.791 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.791 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.792 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.792 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.792 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.792 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.792 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.792 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.792 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.792 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.792 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.792 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.792 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.792 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.792 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.792 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.792 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.793 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.793 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.793 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.793 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.793 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.793 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.793 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.793 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.793 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.793 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.793 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.793 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.793 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.793 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-469" 2023-12-03T12:39:20.793 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.794 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.794 INFO:teuthology.orchestra.run.smithi044.stdout:______________ test_object_lock_put_obj_lock_with_days_and_years _______________ 2023-12-03T12:39:20.794 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.794 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.794 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.794 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.794 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.794 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.794 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.794 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.794 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.794 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.794 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.794 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.795 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.795 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.795 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.795 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.795 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.795 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.795 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.795 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.795 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.795 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.795 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.795 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.795 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.795 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.796 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.796 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.796 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.796 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.796 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.796 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.796 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.796 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.796 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.796 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.796 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.797 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.797 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.797 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.797 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.797 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.797 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.797 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.797 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.797 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.797 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.797 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.797 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.797 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.797 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.797 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.798 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.798 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.798 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.798 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.798 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.798 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.798 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.798 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.798 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.798 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.798 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.798 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.798 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.798 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.799 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.799 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.799 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.799 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.799 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.799 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.799 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.799 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.799 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.799 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.799 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.799 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.800 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.800 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.800 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.800 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.800 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.800 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.800 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.800 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.800 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.800 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.800 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.800 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.800 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.800 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.801 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.801 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.801 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.801 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.801 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.801 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.801 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.801 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.801 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.801 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.801 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.801 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.801 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.801 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.801 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.802 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.802 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.802 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.802 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.802 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.802 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.802 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.802 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.802 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.802 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.802 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.802 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.802 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.802 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.802 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.803 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.803 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.803 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.803 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.803 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.803 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.803 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.803 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.803 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.803 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.803 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.803 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.803 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.803 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.804 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.804 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.804 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.804 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.804 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.804 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.804 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.804 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.804 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.804 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.804 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.804 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.804 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.804 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.804 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.804 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.805 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.805 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.805 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.805 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.805 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.805 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.805 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.805 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.805 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.805 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.805 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.805 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.805 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.805 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.806 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.806 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.806 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.806 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.806 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.806 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.806 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_put_obj_lock_with_days_and_years(): 2023-12-03T12:39:20.806 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:20.806 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:20.806 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:20.806 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.806 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11695: 2023-12-03T12:39:20.806 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.806 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.807 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.807 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.807 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.807 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.807 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.807 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.807 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.807 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.807 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.807 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.807 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.807 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.807 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.807 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.807 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.807 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.808 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.808 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.808 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.808 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.808 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.808 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.808 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.808 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.809 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.809 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.809 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.809 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.809 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.809 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.809 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.809 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.809 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.809 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.809 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.809 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.809 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.809 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.809 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.810 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.810 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.810 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.810 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.810 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.810 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.810 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.810 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.810 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.810 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.810 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.810 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.810 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.810 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.810 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.810 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.811 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.811 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.811 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.811 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.811 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.811 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.811 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.811 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.811 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.811 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.811 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.811 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.811 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.811 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.812 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.812 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.812 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.812 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.812 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.812 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.812 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.812 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.812 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.812 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.812 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-470" 2023-12-03T12:39:20.812 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.812 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.812 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ test_object_lock_put_obj_lock_invalid_days __________________ 2023-12-03T12:39:20.812 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.812 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.813 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.813 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.813 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.813 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.813 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.813 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.813 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.813 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.813 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.813 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.813 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.813 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.813 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.813 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.813 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.813 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.814 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.814 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.814 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.814 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.814 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.814 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.814 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.814 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.814 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.814 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.814 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.814 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.814 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.814 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.814 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.815 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.815 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.815 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.815 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.815 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.815 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.815 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.815 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.815 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.815 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.815 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.815 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.815 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.816 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.816 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.816 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.816 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.816 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.816 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.816 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.816 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.816 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.816 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.816 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.816 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.816 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.816 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.816 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.816 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.817 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.817 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.817 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.817 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.817 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.817 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.817 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.817 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.817 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.817 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.817 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.817 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.817 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.817 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.817 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.817 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.818 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.818 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.818 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.818 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.818 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.818 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.818 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.818 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.818 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.818 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.818 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.818 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.818 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.818 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.819 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.819 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.819 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.819 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.819 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.819 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.819 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.819 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.819 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.819 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.819 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.819 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.819 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.819 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.820 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.820 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.820 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.820 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.820 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.820 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.820 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.820 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.820 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.820 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.820 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.820 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.820 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.820 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.820 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.820 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.821 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.821 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.821 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.821 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.821 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.821 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.821 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.821 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.821 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.821 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.821 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.821 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.821 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.821 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.822 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.822 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.822 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.822 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.822 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.822 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.822 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.822 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.822 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.822 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.822 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.822 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.822 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.822 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.822 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.823 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.823 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.823 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.823 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.823 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.823 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.823 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.823 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.823 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.823 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.823 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.823 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.823 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.823 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.823 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.823 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.824 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.824 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.824 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.824 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.824 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.824 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.824 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.824 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.824 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.824 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.824 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.824 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.824 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.824 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.825 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.825 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_put_obj_lock_invalid_days(): 2023-12-03T12:39:20.825 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:20.825 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:20.825 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:20.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.825 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11714: 2023-12-03T12:39:20.825 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.825 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.825 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.825 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.825 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.825 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.825 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.826 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.826 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.826 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.826 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.826 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.826 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.826 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.826 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.826 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.826 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.826 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.826 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.826 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.827 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.827 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.827 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.827 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.827 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.827 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.827 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.827 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.827 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.827 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.827 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.827 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.827 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.827 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.827 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.827 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.828 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.828 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.828 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.828 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.828 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.828 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.828 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.828 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.828 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.828 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.828 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.828 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.828 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.828 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.828 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.829 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.829 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.829 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.829 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.829 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.829 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.829 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.829 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.829 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.829 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.829 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.829 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.830 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.830 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.830 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.830 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.830 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.830 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.830 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.830 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.830 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.830 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.830 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.830 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.830 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.831 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.831 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.831 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.831 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.831 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.831 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.831 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.831 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.831 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.831 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.831 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.831 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-471" 2023-12-03T12:39:20.831 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.831 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.832 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ test_object_lock_put_obj_lock_invalid_years __________________ 2023-12-03T12:39:20.832 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.832 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.832 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.832 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.832 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.832 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.832 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.832 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.832 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.832 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.832 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.832 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.832 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.832 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.833 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.833 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.833 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.833 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.833 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.833 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.833 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.833 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.833 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.833 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.833 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.833 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.834 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.834 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.834 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.834 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.834 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.834 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.834 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.834 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.834 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.834 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.834 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.834 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.834 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.835 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.835 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.835 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.835 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.835 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.835 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.835 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.835 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.835 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.835 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.835 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.837 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.837 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.837 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.837 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.837 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.837 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.837 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.838 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.838 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.838 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.838 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.838 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.838 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.838 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.838 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.838 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.838 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.838 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.838 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.838 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.838 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.839 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.839 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.839 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.839 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.839 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.839 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.839 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.839 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.839 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.839 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.839 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.839 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.840 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.840 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.840 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.840 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.840 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.840 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.840 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.840 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.840 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.840 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.840 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.840 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.840 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.840 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.841 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.841 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.841 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.841 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.841 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.841 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.841 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.841 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.841 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.841 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.841 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.841 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.841 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.841 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.841 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.842 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.842 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.842 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.842 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.842 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.842 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.842 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.842 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.842 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.843 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.843 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.843 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.843 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.843 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.843 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.843 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.843 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.843 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.843 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.843 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.843 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.843 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.843 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.843 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.843 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.843 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.844 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.844 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.844 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.844 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.844 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.844 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.844 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.844 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.844 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.844 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.845 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.845 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.845 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.845 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.845 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.845 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.845 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.845 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.845 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.845 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.845 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.845 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.845 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.845 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.845 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.845 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.846 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.846 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.846 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.846 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.846 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_put_obj_lock_invalid_years(): 2023-12-03T12:39:20.846 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:20.846 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:20.846 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:20.846 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.846 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11732: 2023-12-03T12:39:20.846 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.846 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.846 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.846 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.847 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.847 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.847 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.847 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.847 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.847 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.847 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.847 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.847 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.847 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.847 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.847 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.847 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.847 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.847 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.847 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.848 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.848 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.848 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.848 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.848 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.848 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.848 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.848 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.848 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.848 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.849 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.849 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.849 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.849 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.849 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.849 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.849 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.849 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.849 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.849 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.849 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.849 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.849 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.849 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.849 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.850 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.850 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.850 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.850 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.850 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.850 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.850 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.850 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.850 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.850 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.850 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.850 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.850 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.850 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.851 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.851 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.851 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.851 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.851 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.851 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.851 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.851 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.851 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.851 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.851 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.851 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.851 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.851 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.851 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.851 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.851 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.852 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.852 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.852 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.852 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.852 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.852 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-472" 2023-12-03T12:39:20.852 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.852 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.852 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ test_object_lock_put_obj_lock_invalid_mode __________________ 2023-12-03T12:39:20.852 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.852 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.852 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.852 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.852 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.852 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.853 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.853 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.853 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.853 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.853 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.853 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.853 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.853 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.853 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.853 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.853 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.853 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.853 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.853 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.853 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.853 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.854 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.854 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.854 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.854 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.854 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.854 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.854 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.854 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.854 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.854 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.854 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.854 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.854 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.854 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.855 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.855 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.855 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.855 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.855 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.855 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.855 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.855 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.855 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.855 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.855 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.855 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.855 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.855 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.855 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.856 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.856 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.856 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.856 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.856 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.856 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.856 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.856 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.856 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.856 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.856 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.856 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.856 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.856 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.856 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.857 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.857 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.857 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.857 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.857 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.857 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.857 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.857 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.857 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.857 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.857 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.857 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.857 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.857 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.857 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.858 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.858 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.858 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.858 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.858 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.858 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.858 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.858 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.858 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.858 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.858 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.858 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.858 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.858 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.859 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.859 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.859 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.859 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.859 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.859 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.859 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.859 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.859 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.859 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.859 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.859 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.859 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.859 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.859 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.859 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.859 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.860 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.860 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.860 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.860 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.860 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.860 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.860 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.860 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.860 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.860 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.860 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.860 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.860 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.860 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.860 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.861 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.861 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.861 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.861 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.861 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.861 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.861 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.861 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.861 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.861 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.861 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.861 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.861 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.861 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.861 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.862 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.862 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.862 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.862 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.862 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.862 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.862 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.862 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.862 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.862 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.862 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.862 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.862 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.862 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.862 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.863 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.863 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.863 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.863 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.863 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.863 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.863 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.863 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.863 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.863 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.863 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.863 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.863 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.863 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.863 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.863 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.864 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.864 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.864 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.864 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.864 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.864 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.864 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.864 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.864 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.864 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.864 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.864 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.864 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_put_obj_lock_invalid_mode(): 2023-12-03T12:39:20.864 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:20.864 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:20.864 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:20.864 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.865 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11750: 2023-12-03T12:39:20.865 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.865 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.865 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.865 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.865 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.865 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.865 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.865 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.865 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.865 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.865 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.865 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.865 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.865 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.865 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.866 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.866 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.866 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.866 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.866 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.866 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.866 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.866 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.866 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.866 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.866 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.866 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.866 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.866 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.867 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.867 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.867 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.867 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.867 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.867 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.867 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.867 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.867 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.867 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.867 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.867 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.867 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.868 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.868 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.868 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.868 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.868 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.868 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.868 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.868 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.868 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.868 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.868 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.868 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.868 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.868 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.868 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.868 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.869 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.869 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.869 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.869 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.869 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.869 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.869 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.869 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.869 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.869 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.869 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.869 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.869 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.869 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.869 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.870 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.870 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.870 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.870 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.870 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.870 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.870 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.870 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.870 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.870 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.870 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-473" 2023-12-03T12:39:20.870 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.870 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.870 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ test_object_lock_put_obj_lock_invalid_status _________________ 2023-12-03T12:39:20.870 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.870 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.870 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.871 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.871 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.871 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.871 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.871 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.871 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.871 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.871 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.871 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.871 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.871 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.871 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.871 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.871 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.871 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.872 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.872 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.872 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.872 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.872 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.872 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.872 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.872 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.872 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.872 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.872 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.872 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.872 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.872 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.872 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.872 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.873 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.873 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.873 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.873 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.873 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.873 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.873 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.873 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.873 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.873 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.873 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.873 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.873 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.873 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.873 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.873 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.873 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.874 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.874 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.874 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.874 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.874 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.874 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.874 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.874 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.874 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.874 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.874 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.874 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.874 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.874 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.874 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.874 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.875 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.875 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.875 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.875 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.875 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.875 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.875 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.875 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.875 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.875 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.875 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.875 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.876 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.876 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.876 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.876 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.876 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.876 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.876 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.876 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.876 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.876 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.876 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.876 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.876 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.876 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.876 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.876 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.877 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.877 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.877 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.877 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.877 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.877 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.877 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.877 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.877 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.877 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.877 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.877 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.877 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.877 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.878 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.878 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.878 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.878 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.878 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.878 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.878 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.878 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.878 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.878 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.878 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.878 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.878 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.878 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.878 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.879 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.879 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.879 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.879 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.879 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.879 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.879 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.879 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.879 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.879 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.879 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.879 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.879 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.879 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.879 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.879 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.879 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.880 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.880 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.880 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.880 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.880 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.880 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.880 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.880 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.880 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.880 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.880 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.881 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.881 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.881 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.881 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.881 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.881 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.881 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.881 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.881 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.881 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.881 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.881 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.881 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.881 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.881 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.881 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.882 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.882 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.882 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.882 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_put_obj_lock_invalid_status(): 2023-12-03T12:39:20.882 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:20.882 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:20.882 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:20.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.882 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11780: 2023-12-03T12:39:20.882 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.882 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.882 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.883 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.883 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.883 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.883 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.883 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.883 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.883 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.883 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.883 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.883 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.883 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.883 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.883 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.883 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.883 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.883 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.883 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.884 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.884 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.884 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.884 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.884 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.884 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.884 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.884 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.884 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.884 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.884 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.884 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.884 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.884 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.884 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.884 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.884 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.885 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.885 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.885 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.885 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.885 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.885 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.885 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.885 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.885 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.885 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.885 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.885 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.885 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.885 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.885 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.885 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.886 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.886 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.886 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.886 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.886 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.886 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.886 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.886 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.886 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.886 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.886 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.886 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.886 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.886 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.886 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.886 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.887 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.887 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.887 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.887 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.887 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.887 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.887 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.887 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.887 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.887 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.887 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.887 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.888 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.888 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.888 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.888 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.888 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-474" 2023-12-03T12:39:20.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.888 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.888 INFO:teuthology.orchestra.run.smithi044.stdout:_____________________ test_object_lock_suspend_versioning ______________________ 2023-12-03T12:39:20.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.888 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.888 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.888 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.889 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.889 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.889 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.889 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.889 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.889 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.889 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.889 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.889 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.889 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.889 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.889 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.889 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.889 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.889 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.890 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.890 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.890 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.890 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.890 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.890 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.890 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.890 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.890 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.890 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.890 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.890 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.890 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.890 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.891 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.891 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.891 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.891 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.891 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.891 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.891 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.891 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.891 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.891 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.891 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.891 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.891 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.891 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.891 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.892 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.892 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.892 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.892 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.892 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.892 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.892 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.892 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.892 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.892 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.892 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.892 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.892 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.892 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.892 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.893 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.893 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.893 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.893 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.893 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.893 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.893 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.893 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.893 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.893 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.893 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.893 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.893 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.893 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.893 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.893 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.893 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.894 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.894 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.894 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.894 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.894 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.894 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.894 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.894 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.894 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.894 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.894 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.894 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.894 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.894 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.895 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.895 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.895 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.895 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.895 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.895 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.895 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.895 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.895 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.895 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.895 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.895 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.895 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.895 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.895 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.895 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.895 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.896 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.896 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.896 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.896 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.896 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.896 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.896 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.896 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.896 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.896 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.896 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.896 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.896 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.896 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.896 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.896 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.896 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.897 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.897 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.897 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.897 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.897 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.897 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.897 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.897 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.897 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.897 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.897 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.897 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.897 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.897 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.897 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.897 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.898 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.898 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.898 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.898 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.898 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.898 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.898 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.898 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.898 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.898 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.898 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.898 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.898 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.898 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.898 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.898 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.898 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.899 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.899 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.899 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.899 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.899 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.899 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.899 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.899 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.899 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.899 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.899 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.899 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.900 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.900 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.900 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.900 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.900 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.900 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.900 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.900 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_suspend_versioning(): 2023-12-03T12:39:20.900 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:20.900 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:20.900 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:20.900 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.900 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11798: 2023-12-03T12:39:20.900 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.900 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.901 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.901 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.901 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.901 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.901 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.901 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.901 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.901 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.901 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.902 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.902 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.902 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.902 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.902 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.902 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.902 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.902 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.902 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.902 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.902 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.902 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.902 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.902 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.902 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.903 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.903 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.903 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.903 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.903 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.903 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.903 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.903 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.903 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.903 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.903 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.903 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.903 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.903 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.903 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.903 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.903 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.904 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.904 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.904 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.904 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.904 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.904 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.904 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.904 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.904 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.904 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.904 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.904 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.904 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.904 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.904 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.904 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.905 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.905 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.905 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.905 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.905 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.905 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.905 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.905 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.905 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.905 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.905 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.905 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.905 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.905 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.905 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.905 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.905 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.905 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.906 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.906 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.906 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.906 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-475" 2023-12-03T12:39:20.906 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.906 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.906 INFO:teuthology.orchestra.run.smithi044.stdout:________________________ test_object_lock_get_obj_lock _________________________ 2023-12-03T12:39:20.906 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.906 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.906 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.906 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.906 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.906 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.906 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.907 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.907 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.907 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.907 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.907 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.907 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.907 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.907 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.907 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.907 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.907 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.907 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.907 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.908 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.908 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.908 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.908 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.908 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.908 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.908 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.908 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.908 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.908 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.908 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.908 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.908 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.908 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.908 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.908 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.909 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.909 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.909 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.909 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.909 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.909 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.909 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.909 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.909 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.909 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.909 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.909 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.909 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.909 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.909 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.909 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.910 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.910 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.910 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.910 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.910 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.910 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.910 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.910 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.910 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.910 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.910 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.910 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.910 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.910 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.911 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.911 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.911 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.911 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.911 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.911 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.911 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.911 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.911 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.911 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.911 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.911 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.912 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.912 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.912 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.912 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.912 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.912 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.912 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.912 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.912 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.912 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.912 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.912 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.912 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.912 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.912 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.912 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.913 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.913 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.913 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.913 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.913 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.913 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.913 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.913 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.913 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.913 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.913 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.913 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.913 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.913 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.914 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.914 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.914 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.914 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.914 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.914 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.914 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.914 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.914 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.914 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.914 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.914 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.914 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.914 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.914 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.914 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.915 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.915 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.915 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.915 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.915 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.915 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.915 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.915 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.915 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.915 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.915 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.915 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.915 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.915 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.915 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.915 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.916 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.916 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.916 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.916 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.916 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.916 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.916 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.916 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.916 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.916 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.917 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.917 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.917 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.917 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.917 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.917 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.917 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.917 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.917 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.917 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.917 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.917 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.917 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.917 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.917 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.917 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.918 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.918 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.918 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.918 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.918 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_get_obj_lock(): 2023-12-03T12:39:20.918 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:20.918 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:20.918 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:20.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.918 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11809: 2023-12-03T12:39:20.918 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.918 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.919 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.919 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.919 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.919 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.919 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.919 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.919 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.919 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.919 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.920 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.920 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.920 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.920 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.920 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.920 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.920 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.920 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.920 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.921 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.921 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.921 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.921 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.921 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.921 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.921 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.921 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.921 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.921 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.921 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.921 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.921 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.921 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.922 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.922 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.922 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.922 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.922 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.922 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.922 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.922 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.922 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.922 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.922 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.922 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.922 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.922 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.922 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.922 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.923 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.923 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.923 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.923 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.923 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.923 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.923 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.923 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.923 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.923 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.923 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.923 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.923 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.923 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.923 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.923 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.924 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.924 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.924 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.924 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.924 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.924 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.924 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.924 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-476" 2023-12-03T12:39:20.924 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.924 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.924 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ test_object_lock_get_obj_lock_invalid_bucket _________________ 2023-12-03T12:39:20.924 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.924 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.924 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.925 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.925 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.925 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.925 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.925 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.925 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.925 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.925 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.925 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.925 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.925 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.925 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.925 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.925 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.925 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.925 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.926 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.926 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.926 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.926 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.926 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.926 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.926 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.926 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.926 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.926 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.926 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.926 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.926 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.926 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.927 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.927 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.927 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.927 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.927 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.927 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.927 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.927 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.927 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.927 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.927 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.927 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.928 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.928 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.928 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.928 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.928 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.928 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.928 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.928 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.928 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.928 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.928 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.928 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.928 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.928 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.928 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.928 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.929 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.929 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.929 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.929 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.929 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.929 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.929 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.929 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.929 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.929 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.930 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.930 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.930 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.930 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.930 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.930 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.930 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.930 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.930 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.930 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.930 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.930 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.930 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.930 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.930 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.931 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.931 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.931 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.931 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.931 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.931 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.931 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.931 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.931 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.931 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.931 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.931 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.931 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.931 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.932 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.932 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.932 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.932 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.932 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.932 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.932 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.932 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.932 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.932 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.932 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.932 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.932 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.932 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.932 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.932 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.933 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.933 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.933 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.933 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.933 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.933 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.933 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.933 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.933 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.933 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.933 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.933 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.933 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.933 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.933 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.933 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.934 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.934 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.934 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.934 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.934 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.934 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.934 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.934 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.934 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.934 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.934 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.934 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.934 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.934 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.934 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.935 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.935 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.935 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.935 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.935 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.935 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.935 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.935 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.935 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.935 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.935 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.935 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.935 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.935 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.935 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.935 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.936 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.936 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.936 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.936 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.936 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.936 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.936 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.936 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.936 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.936 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.936 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.936 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.936 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_get_obj_lock_invalid_bucket(): 2023-12-03T12:39:20.937 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:20.937 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:20.937 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name) 2023-12-03T12:39:20.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.937 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11827: 2023-12-03T12:39:20.937 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.937 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.937 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.937 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.937 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.937 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.937 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.937 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.937 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.937 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.937 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.937 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.938 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.938 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.938 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.938 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.938 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.938 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.938 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.938 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.938 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.938 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.938 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.938 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.938 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.938 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.938 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.939 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.939 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.939 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.939 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.939 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.939 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.939 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.939 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.939 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.939 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.939 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.939 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.939 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.940 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.940 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.940 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.940 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.940 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.940 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.940 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.940 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.940 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.940 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.940 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.940 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.940 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.940 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.940 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.941 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.941 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.941 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.941 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.941 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.941 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.941 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.941 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.941 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.941 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.941 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.941 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.941 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.941 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.942 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.942 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.942 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.942 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.942 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.942 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.942 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.942 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.942 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.942 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.942 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.942 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.942 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.942 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.943 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-477" 2023-12-03T12:39:20.943 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.943 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.943 INFO:teuthology.orchestra.run.smithi044.stdout:______________________ test_object_lock_put_obj_retention ______________________ 2023-12-03T12:39:20.943 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.943 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.943 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.943 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.943 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.943 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.943 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.943 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.943 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.943 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.943 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.944 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.944 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.944 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.944 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.944 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.944 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.944 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.944 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.944 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.944 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.944 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.944 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.944 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.945 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.945 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.945 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.945 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.945 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.945 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.945 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.945 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.945 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.945 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.945 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.945 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.945 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.945 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.945 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.946 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.946 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.946 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.946 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.946 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.946 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.946 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.946 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.946 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.946 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.946 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.946 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.946 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.946 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.946 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.947 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.947 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.947 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.947 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.947 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.947 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.947 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.947 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.947 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.947 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.947 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.947 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.947 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.947 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.948 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.948 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.948 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.948 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.948 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.948 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.948 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.948 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.948 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.948 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.948 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.949 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.949 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.949 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.949 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.949 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.949 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.949 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.949 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.949 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.949 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.949 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.949 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.949 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.949 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.950 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.950 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.950 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.950 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.950 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.950 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.950 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.950 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.950 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.950 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.950 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.950 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.950 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.950 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.951 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.951 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.951 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.951 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.951 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.951 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.951 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.951 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.951 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.952 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.952 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.952 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.952 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.952 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.952 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.952 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.952 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.952 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.952 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.952 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.952 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.952 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.952 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.953 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.953 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.953 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.953 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.953 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.953 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.953 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.953 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.953 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.953 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.953 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.953 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.953 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.953 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.953 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.954 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.954 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.954 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.954 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.954 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.954 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.954 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.954 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.954 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.954 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.954 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.954 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.954 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.954 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.954 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.954 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.955 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.955 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.955 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.955 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.955 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_put_obj_retention(): 2023-12-03T12:39:20.955 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:20.955 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:20.955 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:20.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.955 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11838: 2023-12-03T12:39:20.955 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.955 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.956 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.956 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.956 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.956 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.956 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.956 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.956 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.956 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.956 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.956 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.956 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.956 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.956 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.956 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.957 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.957 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.957 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.957 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.957 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.957 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.957 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.957 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.957 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.957 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.957 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.957 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.957 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.957 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.957 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.957 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.957 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.958 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.958 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.958 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.958 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.958 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.958 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.958 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.958 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.958 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.958 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.958 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.958 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.958 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.958 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.959 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.959 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.959 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.959 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.959 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.959 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.959 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.959 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.959 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.959 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.959 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.959 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.959 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.959 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.959 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.959 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.960 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.960 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.960 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.960 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.960 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.960 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.960 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.960 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.960 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.960 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.960 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.960 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.960 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.960 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.960 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.961 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.961 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.961 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.961 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.961 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.961 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.961 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.961 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.961 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.961 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-478" 2023-12-03T12:39:20.961 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.961 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.961 INFO:teuthology.orchestra.run.smithi044.stdout:______________ test_object_lock_put_obj_retention_invalid_bucket _______________ 2023-12-03T12:39:20.961 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.961 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.961 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.962 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.962 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.962 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.962 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.962 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.962 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.962 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.962 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.962 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.962 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.962 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.962 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.962 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.962 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.962 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.962 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.963 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.963 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.963 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.963 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.963 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.963 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.963 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.963 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.963 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.963 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.963 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.963 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.963 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.963 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.963 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.963 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.964 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.964 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.964 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.964 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.964 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.964 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.964 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.964 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.964 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.964 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.964 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.964 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.964 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.964 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.964 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.964 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.965 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.965 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.965 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.965 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.965 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.965 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.965 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.965 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.965 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.965 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.965 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.965 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.965 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.965 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.965 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.965 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.965 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.966 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.966 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.966 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.966 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.966 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.966 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.966 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.966 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.966 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.966 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.966 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.966 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.966 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.966 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.966 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.967 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.967 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.967 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.967 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.967 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.967 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.967 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.967 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.967 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.967 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.967 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.967 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.967 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.967 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.967 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.968 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.968 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.968 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.968 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.968 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.968 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.968 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.968 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.968 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.968 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.968 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.968 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.968 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.968 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.968 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.968 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.969 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.969 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.969 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.969 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.969 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.969 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.969 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.969 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.969 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.969 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.969 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.969 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.969 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.969 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.969 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.969 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.970 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.970 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.970 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.970 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.970 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.970 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.970 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.970 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.970 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.970 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.970 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.970 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.970 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.970 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.971 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.971 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.971 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.971 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.971 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.971 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.971 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.971 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.971 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.971 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.971 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.971 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.971 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.971 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.971 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.971 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.972 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.972 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.972 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.972 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.972 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.972 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.972 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.972 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.972 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.972 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.972 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.972 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.972 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.972 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.972 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.972 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.972 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.973 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.973 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.973 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.973 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.973 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.973 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.973 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.973 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_put_obj_retention_invalid_bucket(): 2023-12-03T12:39:20.973 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:20.973 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:20.973 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name) 2023-12-03T12:39:20.973 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.973 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11854: 2023-12-03T12:39:20.973 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.973 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.973 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.973 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.974 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.974 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.974 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.974 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.974 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.974 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.974 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.974 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.974 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.974 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.974 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.974 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.974 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.974 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.974 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.975 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.975 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.975 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.975 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.975 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.975 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.975 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.975 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.975 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.975 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.975 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.975 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.975 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.975 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.975 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.975 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.975 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.976 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.976 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.976 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.976 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.976 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.976 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.976 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.976 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.976 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.976 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.976 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.976 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.976 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.977 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.977 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.977 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.977 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.977 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.977 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.977 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.977 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.977 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.977 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.977 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.977 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.977 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.978 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.978 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.978 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.978 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.978 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.978 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.978 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.978 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.978 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.978 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.978 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.978 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.978 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.978 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.978 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.978 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.979 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.979 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.979 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.979 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.979 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.979 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.979 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-479" 2023-12-03T12:39:20.979 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.979 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.979 INFO:teuthology.orchestra.run.smithi044.stdout:_______________ test_object_lock_put_obj_retention_invalid_mode ________________ 2023-12-03T12:39:20.979 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.979 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.979 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.979 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.979 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.979 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.980 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.980 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.980 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.980 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.980 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.980 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.980 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.980 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.980 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.980 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.980 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.980 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.980 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.980 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.980 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.980 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.981 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.981 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.981 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.981 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.981 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.981 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.981 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.981 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.981 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.981 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.981 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.981 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.981 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.981 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.981 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.982 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.982 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.982 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.982 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:20.982 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:20.982 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:20.982 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:20.982 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:20.982 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.982 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.982 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:20.982 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:20.982 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:20.982 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:20.982 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.983 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:20.983 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:20.983 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:20.983 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:20.983 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.983 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.983 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:20.983 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:20.983 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:20.983 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:20.983 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.983 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.983 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:20.983 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:20.983 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:20.983 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.983 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:20.984 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.984 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:20.984 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:20.984 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.984 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:20.984 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:20.984 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:20.984 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:20.984 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:20.984 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:20.984 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.984 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:20.984 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.984 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.984 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.984 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.984 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.985 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.985 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.985 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.985 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.985 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.985 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.985 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.985 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.985 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.985 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.985 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.985 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.985 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.985 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.985 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.985 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.985 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.986 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.986 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:20.986 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.986 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.986 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.986 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.986 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.986 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.986 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.986 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.986 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.986 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.986 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.986 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:20.986 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.986 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:20.987 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:20.987 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:20.987 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:20.987 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:20.987 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:20.987 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:20.987 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:20.987 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:20.987 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:20.987 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:20.987 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:20.987 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:20.987 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:20.987 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:20.988 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:20.988 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:20.988 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.988 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:20.988 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:20.988 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:20.988 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:20.988 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:20.988 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:20.988 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:20.988 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:20.988 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:20.988 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:20.988 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.989 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.989 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.989 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.989 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.989 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.989 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.989 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.989 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.989 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.989 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.989 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.989 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:20.990 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.990 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.990 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:20.990 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:20.990 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:20.990 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:20.990 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:20.990 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.990 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:20.990 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:20.990 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:20.990 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.991 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:20.991 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.991 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:20.991 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.991 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:20.991 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.991 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:20.991 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_put_obj_retention_invalid_mode(): 2023-12-03T12:39:20.991 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:20.991 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:20.991 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:20.991 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.991 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11868: 2023-12-03T12:39:20.991 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:20.992 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:20.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:20.992 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:20.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:20.992 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:20.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:20.992 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:20.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:20.992 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:20.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:20.992 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:20.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:20.992 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:20.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:20.992 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:20.992 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:20.993 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:20.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:20.993 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:20.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:20.993 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:20.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:20.993 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:20.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:20.993 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:20.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:20.993 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:20.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:20.993 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:20.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:20.993 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:20.993 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:20.993 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:20.994 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.994 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.994 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.994 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:20.994 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.994 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:20.994 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.994 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:20.994 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:20.994 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:20.994 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:20.994 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:20.994 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:20.994 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.994 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:20.994 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:20.995 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:20.995 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:20.995 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:20.995 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:20.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.995 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:20.995 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:20.995 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:20.995 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:20.995 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:20.995 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:20.995 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:20.995 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:20.995 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:20.995 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:20.996 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:20.996 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.996 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:20.996 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:20.996 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:20.996 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:20.996 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:20.996 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.996 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:20.996 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:20.996 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:20.996 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:20.996 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:20.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.996 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:20.997 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:20.997 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.997 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:20.997 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:20.997 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-480" 2023-12-03T12:39:20.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.997 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:20.997 INFO:teuthology.orchestra.run.smithi044.stdout:______________________ test_object_lock_get_obj_retention ______________________ 2023-12-03T12:39:20.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.997 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:20.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.997 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:20.997 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:20.997 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.997 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:20.997 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:20.997 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:20.997 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:20.998 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:20.998 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.998 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:20.998 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:20.998 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.998 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:20.998 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:20.998 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:20.998 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:20.998 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:20.998 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.998 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:20.998 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:20.998 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:20.999 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.999 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:20.999 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:20.999 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.999 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:20.999 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:20.999 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:20.999 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:20.999 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:20.999 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:20.999 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:20.999 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:20.999 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:20.999 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:20.999 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:20.999 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.000 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.000 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.000 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.000 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.000 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.000 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.000 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.000 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.000 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.000 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.000 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.000 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.000 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.000 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.000 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.001 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.001 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.001 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.001 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.001 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.001 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.001 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.001 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.001 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.001 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.001 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.001 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.001 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.001 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.002 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.002 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.002 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.002 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.002 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.002 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.002 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.002 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.002 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.002 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.002 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.003 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.003 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.003 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.003 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.003 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.003 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.003 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.003 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.003 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.003 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.003 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.003 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.003 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.003 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.003 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.004 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.004 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.004 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.004 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.004 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.004 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.004 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.004 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.004 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.004 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.004 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.004 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.004 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.004 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.004 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.004 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.005 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.005 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.005 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.005 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.005 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.005 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.005 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.005 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.005 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.005 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.006 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.006 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.006 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.006 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.006 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.006 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.006 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.006 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.006 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.006 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.006 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.006 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.006 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.006 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.008 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.008 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.008 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.009 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.009 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.009 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_get_obj_retention(): 2023-12-03T12:39:21.009 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.009 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.009 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:21.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.009 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11888: 2023-12-03T12:39:21.009 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.009 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.009 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.009 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.009 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.010 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.010 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.010 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.010 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.010 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.010 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.010 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.010 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.011 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.011 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.011 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.011 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.011 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.011 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.011 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.011 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.011 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.011 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.011 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.011 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.011 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.011 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.011 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.012 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.012 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.012 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.012 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.012 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.012 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.012 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.012 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.012 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.012 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.012 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.012 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.012 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.012 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.012 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.012 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.013 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.013 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.013 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.013 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.013 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.013 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.013 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.013 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.013 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.013 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.013 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.013 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.013 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.013 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.013 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.013 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.013 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.014 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.014 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.014 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.014 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.014 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.014 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.014 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.014 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.014 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.014 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.014 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.014 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.014 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.014 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.014 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.015 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.015 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.015 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.015 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.015 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.015 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-481" 2023-12-03T12:39:21.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.015 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.015 INFO:teuthology.orchestra.run.smithi044.stdout:__________________ test_object_lock_get_obj_retention_iso8601 __________________ 2023-12-03T12:39:21.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.015 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.015 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.015 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.015 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.016 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.016 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.016 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.016 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.016 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.016 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.016 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.016 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.016 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.016 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.016 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.016 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.017 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.017 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.017 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.017 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.017 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.017 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.017 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.017 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.017 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.017 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.017 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.017 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.017 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.017 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.017 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.017 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.017 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.018 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.018 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.018 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.018 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.018 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.018 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.018 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.018 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.018 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.018 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.018 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.018 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.018 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.018 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.018 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.018 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.018 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.019 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.019 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.019 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.019 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.019 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.019 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.019 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.019 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.019 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.019 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.019 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.019 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.019 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.019 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.020 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.020 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.020 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.020 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.020 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.020 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.020 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.020 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.020 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.020 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.020 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.020 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.021 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.021 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.021 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.021 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.021 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.021 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.021 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.021 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.021 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.021 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.021 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.021 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.021 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.022 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.022 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.022 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.022 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.022 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.022 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.022 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.022 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.022 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.022 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.022 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.022 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.022 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.022 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.022 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.022 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.023 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.023 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.023 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.023 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.023 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.023 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.023 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.023 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.023 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.023 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.024 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.024 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.024 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.024 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.024 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.024 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.024 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.024 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.024 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.024 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.024 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.024 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.024 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.024 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.024 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.025 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.025 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.025 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.025 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.025 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.025 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.025 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.025 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.025 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.025 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.025 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.025 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.025 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.025 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.025 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.025 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.026 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.026 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.026 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.026 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.026 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.026 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.026 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.026 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.026 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.026 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.026 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.026 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.026 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.026 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.026 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.027 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.027 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.027 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.027 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.027 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_get_obj_retention_iso8601(): 2023-12-03T12:39:21.027 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.027 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.027 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:21.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.027 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11903: 2023-12-03T12:39:21.028 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.028 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.028 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.028 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.028 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.028 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.028 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.028 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.028 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.028 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.028 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.028 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.028 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.028 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.028 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.028 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.028 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.029 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.029 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.029 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.029 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.029 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.029 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.029 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.029 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.029 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.029 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.029 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.029 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.029 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.029 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.030 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.030 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.030 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.030 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.030 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.030 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.030 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.030 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.030 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.030 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.030 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.030 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.031 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.031 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.031 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.031 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.031 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.031 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.031 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.031 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.031 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.031 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.031 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.031 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.031 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.031 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.032 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.032 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.032 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.032 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.032 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.032 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.032 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.032 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.032 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.032 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.032 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.032 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.032 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.033 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.033 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.033 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.033 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.033 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.033 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.033 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.033 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.033 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.033 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.033 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.033 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.033 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.033 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.033 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.033 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.034 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.034 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-482" 2023-12-03T12:39:21.034 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.034 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.034 INFO:teuthology.orchestra.run.smithi044.stdout:______________ test_object_lock_get_obj_retention_invalid_bucket _______________ 2023-12-03T12:39:21.034 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.034 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.034 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.034 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.034 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.034 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.034 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.034 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.034 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.034 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.035 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.035 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.035 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.035 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.035 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.035 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.035 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.035 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.035 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.035 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.035 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.035 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.035 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.036 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.036 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.036 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.036 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.036 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.036 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.036 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.036 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.036 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.036 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.036 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.036 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.036 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.036 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.036 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.037 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.037 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.037 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.037 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.037 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.037 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.037 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.037 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.037 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.037 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.037 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.037 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.037 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.037 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.037 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.037 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.037 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.038 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.038 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.038 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.038 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.038 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.038 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.038 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.038 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.038 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.038 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.038 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.038 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.038 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.038 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.039 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.039 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.039 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.039 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.039 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.039 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.039 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.039 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.039 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.039 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.039 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.039 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.040 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.040 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.040 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.040 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.040 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.040 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.041 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.041 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.041 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.041 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.041 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.041 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.041 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.041 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.041 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.042 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.042 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.042 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.042 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.042 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.042 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.042 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.042 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.042 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.042 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.042 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.042 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.042 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.042 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.043 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.043 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.043 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.043 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.043 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.043 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.043 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.043 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.043 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.044 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.044 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.044 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.044 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.044 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.044 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.044 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.044 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.044 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.044 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.044 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.044 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.044 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.045 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.045 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.045 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.045 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.045 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.045 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.045 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.045 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.045 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.046 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.046 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.046 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.046 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.046 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.046 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.046 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.046 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.046 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.046 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.046 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.046 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.046 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.046 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.047 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.047 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.047 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.047 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.047 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.047 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.047 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.047 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_get_obj_retention_invalid_bucket(): 2023-12-03T12:39:21.047 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.047 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.047 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name) 2023-12-03T12:39:21.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.047 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11920: 2023-12-03T12:39:21.047 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.048 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.048 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.048 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.048 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.048 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.048 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.048 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.048 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.048 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.049 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.049 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.049 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.049 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.049 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.049 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.049 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.049 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.049 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.049 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.049 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.049 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.049 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.049 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.049 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.049 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.050 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.050 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.050 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.050 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.050 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.050 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.050 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.050 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.050 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.050 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.050 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.050 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.050 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.050 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.051 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.051 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.051 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.051 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.051 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.051 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.051 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.051 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.051 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.051 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.051 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.051 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.051 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.051 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.051 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.051 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.052 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.052 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.052 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.052 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.052 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.052 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.052 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.052 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.052 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.052 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.052 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.052 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.052 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.052 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.052 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.052 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.053 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.053 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.053 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.053 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.053 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.053 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.053 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.053 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-483" 2023-12-03T12:39:21.053 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.053 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.053 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ test_object_lock_put_obj_retention_versionid _________________ 2023-12-03T12:39:21.053 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.053 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.053 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.054 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.054 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.054 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.054 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.054 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.054 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.054 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.054 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.054 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.054 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.054 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.054 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.054 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.054 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.054 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.055 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.055 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.055 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.055 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.055 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.055 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.055 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.055 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.055 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.055 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.055 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.055 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.055 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.055 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.056 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.056 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.056 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.056 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.056 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.056 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.056 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.056 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.056 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.056 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.056 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.056 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.056 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.056 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.057 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.057 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.057 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.057 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.057 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.057 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.057 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.057 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.057 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.057 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.057 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.057 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.057 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.057 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.057 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.058 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.058 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.058 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.058 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.058 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.058 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.058 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.058 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.058 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.058 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.058 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.058 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.059 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.059 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.059 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.059 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.059 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.059 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.059 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.059 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.059 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.059 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.059 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.059 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.060 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.060 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.060 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.060 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.060 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.060 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.060 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.060 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.060 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.060 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.060 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.060 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.060 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.060 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.060 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.060 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.061 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.061 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.061 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.061 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.061 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.061 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.061 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.061 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.061 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.061 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.061 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.061 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.061 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.061 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.062 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.062 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.062 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.062 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.062 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.062 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.062 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.062 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.062 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.062 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.062 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.062 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.062 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.062 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.062 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.062 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.063 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.063 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.063 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.063 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.063 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.063 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.063 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.063 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.063 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.063 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.063 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.063 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.063 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.063 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.063 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.063 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.064 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.064 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.064 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.064 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.064 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.064 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.064 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.064 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.064 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.064 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.064 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.064 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.064 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.064 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.064 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.064 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.065 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.065 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.065 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.065 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.065 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.065 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.065 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.065 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.065 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.065 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.065 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.065 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.065 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.065 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.065 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.065 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_put_obj_retention_versionid(): 2023-12-03T12:39:21.065 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.066 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.066 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:21.066 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.066 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11933: 2023-12-03T12:39:21.066 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.066 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.066 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.066 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.066 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.066 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.066 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.066 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.066 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.066 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.066 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.066 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.067 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.067 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.067 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.067 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.067 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.067 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.067 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.067 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.067 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.067 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.067 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.067 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.067 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.068 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.068 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.068 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.068 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.068 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.068 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.068 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.068 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.068 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.068 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.068 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.068 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.068 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.069 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.069 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.069 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.069 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.069 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.069 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.069 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.069 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.069 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.069 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.069 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.069 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.069 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.069 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.069 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.069 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.070 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.070 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.070 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.070 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.070 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.070 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.070 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.070 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.070 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.070 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.070 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.070 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.070 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.070 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.070 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.071 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.071 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.071 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.071 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.071 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.071 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.071 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.071 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.071 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.071 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.071 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.071 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.071 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.071 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.071 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.071 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-484" 2023-12-03T12:39:21.072 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.072 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.072 INFO:teuthology.orchestra.run.smithi044.stdout:________ test_object_lock_put_obj_retention_override_default_retention _________ 2023-12-03T12:39:21.072 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.072 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.072 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.072 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.072 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.072 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.072 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.072 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.072 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.072 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.072 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.072 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.072 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.072 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.073 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.073 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.073 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.073 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.073 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.073 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.073 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.073 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.073 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.073 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.073 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.073 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.073 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.073 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.073 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.073 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.073 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.074 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.074 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.074 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.074 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.074 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.074 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.074 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.074 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.074 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.074 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.074 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.074 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.074 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.074 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.074 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.074 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.075 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.075 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.075 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.075 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.075 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.075 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.075 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.075 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.075 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.075 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.075 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.075 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.075 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.075 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.075 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.075 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.075 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.076 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.076 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.076 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.076 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.076 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.076 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.076 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.076 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.076 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.076 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.076 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.076 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.076 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.077 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.077 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.077 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.077 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.077 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.077 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.077 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.077 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.077 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.077 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.077 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.077 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.077 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.077 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.077 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.077 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.078 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.078 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.078 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.078 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.078 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.078 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.078 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.078 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.078 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.078 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.078 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.078 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.078 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.078 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.079 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.079 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.079 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.079 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.079 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.079 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.079 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.079 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.079 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.079 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.079 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.079 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.079 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.079 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.079 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.079 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.080 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.080 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.080 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.080 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.080 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.080 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.080 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.080 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.080 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.080 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.080 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.080 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.080 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.080 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.080 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.080 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.080 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.081 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.081 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.081 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.081 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.081 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.081 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.081 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.081 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.081 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.081 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.081 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.082 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.082 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.082 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.082 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.082 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.082 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.082 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.082 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.082 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.082 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.082 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.082 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.083 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.083 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.083 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.083 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.083 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.083 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.083 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.083 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.083 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_put_obj_retention_override_default_retention(): 2023-12-03T12:39:21.083 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.083 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.083 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:21.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.084 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11949: 2023-12-03T12:39:21.084 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.084 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.084 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.084 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.084 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.084 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.084 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.084 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.084 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.084 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.084 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.084 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.084 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.084 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.084 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.085 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.085 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.085 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.085 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.085 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.085 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.085 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.085 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.085 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.085 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.085 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.085 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.085 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.085 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.085 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.085 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.085 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.086 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.086 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.086 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.086 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.086 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.086 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.086 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.086 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.086 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.086 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.086 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.086 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.086 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.086 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.086 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.086 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.087 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.087 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.087 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.087 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.087 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.087 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.087 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.087 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.087 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.087 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.087 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.087 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.087 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.087 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.088 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.088 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.088 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.088 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.088 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.088 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.088 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.088 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.088 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.088 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.088 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.088 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.088 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.088 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.089 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.089 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.089 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.089 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.089 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.089 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.089 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.089 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-485" 2023-12-03T12:39:21.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.089 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.089 INFO:teuthology.orchestra.run.smithi044.stdout:______________ test_object_lock_put_obj_retention_increase_period ______________ 2023-12-03T12:39:21.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.090 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.090 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.090 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.090 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.090 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.090 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.090 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.090 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.090 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.090 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.090 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.090 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.091 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.091 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.091 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.091 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.091 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.091 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.091 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.091 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.091 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.091 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.091 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.091 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.091 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.091 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.092 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.092 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.092 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.092 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.092 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.092 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.092 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.092 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.092 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.092 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.092 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.092 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.092 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.092 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.092 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.093 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.093 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.093 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.093 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.093 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.093 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.093 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.093 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.093 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.093 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.093 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.093 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.093 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.093 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.093 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.093 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.093 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.094 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.094 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.094 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.094 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.094 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.094 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.094 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.094 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.094 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.094 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.094 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.094 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.095 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.095 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.095 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.095 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.095 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.095 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.095 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.095 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.095 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.095 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.095 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.095 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.095 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.095 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.095 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.095 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.096 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.096 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.096 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.096 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.096 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.096 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.096 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.096 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.096 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.096 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.096 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.096 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.096 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.096 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.097 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.097 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.097 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.097 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.097 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.097 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.097 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.097 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.097 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.097 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.097 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.097 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.097 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.097 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.097 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.097 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.098 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.098 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.098 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.098 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.098 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.098 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.098 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.098 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.098 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.098 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.098 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.098 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.098 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.098 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.098 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.098 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.099 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.099 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.099 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.099 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.099 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.099 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.099 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.099 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.099 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.099 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.099 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.099 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.100 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.100 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.100 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.100 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.100 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.100 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.100 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.100 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.100 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.100 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.100 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.100 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.100 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.100 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.100 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.100 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.101 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.101 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.101 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.101 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.101 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.101 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.101 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.101 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.101 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_put_obj_retention_increase_period(): 2023-12-03T12:39:21.101 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.102 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.102 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:21.102 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.102 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11974: 2023-12-03T12:39:21.102 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.102 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.102 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.102 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.102 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.102 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.102 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.102 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.102 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.102 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.102 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.102 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.103 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.103 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.103 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.103 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.103 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.103 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.103 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.103 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.103 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.103 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.103 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.103 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.103 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.103 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.103 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.104 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.104 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.104 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.104 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.104 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.104 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.104 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.104 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.104 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.104 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.104 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.104 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.104 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.104 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.104 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.104 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.104 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.105 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.105 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.105 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.105 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.105 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.105 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.105 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.105 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.105 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.105 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.105 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.105 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.105 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.105 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.105 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.105 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.106 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.106 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.106 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.106 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.106 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.106 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.106 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.106 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.106 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.106 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.106 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.106 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.106 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.106 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.107 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.107 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.107 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.107 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.107 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.107 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.107 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.107 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.107 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.107 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.107 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.107 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-486" 2023-12-03T12:39:21.107 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.107 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.107 INFO:teuthology.orchestra.run.smithi044.stdout:______________ test_object_lock_put_obj_retention_shorten_period _______________ 2023-12-03T12:39:21.107 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.107 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.108 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.108 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.108 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.108 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.108 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.108 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.108 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.108 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.108 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.108 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.108 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.108 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.108 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.109 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.109 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.109 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.109 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.109 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.109 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.109 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.109 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.109 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.109 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.109 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.109 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.109 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.109 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.109 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.110 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.110 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.110 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.110 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.110 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.110 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.110 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.110 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.110 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.110 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.110 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.110 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.110 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.110 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.110 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.111 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.111 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.111 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.111 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.111 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.111 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.111 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.111 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.111 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.111 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.111 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.111 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.111 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.111 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.111 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.112 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.112 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.112 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.112 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.112 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.112 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.112 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.112 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.112 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.112 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.112 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.112 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.112 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.112 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.112 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.112 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.112 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.113 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.113 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.113 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.113 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.113 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.113 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.113 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.113 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.113 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.113 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.113 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.113 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.113 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.113 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.113 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.114 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.114 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.114 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.114 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.114 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.114 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.114 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.114 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.114 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.114 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.114 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.114 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.114 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.114 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.114 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.114 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.115 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.115 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.115 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.115 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.115 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.115 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.115 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.115 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.115 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.115 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.115 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.116 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.116 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.116 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.116 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.116 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.116 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.116 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.116 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.116 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.116 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.116 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.116 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.116 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.117 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.117 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.117 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.117 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.117 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.117 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.117 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.117 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.117 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.117 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.117 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.117 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.117 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.117 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.117 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.117 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.117 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.118 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.118 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.118 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.118 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.118 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.118 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.118 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.118 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.118 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.118 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.118 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.118 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.118 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.118 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.118 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.118 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.118 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.119 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.119 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.119 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.119 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.119 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.119 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_put_obj_retention_shorten_period(): 2023-12-03T12:39:21.119 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.119 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.119 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:21.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.119 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:11991: 2023-12-03T12:39:21.119 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.119 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.120 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.120 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.120 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.120 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.120 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.120 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.120 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.120 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.120 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.120 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.120 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.120 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.120 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.120 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.120 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.120 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.120 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.121 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.121 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.121 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.121 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.121 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.121 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.121 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.121 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.121 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.121 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.121 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.121 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.121 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.121 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.121 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.122 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.122 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.122 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.122 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.122 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.122 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.122 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.122 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.122 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.122 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.122 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.122 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.122 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.122 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.122 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.123 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.123 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.123 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.123 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.123 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.123 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.123 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.123 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.123 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.123 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.123 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.123 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.123 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.123 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.123 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.124 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.124 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.124 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.124 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.124 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.124 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.124 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.124 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.124 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.124 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.124 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.124 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.124 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.124 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.124 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.125 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.125 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.125 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.125 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.125 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.125 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.125 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.125 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.125 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-487" 2023-12-03T12:39:21.125 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.125 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.125 INFO:teuthology.orchestra.run.smithi044.stdout:___________ test_object_lock_put_obj_retention_shorten_period_bypass ___________ 2023-12-03T12:39:21.125 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.125 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.125 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.126 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.126 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.126 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.126 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.126 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.126 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.126 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.126 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.126 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.126 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.126 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.126 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.126 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.126 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.126 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.127 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.127 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.127 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.127 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.127 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.127 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.127 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.127 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.127 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.127 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.127 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.128 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.128 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.128 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.128 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.128 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.128 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.128 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.128 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.128 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.128 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.128 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.128 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.128 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.128 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.129 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.129 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.129 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.129 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.129 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.129 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.129 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.129 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.129 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.129 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.129 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.129 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.129 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.129 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.130 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.130 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.130 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.130 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.130 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.130 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.130 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.130 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.130 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.130 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.130 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.130 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.131 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.131 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.131 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.131 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.131 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.131 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.131 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.131 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.131 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.131 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.131 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.131 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.131 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.131 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.132 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.132 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.132 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.132 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.132 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.132 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.132 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.132 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.132 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.132 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.132 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.132 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.132 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.132 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.132 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.132 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.133 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.133 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.133 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.133 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.133 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.133 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.133 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.133 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.133 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.133 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.133 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.133 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.133 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.133 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.133 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.134 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.134 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.134 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.134 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.134 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.134 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.134 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.134 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.134 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.134 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.134 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.134 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.134 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.134 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.134 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.135 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.135 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.135 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.135 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.135 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.135 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.135 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.135 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.135 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.135 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.135 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.135 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.135 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.135 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.135 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.135 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.136 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.136 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.136 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.136 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.136 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.136 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.136 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.136 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.136 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.136 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.136 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.136 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.136 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.136 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.136 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.137 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.137 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.137 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.137 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.137 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.137 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.137 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.137 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.137 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.137 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.137 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.137 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.137 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.138 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.138 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.138 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_put_obj_retention_shorten_period_bypass(): 2023-12-03T12:39:21.138 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.138 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.138 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:21.138 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.138 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12009: 2023-12-03T12:39:21.138 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.138 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.138 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.138 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.138 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.138 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.139 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.139 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.139 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.139 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.139 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.139 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.139 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.139 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.139 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.139 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.139 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.139 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.139 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.139 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.139 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.139 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.140 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.140 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.140 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.140 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.140 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.140 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.140 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.140 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.140 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.140 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.140 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.140 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.140 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.140 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.140 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.140 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.140 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.141 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.141 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.141 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.141 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.141 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.141 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.141 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.141 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.141 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.141 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.141 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.141 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.141 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.142 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.142 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.142 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.142 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.142 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.142 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.142 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.142 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.142 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.142 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.142 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.142 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.142 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.142 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.142 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.143 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.143 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.143 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.143 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.143 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.143 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.143 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.143 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.143 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.143 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.143 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.143 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.143 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.143 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.143 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.143 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.144 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.144 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.144 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.144 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-488" 2023-12-03T12:39:21.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.144 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.144 INFO:teuthology.orchestra.run.smithi044.stdout:________________ test_object_lock_delete_object_with_retention _________________ 2023-12-03T12:39:21.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.144 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.144 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.144 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.144 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.145 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.145 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.145 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.145 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.145 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.145 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.145 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.145 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.145 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.145 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.145 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.146 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.146 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.146 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.146 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.146 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.146 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.146 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.146 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.146 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.146 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.146 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.146 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.146 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.146 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.146 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.147 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.147 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.147 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.147 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.147 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.147 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.147 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.147 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.147 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.147 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.147 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.147 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.147 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.147 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.147 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.147 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.147 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.148 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.148 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.148 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.148 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.148 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.148 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.148 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.148 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.148 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.148 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.148 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.148 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.148 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.148 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.148 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.148 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.149 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.149 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.149 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.149 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.149 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.149 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.149 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.149 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.149 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.149 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.149 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.149 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.150 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.150 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.150 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.150 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.150 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.150 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.150 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.150 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.150 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.150 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.150 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.150 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.150 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.151 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.151 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.151 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.151 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.151 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.151 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.151 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.151 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.151 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.151 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.151 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.151 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.151 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.151 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.151 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.151 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.152 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.152 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.152 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.152 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.152 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.152 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.152 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.152 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.152 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.152 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.153 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.153 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.153 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.153 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.153 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.153 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.153 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.153 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.153 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.153 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.153 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.153 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.154 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.154 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.154 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.154 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.154 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.154 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.154 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.154 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.154 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.154 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.154 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.154 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.154 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.154 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.155 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.155 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.155 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.155 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.155 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.155 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.155 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.155 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.155 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.155 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.155 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.155 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.155 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.155 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.155 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.155 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.156 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.156 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.156 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.156 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.156 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.156 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.156 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.156 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.156 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.156 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_delete_object_with_retention(): 2023-12-03T12:39:21.156 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.156 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.157 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:21.157 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.157 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12026: 2023-12-03T12:39:21.157 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.157 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.157 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.157 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.157 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.157 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.157 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.157 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.157 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.157 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.157 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.157 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.158 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.158 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.158 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.158 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.158 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.158 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.158 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.158 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.158 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.158 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.158 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.158 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.158 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.158 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.158 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.158 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.159 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.159 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.159 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.159 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.159 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.159 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.159 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.159 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.159 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.159 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.159 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.159 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.159 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.159 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.159 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.160 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.160 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.160 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.160 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.160 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.160 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.160 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.160 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.160 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.160 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.160 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.160 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.160 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.160 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.160 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.161 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.161 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.161 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.161 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.161 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.161 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.161 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.161 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.161 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.161 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.161 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.161 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.161 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.161 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.161 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.161 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.161 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.162 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.162 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.162 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.162 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.162 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.162 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.162 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.162 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.162 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.162 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.162 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-489" 2023-12-03T12:39:21.162 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.162 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.162 INFO:teuthology.orchestra.run.smithi044.stdout:___________ test_object_lock_delete_object_with_retention_and_marker ___________ 2023-12-03T12:39:21.162 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.162 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.163 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.163 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.163 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.163 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.163 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.163 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.163 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.163 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.163 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.163 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.163 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.163 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.164 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.164 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.164 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.164 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.164 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.164 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.164 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.164 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.164 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.164 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.164 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.164 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.164 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.164 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.164 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.164 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.164 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.165 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.165 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.165 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.165 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.165 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.165 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.165 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.165 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.165 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.165 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.165 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.165 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.165 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.166 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.166 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.166 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.166 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.166 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.166 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.166 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.166 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.166 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.166 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.166 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.166 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.166 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.166 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.166 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.166 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.167 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.167 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.167 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.167 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.167 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.167 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.167 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.167 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.167 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.167 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.167 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.167 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.167 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.167 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.167 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.167 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.168 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.168 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.168 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.168 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.168 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.168 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.168 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.168 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.168 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.168 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.168 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.168 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.168 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.168 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.169 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.169 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.169 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.169 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.169 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.169 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.169 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.169 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.169 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.169 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.169 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.169 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.169 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.169 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.170 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.170 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.170 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.170 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.170 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.170 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.170 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.170 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.170 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.170 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.170 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.170 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.170 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.170 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.171 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.171 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.171 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.171 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.171 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.171 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.171 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.171 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.171 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.171 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.171 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.171 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.171 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.171 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.171 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.172 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.172 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.172 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.172 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.172 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.172 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.172 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.172 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.172 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.172 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.172 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.172 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.172 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.172 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.172 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.172 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.172 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.173 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.173 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.173 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.173 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.173 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.173 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.173 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.173 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.173 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.173 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.173 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.173 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.173 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.173 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.173 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.173 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.173 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.174 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.174 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.174 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.174 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.174 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.174 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.174 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.174 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.174 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.174 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.174 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_delete_object_with_retention_and_marker(): 2023-12-03T12:39:21.174 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.174 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.174 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:21.174 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.174 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12044: 2023-12-03T12:39:21.175 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.175 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.175 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.175 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.175 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.175 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.175 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.175 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.175 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.175 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.176 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.176 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.176 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.176 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.176 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.176 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.176 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.176 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.176 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.177 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.177 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.177 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.177 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.177 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.177 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.177 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.177 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.177 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.177 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.177 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.177 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.177 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.177 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.177 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.178 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.178 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.178 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.178 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.178 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.178 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.178 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.178 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.178 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.178 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.178 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.178 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.178 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.178 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.179 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.179 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.179 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.179 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.179 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.179 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.179 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.179 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.179 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.179 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.179 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.179 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.179 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.179 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.179 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.180 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.180 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.180 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.180 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.180 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.180 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-490" 2023-12-03T12:39:21.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.180 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.180 INFO:teuthology.orchestra.run.smithi044.stdout:_____________ test_object_lock_multi_delete_object_with_retention ______________ 2023-12-03T12:39:21.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.180 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.180 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.180 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.181 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.181 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.181 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.181 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.181 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.181 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.181 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.181 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.181 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.181 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.181 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.181 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.181 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.181 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.181 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.182 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.182 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.182 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.182 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.182 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.182 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.182 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.182 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.182 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.182 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.182 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.182 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.182 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.182 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.182 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.182 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.183 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.183 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.183 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.183 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.183 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.183 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.183 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.183 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.183 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.183 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.183 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.183 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.183 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.183 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.183 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.183 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.184 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.184 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.184 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.184 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.184 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.184 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.184 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.184 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.184 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.184 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.184 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.184 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.184 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.184 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.184 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.185 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.185 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.185 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.185 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.185 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.185 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.185 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.185 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.185 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.185 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.185 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.185 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.186 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.186 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.186 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.186 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.186 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.186 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.186 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.186 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.186 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.186 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.186 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.186 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.186 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.186 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.186 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.186 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.187 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.187 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.187 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.187 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.187 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.187 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.187 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.187 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.187 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.187 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.187 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.187 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.187 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.187 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.187 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.187 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.188 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.188 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.188 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.188 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.188 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.188 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.188 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.188 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.189 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.189 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.189 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.189 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.189 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.189 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.189 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.189 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.189 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.189 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.189 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.189 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.189 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.189 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.189 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.189 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.190 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.190 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.190 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.190 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.190 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.190 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.190 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.190 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.190 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.191 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.191 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.191 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.191 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.191 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.191 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.191 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.191 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.191 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.191 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.191 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.191 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.191 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.192 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.192 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.192 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.192 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.192 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.192 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.192 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.192 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.192 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.192 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.192 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.192 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_multi_delete_object_with_retention(): 2023-12-03T12:39:21.192 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.192 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.192 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:21.192 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.192 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12069: 2023-12-03T12:39:21.193 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.193 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.193 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.193 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.193 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.193 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.193 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.193 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.193 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.194 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.194 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.194 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.194 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.194 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.194 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.194 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.194 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.194 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.195 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.195 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.195 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.195 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.195 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.195 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.195 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.195 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.195 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.195 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.195 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.195 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.195 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.195 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.195 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.195 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.196 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.196 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.196 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.196 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.196 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.196 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.196 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.196 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.196 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.196 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.196 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.196 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.196 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.196 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.196 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.196 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.197 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.197 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.197 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.197 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.197 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.197 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.197 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.197 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.197 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.197 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.197 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.197 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.197 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.197 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.197 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.197 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.197 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.198 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.198 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.198 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.198 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.198 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.198 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-491" 2023-12-03T12:39:21.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.198 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.198 INFO:teuthology.orchestra.run.smithi044.stdout:_______________________ test_object_lock_put_legal_hold ________________________ 2023-12-03T12:39:21.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.198 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.198 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.198 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.199 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.199 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.199 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.199 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.199 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.199 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.199 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.199 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.199 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.199 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.199 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.199 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.199 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.200 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.200 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.200 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.200 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.200 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.200 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.200 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.200 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.200 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.200 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.200 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.200 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.200 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.201 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.201 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.201 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.201 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.201 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.201 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.201 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.201 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.201 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.201 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.201 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.201 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.201 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.201 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.201 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.202 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.202 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.202 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.202 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.202 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.202 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.202 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.202 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.202 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.202 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.202 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.202 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.202 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.202 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.202 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.203 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.203 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.203 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.203 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.203 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.203 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.203 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.203 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.203 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.203 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.203 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.203 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.204 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.204 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.204 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.204 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.204 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.204 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.204 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.204 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.204 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.204 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.204 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.204 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.204 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.204 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.204 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.204 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.205 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.205 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.205 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.205 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.205 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.205 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.205 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.205 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.205 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.205 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.205 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.205 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.205 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.205 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.205 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.206 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.206 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.206 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.206 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.206 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.206 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.206 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.206 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.206 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.206 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.206 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.206 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.206 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.206 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.206 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.206 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.206 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.207 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.207 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.207 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.207 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.207 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.207 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.207 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.207 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.207 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.207 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.207 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.207 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.207 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.207 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.207 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.207 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.208 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.208 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.208 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.208 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.208 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.208 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.208 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.208 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.208 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.208 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.208 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.208 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.208 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.208 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.208 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.209 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.209 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.209 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.209 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.209 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.209 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.209 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.209 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.209 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.209 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.209 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.209 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.209 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.210 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.210 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.210 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.210 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_put_legal_hold(): 2023-12-03T12:39:21.210 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.210 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.210 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:21.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.210 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12136: 2023-12-03T12:39:21.210 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.210 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.210 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.210 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.211 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.211 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.211 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.211 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.211 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.211 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.211 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.211 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.211 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.211 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.211 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.211 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.211 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.211 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.211 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.211 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.212 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.212 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.212 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.212 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.212 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.212 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.212 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.212 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.212 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.212 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.212 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.212 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.212 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.212 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.212 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.212 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.213 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.213 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.213 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.213 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.213 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.213 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.213 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.213 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.213 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.213 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.213 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.213 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.213 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.213 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.213 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.213 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.213 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.214 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.214 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.214 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.214 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.214 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.214 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.214 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.214 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.214 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.214 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.214 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.214 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.214 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.214 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.214 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.215 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.215 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.215 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.215 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.215 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.215 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.215 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.215 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.215 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.215 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.215 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.215 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.215 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.215 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.215 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.215 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.216 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.216 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.216 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.216 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-492" 2023-12-03T12:39:21.216 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.216 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.216 INFO:teuthology.orchestra.run.smithi044.stdout:________________ test_object_lock_put_legal_hold_invalid_bucket ________________ 2023-12-03T12:39:21.216 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.216 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.216 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.216 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.216 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.216 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.216 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.216 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.216 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.217 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.217 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.217 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.217 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.217 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.217 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.217 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.217 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.217 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.217 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.217 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.217 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.217 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.217 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.217 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.217 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.217 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.217 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.218 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.218 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.218 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.218 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.218 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.218 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.218 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.218 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.218 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.218 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.218 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.218 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.218 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.218 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.218 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.219 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.219 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.219 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.219 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.219 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.219 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.219 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.219 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.219 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.219 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.219 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.219 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.219 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.220 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.220 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.220 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.220 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.220 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.220 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.220 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.220 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.220 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.220 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.220 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.220 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.220 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.220 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.220 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.220 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.221 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.221 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.221 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.221 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.221 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.221 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.221 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.221 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.221 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.221 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.221 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.221 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.221 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.221 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.221 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.221 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.222 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.223 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.223 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.223 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.223 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.223 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.223 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.223 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.223 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.223 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.223 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.223 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.223 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.223 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.223 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.223 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.224 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.224 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.224 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.224 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.224 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.224 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.224 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.224 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.224 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.224 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.224 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.224 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.224 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.224 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.224 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.224 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.224 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.225 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.225 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.225 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.225 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.225 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.225 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.225 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.225 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.225 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.225 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.225 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.225 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.225 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.225 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.225 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.226 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.226 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.226 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.226 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.226 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.226 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.226 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.226 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.226 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.226 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.226 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.226 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.226 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.226 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.227 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.227 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.227 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.227 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.227 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.227 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.227 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.227 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.227 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.227 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.227 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.227 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.227 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.227 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.227 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.228 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.228 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.228 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.228 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_put_legal_hold_invalid_bucket(): 2023-12-03T12:39:21.228 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.228 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.228 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name) 2023-12-03T12:39:21.228 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.228 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12149: 2023-12-03T12:39:21.228 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.228 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.228 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.228 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.228 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.228 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.228 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.228 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.229 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.229 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.229 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.229 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.229 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.229 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.229 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.229 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.229 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.229 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.229 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.229 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.229 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.229 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.229 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.229 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.230 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.230 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.230 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.230 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.230 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.230 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.230 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.230 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.230 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.230 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.230 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.230 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.230 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.230 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.231 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.231 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.231 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.231 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.231 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.231 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.231 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.231 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.231 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.231 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.231 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.231 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.232 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.232 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.232 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.232 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.232 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.232 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.232 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.232 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.232 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.232 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.232 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.232 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.232 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.232 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.232 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.232 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.232 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.233 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.233 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.233 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.233 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.233 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.233 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.233 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.233 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.233 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.233 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.233 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.233 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.233 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.233 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.233 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.234 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.234 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.234 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.234 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-493" 2023-12-03T12:39:21.234 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.234 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.234 INFO:teuthology.orchestra.run.smithi044.stdout:________________ test_object_lock_put_legal_hold_invalid_status ________________ 2023-12-03T12:39:21.234 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.234 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.234 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.234 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.234 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.234 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.234 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.234 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.235 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.235 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.235 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.235 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.235 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.235 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.235 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.235 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.235 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.235 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.235 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.235 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.235 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.235 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.235 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.235 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.235 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.236 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.236 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.236 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.236 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.236 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.236 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.236 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.236 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.236 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.236 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.236 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.236 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.236 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.236 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.236 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.236 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.236 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.237 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.237 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.237 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.237 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.237 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.237 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.237 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.237 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.237 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.237 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.237 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.237 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.237 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.237 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.237 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.237 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.238 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.238 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.238 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.238 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.238 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.238 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.238 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.238 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.238 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.238 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.238 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.238 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.238 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.238 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.238 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.238 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.239 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.239 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.239 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.239 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.239 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.239 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.239 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.239 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.239 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.239 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.239 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.239 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.239 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.239 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.239 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.240 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.240 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.240 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.240 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.240 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.240 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.240 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.240 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.240 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.240 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.240 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.240 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.240 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.240 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.240 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.240 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.240 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.241 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.241 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.241 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.241 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.241 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.241 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.241 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.241 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.241 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.241 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.241 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.241 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.241 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.241 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.242 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.242 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.242 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.242 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.242 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.242 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.242 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.242 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.242 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.242 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.242 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.242 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.242 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.243 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.243 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.243 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.243 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.243 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.245 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.245 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.245 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.245 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.245 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.245 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.245 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.245 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.245 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.246 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.246 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.246 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.246 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.246 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.246 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.246 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.246 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.246 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.246 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.246 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.246 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.246 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.246 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.246 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.247 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.247 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.247 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.247 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.247 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.247 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.247 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.247 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.247 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.247 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.247 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.247 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.247 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.247 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.247 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.247 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.247 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.248 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.248 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.248 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.248 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.248 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.248 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_put_legal_hold_invalid_status(): 2023-12-03T12:39:21.248 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.248 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.248 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:21.248 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.248 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12163: 2023-12-03T12:39:21.248 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.248 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.248 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.248 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.248 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.248 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.249 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.249 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.249 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.249 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.249 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.249 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.249 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.249 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.249 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.249 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.249 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.249 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.249 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.249 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.249 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.249 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.250 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.250 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.250 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.250 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.250 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.250 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.250 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.250 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.250 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.250 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.250 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.250 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.250 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.250 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.251 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.251 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.251 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.251 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.251 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.251 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.251 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.251 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.251 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.251 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.251 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.251 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.251 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.251 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.252 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.252 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.252 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.252 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.252 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.252 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.252 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.252 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.252 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.252 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.252 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.252 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.252 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.252 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.252 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.252 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.253 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.253 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.253 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.253 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.253 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.253 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.253 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.253 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.253 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.253 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.253 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.253 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.253 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.253 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.253 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.253 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.254 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.254 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.254 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.254 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.254 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.254 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-494" 2023-12-03T12:39:21.254 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.254 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.254 INFO:teuthology.orchestra.run.smithi044.stdout:_______________________ test_object_lock_get_legal_hold ________________________ 2023-12-03T12:39:21.254 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.254 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.254 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.255 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.255 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.255 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.255 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.255 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.255 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.255 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.255 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.255 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.255 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.256 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.256 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.256 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.256 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.256 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.256 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.256 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.256 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.256 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.256 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.256 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.256 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.256 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.256 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.256 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.256 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.257 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.257 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.257 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.257 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.257 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.257 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.257 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.257 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.257 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.257 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.257 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.257 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.257 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.257 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.258 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.258 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.258 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.258 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.258 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.258 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.258 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.258 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.258 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.258 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.259 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.259 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.259 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.259 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.259 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.259 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.259 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.260 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.260 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.260 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.260 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.260 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.260 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.260 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.261 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.261 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.261 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.261 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.261 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.261 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.261 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.262 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.262 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.262 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.262 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.262 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.262 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.263 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.263 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.263 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.263 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.263 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.264 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.264 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.264 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.264 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.264 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.264 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.264 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.264 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.264 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.265 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.265 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.265 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.265 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.265 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.265 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.265 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.265 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.265 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.265 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.265 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.265 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.265 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.265 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.266 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.266 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.266 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.266 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.266 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.266 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.266 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.266 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.266 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.266 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.266 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.267 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.267 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.267 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.267 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.267 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.267 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.267 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.267 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.268 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.268 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.268 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.268 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.268 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.268 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.269 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.269 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.269 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.269 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.269 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.269 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.270 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.270 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.270 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.270 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.270 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.270 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.270 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.270 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.270 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.270 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.270 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.271 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.271 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.271 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.271 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.271 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.271 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.271 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.271 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.271 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.271 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.271 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.271 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.271 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.271 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.272 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.272 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.272 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.272 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.272 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_get_legal_hold(): 2023-12-03T12:39:21.272 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.272 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.272 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:21.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.272 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12177: 2023-12-03T12:39:21.272 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.272 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.273 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.273 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.273 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.273 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.273 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.273 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.273 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.273 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.273 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.273 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.273 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.273 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.273 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.273 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.274 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.274 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.274 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.274 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.274 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.274 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.274 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.274 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.274 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.274 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.274 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.274 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.274 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.274 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.275 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.275 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.275 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.275 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.275 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.275 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.275 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.275 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.275 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.275 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.275 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.275 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.275 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.275 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.276 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.276 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.276 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.276 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.276 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.276 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.276 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.276 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.276 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.276 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.276 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.276 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.276 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.277 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.277 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.277 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.277 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.277 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.277 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.277 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.277 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.277 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.277 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.277 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.277 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.277 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.277 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.277 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.277 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.278 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.278 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.278 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.278 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.278 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.278 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.278 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.278 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.278 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.278 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.278 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.278 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-495" 2023-12-03T12:39:21.278 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.279 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.279 INFO:teuthology.orchestra.run.smithi044.stdout:________________ test_object_lock_get_legal_hold_invalid_bucket ________________ 2023-12-03T12:39:21.279 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.279 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.279 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.279 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.279 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.279 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.279 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.279 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.279 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.280 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.280 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.280 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.280 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.280 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.280 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.280 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.280 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.280 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.280 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.280 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.281 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.281 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.281 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.281 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.281 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.281 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.281 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.282 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.282 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.282 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.282 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.282 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.282 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.282 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.282 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.282 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.282 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.282 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.282 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.282 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.282 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.283 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.283 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.283 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.283 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.283 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.283 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.283 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.283 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.283 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.283 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.283 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.283 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.283 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.283 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.284 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.284 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.284 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.284 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.284 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.284 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.284 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.284 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.284 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.284 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.284 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.284 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.284 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.284 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.284 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.285 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.285 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.285 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.285 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.285 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.285 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.285 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.285 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.285 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.285 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.285 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.285 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.285 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.286 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.286 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.286 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.286 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.286 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.286 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.286 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.286 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.286 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.286 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.286 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.286 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.287 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.287 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.287 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.287 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.287 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.287 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.287 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.287 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.287 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.287 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.287 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.287 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.287 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.287 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.287 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.288 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.288 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.288 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.288 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.288 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.288 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.288 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.288 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.288 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.288 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.288 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.288 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.289 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.289 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.289 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.289 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.289 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.289 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.289 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.289 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.289 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.289 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.289 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.289 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.289 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.289 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.289 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.290 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.290 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.290 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.290 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.290 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.290 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.290 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.290 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.290 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.290 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.290 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.290 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.290 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.291 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.291 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.291 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.291 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.291 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.291 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.291 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.291 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.291 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.291 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.291 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.292 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.292 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.292 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.292 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.292 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.292 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.292 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.292 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.292 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.292 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.292 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.292 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.292 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.292 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.293 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.293 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.293 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.293 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.293 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_get_legal_hold_invalid_bucket(): 2023-12-03T12:39:21.293 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.293 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.293 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name) 2023-12-03T12:39:21.293 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.293 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12193: 2023-12-03T12:39:21.293 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.293 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.293 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.293 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.293 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.293 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.294 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.294 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.294 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.294 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.294 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.294 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.294 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.294 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.294 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.294 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.294 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.294 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.294 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.294 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.295 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.295 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.295 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.295 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.295 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.295 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.295 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.295 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.295 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.295 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.295 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.295 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.295 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.295 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.295 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.296 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.296 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.296 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.299 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.299 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-496" 2023-12-03T12:39:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.299 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.299 INFO:teuthology.orchestra.run.smithi044.stdout:______________ test_object_lock_delete_object_with_legal_hold_on _______________ 2023-12-03T12:39:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.299 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.300 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.301 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.301 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.301 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.301 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.301 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.301 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.301 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.301 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.301 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.301 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.305 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.305 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.305 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.305 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.305 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.305 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.306 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.307 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.307 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.307 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.307 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.308 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.308 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.308 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.308 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.308 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.308 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.308 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.308 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.308 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.308 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.308 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.308 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.308 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.308 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.308 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.308 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.308 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.309 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.309 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.309 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.309 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.309 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.311 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.311 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.311 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.311 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.312 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.312 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_delete_object_with_legal_hold_on(): 2023-12-03T12:39:21.312 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.312 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.312 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:21.312 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.312 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12206: 2023-12-03T12:39:21.312 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.312 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.312 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.312 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.312 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.312 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.312 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.312 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.313 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.314 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.314 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.314 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.314 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.314 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.314 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.314 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.314 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.314 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.314 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.314 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.314 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.314 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.314 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.317 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.318 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-497" 2023-12-03T12:39:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.318 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.318 INFO:teuthology.orchestra.run.smithi044.stdout:______________ test_object_lock_delete_object_with_legal_hold_off ______________ 2023-12-03T12:39:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.318 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.319 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.319 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.319 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.319 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.319 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.319 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.320 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.323 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.323 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.323 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.323 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.323 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.323 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.325 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.326 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.326 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.326 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.326 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.326 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.326 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.326 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.326 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.326 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.327 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.327 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.327 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.327 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.327 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.327 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.327 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.328 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.328 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.329 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.329 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.330 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.330 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_delete_object_with_legal_hold_off(): 2023-12-03T12:39:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.330 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.330 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12221: 2023-12-03T12:39:21.330 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.330 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.331 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.331 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.331 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.331 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.331 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.331 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.331 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.331 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.332 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.332 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.332 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.332 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.332 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.332 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.332 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.332 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.332 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.332 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.332 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.332 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.332 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.333 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.333 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.333 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.333 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.333 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.336 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.336 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-498" 2023-12-03T12:39:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.336 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.336 INFO:teuthology.orchestra.run.smithi044.stdout:______________________ test_object_lock_get_obj_metadata _______________________ 2023-12-03T12:39:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.336 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.337 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.338 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.338 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.338 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.338 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.338 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.338 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.338 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.338 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.338 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.338 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.338 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.338 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.338 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.338 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.341 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.341 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.341 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.341 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.342 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.342 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.343 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.344 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.344 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.344 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.344 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.344 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.344 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.344 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.344 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.344 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.344 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.344 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.344 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.344 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.344 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.344 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.344 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.345 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.345 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.345 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.345 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.345 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.345 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.345 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.346 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.346 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.346 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.348 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.348 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.348 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.348 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_get_obj_metadata(): 2023-12-03T12:39:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.348 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.349 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12233: 2023-12-03T12:39:21.349 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.349 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.349 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.349 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.349 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.349 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.349 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.349 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.350 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.350 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.350 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.350 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.350 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.350 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.350 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.350 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.351 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.351 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.351 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.351 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.351 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.354 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.354 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-499" 2023-12-03T12:39:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.355 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.355 INFO:teuthology.orchestra.run.smithi044.stdout:________________________ test_object_lock_uploading_obj ________________________ 2023-12-03T12:39:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.355 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.356 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.356 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.356 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.356 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.356 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.356 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.357 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.360 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.360 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.360 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.360 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.360 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.360 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.362 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.362 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.362 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.363 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.363 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.363 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.363 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.363 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.363 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.363 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.363 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.364 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.364 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.364 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.364 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.364 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.364 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.364 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.366 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.366 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.366 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.366 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_uploading_obj(): 2023-12-03T12:39:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.367 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.367 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12253: 2023-12-03T12:39:21.367 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.367 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.367 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.367 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.367 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.367 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.368 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.369 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.369 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.369 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.369 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.369 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.369 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.369 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.369 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.372 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.372 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-500" 2023-12-03T12:39:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.373 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.373 INFO:teuthology.orchestra.run.smithi044.stdout:__________ test_object_lock_changing_mode_from_governance_with_bypass __________ 2023-12-03T12:39:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.373 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.374 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.374 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.374 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.374 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.374 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.374 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.374 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.377 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.377 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.378 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.378 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.378 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.378 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.379 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.380 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.380 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.380 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.380 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.380 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.380 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.380 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.381 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.381 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.381 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.381 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.381 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.382 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.382 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.382 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.383 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.384 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.384 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.384 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_changing_mode_from_governance_with_bypass(): 2023-12-03T12:39:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: key = 'file1' 2023-12-03T12:39:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.384 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.384 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12270: 2023-12-03T12:39:21.384 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.385 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.385 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.385 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.385 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.385 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.385 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.385 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.385 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.385 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.386 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.386 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.386 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.386 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.386 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.386 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.386 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.386 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.386 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.386 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.386 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.386 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.386 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.386 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.386 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.386 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.387 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.387 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.387 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.390 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.390 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-501" 2023-12-03T12:39:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.390 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.390 INFO:teuthology.orchestra.run.smithi044.stdout:________ test_object_lock_changing_mode_from_governance_without_bypass _________ 2023-12-03T12:39:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.390 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.391 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.392 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.392 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.392 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.392 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.392 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.392 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.395 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.395 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.395 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.395 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.396 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.396 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.397 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.397 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.398 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.398 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.398 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.398 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.398 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.398 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.398 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.398 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.398 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.398 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.398 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.398 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.398 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.398 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.398 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.399 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.399 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.399 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.399 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.399 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.399 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.399 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.399 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.399 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.399 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.399 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.399 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.399 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.399 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.399 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.399 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.399 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.401 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.401 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.401 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.402 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_changing_mode_from_governance_without_bypass(): 2023-12-03T12:39:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: key = 'file1' 2023-12-03T12:39:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.402 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.402 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12284: 2023-12-03T12:39:21.402 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.402 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.402 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.402 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.403 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.403 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.403 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.403 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.403 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.403 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.403 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.403 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.404 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.404 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.404 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.404 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.404 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.404 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.404 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.404 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.404 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.404 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.404 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.404 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.404 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.404 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.404 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.404 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.404 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.405 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.405 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.405 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.405 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.405 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.405 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.405 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.405 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.405 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.405 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.405 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.405 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.405 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.405 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.405 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.405 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.406 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.406 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.406 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.406 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.406 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.406 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.406 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.406 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.406 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.406 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.406 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.406 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.406 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.406 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.406 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.406 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.406 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.407 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.407 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.407 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.407 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.407 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.407 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.407 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.407 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.407 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.407 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.407 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.407 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.407 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.407 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-502" 2023-12-03T12:39:21.407 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.407 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.408 INFO:teuthology.orchestra.run.smithi044.stdout:________________ test_object_lock_changing_mode_from_compliance ________________ 2023-12-03T12:39:21.408 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.408 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.408 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.408 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.408 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.408 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.408 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.408 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.408 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.408 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.408 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.408 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.408 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.408 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.408 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.409 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.409 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.409 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.409 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.409 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.409 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.409 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.409 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.409 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.409 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.409 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.409 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.409 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.410 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.410 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.410 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.410 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.410 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.410 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.410 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.410 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.410 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.410 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.410 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.410 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.410 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.410 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.410 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.411 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.411 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.411 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.411 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.411 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.411 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.411 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.411 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.411 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.411 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.411 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.411 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.411 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.412 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.412 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.412 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.412 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.412 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.412 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.412 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.412 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.412 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.412 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.412 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.412 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.412 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.412 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.412 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.412 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.412 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.413 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.413 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.413 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.413 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.413 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.413 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.413 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.413 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.413 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.413 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.413 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.413 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.414 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.414 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.414 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.414 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.414 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.414 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.414 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.414 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.414 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.414 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.414 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.414 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.414 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.414 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.414 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.414 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.415 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.415 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.415 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.415 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.415 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.415 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.415 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.415 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.415 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.415 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.415 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.415 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.415 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.415 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.415 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.415 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.415 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.416 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.416 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.416 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.416 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.416 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.416 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.416 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.416 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.416 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.416 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.416 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.416 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.416 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.416 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.416 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.416 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.417 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.417 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.417 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.417 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.417 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.417 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.417 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.417 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.417 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.417 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.417 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.417 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.417 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.417 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.417 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.417 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.418 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.418 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.418 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.418 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.418 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.418 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.418 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.418 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.418 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.418 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.418 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.418 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.418 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.418 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.419 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.419 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.419 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.419 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.419 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.419 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.419 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.419 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.419 INFO:teuthology.orchestra.run.smithi044.stdout: def test_object_lock_changing_mode_from_compliance(): 2023-12-03T12:39:21.419 INFO:teuthology.orchestra.run.smithi044.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:39:21.419 INFO:teuthology.orchestra.run.smithi044.stdout: key = 'file1' 2023-12-03T12:39:21.419 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.419 INFO:teuthology.orchestra.run.smithi044.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:39:21.419 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.419 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12301: 2023-12-03T12:39:21.419 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.420 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.420 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.420 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.420 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.420 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.420 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.420 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.420 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.420 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.420 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.420 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.420 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.420 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.420 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.420 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.420 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.420 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.421 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.421 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.421 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.421 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.421 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.421 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.421 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.421 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.421 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.422 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.422 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.422 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.422 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.422 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.422 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.422 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.422 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.422 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.422 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.422 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.422 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.422 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.422 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.422 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.422 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.423 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.423 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.423 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.423 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.423 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.423 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.423 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.423 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.423 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.423 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.423 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.423 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.423 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.423 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.423 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.423 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.423 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.424 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.424 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.424 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.424 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.424 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.424 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.424 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.424 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.424 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.424 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.424 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.424 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.424 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.424 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.425 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.425 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.425 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.425 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-503" 2023-12-03T12:39:21.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.425 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.425 INFO:teuthology.orchestra.run.smithi044.stdout:________________________ test_copy_object_ifmatch_good _________________________ 2023-12-03T12:39:21.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.425 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.425 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.425 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.425 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.425 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.426 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.426 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.426 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.426 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.426 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.426 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.426 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.426 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.426 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.426 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.426 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.426 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.426 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.426 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.426 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.427 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.427 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.427 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.427 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.427 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.427 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.427 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.427 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.427 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.427 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.427 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.427 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.427 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.427 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.427 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.427 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.427 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.428 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.428 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.428 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.428 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.428 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.428 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.428 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.428 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.428 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.428 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.428 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.428 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.428 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.428 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.429 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.429 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.429 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.429 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.429 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.429 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.429 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.429 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.429 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.429 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.429 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.429 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.429 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.429 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.429 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.430 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.430 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.430 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.430 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.430 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.430 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.430 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.430 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.430 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.430 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.430 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.430 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.430 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.430 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.430 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.431 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.431 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.431 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.431 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.431 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.431 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.431 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.431 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.431 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.431 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.431 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.431 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.431 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.431 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.431 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.431 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.431 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.432 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.432 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.432 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.432 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.432 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.432 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.432 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.432 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.432 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.432 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.432 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.432 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.432 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.432 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.432 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.432 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.433 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.433 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.433 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.433 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.433 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.433 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.433 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.433 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.433 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.433 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.433 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.433 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.433 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.433 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.434 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.434 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.434 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.434 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.434 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.434 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.434 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.434 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.434 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.434 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.434 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.434 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.434 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.434 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.434 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.434 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.435 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.435 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.435 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.435 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.435 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.435 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.435 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.435 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.435 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.435 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.435 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.435 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.436 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.436 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.436 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.436 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.436 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.436 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.436 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.436 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.436 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.436 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.436 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.436 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.436 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.436 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.436 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.436 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.436 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.437 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.437 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.437 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.437 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.437 INFO:teuthology.orchestra.run.smithi044.stdout: def test_copy_object_ifmatch_good(): 2023-12-03T12:39:21.437 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:21.437 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.437 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12315: 2023-12-03T12:39:21.437 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.437 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:21.437 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:21.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.437 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.437 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.437 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.437 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.438 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.438 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.438 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.438 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.438 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.438 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.438 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.438 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.438 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.439 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.439 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.439 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.439 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.439 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.439 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.439 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.439 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.439 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.439 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.439 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.439 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.439 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.439 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.439 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.440 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.440 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.440 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.440 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.440 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.440 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.440 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.440 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.440 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.440 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.440 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.440 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.440 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.440 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.440 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.441 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.441 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.441 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.441 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.441 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.441 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.441 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.441 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.441 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.441 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.441 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.441 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.441 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.441 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.441 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.441 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.442 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.442 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.442 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.442 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.442 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.442 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.442 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.442 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.442 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.442 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.442 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.442 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.442 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.443 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.443 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.443 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.443 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-504" 2023-12-03T12:39:21.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.443 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.443 INFO:teuthology.orchestra.run.smithi044.stdout:_____________________ test_copy_object_ifnonematch_failed ______________________ 2023-12-03T12:39:21.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.443 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.443 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.443 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.443 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.444 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.444 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.444 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.444 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.444 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.444 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.444 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.444 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.444 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.444 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.444 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.444 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.444 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.445 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.445 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.445 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.445 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.445 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.445 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.445 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.445 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.445 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.445 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.445 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.445 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.445 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.445 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.446 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.446 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.446 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.446 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.446 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.446 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.446 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.446 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.446 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.446 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.446 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.446 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.447 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.447 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.447 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.447 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.447 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.447 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.447 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.447 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.447 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.447 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.447 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.447 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.447 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.447 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.447 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.448 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.448 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.448 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.448 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.448 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.448 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.448 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.448 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.448 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.448 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.448 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.448 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.448 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.448 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.448 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.448 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.449 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.449 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.449 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.449 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.449 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.449 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.449 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.449 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.449 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.449 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.449 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.449 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.449 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.449 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.449 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.450 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.450 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.450 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.450 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.450 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.450 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.450 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.450 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.450 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.450 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.450 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.450 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.450 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.450 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.450 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.450 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.451 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.451 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.451 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.451 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.451 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.451 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.451 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.451 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.452 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.452 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.452 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.452 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.452 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.452 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.452 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.452 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.452 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.452 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.452 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.452 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.452 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.452 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.452 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.452 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.453 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.453 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.453 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.453 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.453 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.453 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.453 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.453 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.453 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.453 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.453 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.453 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.453 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.454 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.454 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.454 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.454 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.454 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.454 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.454 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.454 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.454 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.454 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.454 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.454 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.454 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.454 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.454 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.455 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.455 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.455 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.455 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.455 INFO:teuthology.orchestra.run.smithi044.stdout: def test_copy_object_ifnonematch_failed(): 2023-12-03T12:39:21.455 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:21.455 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.455 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12350: 2023-12-03T12:39:21.455 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.455 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:21.455 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:21.455 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.456 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.456 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.456 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.456 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.456 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.456 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.456 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.456 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.456 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.457 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.457 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.457 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.457 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.457 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.457 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.457 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.457 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.457 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.457 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.458 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.458 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.458 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.458 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.458 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.458 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.458 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.458 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.458 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.458 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.458 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.458 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.458 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.459 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.459 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.459 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.459 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.459 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.459 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.459 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.459 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.459 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.459 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.459 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.459 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.459 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.459 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.459 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.459 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.459 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.460 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.460 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.460 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.460 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.460 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.460 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.460 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.460 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.460 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.460 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.460 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.460 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.460 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.460 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.460 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.460 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.461 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.461 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.461 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.461 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.461 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-505" 2023-12-03T12:39:21.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.461 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.461 INFO:teuthology.orchestra.run.smithi044.stdout:________________________ test_get_bucket_policy_status _________________________ 2023-12-03T12:39:21.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.461 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.461 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.461 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.461 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.461 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.462 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.462 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.462 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.462 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.462 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.462 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.462 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.462 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.462 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.462 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.462 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.462 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.463 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.463 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.463 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.463 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.463 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.463 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.463 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.463 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.463 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.463 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.463 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.463 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.463 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.464 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.464 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.464 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.464 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.464 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.464 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.464 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.464 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.464 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.464 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.464 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.464 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.464 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.464 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.464 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.465 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.465 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.465 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.465 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.465 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.465 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.465 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.465 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.465 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.465 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.465 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.465 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.465 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.466 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.466 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.466 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.466 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.466 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.466 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.466 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.466 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.466 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.466 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.466 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.466 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.467 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.467 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.467 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.467 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.467 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.467 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.467 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.467 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.467 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.467 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.467 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.467 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.467 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.467 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.467 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.468 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.468 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.468 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.468 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.468 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.468 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.468 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.468 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.468 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.468 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.468 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.468 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.468 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.468 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.468 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.468 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.469 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.469 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.469 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.469 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.469 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.469 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.469 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.469 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.469 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.469 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.469 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.469 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.470 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.470 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.470 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.470 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.470 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.470 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.470 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.470 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.470 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.470 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.470 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.471 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.471 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.471 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.471 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.471 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.471 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.471 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.471 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.471 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.471 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.471 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.471 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.471 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.471 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.471 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.471 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.472 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.472 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.472 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.472 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.472 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.472 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.472 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.472 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.472 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.472 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.472 INFO:teuthology.orchestra.run.smithi044.stdout: def test_get_bucket_policy_status(): 2023-12-03T12:39:21.472 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:21.473 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.473 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12370: 2023-12-03T12:39:21.473 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.473 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:21.473 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:21.473 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.473 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.473 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.473 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.473 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.473 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.473 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.473 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.473 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.473 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.474 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.474 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.474 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.474 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.474 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.474 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.474 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.474 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.474 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.474 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.474 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.474 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.474 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.474 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.474 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.474 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.475 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.475 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.475 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.475 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.475 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.475 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.475 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.475 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.475 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.475 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.475 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.475 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.475 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.475 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.475 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.476 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.476 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.476 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.476 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.476 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.476 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.476 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.476 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.476 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.476 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.476 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.476 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.476 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.476 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.476 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.476 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.477 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.477 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.477 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.477 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.477 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.477 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.477 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.477 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.477 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.477 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.477 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.477 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.477 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.477 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.477 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.478 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.478 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.478 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.478 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.478 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.478 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.478 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.478 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.478 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.478 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.478 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.478 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-506" 2023-12-03T12:39:21.478 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.478 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.478 INFO:teuthology.orchestra.run.smithi044.stdout:___________________ test_get_public_acl_bucket_policy_status ___________________ 2023-12-03T12:39:21.478 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.479 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.479 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.479 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.479 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.479 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.479 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.479 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.479 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.479 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.479 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.479 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.479 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.479 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.479 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.479 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.479 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.479 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.480 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.480 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.480 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.480 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.480 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.480 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.480 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.480 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.480 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.480 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.480 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.480 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.480 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.480 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.480 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.480 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.481 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.481 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.481 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.481 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.481 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.481 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.481 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.481 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.481 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.481 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.481 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.481 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.481 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.481 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.481 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.482 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.482 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.482 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.482 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.482 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.482 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.482 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.482 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.482 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.482 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.482 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.482 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.482 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.482 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.482 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.482 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.483 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.483 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.483 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.483 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.483 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.483 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.483 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.483 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.483 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.483 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.483 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.483 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.484 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.484 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.484 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.484 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.484 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.484 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.484 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.484 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.484 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.484 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.484 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.484 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.484 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.484 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.484 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.484 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.485 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.485 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.485 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.485 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.485 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.485 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.485 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.485 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.485 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.485 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.485 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.485 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.485 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.485 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.485 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.486 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.486 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.486 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.486 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.486 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.486 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.486 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.486 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.486 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.486 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.486 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.486 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.486 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.486 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.486 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.486 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.487 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.487 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.487 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.487 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.487 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.487 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.487 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.487 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.487 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.487 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.487 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.487 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.487 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.487 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.487 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.487 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.487 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.488 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.488 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.488 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.488 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.488 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.488 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.488 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.488 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.488 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.488 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.488 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.488 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.488 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.488 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.488 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.488 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.489 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.489 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.489 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.489 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.489 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.489 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.489 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.489 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.489 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.489 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.489 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.489 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.489 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.489 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.489 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.490 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.490 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.490 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.490 INFO:teuthology.orchestra.run.smithi044.stdout: def test_get_public_acl_bucket_policy_status(): 2023-12-03T12:39:21.490 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:21.490 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.490 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12376: 2023-12-03T12:39:21.490 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.490 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:21.490 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:21.490 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.490 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.490 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.490 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.490 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.490 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.491 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.491 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.491 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.491 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.491 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.491 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.491 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.491 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.491 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.491 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.491 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.491 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.491 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.491 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.491 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.492 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.492 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.492 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.492 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.492 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.492 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.492 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.492 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.492 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.492 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.492 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.493 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.493 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.493 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.493 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.493 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.493 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.493 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.493 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.493 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.493 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.493 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.493 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.493 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.493 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.493 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.494 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.494 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.494 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.494 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.494 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.494 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.494 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.494 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.494 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.494 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.494 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.494 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.494 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.494 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.494 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.495 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.495 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.495 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.495 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.495 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.495 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.495 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.495 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.495 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.495 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.495 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.495 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.495 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.495 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.495 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.495 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.495 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.496 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-507" 2023-12-03T12:39:21.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.496 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.496 INFO:teuthology.orchestra.run.smithi044.stdout:_________________ test_get_authpublic_acl_bucket_policy_status _________________ 2023-12-03T12:39:21.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.496 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.496 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.496 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.496 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.496 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.496 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.496 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.496 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.497 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.497 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.497 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.497 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.497 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.497 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.497 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.497 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.497 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.497 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.497 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.497 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.497 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.497 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.497 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.498 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.498 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.498 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.498 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.498 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.498 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.498 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.498 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.498 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.498 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.498 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.498 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.498 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.498 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.498 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.498 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.499 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.499 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.499 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.499 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.499 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.499 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.499 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.499 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.499 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.499 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.499 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.499 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.499 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.499 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.499 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.499 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.500 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.500 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.500 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.500 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.500 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.500 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.500 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.500 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.500 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.500 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.500 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.500 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.500 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.500 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.500 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.501 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.501 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.501 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.501 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.501 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.501 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.501 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.501 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.501 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.501 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.501 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.501 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.502 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.502 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.502 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.502 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.502 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.502 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.502 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.502 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.502 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.502 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.502 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.502 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.502 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.502 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.503 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.503 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.503 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.503 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.503 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.503 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.503 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.503 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.503 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.503 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.503 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.503 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.503 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.503 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.503 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.503 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.503 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.503 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.504 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.504 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.504 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.504 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.504 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.504 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.504 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.504 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.504 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.504 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.504 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.504 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.504 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.504 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.504 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.505 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.505 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.505 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.505 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.505 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.505 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.505 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.505 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.505 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.505 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.505 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.505 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.505 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.505 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.505 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.505 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.506 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.506 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.506 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.506 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.506 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.506 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.506 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.506 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.506 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.506 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.506 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.506 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.506 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.506 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.506 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.506 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.507 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.507 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.507 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.507 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.507 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.507 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.507 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.507 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.507 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.507 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.507 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.507 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.507 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.507 INFO:teuthology.orchestra.run.smithi044.stdout: def test_get_authpublic_acl_bucket_policy_status(): 2023-12-03T12:39:21.507 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:21.507 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.507 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12383: 2023-12-03T12:39:21.508 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.508 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:21.508 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:21.508 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.508 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.508 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.508 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.508 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.508 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.508 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.508 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.508 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.508 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.508 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.508 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.508 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.509 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.509 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.509 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.509 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.509 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.509 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.509 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.509 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.509 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.510 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.510 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.510 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.510 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.510 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.510 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.510 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.510 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.510 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.510 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.510 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.510 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.510 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.510 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.511 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.511 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.511 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.511 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.511 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.511 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.511 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.511 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.511 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.511 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.511 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.511 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.511 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.511 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.511 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.511 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.512 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.512 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.512 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.512 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.512 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.512 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.512 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.512 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.512 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.512 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.512 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.512 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.512 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.512 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.512 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.513 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.513 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.513 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.513 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.513 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.513 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.513 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.513 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.513 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.513 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-508" 2023-12-03T12:39:21.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.513 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.513 INFO:teuthology.orchestra.run.smithi044.stdout:________________ test_get_publicpolicy_acl_bucket_policy_status ________________ 2023-12-03T12:39:21.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.513 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.513 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.514 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.514 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.514 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.514 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.514 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.514 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.514 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.514 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.514 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.514 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.514 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.514 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.514 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.514 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.514 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.514 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.515 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.515 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.515 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.515 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.515 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.515 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.515 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.515 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.515 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.515 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.515 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.515 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.515 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.515 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.515 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.515 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.516 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.516 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.516 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.516 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.516 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.516 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.516 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.516 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.516 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.516 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.516 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.516 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.516 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.516 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.516 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.516 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.517 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.517 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.517 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.517 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.517 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.517 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.517 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.517 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.517 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.517 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.517 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.517 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.517 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.517 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.517 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.517 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.518 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.518 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.518 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.518 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.518 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.518 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.518 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.518 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.518 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.518 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.518 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.518 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.519 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.519 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.519 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.519 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.519 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.519 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.519 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.519 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.519 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.519 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.519 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.519 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.519 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.519 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.519 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.519 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.519 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.520 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.520 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.520 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.520 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.520 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.520 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.520 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.520 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.520 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.520 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.520 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.520 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.520 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.520 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.521 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.521 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.521 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.521 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.521 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.521 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.521 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.521 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.521 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.521 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.522 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.522 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.522 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.522 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.522 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.522 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.522 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.522 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.522 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.522 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.522 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.522 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.522 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.522 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.522 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.522 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.523 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.523 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.523 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.523 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.523 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.523 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.523 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.523 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.523 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.523 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.523 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.523 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.523 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.523 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.523 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.523 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.523 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.524 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.524 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.524 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.524 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.524 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.524 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.524 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.524 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.524 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.524 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.524 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.524 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.524 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.525 INFO:teuthology.orchestra.run.smithi044.stdout: def test_get_publicpolicy_acl_bucket_policy_status(): 2023-12-03T12:39:21.525 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:21.525 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.525 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12391: 2023-12-03T12:39:21.525 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.525 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:21.525 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:21.525 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.525 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.525 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.525 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.525 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.525 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.525 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.525 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.526 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.526 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.526 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.526 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.526 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.526 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.526 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.526 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.526 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.526 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.526 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.526 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.526 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.527 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.527 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.527 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.527 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.527 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.527 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.527 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.527 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.527 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.527 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.527 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.527 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.528 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.528 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.528 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.528 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.528 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.528 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.528 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.528 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.528 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.528 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.528 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.528 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.528 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.528 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.529 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.529 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.529 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.529 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.529 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.529 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.529 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.529 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.529 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.529 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.529 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.529 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.529 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.529 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.529 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.530 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.530 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.530 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.530 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.530 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.530 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.530 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.530 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.530 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.530 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.530 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.530 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.530 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.530 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.530 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.531 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.531 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.531 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.531 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.531 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-509" 2023-12-03T12:39:21.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.531 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.531 INFO:teuthology.orchestra.run.smithi044.stdout:______________ test_get_nonpublicpolicy_acl_bucket_policy_status _______________ 2023-12-03T12:39:21.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.531 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.531 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.531 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.531 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.532 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.532 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.532 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.532 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.532 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.532 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.532 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.532 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.532 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.532 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.532 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.532 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.532 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.533 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.533 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.533 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.533 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.533 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.533 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.533 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.533 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.533 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.533 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.533 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.534 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.534 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.534 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.534 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.534 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.534 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.534 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.534 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.534 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.534 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.534 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.534 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.534 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.534 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.534 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.534 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.535 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.535 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.535 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.535 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.535 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.535 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.535 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.535 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.535 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.535 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.535 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.535 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.535 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.535 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.535 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.535 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.536 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.536 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.536 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.536 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.536 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.536 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.536 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.536 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.536 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.536 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.536 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.536 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.536 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.536 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.536 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.536 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.536 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.537 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.537 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.537 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.537 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.537 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.537 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.537 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.537 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.537 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.537 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.537 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.537 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.537 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.537 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.537 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.537 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.538 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.538 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.538 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.538 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.538 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.538 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.538 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.538 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.538 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.538 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.538 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.538 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.538 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.539 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.539 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.539 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.539 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.539 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.539 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.539 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.539 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.539 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.539 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.539 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.539 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.539 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.539 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.539 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.539 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.540 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.540 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.540 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.540 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.540 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.540 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.540 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.540 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.540 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.540 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.540 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.540 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.540 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.540 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.540 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.541 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.541 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.541 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.541 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.541 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.541 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.541 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.541 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.541 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.541 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.541 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.541 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.541 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.541 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.541 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.541 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.542 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.542 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.542 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.542 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.542 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.542 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.542 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.542 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.542 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.542 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.542 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.542 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.542 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.542 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.542 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.543 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.543 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.543 INFO:teuthology.orchestra.run.smithi044.stdout: def test_get_nonpublicpolicy_acl_bucket_policy_status(): 2023-12-03T12:39:21.543 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:21.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.543 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12419: 2023-12-03T12:39:21.543 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.543 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:21.543 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:21.543 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.543 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.543 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.543 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.544 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.544 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.544 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.544 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.544 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.544 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.544 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.544 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.544 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.545 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.545 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.545 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.545 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.545 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.545 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.545 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.545 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.545 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.545 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.545 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.545 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.545 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.545 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.545 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.545 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.545 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.546 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.546 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.546 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.546 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.546 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.546 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.546 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.546 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.546 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.546 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.546 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.546 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.546 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.547 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.547 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.547 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.547 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.547 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.547 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.547 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.547 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.547 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.547 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.547 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.547 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.547 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.547 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.547 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.548 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.548 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.548 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.548 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.548 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.548 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.548 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.548 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.548 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.548 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.548 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.548 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.548 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.548 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.548 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.548 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.549 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.549 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.549 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.549 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.549 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.549 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-510" 2023-12-03T12:39:21.549 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.549 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.549 INFO:teuthology.orchestra.run.smithi044.stdout:______________ test_get_nonpublicpolicy_deny_bucket_policy_status ______________ 2023-12-03T12:39:21.549 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.549 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.549 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.549 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.549 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.549 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.549 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.550 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.550 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.550 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.550 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.550 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.550 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.550 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.550 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.550 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.550 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.550 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.550 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.550 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.550 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.550 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.550 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.551 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.551 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.551 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.551 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.551 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.551 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.551 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.551 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.551 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.551 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.551 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.551 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.552 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.552 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.552 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.552 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.552 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.552 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.552 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.552 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.552 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.552 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.552 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.552 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.552 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.552 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.552 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.552 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.553 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.553 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.553 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.553 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.553 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.553 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.553 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.553 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.553 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.553 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.553 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.553 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.553 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.554 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.554 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.554 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.554 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.554 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.554 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.554 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.554 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.554 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.554 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.554 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.555 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.555 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.555 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.555 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.555 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.555 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.555 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.555 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.555 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.555 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.555 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.555 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.555 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.555 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.555 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.556 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.556 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.556 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.556 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.556 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.556 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.556 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.556 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.556 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.556 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.556 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.556 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.556 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.556 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.556 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.556 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.556 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.557 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.557 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.557 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.557 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.557 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.557 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.557 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.557 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.557 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.557 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.557 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.557 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.557 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.557 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.557 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.557 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.558 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.558 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.558 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.558 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.558 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.558 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.558 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.558 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.558 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.558 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.558 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.558 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.558 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.558 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.558 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.559 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.559 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.559 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.559 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.559 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.559 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.559 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.559 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.559 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.559 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.559 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.559 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.560 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.560 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.560 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.560 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.560 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.560 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.560 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.560 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.560 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.560 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.560 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.560 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.560 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.560 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.560 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.560 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.561 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.561 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.561 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.561 INFO:teuthology.orchestra.run.smithi044.stdout: def test_get_nonpublicpolicy_deny_bucket_policy_status(): 2023-12-03T12:39:21.561 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:21.561 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.561 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12451: 2023-12-03T12:39:21.561 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.561 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:21.561 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:21.561 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.561 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.561 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.562 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.562 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.562 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.562 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.562 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.562 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.562 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.562 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.562 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.563 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.563 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.563 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.563 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.563 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.563 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.563 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.563 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.563 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.563 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.563 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.563 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.563 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.563 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.563 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.563 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.564 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.564 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.564 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.564 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.564 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.564 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.564 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.564 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.564 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.564 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.564 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.564 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.564 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.564 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.564 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.564 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.564 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.565 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.565 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.565 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.565 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.565 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.565 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.565 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.565 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.565 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.565 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.565 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.565 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.565 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.565 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.565 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.565 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.565 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.566 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.566 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.566 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.566 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.566 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.566 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.566 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.566 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.566 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.566 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.566 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.566 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.566 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.566 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.567 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.567 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.567 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-511" 2023-12-03T12:39:21.567 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.567 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.567 INFO:teuthology.orchestra.run.smithi044.stdout:________________________ test_get_default_public_block _________________________ 2023-12-03T12:39:21.567 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.567 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.567 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.567 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.567 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.567 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.567 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.567 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.567 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.567 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.568 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.568 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.568 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.568 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.568 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.568 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.568 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.568 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.568 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.568 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.568 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.568 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.568 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.568 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.568 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.568 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.568 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.569 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.569 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.569 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.569 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.569 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.569 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.569 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.569 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.569 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.569 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.569 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.569 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.569 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.569 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.569 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.569 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.570 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.570 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.570 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.570 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.570 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.570 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.570 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.570 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.570 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.570 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.570 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.570 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.570 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.570 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.570 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.570 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.571 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.571 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.571 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.571 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.571 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.571 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.571 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.571 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.571 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.571 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.571 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.571 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.572 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.572 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.572 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.572 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.572 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.572 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.572 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.572 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.572 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.572 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.572 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.572 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.572 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.572 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.572 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.572 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.573 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.573 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.573 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.573 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.573 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.573 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.573 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.573 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.573 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.573 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.573 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.573 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.573 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.573 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.573 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.573 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.573 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.574 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.574 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.574 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.574 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.574 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.574 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.574 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.574 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.574 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.574 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.574 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.574 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.574 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.574 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.574 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.575 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.575 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.575 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.575 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.575 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.575 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.575 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.575 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.575 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.575 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.575 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.575 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.576 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.576 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.576 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.576 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.576 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.576 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.576 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.576 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.576 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.576 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.576 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.576 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.576 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.576 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.577 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.577 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.577 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.577 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.577 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.577 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.577 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.577 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.577 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.577 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.577 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.577 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.578 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.578 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.578 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.578 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.578 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.578 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.578 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.578 INFO:teuthology.orchestra.run.smithi044.stdout: def test_get_default_public_block(): 2023-12-03T12:39:21.578 INFO:teuthology.orchestra.run.smithi044.stdout: #client = get_svc_client(svc='s3control', client_config=Config(s3={'addressing_style': 'path'})) 2023-12-03T12:39:21.578 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:21.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.578 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12479: 2023-12-03T12:39:21.578 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.578 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:21.579 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:21.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.579 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.579 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.579 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.579 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.579 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.579 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.579 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.579 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.580 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.580 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.580 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.580 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.580 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.580 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.580 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.580 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.580 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.580 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.580 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.580 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.580 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.580 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.580 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.580 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.581 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.581 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.581 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.581 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.581 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.581 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.581 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.581 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.581 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.581 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.581 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.581 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.581 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.581 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.581 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.582 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.582 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.582 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.582 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.582 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.582 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.582 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.582 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.582 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.582 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.582 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.582 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.582 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.582 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.583 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.583 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.583 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.583 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.583 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.583 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.583 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.583 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.583 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.583 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.583 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.583 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.583 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.584 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.584 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.584 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.584 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.584 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.584 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.584 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.584 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.584 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.584 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.584 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.584 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-512" 2023-12-03T12:39:21.584 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.584 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.584 INFO:teuthology.orchestra.run.smithi044.stdout:____________________________ test_put_public_block _____________________________ 2023-12-03T12:39:21.584 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.584 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.585 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.585 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.585 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.585 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.585 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.585 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.585 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.585 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.585 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.585 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.585 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.585 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.585 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.585 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.585 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.585 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.586 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.586 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.586 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.586 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.586 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.586 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.586 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.586 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.586 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.586 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.586 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.586 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.586 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.586 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.587 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.587 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.587 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.587 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.587 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.587 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.587 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.587 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.587 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.587 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.587 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.587 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.587 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.587 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.588 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.588 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.588 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.588 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.588 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.588 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.588 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.588 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.588 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.588 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.588 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.588 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.588 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.588 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.588 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.588 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.588 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.589 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.589 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.589 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.589 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.589 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.589 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.589 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.589 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.589 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.589 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.590 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.590 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.590 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.590 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.590 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.590 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.590 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.590 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.590 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.590 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.590 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.590 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.590 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.590 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.590 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.590 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.591 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.591 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.591 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.591 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.591 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.591 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.591 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.591 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.591 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.591 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.591 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.591 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.591 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.591 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.591 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.592 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.592 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.592 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.592 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.592 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.592 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.592 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.592 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.592 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.592 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.592 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.592 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.592 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.592 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.592 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.592 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.593 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.593 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.593 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.593 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.593 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.593 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.593 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.593 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.593 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.593 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.593 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.593 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.593 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.593 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.593 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.593 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.594 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.594 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.594 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.594 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.594 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.594 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.594 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.594 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.594 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.594 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.594 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.594 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.595 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.595 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.595 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.595 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.595 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.595 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.595 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.595 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.595 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.595 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.595 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.595 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.595 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.595 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.595 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.595 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.596 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.596 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.596 INFO:teuthology.orchestra.run.smithi044.stdout: def test_put_public_block(): 2023-12-03T12:39:21.596 INFO:teuthology.orchestra.run.smithi044.stdout: #client = get_svc_client(svc='s3control', client_config=Config(s3={'addressing_style': 'path'})) 2023-12-03T12:39:21.596 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:21.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.596 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12490: 2023-12-03T12:39:21.596 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.596 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:21.596 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:21.596 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.596 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.596 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.597 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.597 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.597 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.597 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.597 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.597 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.597 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.597 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.597 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.597 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.597 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.597 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.597 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.597 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.597 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.597 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.597 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.598 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.598 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.598 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.598 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.598 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.598 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.598 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.598 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.598 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.598 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.598 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.598 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.598 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.598 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.598 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.598 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.599 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.599 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.599 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.599 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.599 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.599 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.599 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.599 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.599 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.599 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.599 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.599 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.599 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.599 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.599 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.599 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.599 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.600 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.600 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.600 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.600 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.600 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.600 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.600 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.600 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.600 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.600 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.600 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.600 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.600 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.600 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.600 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.600 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.600 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.601 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.601 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.601 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.601 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.601 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.601 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.601 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.601 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.601 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.601 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.601 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.601 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.601 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.601 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.601 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.601 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.601 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-513" 2023-12-03T12:39:21.602 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.602 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.602 INFO:teuthology.orchestra.run.smithi044.stdout:______________________ test_block_public_put_bucket_acls _______________________ 2023-12-03T12:39:21.602 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.602 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.602 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.602 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.602 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.602 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.602 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.602 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.602 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.602 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.602 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.603 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.603 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.603 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.603 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.603 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.603 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.603 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.603 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.603 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.603 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.603 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.605 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.605 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.605 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.605 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.605 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.605 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.605 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.605 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.605 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.605 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.606 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.606 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.606 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.606 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.606 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.606 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.606 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.606 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.606 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.606 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.606 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.606 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.606 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.606 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.606 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.606 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.607 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.607 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.607 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.607 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.607 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.607 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.607 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.607 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.607 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.607 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.607 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.607 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.607 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.607 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.607 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.607 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.607 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.608 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.608 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.608 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.608 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.608 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.608 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.608 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.608 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.608 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.608 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.608 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.608 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.609 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.609 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.609 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.609 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.609 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.609 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.609 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.609 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.609 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.609 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.609 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.609 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.609 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.609 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.610 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.610 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.610 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.610 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.610 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.610 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.610 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.610 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.610 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.610 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.610 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.610 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.610 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.610 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.610 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.611 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.611 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.611 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.611 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.611 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.611 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.611 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.611 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.611 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.612 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.612 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.612 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.612 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.612 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.612 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.612 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.612 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.612 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.612 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.612 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.612 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.612 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.612 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.612 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.612 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.612 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.613 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.613 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.613 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.613 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.613 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.613 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.613 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.613 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.613 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.613 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.613 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.613 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.613 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.613 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.613 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.613 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.613 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.614 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.614 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.614 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.614 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.614 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.614 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.614 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.614 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.614 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.614 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.614 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.614 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.614 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.614 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.614 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.615 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.615 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.615 INFO:teuthology.orchestra.run.smithi044.stdout: def test_block_public_put_bucket_acls(): 2023-12-03T12:39:21.615 INFO:teuthology.orchestra.run.smithi044.stdout: #client = get_svc_client(svc='s3control', client_config=Config(s3={'addressing_style': 'path'})) 2023-12-03T12:39:21.615 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:21.615 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.615 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12509: 2023-12-03T12:39:21.615 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.615 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:21.615 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:21.615 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.615 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.615 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.615 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.616 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.616 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.616 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.616 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.616 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.616 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.616 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.616 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.616 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.616 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.616 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.616 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.616 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.616 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.616 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.616 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.616 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.617 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.617 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.617 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.617 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.617 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.617 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.617 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.617 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.617 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.617 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.617 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.617 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.617 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.617 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.617 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.617 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.618 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.618 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.618 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.618 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.618 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.618 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.618 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.618 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.618 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.618 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.618 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.618 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.618 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.618 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.619 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.619 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.619 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.619 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.619 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.619 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.619 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.619 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.619 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.619 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.619 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.619 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.619 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.619 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.619 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.619 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.619 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.620 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.620 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.620 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.620 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.620 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.620 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.620 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.620 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.620 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.620 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.620 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.620 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.620 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.620 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.620 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.620 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.620 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.621 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-514" 2023-12-03T12:39:21.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.621 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.621 INFO:teuthology.orchestra.run.smithi044.stdout:_____________________ test_block_public_object_canned_acls _____________________ 2023-12-03T12:39:21.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.621 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.621 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.621 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.621 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.621 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.621 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.621 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.621 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.621 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.622 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.622 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.622 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.622 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.622 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.622 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.622 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.622 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.622 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.622 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.622 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.622 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.623 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.623 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.623 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.623 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.623 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.623 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.623 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.623 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.623 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.623 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.623 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.623 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.623 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.623 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.623 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.623 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.623 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.624 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.624 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.624 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.624 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.624 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.624 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.624 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.624 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.624 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.624 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.624 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.624 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.625 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.625 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.625 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.625 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.625 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.625 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.625 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.625 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.625 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.625 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.625 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.625 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.625 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.625 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.625 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.625 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.625 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.626 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.626 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.626 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.626 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.626 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.626 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.626 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.626 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.626 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.626 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.626 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.626 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.626 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.626 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.627 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.627 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.627 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.627 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.627 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.627 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.627 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.627 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.627 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.627 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.627 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.627 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.627 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.627 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.627 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.627 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.628 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.628 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.628 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.628 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.628 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.628 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.628 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.628 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.628 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.628 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.628 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.628 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.628 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.628 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.628 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.629 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.629 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.629 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.629 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.629 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.629 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.629 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.629 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.629 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.629 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.629 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.629 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.629 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.629 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.629 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.630 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.630 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.630 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.630 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.630 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.630 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.630 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.630 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.630 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.630 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.630 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.630 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.630 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.630 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.630 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.630 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.631 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.631 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.631 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.631 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.631 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.631 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.631 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.631 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.631 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.631 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.631 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.631 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.631 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.631 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.631 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.631 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.632 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.632 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.632 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.632 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.632 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.632 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.632 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.632 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.632 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.632 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.632 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.632 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.632 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.632 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.632 INFO:teuthology.orchestra.run.smithi044.stdout: def test_block_public_object_canned_acls(): 2023-12-03T12:39:21.632 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:21.633 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.633 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12537: 2023-12-03T12:39:21.633 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.633 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:21.633 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:21.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.633 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.633 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.633 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.633 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.633 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.633 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.633 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.634 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.634 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.634 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.634 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.634 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.634 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.634 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.634 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.634 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.634 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.634 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.634 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.634 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.635 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.635 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.635 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.635 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.635 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.635 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.635 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.635 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.635 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.635 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.635 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.635 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.635 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.635 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.636 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.636 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.636 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.636 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.636 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.636 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.636 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.636 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.636 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.636 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.636 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.636 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.636 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.636 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.636 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.637 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.637 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.637 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.637 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.637 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.637 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.637 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.637 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.637 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.637 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.637 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.637 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.637 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.637 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.637 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.637 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.637 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.638 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.638 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.638 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.638 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.638 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.638 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.638 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.638 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.638 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.638 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.638 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.638 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.638 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-515" 2023-12-03T12:39:21.638 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.638 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.638 INFO:teuthology.orchestra.run.smithi044.stdout:___________________________ test_block_public_policy ___________________________ 2023-12-03T12:39:21.639 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.639 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.639 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.639 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.639 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.639 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.639 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.639 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.639 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.639 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.639 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.639 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.639 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.639 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.639 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.639 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.639 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.640 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.640 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.640 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.640 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.640 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.640 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.640 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.640 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.640 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.640 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.640 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.640 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.640 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.640 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.640 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.640 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.640 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.641 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.641 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.641 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.641 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.641 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.641 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.641 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.641 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.641 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.641 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.641 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.641 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.641 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.641 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.642 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.642 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.642 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.642 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.642 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.642 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.642 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.642 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.642 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.642 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.642 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.642 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.642 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.643 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.643 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.643 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.643 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.643 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.643 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.643 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.643 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.643 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.643 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.643 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.643 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.643 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.643 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.643 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.644 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.644 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.644 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.644 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.644 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.644 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.644 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.644 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.644 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.644 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.644 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.644 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.644 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.644 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.644 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.644 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.644 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.645 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.645 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.645 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.645 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.645 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.645 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.645 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.645 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.645 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.645 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.645 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.645 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.645 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.645 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.645 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.645 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.646 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.646 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.646 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.646 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.646 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.646 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.646 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.646 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.646 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.647 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.647 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.647 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.647 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.647 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.647 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.647 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.647 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.647 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.647 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.647 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.647 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.647 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.647 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.647 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.648 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.648 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.648 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.648 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.648 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.648 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.648 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.648 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.648 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.648 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.648 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.648 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.648 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.648 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.648 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.648 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.649 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.649 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.649 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.649 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.649 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.649 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.649 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.649 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.649 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.649 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.649 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.649 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.649 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.649 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.650 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.650 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.650 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.650 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.650 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.650 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.650 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.650 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.650 INFO:teuthology.orchestra.run.smithi044.stdout: def test_block_public_policy(): 2023-12-03T12:39:21.650 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:21.650 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.650 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12566: 2023-12-03T12:39:21.650 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.650 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:21.650 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:21.651 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.651 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.651 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.651 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.651 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.651 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.651 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.651 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.651 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.651 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.651 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.651 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.651 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.651 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.651 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.652 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.652 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.652 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.652 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.652 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.652 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.652 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.652 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.652 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.652 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.652 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.652 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.652 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.652 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.652 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.652 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.652 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.653 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.653 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.653 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.653 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.653 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.653 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.653 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.653 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.653 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.653 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.653 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.653 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.653 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.653 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.653 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.653 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.653 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.654 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.654 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.654 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.654 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.654 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.654 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.654 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.654 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.654 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.654 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.654 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.654 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.654 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.654 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.654 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.654 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.655 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.655 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.655 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.655 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.655 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.655 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.655 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.655 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.655 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.655 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.655 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.655 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.655 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.656 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.656 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.656 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.656 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.656 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.656 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-516" 2023-12-03T12:39:21.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.656 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.656 INFO:teuthology.orchestra.run.smithi044.stdout:___________________________ test_ignore_public_acls ____________________________ 2023-12-03T12:39:21.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.656 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.656 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.656 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.657 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.657 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.657 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.657 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.657 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.657 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.657 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.657 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.657 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.657 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.657 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.657 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.657 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.657 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.657 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.657 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.658 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.658 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.658 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.658 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.658 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.658 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.658 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.658 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.658 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.658 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.658 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.658 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.658 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.658 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.658 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.659 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.659 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.659 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.659 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.659 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.659 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.659 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.659 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.659 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.659 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.659 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.659 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.659 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.659 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.659 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.659 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.660 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.660 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.660 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.660 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.660 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.660 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.660 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.660 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.660 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.660 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.660 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.660 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.660 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.660 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.660 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.660 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.661 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.661 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.661 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.661 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.661 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.661 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.661 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.661 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.661 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.661 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.661 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.661 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.661 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.661 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.661 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.661 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.661 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.662 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.662 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.662 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.662 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.662 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.662 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.662 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.662 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.662 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.662 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.662 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.662 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.662 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.662 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.663 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.663 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.663 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.663 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.663 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.663 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.663 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.663 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.663 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.663 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.663 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.663 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.663 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.663 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.663 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.663 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.664 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.664 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.664 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.664 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.664 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.664 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.664 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.664 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.664 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.664 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.664 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.665 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.665 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.665 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.665 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.665 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.665 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.665 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.665 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.665 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.665 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.665 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.665 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.665 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.665 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.665 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.666 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.666 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.666 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.666 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.666 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.666 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.666 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.666 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.666 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.666 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.666 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.666 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.666 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.666 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.666 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.666 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.666 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.667 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.667 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.667 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.667 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.667 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.667 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.667 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.667 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.667 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.667 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.667 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.667 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.667 INFO:teuthology.orchestra.run.smithi044.stdout: def test_ignore_public_acls(): 2023-12-03T12:39:21.668 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:21.668 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.668 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12583: 2023-12-03T12:39:21.668 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.668 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:21.668 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:21.668 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.668 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.668 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.668 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.668 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.668 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.668 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.668 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.668 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.668 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.669 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.669 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.669 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.669 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.669 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.669 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.669 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.669 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.669 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.669 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.669 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.669 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.669 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.669 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.669 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.669 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.669 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.670 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.670 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.670 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.670 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.670 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.670 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.670 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.670 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.670 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.670 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.670 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.670 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.670 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.670 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.671 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.671 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.671 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.671 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.671 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.671 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.671 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.671 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.671 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.671 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.671 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.671 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.671 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.671 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.671 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.671 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.672 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.672 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.672 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.672 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.672 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.672 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.672 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.672 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.672 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.672 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.672 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.672 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.672 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.672 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.672 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.672 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.673 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.673 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.673 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.673 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.673 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.673 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.673 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.673 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.673 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.673 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.673 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.673 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-517" 2023-12-03T12:39:21.673 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.673 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.673 INFO:teuthology.orchestra.run.smithi044.stdout:________________ test_multipart_upload_on_a_bucket_with_policy _________________ 2023-12-03T12:39:21.673 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.673 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.674 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.674 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.674 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.674 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.674 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.674 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.674 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.674 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.674 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.674 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.674 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.675 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.675 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.675 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.675 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.675 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.675 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.675 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.675 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.675 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.675 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.675 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.675 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.675 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.675 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.675 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.675 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.675 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.676 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.676 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.676 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.676 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.676 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.676 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.676 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.676 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.676 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.676 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.676 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.676 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.676 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.676 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.676 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.677 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.677 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.677 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.677 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.677 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.677 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.677 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.677 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.677 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.677 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.677 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.677 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.677 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.677 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.677 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.677 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.677 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.678 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.678 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.678 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.678 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.678 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.678 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.678 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.678 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.678 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.678 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.678 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.678 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.678 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.678 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.678 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.679 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.679 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.679 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.679 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.679 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.679 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.679 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.679 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.679 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.679 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.679 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.679 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.679 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.679 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.679 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.679 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.679 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.680 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.680 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.680 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.680 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.680 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.680 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.680 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.680 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.680 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.680 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.680 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.680 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.680 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.680 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.680 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.680 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.681 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.681 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.681 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.681 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.681 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.681 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.681 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.681 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.681 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.681 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.681 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.681 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.681 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.681 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.681 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.681 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.682 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.682 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.682 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.682 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.682 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.682 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.682 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.682 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.682 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.682 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.682 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.682 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.682 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.682 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.682 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.683 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.683 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.683 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.683 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.683 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.683 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.683 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.683 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.683 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.683 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.683 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.683 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.683 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.683 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.683 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.683 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.683 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.684 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.684 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.684 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.684 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.684 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.684 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.684 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.684 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.684 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.684 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.684 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.684 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.684 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.684 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.684 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.684 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.685 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.685 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.685 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.685 INFO:teuthology.orchestra.run.smithi044.stdout: def test_multipart_upload_on_a_bucket_with_policy(): 2023-12-03T12:39:21.685 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:21.685 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.685 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12610: 2023-12-03T12:39:21.685 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.685 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:21.685 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:21.685 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.685 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.685 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.685 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.685 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.685 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.685 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.686 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.686 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.686 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.686 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.686 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.686 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.686 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.686 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.686 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.687 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.687 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.687 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.687 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.687 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.687 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.687 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.687 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.687 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.687 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.687 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.687 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.687 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.687 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.687 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.687 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.687 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.688 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.688 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.688 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.688 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.688 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.688 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.688 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.688 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.688 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.688 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.688 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.688 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.688 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.688 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.688 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.689 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.689 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.689 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.689 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.689 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.689 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.689 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.689 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.689 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.689 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.689 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.689 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.689 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.690 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.690 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.690 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.690 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.690 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.690 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.690 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.690 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.690 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.690 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.690 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.690 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.690 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.690 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.690 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.691 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.691 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.691 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.691 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.691 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-518" 2023-12-03T12:39:21.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.691 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.691 INFO:teuthology.orchestra.run.smithi044.stdout:________________________ test_put_bucket_encryption_kms ________________________ 2023-12-03T12:39:21.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.691 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.691 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.691 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.692 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.692 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.692 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.692 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.692 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.692 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.692 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.692 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.692 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.692 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.692 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.692 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.693 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.693 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.693 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.693 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.693 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.693 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.693 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.693 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.693 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.693 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.693 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.693 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.693 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.693 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.694 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.694 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.694 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.694 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.694 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.694 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.694 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.694 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.694 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.694 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.694 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.694 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.695 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.695 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.695 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.695 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.695 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.695 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.695 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.695 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.695 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.695 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.695 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.695 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.695 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.695 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.696 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.696 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.696 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.696 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.696 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.696 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.696 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.696 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.696 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.696 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.696 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.696 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.697 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.697 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.697 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.697 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.697 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.697 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.697 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.697 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.697 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.697 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.697 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.697 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.697 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.698 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.698 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.698 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.698 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.698 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.698 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.698 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.698 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.698 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.698 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.698 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.698 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.698 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.699 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.699 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.699 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.699 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.699 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.699 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.699 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.699 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.699 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.699 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.699 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.699 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.699 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.699 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.699 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.700 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.700 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.700 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.700 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.700 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.700 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.700 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.700 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.700 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.700 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.700 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.700 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.700 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.700 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.700 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.701 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.701 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.701 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.701 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.701 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.701 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.701 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.701 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.701 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.701 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.701 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.702 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.702 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.702 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.702 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.702 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.702 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.702 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.702 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.702 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.702 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.702 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.702 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.702 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.702 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.702 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.702 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.703 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.703 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.703 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.703 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.703 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.703 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.703 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.703 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.703 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.703 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.703 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.703 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.703 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:21.703 INFO:teuthology.orchestra.run.smithi044.stdout: def test_put_bucket_encryption_kms(): 2023-12-03T12:39:21.703 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:21.704 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.704 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12679: 2023-12-03T12:39:21.704 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.704 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:21.704 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:21.704 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.704 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.704 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.704 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.704 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.704 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.704 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.704 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.704 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.704 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.704 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.705 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.705 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.705 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.705 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.705 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.705 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.705 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.705 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.705 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.705 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.706 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.706 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.706 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.706 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.706 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.706 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.706 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.706 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.706 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.706 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.706 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.706 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.706 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.706 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.706 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.706 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.707 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.707 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.707 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.707 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.707 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.707 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.707 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.707 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.707 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.707 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.707 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.707 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.707 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.707 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.707 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.707 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.707 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.708 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.708 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.708 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.708 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.708 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.708 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.708 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.708 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.708 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.708 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.708 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.708 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.708 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.708 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.708 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.708 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.709 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.709 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.709 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.709 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.709 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.709 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.709 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.709 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.709 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.709 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-519" 2023-12-03T12:39:21.709 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.709 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.709 INFO:teuthology.orchestra.run.smithi044.stdout:________________________ test_get_bucket_encryption_kms ________________________ 2023-12-03T12:39:21.709 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.709 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.709 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.710 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.710 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.710 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.710 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.710 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.710 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.710 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.710 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.710 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.710 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.710 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.710 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.710 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.710 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.710 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.711 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.711 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.711 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.711 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.711 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.711 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.711 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.711 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.711 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.711 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.711 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.711 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.711 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.711 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.711 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.712 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.712 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.712 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.712 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.712 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.712 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.712 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.712 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.712 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.712 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.712 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.712 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.712 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.713 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.713 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.713 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.713 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.713 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.713 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.713 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.713 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.713 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.713 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.713 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.713 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.713 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.713 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.714 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.714 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.714 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.714 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.714 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.714 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.714 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.714 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.714 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.714 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.714 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.714 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.714 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.714 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.714 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.715 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.715 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.715 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.715 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.715 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.715 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.715 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.715 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.715 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.715 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.715 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.715 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.715 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.715 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.716 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.716 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.716 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.716 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.716 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.716 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.716 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.716 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.716 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.716 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.716 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.716 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.716 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.716 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.716 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.716 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.717 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.717 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.717 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.717 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.717 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.717 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.717 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.717 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.717 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.717 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.717 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.717 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.717 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.717 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.717 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.718 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.718 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.718 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.718 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.718 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.718 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.718 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.718 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.718 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.718 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.718 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.718 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.718 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.718 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.718 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.718 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.718 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.719 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.719 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.719 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.719 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.719 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.719 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.719 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.719 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.719 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.719 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.719 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.719 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.720 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.720 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.720 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.720 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.720 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.720 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.720 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.720 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.720 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.720 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.720 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.720 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.720 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.720 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.720 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.720 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.720 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.721 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.721 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.721 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:21.721 INFO:teuthology.orchestra.run.smithi044.stdout: def test_get_bucket_encryption_kms(): 2023-12-03T12:39:21.721 INFO:teuthology.orchestra.run.smithi044.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:39:21.721 INFO:teuthology.orchestra.run.smithi044.stdout: if kms_keyid is None: 2023-12-03T12:39:21.721 INFO:teuthology.orchestra.run.smithi044.stdout: kms_keyid = 'fool-me-again' 2023-12-03T12:39:21.721 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:21.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.721 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12709: 2023-12-03T12:39:21.721 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.721 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:21.721 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:21.721 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.721 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.722 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.722 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.722 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.722 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.722 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.722 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.722 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.722 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.722 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.723 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.723 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.723 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.723 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.723 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.723 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.723 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.723 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.723 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.723 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.723 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.723 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.723 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.723 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.723 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.723 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.723 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.724 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.724 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.724 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.724 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.724 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.724 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.724 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.724 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.724 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.724 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.724 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.724 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.724 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.724 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.725 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.725 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.725 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.725 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.725 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.725 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.725 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.725 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.725 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.725 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.725 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.725 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.725 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.725 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.725 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.725 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.726 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.726 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.726 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.726 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.726 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.726 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.726 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.726 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.726 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.726 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.726 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.726 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.726 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.726 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.726 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.727 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.727 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.727 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.727 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.727 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-520" 2023-12-03T12:39:21.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.727 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.727 INFO:teuthology.orchestra.run.smithi044.stdout:______________________ test_delete_bucket_encryption_kms _______________________ 2023-12-03T12:39:21.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.727 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.727 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.727 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.727 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.727 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.728 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.728 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.728 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.728 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.728 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.728 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.728 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.728 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.728 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.728 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.728 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.728 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.728 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.728 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.728 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.729 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.729 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.729 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.729 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.729 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.729 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.729 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.729 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.729 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.729 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.729 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.729 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.729 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.729 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.729 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.729 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.730 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.730 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.730 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.730 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.730 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.730 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.730 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.730 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.730 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.730 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.730 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.730 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.730 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.730 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.731 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.731 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.731 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.731 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.731 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.731 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.731 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.731 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.731 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.731 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.731 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.731 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.731 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.731 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.731 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.731 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.731 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.732 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.732 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.732 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.732 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.732 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.732 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.732 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.732 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.732 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.732 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.732 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.732 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.732 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.732 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.732 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.732 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.733 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.733 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.733 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.733 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.733 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.733 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.733 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.733 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.733 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.733 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.733 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.733 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.733 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.733 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.733 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.733 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.734 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.734 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.734 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.734 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.734 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.734 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.734 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.734 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.734 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.734 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.734 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.734 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.734 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.735 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.735 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.735 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.735 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.735 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.735 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.735 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.735 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.735 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.735 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.735 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.735 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.735 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.735 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.735 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.735 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.735 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.736 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.736 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.736 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.736 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.736 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.736 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.736 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.736 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.736 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.736 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.736 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.736 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.736 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.736 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.736 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.736 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.736 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.737 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.737 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.737 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.737 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.737 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.737 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.737 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.737 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.737 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.737 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.737 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.737 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.737 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.738 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.738 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.738 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.738 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.738 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.738 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.738 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.738 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.738 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.738 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.738 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.738 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.739 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.739 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:21.739 INFO:teuthology.orchestra.run.smithi044.stdout: def test_delete_bucket_encryption_kms(): 2023-12-03T12:39:21.739 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:21.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.739 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12752: 2023-12-03T12:39:21.739 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.739 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:21.739 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:21.739 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.739 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.739 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.739 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.739 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.739 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.739 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.740 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.740 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.740 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.740 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.740 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.740 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.740 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.740 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.740 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.740 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.740 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.740 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.740 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.740 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.740 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.740 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.740 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.741 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.741 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.741 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.741 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.741 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.741 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.741 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.741 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.741 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.741 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.741 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.742 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.742 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.742 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.742 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.742 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.742 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.742 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.742 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.742 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.742 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.742 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.742 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.742 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.742 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.742 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.742 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.743 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.743 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.743 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.743 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.743 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.743 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.743 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.743 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.743 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.743 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.743 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.743 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.743 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.743 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.743 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.743 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.744 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.744 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.744 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.744 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.744 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.744 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.744 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.744 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.744 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.744 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.744 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.744 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.744 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.744 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.744 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.745 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-521" 2023-12-03T12:39:21.745 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.745 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.745 INFO:teuthology.orchestra.run.smithi044.stdout:____________ test_sse_kms_default_post_object_authenticated_request ____________ 2023-12-03T12:39:21.745 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.745 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.745 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.745 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.745 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.745 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.745 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.745 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.745 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.745 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.745 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.745 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.745 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.746 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.746 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.746 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.746 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.746 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.746 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.746 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.746 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.746 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.746 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.746 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.746 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.746 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.746 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.747 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.747 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.747 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.747 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.747 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.747 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.747 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.747 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.747 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.747 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.747 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.747 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.747 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.747 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.747 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.748 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.748 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.748 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.748 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.748 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.748 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.748 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.748 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.748 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.748 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.748 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.748 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.748 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.748 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.748 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.748 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.749 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.749 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.749 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.749 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.749 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.749 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.749 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.749 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.749 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.749 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.749 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.749 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.749 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.749 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.749 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.749 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.749 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.750 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.750 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.750 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.750 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.750 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.750 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.750 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.750 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.750 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.750 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.750 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.750 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.750 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.750 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.750 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.750 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.751 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.751 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.751 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.751 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.751 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.751 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.751 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.751 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.751 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.751 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.751 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.751 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.751 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.751 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.751 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.752 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.752 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.752 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.752 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.752 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.752 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.752 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.752 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.752 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.752 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.752 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.752 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.752 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.752 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.752 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.752 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.752 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.753 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.753 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.753 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.753 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.753 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.753 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.753 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.753 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.753 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.753 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.753 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.753 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.753 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.753 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.753 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.754 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.754 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.754 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.754 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.754 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.754 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.754 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.754 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.754 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.754 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.754 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.754 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.754 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.754 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.754 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.755 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.755 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.755 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.755 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.755 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.755 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.755 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.755 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.755 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.755 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.755 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.755 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.755 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.755 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.756 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.756 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.756 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.756 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.756 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.756 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.756 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.756 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.756 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.756 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.757 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.encryption 2023-12-03T12:39:21.757 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.bucket_encryption 2023-12-03T12:39:21.757 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:39:21.757 INFO:teuthology.orchestra.run.smithi044.stdout: def test_sse_kms_default_post_object_authenticated_request(): 2023-12-03T12:39:21.757 INFO:teuthology.orchestra.run.smithi044.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:39:21.757 INFO:teuthology.orchestra.run.smithi044.stdout: if kms_keyid is None: 2023-12-03T12:39:21.757 INFO:teuthology.orchestra.run.smithi044.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-12-03T12:39:21.757 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:21.757 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.757 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:12996: 2023-12-03T12:39:21.757 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.757 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:21.757 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:21.757 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.757 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.757 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.757 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.758 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.758 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.758 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.758 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.758 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.758 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.758 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.758 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.758 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.758 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.758 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.758 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.758 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.758 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.759 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.759 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.759 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.759 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.759 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.759 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.759 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.759 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.759 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.759 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.759 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.759 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.759 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.759 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.759 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.759 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.760 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.760 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.760 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.760 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.760 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.760 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.760 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.760 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.760 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.760 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.760 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.760 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.760 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.760 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.760 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.760 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.760 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.761 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.761 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.761 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.761 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.761 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.761 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.761 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.761 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.761 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.761 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.761 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.761 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.761 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.761 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.761 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.761 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.762 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.762 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.762 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.762 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.762 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.762 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.762 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.762 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.762 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.762 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.762 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.762 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.762 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.763 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.763 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.763 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.763 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.763 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.763 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.763 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-522" 2023-12-03T12:39:21.763 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.763 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.763 INFO:teuthology.orchestra.run.smithi044.stdout:___________________________ test_get_object_torrent ____________________________ 2023-12-03T12:39:21.763 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.763 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.763 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.763 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.763 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.763 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.764 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.764 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.764 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.764 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.764 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.764 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.764 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.764 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.764 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.764 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.764 INFO:teuthology.orchestra.run.smithi044.stdout:> conn = connection.create_connection( 2023-12-03T12:39:21.764 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.764 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.764 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:39:21.765 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.765 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:39:21.765 INFO:teuthology.orchestra.run.smithi044.stdout: raise err 2023-12-03T12:39:21.765 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.765 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.765 INFO:teuthology.orchestra.run.smithi044.stdout:address = ('smithi044.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:39:21.765 INFO:teuthology.orchestra.run.smithi044.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:39:21.765 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.765 INFO:teuthology.orchestra.run.smithi044.stdout: def create_connection( 2023-12-03T12:39:21.765 INFO:teuthology.orchestra.run.smithi044.stdout: address, 2023-12-03T12:39:21.765 INFO:teuthology.orchestra.run.smithi044.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:39:21.765 INFO:teuthology.orchestra.run.smithi044.stdout: source_address=None, 2023-12-03T12:39:21.765 INFO:teuthology.orchestra.run.smithi044.stdout: socket_options=None, 2023-12-03T12:39:21.765 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.765 INFO:teuthology.orchestra.run.smithi044.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:39:21.766 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.766 INFO:teuthology.orchestra.run.smithi044.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:39:21.766 INFO:teuthology.orchestra.run.smithi044.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:39:21.766 INFO:teuthology.orchestra.run.smithi044.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:39:21.766 INFO:teuthology.orchestra.run.smithi044.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:39:21.766 INFO:teuthology.orchestra.run.smithi044.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:39:21.766 INFO:teuthology.orchestra.run.smithi044.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:39:21.766 INFO:teuthology.orchestra.run.smithi044.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:39:21.766 INFO:teuthology.orchestra.run.smithi044.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:39:21.766 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.766 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.766 INFO:teuthology.orchestra.run.smithi044.stdout: host, port = address 2023-12-03T12:39:21.766 INFO:teuthology.orchestra.run.smithi044.stdout: if host.startswith("["): 2023-12-03T12:39:21.766 INFO:teuthology.orchestra.run.smithi044.stdout: host = host.strip("[]") 2023-12-03T12:39:21.767 INFO:teuthology.orchestra.run.smithi044.stdout: err = None 2023-12-03T12:39:21.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.767 INFO:teuthology.orchestra.run.smithi044.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:39:21.767 INFO:teuthology.orchestra.run.smithi044.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:39:21.767 INFO:teuthology.orchestra.run.smithi044.stdout: # The original create_connection function always returns all records. 2023-12-03T12:39:21.767 INFO:teuthology.orchestra.run.smithi044.stdout: family = allowed_gai_family() 2023-12-03T12:39:21.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.767 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.767 INFO:teuthology.orchestra.run.smithi044.stdout: host.encode("idna") 2023-12-03T12:39:21.767 INFO:teuthology.orchestra.run.smithi044.stdout: except UnicodeError: 2023-12-03T12:39:21.767 INFO:teuthology.orchestra.run.smithi044.stdout: return six.raise_from( 2023-12-03T12:39:21.767 INFO:teuthology.orchestra.run.smithi044.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:39:21.767 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.768 INFO:teuthology.orchestra.run.smithi044.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:39:21.768 INFO:teuthology.orchestra.run.smithi044.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:39:21.768 INFO:teuthology.orchestra.run.smithi044.stdout: sock = None 2023-12-03T12:39:21.768 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.768 INFO:teuthology.orchestra.run.smithi044.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:39:21.768 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.768 INFO:teuthology.orchestra.run.smithi044.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:39:21.768 INFO:teuthology.orchestra.run.smithi044.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:39:21.768 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.768 INFO:teuthology.orchestra.run.smithi044.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:39:21.768 INFO:teuthology.orchestra.run.smithi044.stdout: sock.settimeout(timeout) 2023-12-03T12:39:21.768 INFO:teuthology.orchestra.run.smithi044.stdout: if source_address: 2023-12-03T12:39:21.768 INFO:teuthology.orchestra.run.smithi044.stdout: sock.bind(source_address) 2023-12-03T12:39:21.768 INFO:teuthology.orchestra.run.smithi044.stdout:> sock.connect(sa) 2023-12-03T12:39:21.768 INFO:teuthology.orchestra.run.smithi044.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:39:21.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.769 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:39:21.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.769 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.769 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.769 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.769 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.769 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.769 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.769 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.769 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.769 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.769 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.770 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.770 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.770 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.770 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.770 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.770 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.770 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.770 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.770 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.770 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.770 INFO:teuthology.orchestra.run.smithi044.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:39:21.770 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.770 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.770 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.771 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.771 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.771 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.771 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.771 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.771 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.771 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.771 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.771 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:39:21.771 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.771 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:39:21.771 INFO:teuthology.orchestra.run.smithi044.stdout: retries = retries.increment( 2023-12-03T12:39:21.771 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:39:21.771 INFO:teuthology.orchestra.run.smithi044.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:39:21.771 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:39:21.772 INFO:teuthology.orchestra.run.smithi044.stdout: raise value 2023-12-03T12:39:21.772 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:39:21.772 INFO:teuthology.orchestra.run.smithi044.stdout: httplib_response = self._make_request( 2023-12-03T12:39:21.772 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:39:21.772 INFO:teuthology.orchestra.run.smithi044.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:39:21.772 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:39:21.772 INFO:teuthology.orchestra.run.smithi044.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:39:21.772 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:39:21.772 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:39:21.772 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:39:21.772 INFO:teuthology.orchestra.run.smithi044.stdout: rval = super()._send_request( 2023-12-03T12:39:21.772 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:39:21.772 INFO:teuthology.orchestra.run.smithi044.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.772 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:39:21.773 INFO:teuthology.orchestra.run.smithi044.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:39:21.773 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:39:21.773 INFO:teuthology.orchestra.run.smithi044.stdout: self.send(msg) 2023-12-03T12:39:21.773 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:39:21.773 INFO:teuthology.orchestra.run.smithi044.stdout: return super().send(str) 2023-12-03T12:39:21.773 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:39:21.773 INFO:teuthology.orchestra.run.smithi044.stdout: self.connect() 2023-12-03T12:39:21.773 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:39:21.773 INFO:teuthology.orchestra.run.smithi044.stdout: conn = self._new_conn() 2023-12-03T12:39:21.773 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.773 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.773 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.773 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.773 INFO:teuthology.orchestra.run.smithi044.stdout: def _new_conn(self): 2023-12-03T12:39:21.773 INFO:teuthology.orchestra.run.smithi044.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:39:21.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.774 INFO:teuthology.orchestra.run.smithi044.stdout: :return: New socket connection. 2023-12-03T12:39:21.774 INFO:teuthology.orchestra.run.smithi044.stdout: """ 2023-12-03T12:39:21.774 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw = {} 2023-12-03T12:39:21.774 INFO:teuthology.orchestra.run.smithi044.stdout: if self.source_address: 2023-12-03T12:39:21.774 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:39:21.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.774 INFO:teuthology.orchestra.run.smithi044.stdout: if self.socket_options: 2023-12-03T12:39:21.774 INFO:teuthology.orchestra.run.smithi044.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:39:21.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.774 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.774 INFO:teuthology.orchestra.run.smithi044.stdout: conn = connection.create_connection( 2023-12-03T12:39:21.774 INFO:teuthology.orchestra.run.smithi044.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:39:21.774 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.775 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketTimeout: 2023-12-03T12:39:21.775 INFO:teuthology.orchestra.run.smithi044.stdout: raise ConnectTimeoutError( 2023-12-03T12:39:21.775 INFO:teuthology.orchestra.run.smithi044.stdout: self, 2023-12-03T12:39:21.775 INFO:teuthology.orchestra.run.smithi044.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:39:21.775 INFO:teuthology.orchestra.run.smithi044.stdout: % (self.host, self.timeout), 2023-12-03T12:39:21.775 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.775 INFO:teuthology.orchestra.run.smithi044.stdout: except SocketError as e: 2023-12-03T12:39:21.775 INFO:teuthology.orchestra.run.smithi044.stdout:> raise NewConnectionError( 2023-12-03T12:39:21.775 INFO:teuthology.orchestra.run.smithi044.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:39:21.775 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.775 INFO:teuthology.orchestra.run.smithi044.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:39:21.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.775 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:39:21.775 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.776 INFO:teuthology.orchestra.run.smithi044.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:39:21.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.776 INFO:teuthology.orchestra.run.smithi044.stdout: def test_get_object_torrent(): 2023-12-03T12:39:21.776 INFO:teuthology.orchestra.run.smithi044.stdout: client = get_client() 2023-12-03T12:39:21.776 INFO:teuthology.orchestra.run.smithi044.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:39:21.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.776 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:13081: 2023-12-03T12:39:21.776 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.776 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:39:21.776 INFO:teuthology.orchestra.run.smithi044.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:39:21.776 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:39:21.776 INFO:teuthology.orchestra.run.smithi044.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:39:21.776 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:39:21.776 INFO:teuthology.orchestra.run.smithi044.stdout: http, parsed_response = self._make_request( 2023-12-03T12:39:21.776 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:39:21.777 INFO:teuthology.orchestra.run.smithi044.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:39:21.777 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:39:21.777 INFO:teuthology.orchestra.run.smithi044.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:39:21.777 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:39:21.777 INFO:teuthology.orchestra.run.smithi044.stdout: while self._needs_retry( 2023-12-03T12:39:21.777 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:39:21.777 INFO:teuthology.orchestra.run.smithi044.stdout: responses = self._event_emitter.emit( 2023-12-03T12:39:21.777 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:39:21.777 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:39:21.777 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:39:21.777 INFO:teuthology.orchestra.run.smithi044.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:39:21.777 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:39:21.777 INFO:teuthology.orchestra.run.smithi044.stdout: response = handler(**kwargs) 2023-12-03T12:39:21.777 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:39:21.777 INFO:teuthology.orchestra.run.smithi044.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:39:21.777 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:39:21.778 INFO:teuthology.orchestra.run.smithi044.stdout: should_retry = self._should_retry( 2023-12-03T12:39:21.778 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:39:21.778 INFO:teuthology.orchestra.run.smithi044.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:39:21.778 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:39:21.778 INFO:teuthology.orchestra.run.smithi044.stdout: checker_response = checker( 2023-12-03T12:39:21.778 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:39:21.778 INFO:teuthology.orchestra.run.smithi044.stdout: return self._check_caught_exception( 2023-12-03T12:39:21.778 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:39:21.778 INFO:teuthology.orchestra.run.smithi044.stdout: raise caught_exception 2023-12-03T12:39:21.778 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:39:21.778 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = self._send(request) 2023-12-03T12:39:21.778 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:39:21.778 INFO:teuthology.orchestra.run.smithi044.stdout: return self.http_session.send(request) 2023-12-03T12:39:21.778 INFO:teuthology.orchestra.run.smithi044.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:39:21.779 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.779 INFO:teuthology.orchestra.run.smithi044.stdout:self = 2023-12-03T12:39:21.779 INFO:teuthology.orchestra.run.smithi044.stdout:request = 2023-12-03T12:39:21.779 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.779 INFO:teuthology.orchestra.run.smithi044.stdout: def send(self, request): 2023-12-03T12:39:21.779 INFO:teuthology.orchestra.run.smithi044.stdout: try: 2023-12-03T12:39:21.779 INFO:teuthology.orchestra.run.smithi044.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:39:21.779 INFO:teuthology.orchestra.run.smithi044.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:39:21.779 INFO:teuthology.orchestra.run.smithi044.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:39:21.779 INFO:teuthology.orchestra.run.smithi044.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:39:21.779 INFO:teuthology.orchestra.run.smithi044.stdout: if ensure_boolean( 2023-12-03T12:39:21.779 INFO:teuthology.orchestra.run.smithi044.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:39:21.779 INFO:teuthology.orchestra.run.smithi044.stdout: ): 2023-12-03T12:39:21.779 INFO:teuthology.orchestra.run.smithi044.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:39:21.780 INFO:teuthology.orchestra.run.smithi044.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:39:21.780 INFO:teuthology.orchestra.run.smithi044.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:39:21.780 INFO:teuthology.orchestra.run.smithi044.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:39:21.780 INFO:teuthology.orchestra.run.smithi044.stdout: host = urlparse(request.url).hostname 2023-12-03T12:39:21.780 INFO:teuthology.orchestra.run.smithi044.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:39:21.780 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.780 INFO:teuthology.orchestra.run.smithi044.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:39:21.780 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response = conn.urlopen( 2023-12-03T12:39:21.780 INFO:teuthology.orchestra.run.smithi044.stdout: method=request.method, 2023-12-03T12:39:21.780 INFO:teuthology.orchestra.run.smithi044.stdout: url=request_target, 2023-12-03T12:39:21.780 INFO:teuthology.orchestra.run.smithi044.stdout: body=request.body, 2023-12-03T12:39:21.780 INFO:teuthology.orchestra.run.smithi044.stdout: headers=request.headers, 2023-12-03T12:39:21.780 INFO:teuthology.orchestra.run.smithi044.stdout: retries=Retry(False), 2023-12-03T12:39:21.780 INFO:teuthology.orchestra.run.smithi044.stdout: assert_same_host=False, 2023-12-03T12:39:21.780 INFO:teuthology.orchestra.run.smithi044.stdout: preload_content=False, 2023-12-03T12:39:21.781 INFO:teuthology.orchestra.run.smithi044.stdout: decode_content=False, 2023-12-03T12:39:21.781 INFO:teuthology.orchestra.run.smithi044.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:39:21.781 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.781 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.781 INFO:teuthology.orchestra.run.smithi044.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:39:21.781 INFO:teuthology.orchestra.run.smithi044.stdout: request.url, 2023-12-03T12:39:21.781 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.status, 2023-12-03T12:39:21.781 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response.headers, 2023-12-03T12:39:21.781 INFO:teuthology.orchestra.run.smithi044.stdout: urllib_response, 2023-12-03T12:39:21.781 INFO:teuthology.orchestra.run.smithi044.stdout: ) 2023-12-03T12:39:21.781 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.781 INFO:teuthology.orchestra.run.smithi044.stdout: if not request.stream_output: 2023-12-03T12:39:21.781 INFO:teuthology.orchestra.run.smithi044.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:39:21.781 INFO:teuthology.orchestra.run.smithi044.stdout: # this way instead of using preload_content because 2023-12-03T12:39:21.782 INFO:teuthology.orchestra.run.smithi044.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:39:21.782 INFO:teuthology.orchestra.run.smithi044.stdout: http_response.content 2023-12-03T12:39:21.782 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.782 INFO:teuthology.orchestra.run.smithi044.stdout: return http_response 2023-12-03T12:39:21.782 INFO:teuthology.orchestra.run.smithi044.stdout: except URLLib3SSLError as e: 2023-12-03T12:39:21.782 INFO:teuthology.orchestra.run.smithi044.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.782 INFO:teuthology.orchestra.run.smithi044.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:39:21.782 INFO:teuthology.orchestra.run.smithi044.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:39:21.782 INFO:teuthology.orchestra.run.smithi044.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi044.front.sepia.ceph.com:80/test-client.0-irwvb0vnnx30pi1-523" 2023-12-03T12:39:21.782 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.782 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:39:21.782 INFO:teuthology.orchestra.run.smithi044.stdout:=============================== warnings summary =============================== 2023-12-03T12:39:21.782 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2023-12-03T12:39:21.782 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2023-12-03T12:39:21.783 INFO:teuthology.orchestra.run.smithi044.stdout: import imp 2023-12-03T12:39:21.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.783 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py:124 2023-12-03T12:39:21.783 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2023-12-03T12:39:21.783 INFO:teuthology.orchestra.run.smithi044.stdout: if boto_type is 'S3Connection': 2023-12-03T12:39:21.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.783 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py:129 2023-12-03T12:39:21.783 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:129: SyntaxWarning: "is" with a literal. Did you mean "=="? 2023-12-03T12:39:21.783 INFO:teuthology.orchestra.run.smithi044.stdout: elif boto_type is 'HTTPRequest': 2023-12-03T12:39:21.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.783 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py:359 2023-12-03T12:39:21.783 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2023-12-03T12:39:21.783 INFO:teuthology.orchestra.run.smithi044.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2023-12-03T12:39:21.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.783 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py:176 2023-12-03T12:39:21.784 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2023-12-03T12:39:21.784 INFO:teuthology.orchestra.run.smithi044.stdout: if k is 'BucketName': 2023-12-03T12:39:21.784 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.784 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py:253 2023-12-03T12:39:21.784 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2023-12-03T12:39:21.784 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.timeout(10) 2023-12-03T12:39:21.784 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.784 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py:1077 2023-12-03T12:39:21.784 INFO:teuthology.orchestra.run.smithi044.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2023-12-03T12:39:21.784 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.s3website_routing_rules 2023-12-03T12:39:21.784 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.784 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:2212 2023-12-03T12:39:21.784 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2212: DeprecationWarning: invalid escape sequence \$ 2023-12-03T12:39:21.784 INFO:teuthology.orchestra.run.smithi044.stdout: ["starts-with", "$key", "\$foo"],\ 2023-12-03T12:39:21.784 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.785 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:2227 2023-12-03T12:39:21.785 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2227: DeprecationWarning: invalid escape sequence \$ 2023-12-03T12:39:21.785 INFO:teuthology.orchestra.run.smithi044.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2023-12-03T12:39:21.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.785 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:2233 2023-12-03T12:39:21.785 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2233: DeprecationWarning: invalid escape sequence \$ 2023-12-03T12:39:21.785 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2023-12-03T12:39:21.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.785 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:2290 2023-12-03T12:39:21.785 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2290: DeprecationWarning: invalid escape sequence \$ 2023-12-03T12:39:21.785 INFO:teuthology.orchestra.run.smithi044.stdout: ["starts-with", "$key", "\$foo"],\ 2023-12-03T12:39:21.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.785 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:2305 2023-12-03T12:39:21.785 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2305: DeprecationWarning: invalid escape sequence \$ 2023-12-03T12:39:21.785 INFO:teuthology.orchestra.run.smithi044.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2023-12-03T12:39:21.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.786 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:2323 2023-12-03T12:39:21.786 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2323: DeprecationWarning: invalid escape sequence \$ 2023-12-03T12:39:21.786 INFO:teuthology.orchestra.run.smithi044.stdout: ["starts-with", "$key", "\$foo"],\ 2023-12-03T12:39:21.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.786 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:2338 2023-12-03T12:39:21.786 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2338: DeprecationWarning: invalid escape sequence \$ 2023-12-03T12:39:21.786 INFO:teuthology.orchestra.run.smithi044.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2023-12-03T12:39:21.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.786 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:2356 2023-12-03T12:39:21.786 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2356: DeprecationWarning: invalid escape sequence \$ 2023-12-03T12:39:21.786 INFO:teuthology.orchestra.run.smithi044.stdout: ["starts-with", "$key", "\$foo"],\ 2023-12-03T12:39:21.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.786 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:2371 2023-12-03T12:39:21.786 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2371: DeprecationWarning: invalid escape sequence \$ 2023-12-03T12:39:21.787 INFO:teuthology.orchestra.run.smithi044.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2023-12-03T12:39:21.787 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.787 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:2421 2023-12-03T12:39:21.787 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2421: DeprecationWarning: invalid escape sequence \$ 2023-12-03T12:39:21.787 INFO:teuthology.orchestra.run.smithi044.stdout: ["starts-with", "$key", "\$foo"],\ 2023-12-03T12:39:21.787 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.787 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:2453 2023-12-03T12:39:21.787 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2453: DeprecationWarning: invalid escape sequence \$ 2023-12-03T12:39:21.787 INFO:teuthology.orchestra.run.smithi044.stdout: ["starts-with", "$key", "\$foo"],\ 2023-12-03T12:39:21.787 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-12-03T12:39:21.787 INFO:teuthology.orchestra.run.smithi044.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2023-12-03T12:39:21.787 INFO:teuthology.orchestra.run.smithi044.stdout:=========================== short test summary info ============================ 2023-12-03T12:39:21.787 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty - bot... 2023-12-03T12:39:21.788 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_small - bot... 2023-12-03T12:39:21.788 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_copy_small - botoc... 2023-12-03T12:39:21.788 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range 2023-12-03T12:39:21.788 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range 2023-12-03T12:39:21.788 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names 2023-12-03T12:39:21.788 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload - botocore.... 2023-12-03T12:39:21.788 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned - b... 2023-12-03T12:39:21.788 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part 2023-12-03T12:39:21.788 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes 2023-12-03T12:39:21.788 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes 2023-12-03T12:39:21.788 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small 2023-12-03T12:39:21.788 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents - ... 2023-12-03T12:39:21.788 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object 2023-12-03T12:39:21.788 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload - bot... 2023-12-03T12:39:21.789 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found 2023-12-03T12:39:21.789 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_list_multipart_upload - boto... 2023-12-03T12:39:21.789 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner 2023-12-03T12:39:21.789 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part 2023-12-03T12:39:21.789 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag 2023-12-03T12:39:21.789 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_get_part - botocor... 2023-12-03T12:39:21.789 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part - bot... 2023-12-03T12:39:21.789 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_100_continue - botocore.exce... 2023-12-03T12:39:21.789 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_set_cors - botocore.exceptio... 2023-12-03T12:39:21.789 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_cors_origin_response - botoc... 2023-12-03T12:39:21.789 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard - botoc... 2023-12-03T12:39:21.789 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_cors_header_option - botocor... 2023-12-03T12:39:21.790 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object - ... 2023-12-03T12:39:21.790 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant 2023-12-03T12:39:21.790 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging - botocor... 2023-12-03T12:39:21.790 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb - botocore.e... 2023-12-03T12:39:21.790 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb - botocore.e... 2023-12-03T12:39:21.790 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb - botocore.e... 2023-12-03T12:39:21.790 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb - botocore.... 2023-12-03T12:39:21.790 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb - botocore.... 2023-12-03T12:39:21.790 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb - botocore.... 2023-12-03T12:39:21.790 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb - boto... 2023-12-03T12:39:21.790 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb - boto... 2023-12-03T12:39:21.790 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb - boto... 2023-12-03T12:39:21.790 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb 2023-12-03T12:39:21.790 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write 2023-12-03T12:39:21.790 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last 2023-12-03T12:39:21.791 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code 2023-12-03T12:39:21.791 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code 2023-12-03T12:39:21.791 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code 2023-12-03T12:39:21.791 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code 2023-12-03T12:39:21.791 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range 2023-12-03T12:39:21.791 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object 2023-12-03T12:39:21.791 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend 2023-12-03T12:39:21.791 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove 2023-12-03T12:39:21.791 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head 2023-12-03T12:39:21.791 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal 2023-12-03T12:39:21.791 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite 2023-12-03T12:39:21.791 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended 2023-12-03T12:39:21.791 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions 2023-12-03T12:39:21.791 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all 2023-12-03T12:39:21.792 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names 2023-12-03T12:39:21.792 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart 2023-12-03T12:39:21.792 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker 2023-12-03T12:39:21.792 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version 2023-12-03T12:39:21.792 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete 2023-12-03T12:39:21.792 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker 2023-12-03T12:39:21.792 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create 2023-12-03T12:39:21.792 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioned_object_acl - botoc... 2023-12-03T12:39:21.792 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified 2023-12-03T12:39:21.792 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove 2023-12-03T12:39:21.792 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set - botocore.exc... 2023-12-03T12:39:21.792 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_get - botocore.exc... 2023-12-03T12:39:21.792 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id - botoco... 2023-12-03T12:39:21.792 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long - boto... 2023-12-03T12:39:21.793 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id - botocore... 2023-12-03T12:39:21.793 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status - b... 2023-12-03T12:39:21.793 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date - botocor... 2023-12-03T12:39:21.793 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date 2023-12-03T12:39:21.793 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent - b... 2023-12-03T12:39:21.793 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker 2023-12-03T12:39:21.793 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter - botoc... 2023-12-03T12:39:21.793 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter 2023-12-03T12:39:21.793 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart - bo... 2023-12-03T12:39:21.793 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date 2023-12-03T12:39:21.793 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b - boto... 2023-12-03T12:39:21.793 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb - bot... 2023-12-03T12:39:21.793 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB - bot... 2023-12-03T12:39:21.793 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b - bot... 2023-12-03T12:39:21.793 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head 2023-12-03T12:39:21.794 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present - b... 2023-12-03T12:39:21.794 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key 2023-12-03T12:39:21.794 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 2023-12-03T12:39:21.794 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 - bo... 2023-12-03T12:39:21.794 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key - bo... 2023-12-03T12:39:21.794 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c - bo... 2023-12-03T12:39:21.794 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload 2023-12-03T12:39:21.794 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload 2023-12-03T12:39:21.794 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download 2023-12-03T12:39:21.794 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request 2023-12-03T12:39:21.794 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head - botoco... 2023-12-03T12:39:21.794 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_present - botocore.e... 2023-12-03T12:39:21.794 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key - botocore.ex... 2023-12-03T12:39:21.794 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared - botoc... 2023-12-03T12:39:21.795 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload - b... 2023-12-03T12:39:21.795 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 2023-12-03T12:39:21.795 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 2023-12-03T12:39:21.795 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request 2023-12-03T12:39:21.795 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b - botoco... 2023-12-03T12:39:21.795 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb - botoc... 2023-12-03T12:39:21.795 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB - botoc... 2023-12-03T12:39:21.795 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b - botoc... 2023-12-03T12:39:21.795 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare - botoc... 2023-12-03T12:39:21.795 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy - botocore.exc... 2023-12-03T12:39:21.795 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucketv2_policy - botocore.e... 2023-12-03T12:39:21.795 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl - botocore... 2023-12-03T12:39:21.795 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl - botoco... 2023-12-03T12:39:21.795 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket 2023-12-03T12:39:21.795 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket 2023-12-03T12:39:21.796 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_obj_tagging - botocore.e... 2023-12-03T12:39:21.796 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging - botoc... 2023-12-03T12:39:21.796 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_max_tags - botocore.exce... 2023-12-03T12:39:21.796 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_excess_tags - botocore.e... 2023-12-03T12:39:21.796 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags - botoco... 2023-12-03T12:39:21.796 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags - botoco... 2023-12-03T12:39:21.796 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags - botoco... 2023-12-03T12:39:21.796 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_modify_tags - botocore.e... 2023-12-03T12:39:21.796 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_delete_tags - botocore.e... 2023-12-03T12:39:21.796 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request 2023-12-03T12:39:21.796 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request 2023-12-03T12:39:21.796 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags - botocore... 2023-12-03T12:39:21.796 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public - botoco... 2023-12-03T12:39:21.796 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public - botoco... 2023-12-03T12:39:21.797 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public - bot... 2023-12-03T12:39:21.797 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id 2023-12-03T12:39:21.797 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id 2023-12-03T12:39:21.797 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag 2023-12-03T12:39:21.797 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag 2023-12-03T12:39:21.797 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag 2023-12-03T12:39:21.797 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source 2023-12-03T12:39:21.797 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta 2023-12-03T12:39:21.797 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl - ... 2023-12-03T12:39:21.797 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant 2023-12-03T12:39:21.797 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 - ... 2023-12-03T12:39:21.797 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms 2023-12-03T12:39:21.797 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms 2023-12-03T12:39:21.797 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms 2023-12-03T12:39:21.797 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc 2023-12-03T12:39:21.798 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 2023-12-03T12:39:21.798 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag 2023-12-03T12:39:21.798 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock - b... 2023-12-03T12:39:21.798 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket 2023-12-03T12:39:21.798 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years 2023-12-03T12:39:21.798 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days 2023-12-03T12:39:21.798 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years 2023-12-03T12:39:21.798 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode 2023-12-03T12:39:21.798 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status 2023-12-03T12:39:21.798 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning 2023-12-03T12:39:21.798 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock - b... 2023-12-03T12:39:21.798 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket 2023-12-03T12:39:21.798 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention 2023-12-03T12:39:21.798 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket 2023-12-03T12:39:21.799 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode 2023-12-03T12:39:21.799 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention 2023-12-03T12:39:21.799 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 2023-12-03T12:39:21.799 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket 2023-12-03T12:39:21.799 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid 2023-12-03T12:39:21.799 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention 2023-12-03T12:39:21.799 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period 2023-12-03T12:39:21.799 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period 2023-12-03T12:39:21.799 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass 2023-12-03T12:39:21.799 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention 2023-12-03T12:39:21.799 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker 2023-12-03T12:39:21.799 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention 2023-12-03T12:39:21.799 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold 2023-12-03T12:39:21.799 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket 2023-12-03T12:39:21.799 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status 2023-12-03T12:39:21.800 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold 2023-12-03T12:39:21.800 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket 2023-12-03T12:39:21.800 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on 2023-12-03T12:39:21.800 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off 2023-12-03T12:39:21.800 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata 2023-12-03T12:39:21.800 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj - ... 2023-12-03T12:39:21.800 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass 2023-12-03T12:39:21.800 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass 2023-12-03T12:39:21.800 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance 2023-12-03T12:39:21.800 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good - b... 2023-12-03T12:39:21.800 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed 2023-12-03T12:39:21.800 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status - b... 2023-12-03T12:39:21.800 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status 2023-12-03T12:39:21.800 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status 2023-12-03T12:39:21.800 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status 2023-12-03T12:39:21.800 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status 2023-12-03T12:39:21.801 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status 2023-12-03T12:39:21.801 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_default_public_block - b... 2023-12-03T12:39:21.801 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_public_block - botocore.... 2023-12-03T12:39:21.801 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls 2023-12-03T12:39:21.801 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls 2023-12-03T12:39:21.801 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_block_public_policy - botoco... 2023-12-03T12:39:21.801 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ignore_public_acls - botocor... 2023-12-03T12:39:21.801 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy 2023-12-03T12:39:21.801 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms - ... 2023-12-03T12:39:21.801 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms - ... 2023-12-03T12:39:21.801 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms 2023-12-03T12:39:21.801 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request 2023-12-03T12:39:21.801 INFO:teuthology.orchestra.run.smithi044.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_object_torrent - botocor... 2023-12-03T12:39:21.801 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty - boto... 2023-12-03T12:39:21.801 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_small - boto... 2023-12-03T12:39:21.802 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_small - botoco... 2023-12-03T12:39:21.802 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range 2023-12-03T12:39:21.802 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range 2023-12-03T12:39:21.802 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names 2023-12-03T12:39:21.802 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload - botocore.e... 2023-12-03T12:39:21.802 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned - bo... 2023-12-03T12:39:21.802 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part 2023-12-03T12:39:21.802 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes 2023-12-03T12:39:21.802 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes 2023-12-03T12:39:21.802 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small 2023-12-03T12:39:21.802 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents - b... 2023-12-03T12:39:21.802 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object 2023-12-03T12:39:21.802 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload - boto... 2023-12-03T12:39:21.803 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found 2023-12-03T12:39:21.803 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_list_multipart_upload - botoc... 2023-12-03T12:39:21.803 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner 2023-12-03T12:39:21.803 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part 2023-12-03T12:39:21.803 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag 2023-12-03T12:39:21.803 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_get_part - botocore... 2023-12-03T12:39:21.803 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part - boto... 2023-12-03T12:39:21.803 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_100_continue - botocore.excep... 2023-12-03T12:39:21.803 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_set_cors - botocore.exception... 2023-12-03T12:39:21.803 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_origin_response - botoco... 2023-12-03T12:39:21.803 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard - botoco... 2023-12-03T12:39:21.803 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_header_option - botocore... 2023-12-03T12:39:21.803 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object - b... 2023-12-03T12:39:21.803 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant 2023-12-03T12:39:21.804 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging - botocore... 2023-12-03T12:39:21.804 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb - botocore.ex... 2023-12-03T12:39:21.804 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb - botocore.ex... 2023-12-03T12:39:21.804 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb - botocore.ex... 2023-12-03T12:39:21.804 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb - botocore.e... 2023-12-03T12:39:21.804 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb - botocore.e... 2023-12-03T12:39:21.804 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb - botocore.e... 2023-12-03T12:39:21.804 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb - botoc... 2023-12-03T12:39:21.804 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb - botoc... 2023-12-03T12:39:21.804 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb - botoc... 2023-12-03T12:39:21.804 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb 2023-12-03T12:39:21.804 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write 2023-12-03T12:39:21.804 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last 2023-12-03T12:39:21.804 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code 2023-12-03T12:39:21.804 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code 2023-12-03T12:39:21.805 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code 2023-12-03T12:39:21.805 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code 2023-12-03T12:39:21.805 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range 2023-12-03T12:39:21.805 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object 2023-12-03T12:39:21.805 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend 2023-12-03T12:39:21.805 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove 2023-12-03T12:39:21.805 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head 2023-12-03T12:39:21.805 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal 2023-12-03T12:39:21.805 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite 2023-12-03T12:39:21.805 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended 2023-12-03T12:39:21.805 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions 2023-12-03T12:39:21.805 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all 2023-12-03T12:39:21.805 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names 2023-12-03T12:39:21.805 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart 2023-12-03T12:39:21.806 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker - ... 2023-12-03T12:39:21.806 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version 2023-12-03T12:39:21.806 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete 2023-12-03T12:39:21.806 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker 2023-12-03T12:39:21.806 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create 2023-12-03T12:39:21.806 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioned_object_acl - botoco... 2023-12-03T12:39:21.806 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified 2023-12-03T12:39:21.806 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove 2023-12-03T12:39:21.806 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set - botocore.exce... 2023-12-03T12:39:21.806 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_get - botocore.exce... 2023-12-03T12:39:21.806 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id - botocor... 2023-12-03T12:39:21.806 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long - botoc... 2023-12-03T12:39:21.806 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id - botocore.... 2023-12-03T12:39:21.806 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status - bo... 2023-12-03T12:39:21.806 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date - botocore... 2023-12-03T12:39:21.806 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date - ... 2023-12-03T12:39:21.807 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent - bo... 2023-12-03T12:39:21.807 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker - ... 2023-12-03T12:39:21.807 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter - botoco... 2023-12-03T12:39:21.807 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter - ... 2023-12-03T12:39:21.807 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart - bot... 2023-12-03T12:39:21.807 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date 2023-12-03T12:39:21.807 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b - botoc... 2023-12-03T12:39:21.807 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb - boto... 2023-12-03T12:39:21.807 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB - boto... 2023-12-03T12:39:21.807 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b - boto... 2023-12-03T12:39:21.807 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head 2023-12-03T12:39:21.807 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present - bo... 2023-12-03T12:39:21.807 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key - ... 2023-12-03T12:39:21.807 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 2023-12-03T12:39:21.808 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 - bot... 2023-12-03T12:39:21.808 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key - bot... 2023-12-03T12:39:21.808 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c - bot... 2023-12-03T12:39:21.808 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload 2023-12-03T12:39:21.808 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload 2023-12-03T12:39:21.808 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download 2023-12-03T12:39:21.808 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request 2023-12-03T12:39:21.808 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head - botocor... 2023-12-03T12:39:21.808 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_present - botocore.ex... 2023-12-03T12:39:21.808 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key - botocore.exc... 2023-12-03T12:39:21.808 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared - botoco... 2023-12-03T12:39:21.808 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload - bo... 2023-12-03T12:39:21.808 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 2023-12-03T12:39:21.808 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 2023-12-03T12:39:21.809 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request 2023-12-03T12:39:21.809 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b - botocor... 2023-12-03T12:39:21.809 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb - botoco... 2023-12-03T12:39:21.809 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB - botoco... 2023-12-03T12:39:21.809 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b - botoco... 2023-12-03T12:39:21.809 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare - botoco... 2023-12-03T12:39:21.809 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy - botocore.exce... 2023-12-03T12:39:21.809 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucketv2_policy - botocore.ex... 2023-12-03T12:39:21.809 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl - botocore.... 2023-12-03T12:39:21.809 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl - botocor... 2023-12-03T12:39:21.809 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket 2023-12-03T12:39:21.809 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket 2023-12-03T12:39:21.809 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_obj_tagging - botocore.ex... 2023-12-03T12:39:21.809 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging - botoco... 2023-12-03T12:39:21.809 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_max_tags - botocore.excep... 2023-12-03T12:39:21.810 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_excess_tags - botocore.ex... 2023-12-03T12:39:21.810 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags - botocor... 2023-12-03T12:39:21.810 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags - botocor... 2023-12-03T12:39:21.810 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags - botocor... 2023-12-03T12:39:21.810 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_modify_tags - botocore.ex... 2023-12-03T12:39:21.810 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_delete_tags - botocore.ex... 2023-12-03T12:39:21.810 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request 2023-12-03T12:39:21.810 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request 2023-12-03T12:39:21.810 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags - botocore.... 2023-12-03T12:39:21.810 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public - botocor... 2023-12-03T12:39:21.810 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public - botocor... 2023-12-03T12:39:21.810 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public - boto... 2023-12-03T12:39:21.810 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id 2023-12-03T12:39:21.810 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id 2023-12-03T12:39:21.810 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag 2023-12-03T12:39:21.811 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag 2023-12-03T12:39:21.811 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag 2023-12-03T12:39:21.811 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source 2023-12-03T12:39:21.811 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta 2023-12-03T12:39:21.811 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl - b... 2023-12-03T12:39:21.811 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant 2023-12-03T12:39:21.811 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 - b... 2023-12-03T12:39:21.811 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms - ... 2023-12-03T12:39:21.811 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms 2023-12-03T12:39:21.811 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms 2023-12-03T12:39:21.811 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc 2023-12-03T12:39:21.811 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 2023-12-03T12:39:21.811 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag 2023-12-03T12:39:21.811 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock - bo... 2023-12-03T12:39:21.812 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket 2023-12-03T12:39:21.812 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years 2023-12-03T12:39:21.812 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days 2023-12-03T12:39:21.812 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years 2023-12-03T12:39:21.812 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode 2023-12-03T12:39:21.812 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status 2023-12-03T12:39:21.812 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning 2023-12-03T12:39:21.812 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock - bo... 2023-12-03T12:39:21.812 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket 2023-12-03T12:39:21.812 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention 2023-12-03T12:39:21.812 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket 2023-12-03T12:39:21.812 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode 2023-12-03T12:39:21.812 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention 2023-12-03T12:39:21.812 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 2023-12-03T12:39:21.812 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket 2023-12-03T12:39:21.812 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid 2023-12-03T12:39:21.813 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention 2023-12-03T12:39:21.813 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period 2023-12-03T12:39:21.813 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period 2023-12-03T12:39:21.813 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass 2023-12-03T12:39:21.813 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention 2023-12-03T12:39:21.813 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker 2023-12-03T12:39:21.813 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention 2023-12-03T12:39:21.813 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold - ... 2023-12-03T12:39:21.813 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket 2023-12-03T12:39:21.813 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status 2023-12-03T12:39:21.813 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold - ... 2023-12-03T12:39:21.813 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket 2023-12-03T12:39:21.813 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on 2023-12-03T12:39:21.813 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off 2023-12-03T12:39:21.813 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata 2023-12-03T12:39:21.814 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj - b... 2023-12-03T12:39:21.814 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass 2023-12-03T12:39:21.814 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass 2023-12-03T12:39:21.814 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance 2023-12-03T12:39:21.814 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good - bo... 2023-12-03T12:39:21.814 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed 2023-12-03T12:39:21.814 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status - bo... 2023-12-03T12:39:21.814 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status 2023-12-03T12:39:21.814 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status 2023-12-03T12:39:21.814 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status 2023-12-03T12:39:21.814 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status 2023-12-03T12:39:21.814 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status 2023-12-03T12:39:21.814 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_default_public_block - bo... 2023-12-03T12:39:21.815 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_public_block - botocore.e... 2023-12-03T12:39:21.815 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls 2023-12-03T12:39:21.815 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls 2023-12-03T12:39:21.815 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_block_public_policy - botocor... 2023-12-03T12:39:21.815 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ignore_public_acls - botocore... 2023-12-03T12:39:21.815 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy 2023-12-03T12:39:21.815 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms - b... 2023-12-03T12:39:21.815 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms - b... 2023-12-03T12:39:21.815 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms 2023-12-03T12:39:21.815 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request 2023-12-03T12:39:21.815 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_object_torrent - botocore... 2023-12-03T12:39:21.815 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_generate_where_clause 2023-12-03T12:39:21.815 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_generate_projection - b... 2023-12-03T12:39:21.815 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_count_operation - botoc... 2023-12-03T12:39:21.815 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_count_json_operation - ... 2023-12-03T12:39:21.815 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max 2023-12-03T12:39:21.816 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions 2023-12-03T12:39:21.816 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max - bo... 2023-12-03T12:39:21.816 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_nullif_expressions - bo... 2023-12-03T12:39:21.816 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions 2023-12-03T12:39:21.816 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions 2023-12-03T12:39:21.816 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions 2023-12-03T12:39:21.816 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_in_expressions - botoco... 2023-12-03T12:39:21.816 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions 2023-12-03T12:39:21.816 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_like_expressions - boto... 2023-12-03T12:39:21.816 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions 2023-12-03T12:39:21.816 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_complex_expressions - b... 2023-12-03T12:39:21.816 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_alias - botocore.except... 2023-12-03T12:39:21.816 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce 2023-12-03T12:39:21.816 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_datetime - botocore.exc... 2023-12-03T12:39:21.816 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_true_false_datetime - b... 2023-12-03T12:39:21.817 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_csv_parser - botocore.e... 2023-12-03T12:39:21.817 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_csv_definition - botoco... 2023-12-03T12:39:21.817 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_schema_definition - bot... 2023-12-03T12:39:21.817 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions 2023-12-03T12:39:21.817 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions - ... 2023-12-03T12:39:21.817 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_cast_expressions - boto... 2023-12-03T12:39:21.817 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_version - botocore.exce... 2023-12-03T12:39:21.817 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_trim_expressions - boto... 2023-12-03T12:39:21.817 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions 2023-12-03T12:39:21.817 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_escape_expressions - bo... 2023-12-03T12:39:21.817 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_case_value_expressions 2023-12-03T12:39:21.817 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions 2023-12-03T12:39:21.817 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_progress_expressions - ... 2023-12-03T12:39:21.817 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions 2023-12-03T12:39:21.818 INFO:teuthology.orchestra.run.smithi044.stdout:= 201 failed, 362 passed, 65 skipped, 124 deselected, 1 xfailed, 18 warnings, 235 errors in 3287.47s (0:54:47) = 2023-12-03T12:39:21.818 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: InvocationError for command /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' (exited with code 1) 2023-12-03T12:39:21.818 INFO:teuthology.orchestra.run.smithi044.stdout:___________________________________ summary ____________________________________ 2023-12-03T12:39:21.818 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: py: commands failed 2023-12-03T12:39:21.818 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 437, in run_tests File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 380, in toxvenv_sh File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi044 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2023-12-03T12:39:21.820 INFO:tasks.s3tests:Cleaning up boto... 2023-12-03T12:39:21.820 DEBUG:teuthology.orchestra.run.smithi044:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2023-12-03T12:39:21.855 INFO:tasks.s3tests:Removing s3-tests... 2023-12-03T12:39:21.855 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2023-12-03T12:39:22.062 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 703, in task File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 61, in download File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 437, in run_tests File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 380, in toxvenv_sh File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi044 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2023-12-03T12:39:22.132 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=bcddd99eb06041bda02ed4fb7b52ba18 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 703, in task File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 61, in download File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 437, in run_tests File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 380, in toxvenv_sh File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi044 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2023-12-03T12:39:22.134 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2023-12-03T12:39:22.145 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2023-12-03T12:39:22.187 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2023-12-03T12:39:22.187 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2023-12-03T12:39:22.188 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2023-12-03T12:39:22.262 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2023-12-03T12:39:22.262 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2023-12-03T12:39:22.317 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T12:39:22.317 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T12:44:22.319 INFO:teuthology.orchestra.run.smithi044.stderr:failed to fetch mon config (--no-mon-config to skip) 2023-12-03T12:44:22.321 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T12:44:22.322 ERROR:teuthology.run_tasks:Manager failed: s3tests-java Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 101, in end File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 386, in delete_users File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' 2023-12-03T12:44:22.329 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2023-12-03T12:44:22.339 DEBUG:teuthology.run_tasks:Unwinding manager tox 2023-12-03T12:44:22.385 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/tox-venv 2023-12-03T12:44:22.462 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2023-12-03T12:44:22.472 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/rgw.py", line 473, in task File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 101, in end File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 386, in delete_users File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' 2023-12-03T12:44:22.474 DEBUG:tasks.rgw.client.0:waiting for process to exit 2023-12-03T12:44:22.474 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:44:22.474 INFO:tasks.rgw.client.0:Stopped 2023-12-03T12:44:22.474 DEBUG:teuthology.orchestra.run.smithi044:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2023-12-03T12:44:22.505 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f /etc/ceph/vault-root-token 2023-12-03T12:44:22.594 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2023-12-03T12:44:22.595 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2023-12-03T12:44:22.595 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2023-12-03T12:44:22.651 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2023-12-03T12:44:22.652 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T12:49:22.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-12-03T12:49:22.652+0000 7f6a419dc800 0 monclient(hunting): authenticate timed out after 300 2023-12-03T12:49:22.654 INFO:teuthology.orchestra.run.smithi044.stderr:failed to fetch mon config (--no-mon-config to skip) 2023-12-03T12:49:22.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T12:49:22.656 ERROR:teuthology.run_tasks:Manager failed: rgw Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/rgw.py", line 226, in start_rgw File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/rgw.py", line 473, in task File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 101, in end File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 386, in delete_users File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/rgw.py", line 473, in task File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/rgw.py", line 300, in create_pools File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/rgw.py", line 242, in start_rgw File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/util/rgw.py", line 34, in rgwadmin File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all' 2023-12-03T12:49:22.670 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2023-12-03T12:49:22.681 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-03T12:49:22.729 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-03T12:49:22.729 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-03T12:51:22.802 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-12-03T12:51:22.803 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 1918, in task File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 101, in end File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 386, in delete_users File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 1928, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-12-03T12:51:22.814 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-03T12:51:22.814 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-03T12:51:22.814 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-03T12:51:22.814 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:51:22.817 INFO:tasks.ceph.osd.0:Stopped 2023-12-03T12:51:22.817 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-03T12:51:22.817 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:51:22.818 INFO:tasks.ceph.osd.1:Stopped 2023-12-03T12:51:22.818 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-03T12:51:22.818 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:51:22.818 INFO:tasks.ceph.osd.2:Stopped 2023-12-03T12:51:22.818 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-03T12:51:22.818 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:51:22.819 INFO:tasks.ceph.osd.3:Stopped 2023-12-03T12:51:22.819 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-03T12:51:22.819 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:51:22.819 INFO:tasks.ceph.osd.4:Stopped 2023-12-03T12:51:22.819 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-03T12:51:22.819 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:51:22.819 INFO:tasks.ceph.osd.5:Stopped 2023-12-03T12:51:22.820 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-03T12:51:22.820 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:51:22.820 INFO:tasks.ceph.osd.6:Stopped 2023-12-03T12:51:22.820 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-03T12:51:22.820 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:51:22.820 INFO:tasks.ceph.osd.7:Stopped 2023-12-03T12:51:22.820 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-03T12:51:22.821 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-03T12:51:22.821 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:51:22.821 INFO:tasks.ceph.mgr.y:Stopped 2023-12-03T12:51:22.821 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-03T12:51:22.821 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:51:22.821 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T12:51:22.821 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 1918, in task File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 101, in end File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 386, in delete_users File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 1447, in run_daemon File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 1928, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi091 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2023-12-03T12:51:22.832 INFO:tasks.ceph.mgr.x:Stopped 2023-12-03T12:51:22.832 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-03T12:51:22.832 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-03T12:51:22.832 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:51:22.832 INFO:tasks.ceph.mon.a:Stopped 2023-12-03T12:51:22.833 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-03T12:51:22.833 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:51:22.833 INFO:tasks.ceph.mon.c:Stopped 2023-12-03T12:51:22.833 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-03T12:51:22.833 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:51:22.833 INFO:tasks.ceph.mon.b:Stopped 2023-12-03T12:51:22.833 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-03T12:51:22.834 DEBUG:teuthology.orchestra.run.smithi044:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2023-12-03T12:51:22.889 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi044.front.sepia.ceph.com 2023-12-03T12:51:22.889 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-03T12:51:22.999 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi044.front.sepia.ceph.com 2023-12-03T12:51:22.999 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-03T12:51:23.077 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi044.front.sepia.ceph.com 2023-12-03T12:51:23.077 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-03T12:51:23.166 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi044.front.sepia.ceph.com 2023-12-03T12:51:23.166 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-03T12:51:23.256 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi091.front.sepia.ceph.com 2023-12-03T12:51:23.256 DEBUG:teuthology.orchestra.run.smithi091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-03T12:51:23.628 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi091.front.sepia.ceph.com 2023-12-03T12:51:23.629 DEBUG:teuthology.orchestra.run.smithi091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-03T12:51:23.684 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi091.front.sepia.ceph.com 2023-12-03T12:51:23.684 DEBUG:teuthology.orchestra.run.smithi091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-03T12:51:23.750 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi091.front.sepia.ceph.com 2023-12-03T12:51:23.751 DEBUG:teuthology.orchestra.run.smithi091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-03T12:51:23.808 INFO:tasks.ceph:Archiving mon data... 2023-12-03T12:51:23.810 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476136/data/mon.a.tgz 2023-12-03T12:51:23.810 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2023-12-03T12:51:23.841 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.p9AZs3OelX 2023-12-03T12:51:23.841 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.p9AZs3OelX 2023-12-03T12:51:24.023 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.p9AZs3OelX 2023-12-03T12:51:24.138 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.p9AZs3OelX is 348KB 2023-12-03T12:51:24.235 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.p9AZs3OelX 2023-12-03T12:51:24.262 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476136/data/mon.c.tgz 2023-12-03T12:51:24.262 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2023-12-03T12:51:24.330 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.nOtwjuiq4T 2023-12-03T12:51:24.331 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.nOtwjuiq4T 2023-12-03T12:51:24.497 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.nOtwjuiq4T 2023-12-03T12:51:24.610 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.nOtwjuiq4T is 348KB 2023-12-03T12:51:24.690 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.nOtwjuiq4T 2023-12-03T12:51:24.717 DEBUG:teuthology.misc:Transferring archived files from smithi091:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476136/data/mon.b.tgz 2023-12-03T12:51:24.718 DEBUG:teuthology.orchestra.run.smithi091:> mktemp 2023-12-03T12:51:24.736 INFO:teuthology.orchestra.run.smithi091.stdout:/tmp/tmp.AQFf7LXPh1 2023-12-03T12:51:24.736 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.AQFf7LXPh1 2023-12-03T12:51:24.913 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0666 /tmp/tmp.AQFf7LXPh1 2023-12-03T12:51:24.998 DEBUG:teuthology.orchestra.remote:smithi091:/tmp/tmp.AQFf7LXPh1 is 348KB 2023-12-03T12:51:25.066 DEBUG:teuthology.orchestra.run.smithi091:> rm -fr /tmp/tmp.AQFf7LXPh1 2023-12-03T12:51:25.081 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-03T12:51:25.081 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-03T12:51:25.083 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-03T12:51:25.175 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-03T12:51:25.202 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-03T12:51:25.202 INFO:tasks.ceph:Archiving crash dumps... 2023-12-03T12:51:25.204 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/crash to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476136/remote/smithi044/crash 2023-12-03T12:51:25.205 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-03T12:51:25.296 DEBUG:teuthology.misc:Transferring archived files from smithi091:/var/lib/ceph/crash to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476136/remote/smithi091/crash 2023-12-03T12:51:25.297 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-03T12:51:25.322 INFO:tasks.ceph:Compressing logs... 2023-12-03T12:51:25.323 DEBUG:teuthology.orchestra.run.smithi044:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-03T12:51:25.325 DEBUG:teuthology.orchestra.run.smithi091:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-03T12:51:25.365 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101436.log 2023-12-03T12:51:25.367 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-03T12:51:25.367 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105045.log 2023-12-03T12:51:25.368 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101436.log: /var/log/ceph/ceph-mon.a.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.101436.log.gz 2023-12-03T12:51:25.368 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100206.log 2023-12-03T12:51:25.368 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90731.log 2023-12-03T12:51:25.368 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100206.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.105045.log.gz 2023-12-03T12:51:25.368 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91597.log 2023-12-03T12:51:25.368 INFO:teuthology.orchestra.run.smithi044.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.100206.log.gz 2023-12-03T12:51:25.368 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90731.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.78006.log 2023-12-03T12:51:25.368 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90731.log.gz 2023-12-03T12:51:25.368 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.91597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104717.log 2023-12-03T12:51:25.369 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.tmp-client.admin.78006.log: 0.0%gzip -- replaced with /var/log/ceph/ceph.tmp-client.admin.78006.log.gz 2023-12-03T12:51:25.369 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94111.log 2023-12-03T12:51:25.369 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97231.log 2023-12-03T12:51:25.404 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-12-03T12:51:25.404 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83648.log 2023-12-03T12:51:25.404 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83568.log/var/log/ceph/ceph-osd.6.log: 2023-12-03T12:51:25.404 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.83648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83608.log 2023-12-03T12:51:25.404 INFO:teuthology.orchestra.run.smithi091.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83648.log.gz 2023-12-03T12:51:25.405 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.83568.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-03T12:51:25.405 INFO:teuthology.orchestra.run.smithi091.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83568.log.gz 2023-12-03T12:51:25.405 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.83608.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-12-03T12:51:25.405 INFO:teuthology.orchestra.run.smithi091.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83608.log.gz 2023-12-03T12:51:25.405 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83528.log 2023-12-03T12:51:25.405 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83728.log 2023-12-03T12:51:25.405 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.83528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83528.log.gz 2023-12-03T12:51:25.405 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-12-03T12:51:25.405 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-12-03T12:51:25.405 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.83728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83728.log.gz 2023-12-03T12:51:25.406 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83488.log 2023-12-03T12:51:25.406 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-osd.5.log: gzip 90.6% -5 -- replaced with /var/log/ceph/ceph.audit.log.gz --verbose 2023-12-03T12:51:25.406 INFO:teuthology.orchestra.run.smithi091.stderr: -- /var/log/ceph/ceph-mgr.x.log 2023-12-03T12:51:25.406 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.83488.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-03T12:51:25.406 INFO:teuthology.orchestra.run.smithi091.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83488.log.gz 2023-12-03T12:51:25.406 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-12-03T12:51:25.406 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83688.log 2023-12-03T12:51:25.406 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83448.log 2023-12-03T12:51:25.406 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.83688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83688.log.gz 2023-12-03T12:51:25.406 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.83448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83448.log.gz 2023-12-03T12:51:25.407 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-03T12:51:25.414 INFO:teuthology.orchestra.run.smithi091.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-03T12:51:25.452 INFO:teuthology.orchestra.run.smithi044.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.104717.log.gz 2023-12-03T12:51:25.452 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94111.log: 95.8% -- replaced with /var/log/ceph/ceph-client.0.91597.log.gz 2023-12-03T12:51:25.452 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93195.log 2023-12-03T12:51:25.452 INFO:teuthology.orchestra.run.smithi044.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.94111.log.gz 2023-12-03T12:51:25.453 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91088.log 2023-12-03T12:51:25.453 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102503.log 2023-12-03T12:51:25.453 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93195.log: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.97231.log.gz 2023-12-03T12:51:25.453 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.91088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99366.log 2023-12-03T12:51:25.453 INFO:teuthology.orchestra.run.smithi044.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.93195.log.gz 2023-12-03T12:51:25.453 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91088.log.gz 2023-12-03T12:51:25.453 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106123.log 2023-12-03T12:51:25.453 INFO:teuthology.orchestra.run.smithi044.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.102503.log.gz 2023-12-03T12:51:25.453 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.99366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94791.log 2023-12-03T12:51:25.453 INFO:teuthology.orchestra.run.smithi044.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.99366.log.gz 2023-12-03T12:51:25.454 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.106123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110573.log 2023-12-03T12:51:25.454 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106123.log.gz 2023-12-03T12:51:25.454 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103569.log 2023-12-03T12:51:25.454 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.94791.log.gz 2023-12-03T12:51:25.454 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.110573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91492.log 2023-12-03T12:51:25.454 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112386.log 2023-12-03T12:51:25.454 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.91492.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.103569.log.gz 2023-12-03T12:51:25.454 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90068.log 2023-12-03T12:51:25.454 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91492.log.gz 2023-12-03T12:51:25.454 INFO:teuthology.orchestra.run.smithi044.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.110573.log.gz 2023-12-03T12:51:25.455 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92077.log 2023-12-03T12:51:25.455 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.112386.log: 9.2% -- replaced with /var/log/ceph/ceph-client.0.112386.log.gz 2023-12-03T12:51:25.455 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105291.log 2023-12-03T12:51:25.455 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90068.log.gz 2023-12-03T12:51:25.455 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.92077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94275.log 2023-12-03T12:51:25.455 INFO:teuthology.orchestra.run.smithi044.stderr: 42.8% -- replaced with /var/log/ceph/ceph-client.0.92077.log.gz 2023-12-03T12:51:25.455 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94193.log 2023-12-03T12:51:25.455 INFO:teuthology.orchestra.run.smithi044.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.105291.log.gz 2023-12-03T12:51:25.455 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101764.log 2023-12-03T12:51:25.455 INFO:teuthology.orchestra.run.smithi044.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.94275.log.gz 2023-12-03T12:51:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.108739.log 2023-12-03T12:51:25.456 INFO:teuthology.orchestra.run.smithi044.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.94193.log.gz 2023-12-03T12:51:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101190.log 2023-12-03T12:51:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.108739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112177.log 2023-12-03T12:51:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101190.log: gzip -5 --verbose -- 83.8% /var/log/ceph/ceph-client.admin.91090.log 2023-12-03T12:51:25.456 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.0.108739.log.gz 2023-12-03T12:51:25.456 INFO:teuthology.orchestra.run.smithi044.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.101190.log.gz 2023-12-03T12:51:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101846.log 2023-12-03T12:51:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112177.log.gz 2023-12-03T12:51:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.91090.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.101764.log.gz 2023-12-03T12:51:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101272.log 2023-12-03T12:51:25.457 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91090.log.gz 2023-12-03T12:51:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101026.log 2023-12-03T12:51:25.457 INFO:teuthology.orchestra.run.smithi044.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.101846.log.gz 2023-12-03T12:51:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102913.log 2023-12-03T12:51:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101026.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.101272.log.gz 2023-12-03T12:51:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104881.log 2023-12-03T12:51:25.457 INFO:teuthology.orchestra.run.smithi044.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.101026.log.gz 2023-12-03T12:51:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104225.log 2023-12-03T12:51:25.458 INFO:teuthology.orchestra.run.smithi044.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.102913.log.gz 2023-12-03T12:51:25.458 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99704.log 2023-12-03T12:51:25.458 INFO:teuthology.orchestra.run.smithi044.stderr: 81.7%/var/log/ceph/ceph-client.admin.104225.log: -- replaced with /var/log/ceph/ceph-client.admin.104881.log.gz 2023-12-03T12:51:25.458 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97133.log 2023-12-03T12:51:25.458 INFO:teuthology.orchestra.run.smithi044.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.104225.log.gz 2023-12-03T12:51:25.458 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.99704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106099.log 2023-12-03T12:51:25.458 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90409.log 2023-12-03T12:51:25.458 INFO:teuthology.orchestra.run.smithi044.stderr: 19.9% -- replaced with /var/log/ceph/ceph-client.admin.97133.log.gz 2023-12-03T12:51:25.458 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.106099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106099.log.gz 2023-12-03T12:51:25.458 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112271.log 2023-12-03T12:51:25.459 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103077.log 2023-12-03T12:51:25.459 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90409.log.gz 2023-12-03T12:51:25.459 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.112271.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.104553.log 2023-12-03T12:51:25.459 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112271.log.gz 2023-12-03T12:51:25.459 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104307.log 2023-12-03T12:51:25.459 INFO:teuthology.orchestra.run.smithi044.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.103077.log.gz 2023-12-03T12:51:25.459 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104389.log 2023-12-03T12:51:25.459 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104553.log: /var/log/ceph/ceph-client.admin.104307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90653.log 2023-12-03T12:51:25.459 INFO:teuthology.orchestra.run.smithi044.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.104553.log.gz 2023-12-03T12:51:25.459 INFO:teuthology.orchestra.run.smithi044.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.104307.log.gz 2023-12-03T12:51:25.460 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97423.log 2023-12-03T12:51:25.460 INFO:teuthology.orchestra.run.smithi044.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.0.99704.log.gz 2023-12-03T12:51:25.460 INFO:teuthology.orchestra.run.smithi044.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.104389.log.gz 2023-12-03T12:51:25.460 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96560.log 2023-12-03T12:51:25.460 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90653.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90653.log.gz 2023-12-03T12:51:25.460 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101518.log 2023-12-03T12:51:25.460 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102585.log 2023-12-03T12:51:25.460 INFO:teuthology.orchestra.run.smithi044.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.96560.log.gz 2023-12-03T12:51:25.460 INFO:teuthology.orchestra.run.smithi044.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.97423.log.gz 2023-12-03T12:51:25.460 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102995.log 2023-12-03T12:51:25.461 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96504.log 2023-12-03T12:51:25.461 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102585.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.101518.log.gz 2023-12-03T12:51:25.461 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106017.log 2023-12-03T12:51:25.461 INFO:teuthology.orchestra.run.smithi044.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.102585.log.gz 2023-12-03T12:51:25.461 INFO:teuthology.orchestra.run.smithi044.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.102995.log.gz 2023-12-03T12:51:25.461 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100452.log 2023-12-03T12:51:25.461 INFO:teuthology.orchestra.run.smithi044.stderr: 55.0% -- replaced with /var/log/ceph/ceph-client.admin.96504.log.gz 2023-12-03T12:51:25.461 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97533.log 2023-12-03T12:51:25.461 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.106017.log: /var/log/ceph/ceph-client.admin.100452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99802.log 2023-12-03T12:51:25.461 INFO:teuthology.orchestra.run.smithi044.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.106017.log.gz 2023-12-03T12:51:25.462 INFO:teuthology.orchestra.run.smithi044.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.100452.log.gz 2023-12-03T12:51:25.462 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109482.log 2023-12-03T12:51:25.462 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97533.log: /var/log/ceph/ceph-client.0.99802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100862.log 2023-12-03T12:51:25.462 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109482.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.99802.log.gz 2023-12-03T12:51:25.462 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104143.log 2023-12-03T12:51:25.462 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100862.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.109482.log.gz 2023-12-03T12:51:25.462 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91703.log 2023-12-03T12:51:25.462 INFO:teuthology.orchestra.run.smithi044.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.100862.log.gz 2023-12-03T12:51:25.462 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100944.log 2023-12-03T12:51:25.463 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104143.log: /var/log/ceph/ceph-client.0.91703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93817.log 2023-12-03T12:51:25.463 INFO:teuthology.orchestra.run.smithi044.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.104143.log.gz 2023-12-03T12:51:25.463 INFO:teuthology.orchestra.run.smithi044.stderr: 43.2% -- replaced with /var/log/ceph/ceph-client.0.91703.log.gz 2023-12-03T12:51:25.463 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100944.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-03T12:51:25.463 INFO:teuthology.orchestra.run.smithi044.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.100944.log.gz 2023-12-03T12:51:25.463 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.110908.log 2023-12-03T12:51:25.463 INFO:teuthology.orchestra.run.smithi044.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.93817.log.gz 2023-12-03T12:51:25.463 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.112165.log 2023-12-03T12:51:25.463 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110121.log 2023-12-03T12:51:25.463 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.110908.log: /var/log/ceph/ceph-client.crash.112165.log: 80.1% -- replaced with /var/log/ceph/ceph-client.0.110908.log.gz 2023-12-03T12:51:25.464 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94521.log 2023-12-03T12:51:25.464 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.112165.log.gz 2023-12-03T12:51:25.464 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.110121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.smithi044.112208.log 2023-12-03T12:51:25.464 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101928.log 2023-12-03T12:51:25.464 INFO:teuthology.orchestra.run.smithi044.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.110121.log.gz 79.8% -- replaced with /var/log/ceph/ceph-client.admin.94521.log.gz 2023-12-03T12:51:25.464 INFO:teuthology.orchestra.run.smithi044.stderr: 2023-12-03T12:51:25.464 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.crash.smithi044.112208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98193.log 2023-12-03T12:51:25.464 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.smithi044.112208.log.gz 2023-12-03T12:51:25.464 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96298.log 2023-12-03T12:51:25.465 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101928.log: /var/log/ceph/ceph-client.admin.98193.log: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-03T12:51:25.465 INFO:teuthology.orchestra.run.smithi044.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.101928.log.gz 2023-12-03T12:51:25.465 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105209.log 2023-12-03T12:51:25.465 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100370.log 2023-12-03T12:51:25.465 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96298.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.96298.log.gz 2023-12-03T12:51:25.465 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111522.log 2023-12-03T12:51:25.465 INFO:teuthology.orchestra.run.smithi044.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.97533.log.gz 2023-12-03T12:51:25.465 INFO:teuthology.orchestra.run.smithi044.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.105209.log.gz 2023-12-03T12:51:25.465 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104635.log 2023-12-03T12:51:25.466 INFO:teuthology.orchestra.run.smithi044.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.100370.log.gz 2023-12-03T12:51:25.466 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.111522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102093.log 2023-12-03T12:51:25.466 INFO:teuthology.orchestra.run.smithi044.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.98193.log.gz 2023-12-03T12:51:25.466 INFO:teuthology.orchestra.run.smithi044.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.111522.log.gz 2023-12-03T12:51:25.466 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91085.log 2023-12-03T12:51:25.466 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104635.log: /var/log/ceph/ceph-client.admin.102093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.112259.log 2023-12-03T12:51:25.466 INFO:teuthology.orchestra.run.smithi044.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.102093.log.gz 2023-12-03T12:51:25.466 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.91085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94685.log 2023-12-03T12:51:25.466 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91085.log.gz 2023-12-03T12:51:25.466 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100534.log 2023-12-03T12:51:25.467 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.crash.112259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.112259.log.gz 2023-12-03T12:51:25.467 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104963.log 2023-12-03T12:51:25.467 INFO:teuthology.orchestra.run.smithi044.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.104635.log.gz 2023-12-03T12:51:25.467 INFO:teuthology.orchestra.run.smithi044.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.94685.log.gz 2023-12-03T12:51:25.467 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90110.log 2023-12-03T12:51:25.467 INFO:teuthology.orchestra.run.smithi044.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.100534.log.gz 2023-12-03T12:51:25.467 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94815.log 2023-12-03T12:51:25.467 INFO:teuthology.orchestra.run.smithi044.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.104963.log.gz 2023-12-03T12:51:25.467 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103323.log 2023-12-03T12:51:25.467 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90110.log.gz 2023-12-03T12:51:25.468 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103159.log 2023-12-03T12:51:25.468 INFO:teuthology.orchestra.run.smithi044.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.94815.log.gz 2023-12-03T12:51:25.468 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105127.log 2023-12-03T12:51:25.468 INFO:teuthology.orchestra.run.smithi044.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.103323.log.gz 2023-12-03T12:51:25.468 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90194.log 2023-12-03T12:51:25.468 INFO:teuthology.orchestra.run.smithi044.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.103159.log.gz 2023-12-03T12:51:25.468 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111114.log 2023-12-03T12:51:25.468 INFO:teuthology.orchestra.run.smithi044.stderr: 81.5%/var/log/ceph/ceph-client.admin.90194.log: -- replaced with /var/log/ceph/ceph-client.admin.105127.log.gz 2023-12-03T12:51:25.468 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90648.log 2023-12-03T12:51:25.468 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90194.log.gz 2023-12-03T12:51:25.469 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.111114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111420.log 2023-12-03T12:51:25.469 INFO:teuthology.orchestra.run.smithi044.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.0.111114.log.gz 2023-12-03T12:51:25.469 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102831.log 2023-12-03T12:51:25.469 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90648.log.gz 2023-12-03T12:51:25.469 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.111420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93523.log 2023-12-03T12:51:25.469 INFO:teuthology.orchestra.run.smithi044.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.0.111420.log.gz 2023-12-03T12:51:25.469 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93947.log 2023-12-03T12:51:25.469 INFO:teuthology.orchestra.run.smithi044.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.102831.log.gz 2023-12-03T12:51:25.469 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93523.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-03T12:51:25.469 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93523.log.gz 2023-12-03T12:51:25.470 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100698.log 2023-12-03T12:51:25.470 INFO:teuthology.orchestra.run.smithi044.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.93947.log.gz 2023-12-03T12:51:25.470 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105805.log 2023-12-03T12:51:25.470 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90417.log 2023-12-03T12:51:25.470 INFO:teuthology.orchestra.run.smithi044.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.100698.log.gz 2023-12-03T12:51:25.470 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.smithi044.112419.log 2023-12-03T12:51:25.470 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105805.log.gz 2023-12-03T12:51:25.470 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.90417.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.99137.log 2023-12-03T12:51:25.470 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90417.log.gz 2023-12-03T12:51:25.471 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.crash.smithi044.112419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90410.log 2023-12-03T12:51:25.471 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.smithi044.112419.log.gz 2023-12-03T12:51:25.471 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105641.log 2023-12-03T12:51:25.471 INFO:teuthology.orchestra.run.smithi044.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.99137.log.gz 2023-12-03T12:51:25.471 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90410.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90410.log.gz 2023-12-03T12:51:25.471 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95355.log 2023-12-03T12:51:25.471 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90152.log 2023-12-03T12:51:25.471 INFO:teuthology.orchestra.run.smithi044.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.105641.log.gz 2023-12-03T12:51:25.471 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91092.log 2023-12-03T12:51:25.471 INFO:teuthology.orchestra.run.smithi044.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.95355.log.gz 2023-12-03T12:51:25.472 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90416.log 2023-12-03T12:51:25.472 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90152.log.gz 2023-12-03T12:51:25.472 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.91092.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.94979.log 2023-12-03T12:51:25.472 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91092.log.gz 2023-12-03T12:51:25.472 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.smithi044.112247.log 2023-12-03T12:51:25.472 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90416.log.gz 2023-12-03T12:51:25.472 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105723.log 2023-12-03T12:51:25.472 INFO:teuthology.orchestra.run.smithi044.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.94979.log.gz 2023-12-03T12:51:25.472 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.crash.smithi044.112247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90950.log 2023-12-03T12:51:25.472 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.smithi044.112247.log.gz 2023-12-03T12:51:25.473 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99464.log 2023-12-03T12:51:25.473 INFO:teuthology.orchestra.run.smithi044.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.105723.log.gz 2023-12-03T12:51:25.473 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95191.log 2023-12-03T12:51:25.473 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90950.log.gz 2023-12-03T12:51:25.473 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.99464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93359.log 2023-12-03T12:51:25.473 INFO:teuthology.orchestra.run.smithi044.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.99464.log.gz 2023-12-03T12:51:25.473 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111318.log 2023-12-03T12:51:25.473 INFO:teuthology.orchestra.run.smithi044.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.95191.log.gz 2023-12-03T12:51:25.473 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105829.log 2023-12-03T12:51:25.473 INFO:teuthology.orchestra.run.smithi044.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.93359.log.gz 2023-12-03T12:51:25.474 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91286.log 2023-12-03T12:51:25.474 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.111318.log: /var/log/ceph/ceph-client.admin.105829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93735.log 2023-12-03T12:51:25.474 INFO:teuthology.orchestra.run.smithi044.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.111318.log.gz 2023-12-03T12:51:25.474 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105829.log.gz 2023-12-03T12:51:25.474 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.91286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98801.log 2023-12-03T12:51:25.474 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91286.log.gz 2023-12-03T12:51:25.474 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95061.log 2023-12-03T12:51:25.474 INFO:teuthology.orchestra.run.smithi044.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.93735.log.gz 2023-12-03T12:51:25.474 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.98801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103651.log 2023-12-03T12:51:25.475 INFO:teuthology.orchestra.run.smithi044.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.98801.log.gz 2023-12-03T12:51:25.475 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106229.log 2023-12-03T12:51:25.475 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97643.log 2023-12-03T12:51:25.475 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103651.log: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.95061.log.gz 2023-12-03T12:51:25.475 INFO:teuthology.orchestra.run.smithi044.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.103651.log.gz 2023-12-03T12:51:25.475 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.106229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109684.log 2023-12-03T12:51:25.475 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90414.log 2023-12-03T12:51:25.475 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.106229.log.gz 2023-12-03T12:51:25.475 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97643.log: /var/log/ceph/ceph-client.admin.109684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106311.log 2023-12-03T12:51:25.475 INFO:teuthology.orchestra.run.smithi044.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.109684.log.gz 2023-12-03T12:51:25.476 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90654.log 2023-12-03T12:51:25.476 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90414.log.gz 2023-12-03T12:51:25.476 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5/var/log/ceph/ceph-client.admin.106311.log: --verbose -- /var/log/ceph/ceph-client.admin.102011.log 2023-12-03T12:51:25.476 INFO:teuthology.orchestra.run.smithi044.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.106311.log.gz 2023-12-03T12:51:25.476 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90654.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.90654.log.gz -5 2023-12-03T12:51:25.476 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.crash.112220.log 2023-12-03T12:51:25.476 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84285.log 2023-12-03T12:51:25.476 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102011.log: gzip/var/log/ceph/ceph-client.crash.112220.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.99221.log 2023-12-03T12:51:25.476 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.112220.log.gz 2023-12-03T12:51:25.477 INFO:teuthology.orchestra.run.smithi044.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.102011.log.gz 2023-12-03T12:51:25.477 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.84285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109381.log 2023-12-03T12:51:25.477 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84285.log.gz 2023-12-03T12:51:25.477 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103979.log 2023-12-03T12:51:25.477 INFO:teuthology.orchestra.run.smithi044.stderr: 24.7% -- replaced with /var/log/ceph/ceph-client.admin.99221.log.gz 2023-12-03T12:51:25.477 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109381.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-03T12:51:25.477 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98970.log 2023-12-03T12:51:25.477 INFO:teuthology.orchestra.run.smithi044.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.103979.log.gz 2023-12-03T12:51:25.477 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100288.log 2023-12-03T12:51:25.477 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.98970.log: gzip 93.9% -- replaced with /var/log/ceph/ceph-client.admin.109381.log.gz 2023-12-03T12:51:25.478 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.98303.log 2023-12-03T12:51:25.478 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100288.log: gzip -5 --verbose 91.3% -- replaced with /var/log/ceph/ceph-client.admin.98970.log.gz 2023-12-03T12:51:25.478 INFO:teuthology.orchestra.run.smithi044.stderr: -- /var/log/ceph/ceph-client.0.110806.log 81.2% -- replaced with /var/log/ceph/ceph-client.admin.100288.log.gz 2023-12-03T12:51:25.478 INFO:teuthology.orchestra.run.smithi044.stderr: 2023-12-03T12:51:25.478 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.98303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98083.log 2023-12-03T12:51:25.478 INFO:teuthology.orchestra.run.smithi044.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.97643.log.gz 2023-12-03T12:51:25.478 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.110806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110020.log 2023-12-03T12:51:25.478 INFO:teuthology.orchestra.run.smithi044.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.0.110806.log.gz 2023-12-03T12:51:25.478 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.98083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95273.log 2023-12-03T12:51:25.478 INFO:teuthology.orchestra.run.smithi044.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.98303.log.gz 2023-12-03T12:51:25.479 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.110020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91532.log 2023-12-03T12:51:25.479 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95273.log: gzip 92.2% -5 --verbose -- /var/log/ceph/ceph-client.admin.93653.log 2023-12-03T12:51:25.479 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.110020.log.gz 2023-12-03T12:51:25.479 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.91532.log: gzip 85.7% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.95273.log.gz 2023-12-03T12:51:25.479 INFO:teuthology.orchestra.run.smithi044.stderr: /var/log/ceph/ceph-client.admin.84160.log 2023-12-03T12:51:25.479 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91532.log.gz 2023-12-03T12:51:25.479 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96079.log 2023-12-03T12:51:25.479 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93653.log: /var/log/ceph/ceph-client.admin.84160.log: gzip 80.0% -5 --verbose -- /var/log/ceph/ceph-client.0.111624.log 2023-12-03T12:51:25.479 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93653.log.gz 2023-12-03T12:51:25.479 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84160.log.gz 2023-12-03T12:51:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98413.log 2023-12-03T12:51:25.480 INFO:teuthology.orchestra.run.smithi044.stderr: 45.0% -- replaced with /var/log/ceph/ceph-client.admin.96079.log.gz 2023-12-03T12:51:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91328.log 2023-12-03T12:51:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.111624.log: /var/log/ceph/ceph-client.admin.98413.log: gzip -5 --verbose -- 80.0% -- replaced with /var/log/ceph/ceph-client.0.111624.log.gz 2023-12-03T12:51:25.480 INFO:teuthology.orchestra.run.smithi044.stderr: /var/log/ceph/ceph-client.admin.93899.log 2023-12-03T12:51:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.91328.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104061.log 2023-12-03T12:51:25.480 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.91328.log.gz 2023-12-03T12:51:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111012.log 2023-12-03T12:51:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93899.log.gz 2023-12-03T12:51:25.480 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98413.log.gz 2023-12-03T12:51:25.481 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103241.log 2023-12-03T12:51:25.481 INFO:teuthology.orchestra.run.smithi044.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.104061.log.gz 2023-12-03T12:51:25.481 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.111012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91985.log 2023-12-03T12:51:25.481 INFO:teuthology.orchestra.run.smithi044.stderr:gzip 84.2% -- replaced with /var/log/ceph/ceph-client.0.111012.log.gz 2023-12-03T12:51:25.481 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103241.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.99652.log 2023-12-03T12:51:25.481 INFO:teuthology.orchestra.run.smithi044.stderr: 81.8%/var/log/ceph/ceph-client.0.91985.log: -- replaced with /var/log/ceph/ceph-client.admin.103241.log.gz 2023-12-03T12:51:25.481 INFO:teuthology.orchestra.run.smithi044.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.91985.log.gz 2023-12-03T12:51:25.481 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94439.log 2023-12-03T12:51:25.481 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109919.log 2023-12-03T12:51:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99652.log: 50.3% -- replaced with /var/log/ceph/ceph-client.admin.99652.log.gz 2023-12-03T12:51:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102257.log 2023-12-03T12:51:25.482 INFO:teuthology.orchestra.run.smithi044.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.94439.log.gz 2023-12-03T12:51:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91450.log 2023-12-03T12:51:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102257.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.109919.log.gz 2023-12-03T12:51:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90415.log 2023-12-03T12:51:25.482 INFO:teuthology.orchestra.run.smithi044.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.102257.log.gz 2023-12-03T12:51:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.91450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91450.log.gz 2023-12-03T12:51:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2023-12-03T12:51:25.483 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90415.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90415.log.gz 2023-12-03T12:51:25.483 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.104471.log 2023-12-03T12:51:25.483 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90734.log 2023-12-03T12:51:25.483 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110674.log 2023-12-03T12:51:25.483 INFO:teuthology.orchestra.run.smithi044.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.104471.log.gz/var/log/ceph/ceph-client.admin.90734.log: 2023-12-03T12:51:25.483 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90734.log.gz 2023-12-03T12:51:25.483 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93277.log 2023-12-03T12:51:25.483 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.110674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90759.log 2023-12-03T12:51:25.483 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93277.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.110674.log.gz 2023-12-03T12:51:25.484 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-12-03T12:51:25.484 INFO:teuthology.orchestra.run.smithi044.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.93277.log.gz 2023-12-03T12:51:25.484 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90759.log.gz 2023-12-03T12:51:25.484 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101108.log 2023-12-03T12:51:25.484 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5/var/log/ceph/ceph-mgr.y.log: --verbose -- /var/log/ceph/ceph-client.admin.90989.log 2023-12-03T12:51:25.484 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94029.log 2023-12-03T12:51:25.484 INFO:teuthology.orchestra.run.smithi044.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.101108.log.gz 2023-12-03T12:51:25.484 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90989.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112570.log 2023-12-03T12:51:25.484 INFO:teuthology.orchestra.run.smithi044.stderr: 2023-12-03T12:51:25.484 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111216.log 2023-12-03T12:51:25.485 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94029.log: /var/log/ceph/ceph-client.admin.112570.log: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2023-12-03T12:51:25.485 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112570.log.gz 2023-12-03T12:51:25.485 INFO:teuthology.orchestra.run.smithi044.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.94029.log.gz 2023-12-03T12:51:25.485 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91574.log 2023-12-03T12:51:25.485 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.0.111216.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.96376.log 2023-12-03T12:51:25.485 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.91574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90990.log 2023-12-03T12:51:25.485 INFO:teuthology.orchestra.run.smithi044.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.111216.log.gz 2023-12-03T12:51:25.485 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91574.log.gz 2023-12-03T12:51:25.485 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.96376.log: -- /var/log/ceph/ceph-client.admin.110222.log 2023-12-03T12:51:25.485 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96376.log.gz 2023-12-03T12:51:25.486 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90990.log.gz 2023-12-03T12:51:25.486 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90236.log 2023-12-03T12:51:25.486 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.110222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91370.log 2023-12-03T12:51:25.486 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90236.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.110222.log.gz 2023-12-03T12:51:25.486 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90236.log.gz 2023-12-03T12:51:25.486 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90412.log 2023-12-03T12:51:25.486 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.91370.log: -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.108983.log 2023-12-03T12:51:25.486 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.91370.log.gz 2023-12-03T12:51:25.486 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90412.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90412.log.gz 2023-12-03T12:51:25.486 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.95143.log 2023-12-03T12:51:25.487 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.108983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105935.log 2023-12-03T12:51:25.487 INFO:teuthology.orchestra.run.smithi044.stderr: 92.2%/var/log/ceph/ceph-client.admin.95143.log: -- replaced with /var/log/ceph/ceph-client.admin.108983.log.gz 2023-12-03T12:51:25.487 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97973.log 2023-12-03T12:51:25.487 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95143.log.gz 2023-12-03T12:51:25.487 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93441.log 2023-12-03T12:51:25.487 INFO:teuthology.orchestra.run.smithi044.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.105935.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95167.log 2023-12-03T12:51:25.487 INFO:teuthology.orchestra.run.smithi044.stderr: 2023-12-03T12:51:25.487 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97973.log: /var/log/ceph/ceph-client.admin.93441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112232.log 2023-12-03T12:51:25.487 INFO:teuthology.orchestra.run.smithi044.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.93441.log.gz/var/log/ceph/ceph-client.admin.95167.log: 2023-12-03T12:51:25.487 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.95167.log.gz 2023-12-03T12:51:25.488 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91089.log 2023-12-03T12:51:25.488 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112232.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102175.log 2023-12-03T12:51:25.488 INFO:teuthology.orchestra.run.smithi044.stderr: 2023-12-03T12:51:25.488 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83869.log 2023-12-03T12:51:25.488 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97973.log.gz 2023-12-03T12:51:25.488 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.91089.log: /var/log/ceph/ceph-client.admin.102175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91089.log.gz 2023-12-03T12:51:25.488 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.smithi044.112286.log 81.9% -- replaced with /var/log/ceph/ceph-client.admin.102175.log.gz 2023-12-03T12:51:25.488 INFO:teuthology.orchestra.run.smithi044.stderr: 2023-12-03T12:51:25.488 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.83869.log: 29.1% -- replaced with /var/log/ceph/ceph-client.admin.83869.log.gz 2023-12-03T12:51:25.488 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105374.log 2023-12-03T12:51:25.489 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.crash.smithi044.112286.log: -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.crash.smithi044.112286.log.gz 2023-12-03T12:51:25.489 INFO:teuthology.orchestra.run.smithi044.stderr: -- /var/log/ceph/ceph-client.crash.smithi044.112153.log 2023-12-03T12:51:25.489 INFO:teuthology.orchestra.run.smithi044.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.98083.log.gz 2023-12-03T12:51:25.489 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105374.log.gz 2023-12-03T12:51:25.489 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104799.log 2023-12-03T12:51:25.489 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.crash.smithi044.112153.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-03T12:51:25.489 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.smithi044.112153.log.gz 2023-12-03T12:51:25.489 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98883.log 2023-12-03T12:51:25.489 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.0.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.104799.log.gz 2023-12-03T12:51:25.489 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93547.log 2023-12-03T12:51:25.490 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.98883.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2023-12-03T12:51:25.490 INFO:teuthology.orchestra.run.smithi044.stderr: 83.8%/var/log/ceph/ceph-client.admin.93547.log: -- replaced with /var/log/ceph/ceph-client.admin.98883.log.gz 2023-12-03T12:51:25.490 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93547.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94767.log 2023-12-03T12:51:25.490 INFO:teuthology.orchestra.run.smithi044.stderr: 2023-12-03T12:51:25.490 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103487.log 2023-12-03T12:51:25.490 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ops-log-ceph-client.0.log: /var/log/ceph/ceph-client.admin.94767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91410.log 2023-12-03T12:51:25.490 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.94767.log.gz 2023-12-03T12:51:25.490 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105853.log 2023-12-03T12:51:25.490 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.91410.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91410.log.gz 2023-12-03T12:51:25.491 INFO:teuthology.orchestra.run.smithi044.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.103487.log.gz 2023-12-03T12:51:25.491 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90418.log 2023-12-03T12:51:25.491 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101682.log 2023-12-03T12:51:25.491 INFO:teuthology.orchestra.run.smithi044.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.105853.log.gz 2023-12-03T12:51:25.491 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100124.log 2023-12-03T12:51:25.491 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90418.log.gz 2023-12-03T12:51:25.491 INFO:teuthology.orchestra.run.smithi044.stderr: 82.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102421.log 2023-12-03T12:51:25.491 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101682.log.gz 2023-12-03T12:51:25.491 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100124.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-03T12:51:25.491 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102421.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.100124.log.gz 2023-12-03T12:51:25.492 INFO:teuthology.orchestra.run.smithi044.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.102421.log.gz 2023-12-03T12:51:25.492 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90732.log 2023-12-03T12:51:25.492 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94897.log 2023-12-03T12:51:25.492 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90732.log.gz 2023-12-03T12:51:25.492 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-03T12:51:25.492 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94897.log: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.94897.log.gz 2023-12-03T12:51:25.492 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89911.log 2023-12-03T12:51:25.492 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.2.log: 93.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-03T12:51:25.492 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99053.log 2023-12-03T12:51:25.492 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.89911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89911.log.gz 2023-12-03T12:51:25.493 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100616.log 2023-12-03T12:51:25.493 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99053.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.99053.log.gz 2023-12-03T12:51:25.493 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95702.log 2023-12-03T12:51:25.493 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100616.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.100616.log.gz 2023-12-03T12:51:25.493 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111726.log 2023-12-03T12:51:25.493 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95702.log: 61.4% -- replaced with /var/log/ceph/ceph-client.admin.95702.log.gz 2023-12-03T12:51:25.493 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.112431.log 2023-12-03T12:51:25.493 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.111726.log: 79.9% -- replaced with /var/log/ceph/ceph-client.0.111726.log.gz 2023-12-03T12:51:25.493 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.112298.log 2023-12-03T12:51:25.493 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.crash.112431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.112431.log.gz 2023-12-03T12:51:25.494 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100780.log 2023-12-03T12:51:25.494 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.crash.112298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.112298.log.gz 2023-12-03T12:51:25.494 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97313.log 2023-12-03T12:51:25.494 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100780.log: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.100780.log.gz 2023-12-03T12:51:25.494 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91893.log 2023-12-03T12:51:25.498 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97313.log: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.97313.log.gz 2023-12-03T12:51:25.499 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90012.log 2023-12-03T12:51:25.499 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.91893.log: 43.2% -- replaced with /var/log/ceph/ceph-client.0.91893.log.gz 2023-12-03T12:51:25.499 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92169.log 2023-12-03T12:51:25.499 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90012.log.gz 2023-12-03T12:51:25.499 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2023-12-03T12:51:25.499 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.92169.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.92169.log.gz 2023-12-03T12:51:25.499 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97753.log 2023-12-03T12:51:25.499 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94357.log 2023-12-03T12:51:25.499 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97753.log: 93.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103815.log 2023-12-03T12:51:25.500 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97753.log.gz 2023-12-03T12:51:25.500 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94357.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.94357.log.gz 2023-12-03T12:51:25.504 INFO:teuthology.orchestra.run.smithi044.stderr: 94.9% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2023-12-03T12:51:25.508 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101354.log 2023-12-03T12:51:25.509 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103815.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.103815.log.gz 2023-12-03T12:51:25.510 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112516.log 2023-12-03T12:51:25.511 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101354.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.101354.log.gz 2023-12-03T12:51:25.511 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109583.log 2023-12-03T12:51:25.512 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.112516.log: 8.2% -- replaced with /var/log/ceph/ceph-client.0.112516.log.gz 2023-12-03T12:51:25.512 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103897.log 2023-12-03T12:51:25.513 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109583.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.109583.log.gz 2023-12-03T12:51:25.513 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106147.log 2023-12-03T12:51:25.514 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103897.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.103897.log.gz 2023-12-03T12:51:25.514 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108882.log 2023-12-03T12:51:25.515 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.106147.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106147.log.gz 2023-12-03T12:51:25.516 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102667.log 2023-12-03T12:51:25.516 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.108882.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.108882.log.gz 2023-12-03T12:51:25.517 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112313.log 2023-12-03T12:51:25.518 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102667.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.102667.log.gz 2023-12-03T12:51:25.520 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102749.log 2023-12-03T12:51:25.520 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112313.log.gz 2023-12-03T12:51:25.520 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93923.log 2023-12-03T12:51:25.520 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102749.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.102749.log.gz 2023-12-03T12:51:25.521 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93571.log 2023-12-03T12:51:25.522 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93923.log.gz 2023-12-03T12:51:25.522 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101600.log 2023-12-03T12:51:25.522 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93571.log: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.93571.log.gz 2023-12-03T12:51:25.522 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103733.log 2023-12-03T12:51:25.523 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101600.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.101600.log.gz 2023-12-03T12:51:25.523 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105395.log 2023-12-03T12:51:25.523 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103733.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.103733.log.gz 2023-12-03T12:51:25.524 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105477.log 2023-12-03T12:51:25.524 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105395.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.105395.log.gz 2023-12-03T12:51:25.525 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95969.log 2023-12-03T12:51:25.525 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105477.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.105477.log.gz 2023-12-03T12:51:25.526 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103405.log 2023-12-03T12:51:25.526 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95969.log: 51.9% -- replaced with /var/log/ceph/ceph-client.admin.95969.log.gz 2023-12-03T12:51:25.527 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112443.log 2023-12-03T12:51:25.528 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103405.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.103405.log.gz 2023-12-03T12:51:25.528 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94603.log 2023-12-03T12:51:25.528 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112443.log.gz 2023-12-03T12:51:25.529 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97863.log 2023-12-03T12:51:25.529 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94603.log: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.94603.log.gz 2023-12-03T12:51:25.529 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91795.log 2023-12-03T12:51:25.532 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97863.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97863.log.gz 2023-12-03T12:51:25.532 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105559.log 2023-12-03T12:51:25.533 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.91795.log: 80.1% -- replaced with /var/log/ceph/ceph-client.0.91795.log.gz 2023-12-03T12:51:25.533 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90733.log 2023-12-03T12:51:25.533 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105559.log: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.105559.log.gz 2023-12-03T12:51:25.534 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-12-03T12:51:25.534 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90733.log.gz 2023-12-03T12:51:25.534 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102339.log 2023-12-03T12:51:25.547 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96444.log 2023-12-03T12:51:25.548 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102339.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.102339.log.gz 2023-12-03T12:51:25.584 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96444.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96444.log.gz 2023-12-03T12:51:25.685 INFO:teuthology.orchestra.run.smithi044.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-12-03T12:51:25.952 INFO:teuthology.orchestra.run.smithi091.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-12-03T12:51:26.149 INFO:teuthology.orchestra.run.smithi044.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-12-03T12:51:26.485 INFO:teuthology.orchestra.run.smithi044.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-03T12:51:27.613 INFO:teuthology.orchestra.run.smithi044.stderr: 92.7% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2023-12-03T12:51:29.591 INFO:teuthology.orchestra.run.smithi091.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-12-03T12:51:30.975 INFO:teuthology.orchestra.run.smithi044.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-03T12:51:31.050 INFO:teuthology.orchestra.run.smithi091.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-12-03T12:51:31.511 INFO:teuthology.orchestra.run.smithi044.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-03T12:51:32.345 INFO:teuthology.orchestra.run.smithi091.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-12-03T12:51:33.905 INFO:teuthology.orchestra.run.smithi044.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-03T12:51:33.996 INFO:teuthology.orchestra.run.smithi091.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-12-03T12:51:33.999 INFO:teuthology.orchestra.run.smithi091.stderr: 2023-12-03T12:51:33.999 INFO:teuthology.orchestra.run.smithi091.stderr:real 0m8.621s 2023-12-03T12:51:33.999 INFO:teuthology.orchestra.run.smithi091.stderr:user 0m25.088s 2023-12-03T12:51:33.999 INFO:teuthology.orchestra.run.smithi091.stderr:sys 0m0.898s 2023-12-03T12:51:39.761 INFO:teuthology.orchestra.run.smithi044.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-03T12:51:39.763 INFO:teuthology.orchestra.run.smithi044.stderr: 2023-12-03T12:51:39.764 INFO:teuthology.orchestra.run.smithi044.stderr:real 0m14.414s 2023-12-03T12:51:39.764 INFO:teuthology.orchestra.run.smithi044.stderr:user 0m37.630s 2023-12-03T12:51:39.764 INFO:teuthology.orchestra.run.smithi044.stderr:sys 0m1.319s 2023-12-03T12:51:39.764 INFO:tasks.ceph:Archiving logs... 2023-12-03T12:51:39.764 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/log/ceph to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476136/remote/smithi044/log 2023-12-03T12:51:39.765 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-03T12:51:44.447 DEBUG:teuthology.misc:Transferring archived files from smithi091:/var/log/ceph to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476136/remote/smithi091/log 2023-12-03T12:51:44.448 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-03T12:51:47.848 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 1918, in task File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 101, in end File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 386, in delete_users File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 1928, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-12-03T12:51:47.859 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-03T12:51:47.870 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 101, in end File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 386, in delete_users File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' 2023-12-03T12:51:47.880 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-03T12:51:47.880 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-03T12:51:47.884 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-03T12:51:47.981 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-03T12:51:47.992 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-03T12:51:47.992 DEBUG:teuthology.orchestra.run.smithi044:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-03T12:51:47.994 DEBUG:teuthology.orchestra.run.smithi091:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-03T12:51:48.010 INFO:teuthology.orchestra.run.smithi091.stderr:bash: line 1: ntpq: command not found 2023-12-03T12:51:48.014 INFO:teuthology.orchestra.run.smithi091.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-03T12:51:48.014 INFO:teuthology.orchestra.run.smithi091.stdout:=============================================================================== 2023-12-03T12:51:48.014 INFO:teuthology.orchestra.run.smithi091.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 33 +2136us[+2136us] +/- 76ms 2023-12-03T12:51:48.014 INFO:teuthology.orchestra.run.smithi091.stdout:^* hv02.front.sepia.ceph.com 3 7 377 92 -1209us[-1191us] +/- 57ms 2023-12-03T12:51:48.014 INFO:teuthology.orchestra.run.smithi091.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 30 -309us[ -309us] +/- 79ms 2023-12-03T12:51:48.014 INFO:teuthology.orchestra.run.smithi091.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T12:51:48.022 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2023-12-03T12:51:48.027 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-03T12:51:48.027 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2023-12-03T12:51:48.027 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 26 +2217us[+2217us] +/- 77ms 2023-12-03T12:51:48.027 INFO:teuthology.orchestra.run.smithi044.stdout:^* hv02.front.sepia.ceph.com 3 7 377 31 -1195us[-1213us] +/- 58ms 2023-12-03T12:51:48.027 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 -266us[ -266us] +/- 79ms 2023-12-03T12:51:48.027 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T12:51:48.028 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-03T12:51:48.049 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-03T12:51:48.050 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-03T12:51:48.099 DEBUG:teuthology.orchestra.run.smithi044:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-03T12:51:48.220 DEBUG:teuthology.orchestra.run.smithi091:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-03T12:51:48.316 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-03T12:51:48.365 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T12:51:48.365 DEBUG:teuthology.orchestra.run.smithi091:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-03T12:51:48.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T12:51:48.398 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-03T12:51:48.409 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-03T12:51:48.448 INFO:teuthology.task.internal:Duration was 5632.106961 seconds 2023-12-03T12:51:48.449 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-03T12:51:48.499 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-03T12:51:48.499 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-03T12:51:48.502 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-03T12:51:48.545 INFO:teuthology.orchestra.run.smithi091.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-03T12:51:48.563 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-03T12:51:48.869 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-03T12:51:48.869 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi044.front.sepia.ceph.com 2023-12-03T12:51:48.869 DEBUG:teuthology.orchestra.run.smithi044:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-03T12:51:48.902 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi091.front.sepia.ceph.com 2023-12-03T12:51:48.902 DEBUG:teuthology.orchestra.run.smithi091:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-03T12:51:48.929 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-03T12:51:48.930 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-03T12:51:48.944 DEBUG:teuthology.orchestra.run.smithi091:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-03T12:51:48.998 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-03T12:51:48.999 DEBUG:teuthology.orchestra.run.smithi044:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-03T12:51:49.001 DEBUG:teuthology.orchestra.run.smithi091:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-03T12:51:49.130 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-03T12:51:49.142 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-03T12:51:49.142 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-03T12:51:49.186 DEBUG:teuthology.orchestra.run.smithi091:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-03T12:51:49.212 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-03T12:51:49.224 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-03T12:51:49.228 DEBUG:teuthology.orchestra.run.smithi091:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-03T12:51:49.269 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = core 2023-12-03T12:51:49.278 INFO:teuthology.orchestra.run.smithi091.stdout:kernel.core_pattern = core 2023-12-03T12:51:49.305 DEBUG:teuthology.orchestra.run.smithi044:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-03T12:51:49.355 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T12:51:49.355 DEBUG:teuthology.orchestra.run.smithi091:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-03T12:51:49.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T12:51:49.369 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-03T12:51:49.382 INFO:teuthology.task.internal:Transferring archived files... 2023-12-03T12:51:49.382 DEBUG:teuthology.misc:Transferring archived files from smithi044:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476136/remote/smithi044 2023-12-03T12:51:49.383 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-03T12:51:49.449 DEBUG:teuthology.misc:Transferring archived files from smithi091:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476136/remote/smithi091 2023-12-03T12:51:49.450 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-03T12:51:49.484 INFO:teuthology.task.internal:Removing archive directory... 2023-12-03T12:51:49.485 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-03T12:51:49.487 DEBUG:teuthology.orchestra.run.smithi091:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-03T12:51:49.533 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-03T12:51:49.544 INFO:teuthology.task.internal:Not uploading archives. 2023-12-03T12:51:49.544 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-03T12:51:49.575 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-03T12:51:49.576 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-03T12:51:49.578 DEBUG:teuthology.orchestra.run.smithi091:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-03T12:51:49.592 INFO:teuthology.orchestra.run.smithi091.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 3 12:51 /home/ubuntu/cephtest 2023-12-03T12:51:49.603 INFO:teuthology.orchestra.run.smithi044.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 3 12:51 /home/ubuntu/cephtest 2023-12-03T12:51:49.604 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-03T12:51:49.626 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-03T12:51:49.677 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi044 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' 2023-12-03T12:51:49.677 INFO:teuthology.nuke:Checking targets against current locks 2023-12-03T12:51:49.700 DEBUG:teuthology.nuke:shortname: smithi044 2023-12-03T12:51:49.700 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-03T12:51:49.722 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476136', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-03 11:09:19.973086', 'locked_by': 'scheduled_alimasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEjVgoNZsA4+nJDNNbVQcRvbU+qh2yA/AydLGaw/f+bA6qmXDxMYkXpHapKUQlf8qB3+RmoWZQz6FiiPq/GHxt4='} 2023-12-03T12:51:49.725 DEBUG:teuthology.nuke:shortname: smithi091 2023-12-03T12:51:49.726 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-03T12:51:49.747 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi091.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476136', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-03 11:09:19.971455', 'locked_by': 'scheduled_alimasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAMA8rmc7tNlD/CrJT2zG94+3pIdpxiAZ4MY138usUaHhQ2vca7Wiwaxn6PV8HGBKDqqyIAtTkGok9mHEuso4Kc='} 2023-12-03T12:51:49.772 INFO:teuthology.orchestra.console.smithi044:Power off 2023-12-03T12:51:49.772 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-03T12:51:49.794 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off 2023-12-03T12:51:49.794 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-03T12:51:49.814 INFO:teuthology.orchestra.console.smithi091:Power off 2023-12-03T12:51:49.815 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-03T12:51:49.823 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2023-12-03T12:51:49.836 DEBUG:teuthology.orchestra.console.smithi091:power off output: Chassis Power Control: Down/Off 2023-12-03T12:51:49.836 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-03T12:51:49.857 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on 2023-12-03T12:51:53.824 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-03T12:51:53.858 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-03T12:51:53.934 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2023-12-03T12:51:53.967 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on 2023-12-03T12:51:57.938 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-03T12:51:57.968 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-03T12:51:58.049 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2023-12-03T12:51:58.077 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on 2023-12-03T12:52:02.054 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-03T12:52:02.078 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-03T12:52:02.164 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2023-12-03T12:52:02.188 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is off 2023-12-03T12:52:02.265 INFO:teuthology.orchestra.console.smithi044:Power off completed 2023-12-03T12:52:02.289 INFO:teuthology.orchestra.console.smithi091:Power off completed 2023-12-03T12:52:02.394 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 5632.106961250305 failure_reason: 'Command failed (s3 tests against rgw) on smithi044 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m ''not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3''"' flavor: default owner: scheduled_alimasa@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=bcddd99eb06041bda02ed4fb7b52ba18 status: fail success: false 2023-12-03T12:52:02.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-03T12:52:02.470 INFO:teuthology.run:FAIL